You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2015/10/23 20:38:32 UTC
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 830 - Still
Failing
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/830/
4 tests failed.
FAILED: org.apache.solr.cloud.CdcrReplicationDistributedZkTest.doTests
Error Message:
There are still nodes recoverying - waited for 330 seconds
Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 330 seconds
at __randomizedtesting.SeedInfo.seed([1DD2ACE0381532AA:15B2D9CC371B1AA1]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:172)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:133)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:128)
at org.apache.solr.cloud.BaseCdcrDistributedZkTest.waitForRecoveriesToFinish(BaseCdcrDistributedZkTest.java:465)
at org.apache.solr.cloud.BaseCdcrDistributedZkTest.clearSourceCollection(BaseCdcrDistributedZkTest.java:319)
at org.apache.solr.cloud.CdcrReplicationDistributedZkTest.doTestOps(CdcrReplicationDistributedZkTest.java:430)
at org.apache.solr.cloud.CdcrReplicationDistributedZkTest.doTests(CdcrReplicationDistributedZkTest.java:54)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1665)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:864)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:900)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:914)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:963)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:938)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:873)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:775)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:809)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:820)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test
Error Message:
Captured an uncaught exception in thread: Thread[id=5946, name=collection2, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=5946, name=collection2, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:51371: Could not find collection : awholynewstresscollection_collection2_1
at __randomizedtesting.SeedInfo.seed([1DD2ACE0381532AA]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:895)
FAILED: org.apache.solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR
Error Message:
Captured an uncaught exception in thread: Thread[id=23831, name=coreZkRegister-5662-thread-1, state=RUNNABLE, group=TGRP-LeaderInitiatedRecoveryOnShardRestartTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=23831, name=coreZkRegister-5662-thread-1, state=RUNNABLE, group=TGRP-LeaderInitiatedRecoveryOnShardRestartTest]
Caused by: java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([1DD2ACE0381532AA]:0)
at org.apache.solr.cloud.ZkController.updateLeaderInitiatedRecoveryState(ZkController.java:2126)
at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:433)
at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:197)
at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:157)
at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:346)
at org.apache.solr.cloud.ZkController.joinElection(ZkController.java:1113)
at org.apache.solr.cloud.ZkController.register(ZkController.java:926)
at org.apache.solr.cloud.ZkController.register(ZkController.java:881)
at org.apache.solr.core.ZkContainer$2.run(ZkContainer.java:183)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:231)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.handler.TestReplicationHandler.doTestStressReplication
Error Message:
timed out waiting for collection1 startAt time to exceed: Sat Oct 24 08:10:09 WSDT 2015
Stack Trace:
java.lang.AssertionError: timed out waiting for collection1 startAt time to exceed: Sat Oct 24 08:10:09 WSDT 2015
at __randomizedtesting.SeedInfo.seed([1DD2ACE0381532AA:C679AC263D3D5B19]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.handler.TestReplicationHandler.watchCoreStartAt(TestReplicationHandler.java:1417)
at org.apache.solr.handler.TestReplicationHandler.doTestStressReplication(TestReplicationHandler.java:769)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1665)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:864)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:900)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:914)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:873)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:775)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:809)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:820)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 10190 lines...]
[junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_1DD2ACE0381532AA-001/init-core-data-001
[junit4] 2> 864473 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[1DD2ACE0381532AA]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
[junit4] 2> 864473 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[1DD2ACE0381532AA]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
[junit4] 2> 864475 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 864478 INFO (Thread-2343) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 864478 INFO (Thread-2343) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 864578 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.ZkTestServer start zk server on port:41201
[junit4] 2> 864578 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 864580 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 864584 INFO (zkCallback-808-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7af897cc name:ZooKeeperConnection Watcher:127.0.0.1:41201 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 864584 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 864584 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 864584 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 864590 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 864594 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 864595 INFO (zkCallback-809-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@67397cdc name:ZooKeeperConnection Watcher:127.0.0.1:41201/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 864595 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 864595 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 864595 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
[junit4] 2> 864597 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
[junit4] 2> 864598 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
[junit4] 2> 864599 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
[junit4] 2> 864600 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 864601 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 864603 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 864603 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
[junit4] 2> 864610 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 864610 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 864611 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 864612 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
[junit4] 2> 864613 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 864613 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
[junit4] 2> 864626 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 864626 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
[junit4] 2> 864627 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 864628 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 864629 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 864629 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 864631 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 864631 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 864632 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 864632 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 864633 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 864634 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
[junit4] 2> 864636 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 864637 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 864662 INFO (zkCallback-810-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@116b9e61 name:ZooKeeperConnection Watcher:127.0.0.1:41201 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 864662 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 864663 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 864663 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 864665 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 864667 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 864680 INFO (zkCallback-811-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5a261bbe name:ZooKeeperConnection Watcher:127.0.0.1:41201/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 864680 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 864680 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 864680 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf2/solrconfig.xml
[junit4] 2> 864681 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/solrconfig.xml
[junit4] 2> 864683 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf2/schema.xml
[junit4] 2> 864683 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/schema.xml
[junit4] 2> 864685 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf2/enumsConfig.xml
[junit4] 2> 864685 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/enumsConfig.xml
[junit4] 2> 864687 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf2/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 864687 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 864688 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf2/stopwords.txt
[junit4] 2> 864689 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/stopwords.txt
[junit4] 2> 864690 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf2/protwords.txt
[junit4] 2> 864690 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/protwords.txt
[junit4] 2> 864692 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf2/currency.xml
[junit4] 2> 864692 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/currency.xml
[junit4] 2> 864693 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf2/open-exchange-rates.json
[junit4] 2> 864693 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/open-exchange-rates.json
[junit4] 2> 864695 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf2/mapping-ISOLatin1Accent.txt
[junit4] 2> 864695 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/mapping-ISOLatin1Accent.txt
[junit4] 2> 864697 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf2/old_synonyms.txt
[junit4] 2> 864697 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/old_synonyms.txt
[junit4] 2> 864698 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf2/synonyms.txt
[junit4] 2> 864698 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/synonyms.txt
[junit4] 2> 864700 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/elevate.xml to /configs/conf2/elevate.xml
[junit4] 2> 864700 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/elevate.xml
[junit4] 2> 865040 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_1DD2ACE0381532AA-001/control-001/cores/collection1
[junit4] 2> 865042 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.e.j.s.Server jetty-9.2.13.v20150730
[junit4] 2> 865044 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@37e3f681{/,null,AVAILABLE}
[junit4] 2> 865044 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.e.j.s.ServerConnector Started ServerConnector@71e67775{HTTP/1.1}{127.0.0.1:56475}
[junit4] 2> 865044 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.e.j.s.Server Started @868422ms
[junit4] 2> 865044 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_1DD2ACE0381532AA-001/tempDir-001/control/data, hostContext=/, hostPort=56475, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_1DD2ACE0381532AA-001/control-001/cores}
[junit4] 2> 865045 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 865045 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_1DD2ACE0381532AA-001/control-001/'
[junit4] 2> 865045 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 865045 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 865070 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 865071 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 865090 INFO (zkCallback-812-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@69008aa5 name:ZooKeeperConnection Watcher:127.0.0.1:41201/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 865090 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 865090 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 865092 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 865092 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_1DD2ACE0381532AA-001/control-001/solr.xml
[junit4] 2> 865098 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_1DD2ACE0381532AA-001/control-001/cores
[junit4] 2> 865098 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.CoreContainer New CoreContainer 314641124
[junit4] 2> 865098 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_1DD2ACE0381532AA-001/control-001/]
[junit4] 2> 865098 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_1DD2ACE0381532AA-001/control-001/lib
[junit4] 2> 865099 WARN (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_1DD2ACE0381532AA-001/control-001/lib).
[junit4] 2> 865115 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 865116 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 865117 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 865117 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 865117 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41201/solr
[junit4] 2> 865117 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 865117 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 865119 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 865119 INFO (zkCallback-814-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@19c02ef4 name:ZooKeeperConnection Watcher:127.0.0.1:41201 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 865120 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 865121 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 865126 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [n:127.0.0.1:56475_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 865127 INFO (zkCallback-815-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@491bed59 name:ZooKeeperConnection Watcher:127.0.0.1:41201/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 865127 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [n:127.0.0.1:56475_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 865128 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [n:127.0.0.1:56475_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
[junit4] 2> 865130 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [n:127.0.0.1:56475_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 865133 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [n:127.0.0.1:56475_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 865135 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [n:127.0.0.1:56475_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 865137 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [n:127.0.0.1:56475_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 865139 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [n:127.0.0.1:56475_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 865141 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [n:127.0.0.1:56475_ ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 865142 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [n:127.0.0.1:56475_ ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 865143 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [n:127.0.0.1:56475_ ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 865144 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [n:127.0.0.1:56475_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56475_
[junit4] 2> 865144 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [n:127.0.0.1:56475_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:56475_
[junit4] 2> 865146 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [n:127.0.0.1:56475_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 865147 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [n:127.0.0.1:56475_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 865148 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [n:127.0.0.1:56475_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 865148 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [n:127.0.0.1:56475_ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94740302080770054-127.0.0.1:56475_-n_0000000000
[junit4] 2> 865149 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [n:127.0.0.1:56475_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:56475_
[junit4] 2> 865149 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [n:127.0.0.1:56475_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
[junit4] 2> 865151 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [n:127.0.0.1:56475_ ] o.a.s.c.Overseer Overseer (id=94740302080770054-127.0.0.1:56475_-n_0000000000) starting
[junit4] 2> 865152 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [n:127.0.0.1:56475_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
[junit4] 2> 865158 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [n:127.0.0.1:56475_ ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 865166 INFO (OverseerCollectionConfigSetProcessor-94740302080770054-127.0.0.1:56475_-n_0000000000) [n:127.0.0.1:56475_ ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
[junit4] 2> 865166 INFO (OverseerStateUpdate-94740302080770054-127.0.0.1:56475_-n_0000000000) [n:127.0.0.1:56475_ ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 865166 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [n:127.0.0.1:56475_ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 865184 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [n:127.0.0.1:56475_ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 865185 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [n:127.0.0.1:56475_ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 865185 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [n:127.0.0.1:56475_ ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_1DD2ACE0381532AA-001/control-001/cores
[junit4] 2> 865186 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [n:127.0.0.1:56475_ ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_1DD2ACE0381532AA-001/control-001/cores/collection1, collection=control_collection, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_1DD2ACE0381532AA-001/control-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 865186 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [n:127.0.0.1:56475_ ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_1DD2ACE0381532AA-001/control-001/cores/collection1/
[junit4] 2> 865187 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [n:127.0.0.1:56475_ ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 865197 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 865197 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 865197 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [n:127.0.0.1:56475_ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4] 2> 865197 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [n:127.0.0.1:56475_ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 865208 INFO (OverseerStateUpdate-94740302080770054-127.0.0.1:56475_-n_0000000000) [n:127.0.0.1:56475_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:56475",
[junit4] 2> "node_name":"127.0.0.1:56475_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 865208 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 865209 INFO (OverseerStateUpdate-94740302080770054-127.0.0.1:56475_-n_0000000000) [n:127.0.0.1:56475_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:56475",
[junit4] 2> "node_name":"127.0.0.1:56475_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 865209 INFO (OverseerStateUpdate-94740302080770054-127.0.0.1:56475_-n_0000000000) [n:127.0.0.1:56475_ ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
[junit4] 2> 865210 INFO (OverseerStateUpdate-94740302080770054-127.0.0.1:56475_-n_0000000000) [n:127.0.0.1:56475_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 865211 INFO (zkCallback-815-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 866209 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 866209 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
[junit4] 2> 866210 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 866210 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 866211 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 866211 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_1DD2ACE0381532AA-001/control-001/cores/collection1/'
[junit4] 2> 866211 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 866211 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 866226 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 866231 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 866235 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 866243 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
[junit4] 2> 866245 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 866249 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 866343 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 866349 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 866350 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 866360 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 866363 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 866365 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 866366 WARN (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 866366 WARN (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 866366 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 866367 WARN (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 866367 WARN (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 866368 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4] 2> 866368 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 866368 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 866368 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_1DD2ACE0381532AA-001/control-001/cores/collection1/], dataDir=[null]
[junit4] 2> 866368 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@55fd9a7b
[junit4] 2> 866369 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_1DD2ACE0381532AA-001/control-001/cores/collection1/data
[junit4] 2> 866369 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_1DD2ACE0381532AA-001/control-001/cores/collection1/data/index/
[junit4] 2> 866369 WARN (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_1DD2ACE0381532AA-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 866369 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_1DD2ACE0381532AA-001/control-001/cores/collection1/data/index
[junit4] 2> 866369 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=26, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=0.98046875, noCFSRatio=0.497874104473354]
[junit4] 2> 866370 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@5f684b1d lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2f5f743),segFN=segments_1,generation=1}
[junit4] 2> 866370 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 866371 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_1DD2ACE0381532AA-001/control-001/cores/collection1/data/
[junit4] 2> 866371 WARN (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_1DD2ACE0381532AA-001/control-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
[junit4] 2> 866374 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 866375 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
[junit4] 2> 866375 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 866375 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 866375 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 866375 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 866375 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 866375 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 866375 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 866377 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 866378 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 866379 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 866380 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 866383 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 866383 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 866384 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 866384 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 866385 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
[junit4] 2> 866385 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
[junit4] 2> 866385 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=31, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 866386 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@5f684b1d lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2f5f743),segFN=segments_1,generation=1}
[junit4] 2> 866386 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 866386 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@698350a9[collection1] main
[junit4] 2> 866386 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 866387 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 866387 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 866387 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 866387 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
[junit4] 2> 866387 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 866388 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 866388 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 866388 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 866388 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 866388 INFO (searcherExecutor-1631-thread-1-processing-n:127.0.0.1:56475_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@698350a9[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 866388 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
[junit4] 2> 866389 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
[junit4] 2> 866389 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
[junit4] 2> 866389 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1515844835282518016
[junit4] 2> 866391 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 2.0ms to seed version buckets with highest version 1515844835282518016
[junit4] 2> 866391 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
[junit4] 2> 866391 INFO (coreLoadExecutor-1630-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 866392 INFO (coreZkRegister-1624-thread-1-processing-n:127.0.0.1:56475_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:56475 collection:control_collection shard:shard1
[junit4] 2> 866392 INFO (coreZkRegister-1624-thread-1-processing-n:127.0.0.1:56475_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 866396 INFO (coreZkRegister-1624-thread-1-processing-n:127.0.0.1:56475_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/94740302080770054-core_node1-n_0000000000
[junit4] 2> 866396 INFO (coreZkRegister-1624-thread-1-processing-n:127.0.0.1:56475_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1
[junit4] 2> 866398 INFO (coreZkRegister-1624-thread-1-processing-n:127.0.0.1:56475_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 866398 INFO (coreZkRegister-1624-thread-1-processing-n:127.0.0.1:56475_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 866398 INFO (coreZkRegister-1624-thread-1-processing-n:127.0.0.1:56475_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:56475/collection1/
[junit4] 2> 866398 INFO (coreZkRegister-1624-thread-1-processing-n:127.0.0.1:56475_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 866398 INFO (coreZkRegister-1624-thread-1-processing-n:127.0.0.1:56475_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:56475/collection1/ has no replicas
[junit4] 2> 866398 INFO (coreZkRegister-1624-thread-1-processing-n:127.0.0.1:56475_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:56475/collection1/ shard1
[junit4] 2> 866398 INFO (OverseerStateUpdate-94740302080770054-127.0.0.1:56475_-n_0000000000) [n:127.0.0.1:56475_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection"} current state version: 1
[junit4] 2> 866398 INFO (coreZkRegister-1624-thread-1-processing-n:127.0.0.1:56475_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 866401 INFO (coreZkRegister-1624-thread-1-processing-n:127.0.0.1:56475_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
[junit4] 2> 866404 INFO (OverseerStateUpdate-94740302080770054-127.0.0.1:56475_-n_0000000000) [n:127.0.0.1:56475_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:56475",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 1
[junit4] 2> 866507 INFO (zkCallback-815-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 866555 INFO (coreZkRegister-1624-thread-1-processing-n:127.0.0.1:56475_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:56475/collection1/ and leader is http://127.0.0.1:56475/collection1/
[junit4] 2> 866555 INFO (coreZkRegister-1624-thread-1-processing-n:127.0.0.1:56475_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:56475
[junit4] 2> 866555 INFO (coreZkRegister-1624-thread-1-processing-n:127.0.0.1:56475_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 866555 INFO (coreZkRegister-1624-thread-1-processing-n:127.0.0.1:56475_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
[junit4] 2> 866555 INFO (coreZkRegister-1624-thread-1-processing-n:127.0.0.1:56475_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56475_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 866557 INFO (OverseerStateUpdate-94740302080770054-127.0.0.1:56475_-n_0000000000) [n:127.0.0.1:56475_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:56475",
[junit4] 2> "node_name":"127.0.0.1:56475_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 2
[junit4] 2> 866558 INFO (OverseerStateUpdate-94740302080770054-127.0.0.1:56475_-n_0000000000) [n:127.0.0.1:56475_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:56475",
[junit4] 2> "node_name":"127.0.0.1:56475_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 866661 INFO (zkCallback-815-thread-1-processing-n:127.0.0.1:56475_) [n:127.0.0.1:56475_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 866699 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 866700 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 866701 INFO (zkCallback-817-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5f9b158 name:ZooKeeperConnection Watcher:127.0.0.1:41201/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 866701 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 866701 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 866702 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 866704 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 866704 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with stateFormat=2
[junit4] 2> 866704 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 866704 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 866705 INFO (zkCallback-818-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@58625d64 name:ZooKeeperConnection Watcher:127.0.0.1:41201/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 866705 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 866706 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 866708 INFO (OverseerStateUpdate-94740302080770054-127.0.0.1:56475_-n_0000000000) [n:127.0.0.1:56475_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"create",
[junit4] 2> "name":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "stateFormat":"2"} current state version: 3
[junit4] 2> 866708 INFO (OverseerStateUpdate-94740302080770054-127.0.0.1:56475_-n_0000000000) [n:127.0.0.1:56475_ ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
[junit4] 2> 866816 INFO (OverseerStateUpdate-94740302080770054-127.0.0.1:56475_-n_0000000000) [n:127.0.0.1:56475_ ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/collection1/state.json
[junit4] 2> 867019 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_1DD2ACE0381532AA-001/shard-1-001/cores/collection1
[junit4] 2> 867020 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_1DD2ACE0381532AA-001/shard-1-001
[junit4] 2> 867021 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.e.j.s.Server jetty-9.2.13.v20150730
[junit4] 2> 867023 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1a4aad84{/,null,AVAILABLE}
[junit4] 2> 867023 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.e.j.s.ServerConnector Started ServerConnector@4c221d7c{HTTP/1.1}{127.0.0.1:58376}
[junit4] 2> 867023 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.e.j.s.Server Started @870401ms
[junit4] 2> 867023 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_1DD2ACE0381532AA-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/, hostPort=58376, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_1DD2ACE0381532AA-001/shard-1-001/cores}
[junit4] 2> 867023 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 867024 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_1DD2ACE0381532AA-001/shard-1-001/'
[junit4] 2> 867024 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 867024 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 867040 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 867041 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 867043 INFO (zkCallback-819-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@53bec78d name:ZooKeeperConnection Watcher:127.0.0.1:41201/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 867043 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 867043 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 867044 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 867044 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_1DD2ACE0381532AA-001/shard-1-001/solr.xml
[junit4] 2> 867051 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_1DD2ACE0381532AA-001/shard-1-001/cores
[junit4] 2> 867051 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.CoreContainer New CoreContainer 818231722
[junit4] 2> 867052 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_1DD2ACE0381532AA-001/shard-1-001/]
[junit4] 2> 867052 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_1DD2ACE0381532AA-001/shard-1-001/lib
[junit4] 2> 867052 WARN (TEST-CollectionsAPIDistributedZkTest.test-seed#[1DD2ACE0381532AA]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_1DD2ACE0381532AA-001/shard-1-001/lib).
[junit4] 2> 867060 INFO (TEST-CollectionsAPIDistributedZkTe
[...truncated too long message...]
json
[junit4] 2> 5 /solr/configs/conf1
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 6 /solr/clusterstate.json
[junit4] 2> 3 /solr/overseer_elect/election/94740429052248068-127.0.0.1:51475_-n_0000000000
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 6 /solr/collections
[junit4] 2> 4 /solr/live_nodes
[junit4] 2> 3 /solr/overseer/queue
[junit4] 2> 3 /solr/overseer/collection-queue-work
[junit4] 2>
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=LeaderInitiatedRecoveryOnShardRestartTest -Dtests.method=testRestartWithAllInLIR -Dtests.seed=1DD2ACE0381532AA -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=hi -Dtests.timezone=Asia/Baghdad -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] ERROR 367s J2 | LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR <<<
[junit4] > Throwable #1: java.lang.AssertionError: There are still nodes recoverying - waited for 330 seconds
[junit4] > at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:172)
[junit4] > at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:133)
[junit4] > at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:128)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:830)
[junit4] > at org.apache.solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR(LeaderInitiatedRecoveryOnShardRestartTest.java:81)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:963)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:938)
[junit4] > at java.lang.Thread.run(Thread.java:745)Throwable #2: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=23831, name=coreZkRegister-5662-thread-1, state=RUNNABLE, group=TGRP-LeaderInitiatedRecoveryOnShardRestartTest]
[junit4] > Caused by: java.lang.AssertionError
[junit4] > at __randomizedtesting.SeedInfo.seed([1DD2ACE0381532AA]:0)
[junit4] > at org.apache.solr.cloud.ZkController.updateLeaderInitiatedRecoveryState(ZkController.java:2126)
[junit4] > at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:433)
[junit4] > at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:197)
[junit4] > at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:157)
[junit4] > at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:346)
[junit4] > at org.apache.solr.cloud.ZkController.joinElection(ZkController.java:1113)
[junit4] > at org.apache.solr.cloud.ZkController.register(ZkController.java:926)
[junit4] > at org.apache.solr.cloud.ZkController.register(ZkController.java:881)
[junit4] > at org.apache.solr.core.ZkContainer$2.run(ZkContainer.java:183)
[junit4] > at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:231)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 3168559 INFO (SUITE-LeaderInitiatedRecoveryOnShardRestartTest-seed#[1DD2ACE0381532AA]-worker) [n:127.0.0.1:40215_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_1DD2ACE0381532AA-001
[junit4] 2> Oct 23, 2015 2:23:09 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene53): {}, docValues:{}, sim=ClassicSimilarity, locale=hi, timezone=Asia/Baghdad
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_45 (64-bit)/cpus=4,threads=1,free=156379472,total=527958016
[junit4] 2> NOTE: All tests run in this JVM: [ParsingFieldUpdateProcessorsTest, CloudExitableDirectoryReaderTest, DocValuesMultiTest, SampleTest, ClusterStateTest, AsyncMigrateRouteKeyTest, TestIndexSearcher, RegexBoostProcessorTest, BufferStoreTest, ResponseHeaderTest, SystemInfoHandlerTest, TestMiniSolrCloudClusterBase, AsyncCallRequestStatusResponseTest, BasicDistributedZk2Test, TestSweetSpotSimilarityFactory, SuggesterTSTTest, TestSearchPerf, ShowFileRequestHandlerTest, BinaryUpdateRequestHandlerTest, TestConfigReload, MergeStrategyTest, TestSystemIdResolver, TestSolrCLIRunExample, AutoCommitTest, RequestHandlersTest, TestPostingsSolrHighlighter, TestCloudManagedSchema, TestSolrDeletionPolicy1, TestImplicitCoreProperties, TestSha256AuthenticationProvider, CurrencyFieldXmlFileTest, QueryResultKeyTest, TestZkChroot, ZkStateReaderTest, StatsComponentTest, DistributedFacetPivotSmallAdvancedTest, TestCharFilters, SearchHandlerTest, FieldMutatingUpdateProcessorTest, OverriddenZkACLAndCredentialsProvidersTest, TestSolrQueryParser, TestFastWriter, AnalysisErrorHandlingTest, ScriptEngineTest, TestMinMaxOnMultiValuedField, TestTrieFacet, TriLevelCompositeIdRoutingTest, TestSolrIndexConfig, DirectUpdateHandlerOptimizeTest, TestXIncludeConfig, SuggesterWFSTTest, StatelessScriptUpdateProcessorFactoryTest, SuggestComponentContextFilterQueryTest, TestRecovery, TestCoreDiscovery, StressHdfsTest, TestShardHandlerFactory, RAMDirectoryFactoryTest, TestSolrCloudWithKerberosAlt, TermVectorComponentDistributedTest, TestPerFieldSimilarity, DebugComponentTest, TestStressReorder, DateRangeFieldTest, TestFuzzyAnalyzedSuggestions, TestLRUStatsCache, DistributedFacetPivotSmallTest, TestReqParamsAPI, TestSort, AddBlockUpdateTest, FullSolrCloudDistribCmdsTest, TestSearcherReuse, SecurityConfHandlerTest, TestElisionMultitermQuery, BadComponentTest, UnloadDistributedZkTest, ZkNodePropsTest, DistributedDebugComponentTest, TestReplicationHandlerBackup, HardAutoCommitTest, LukeRequestHandlerTest, TestLRUCache, TestCursorMarkWithoutUniqueKey, TestReRankQParserPlugin, TestManagedSchemaDynamicFieldResource, TestFastLRUCache, HdfsChaosMonkeySafeLeaderTest, SimpleFacetsTest, BasicDistributedZkTest, ChaosMonkeySafeLeaderTest, OpenCloseCoreStressTest, OverseerTest, ZkCLITest, TestDistributedGrouping, TestFaceting, TestHashPartitioner, SolrCoreTest, TestGroupingSearch, TestFunctionQuery, TestLazyCores, DirectUpdateHandlerTest, HighlighterTest, SoftAutoCommitTest, TestFoldingMultitermQuery, SuggesterTest, SpatialFilterTest, SolrCoreCheckLockOnStartupTest, TestUpdate, DefaultValueUpdateProcessorTest, TestRemoteStreaming, IndexBasedSpellCheckerTest, TestQueryUtils, TestWriterPerf, TestQueryTypes, TestOmitPositions, TermsComponentTest, TestIndexingPerformance, RequiredFieldsTest, FastVectorHighlighterTest, TestJmxIntegration, ReturnFieldsTest, MBeansHandlerTest, TestAnalyzedSuggestions, TestPartialUpdateDeduplication, TestPHPSerializedResponseWriter, CSVRequestHandlerTest, TestComponentsName, TestBinaryResponseWriter, TestLFUCache, PrimUtilsTest, TestSuggestSpellingConverter, SpellingQueryConverterTest, UUIDFieldTest, FileUtilsTest, CircularListTest, DistributedMLTComponentTest, TestRTGBase, CursorPagingTest, DistributedIntervalFacetingTest, CdcrVersionReplicationTest, CleanupOldIndexTest, CollectionStateFormat2Test, CollectionsAPIAsyncDistributedZkTest, ConcurrentDeleteAndCreateCollectionTest, DeleteShardTest, DistribDocExpirationUpdateProcessorTest, DistributedVersionInfoTest, LeaderFailoverAfterPartitionTest, LeaderInitiatedRecoveryOnShardRestartTest]
[junit4] Completed [423/552] on J2 in 367.67s, 1 test, 1 error <<< FAILURES!
[...truncated 425 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987: There were test failures: 552 suites (8 ignored), 2172 tests, 2 errors, 2 failures, 31 ignored (18 assumptions) [seed: 1DD2ACE0381532AA]
Total time: 186 minutes 4 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 897 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/897/
3 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
Error Message:
ObjectTracker found 1 object(s) that were not released!!! [TransactionLog]
Stack Trace:
java.lang.AssertionError: ObjectTracker found 1 object(s) that were not released!!! [TransactionLog]
at __randomizedtesting.SeedInfo.seed([D77AACF2B2B5CCE7]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNull(Assert.java:551)
at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:229)
at sun.reflect.GeneratedMethodAccessor23.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:834)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest
Error Message:
ObjectTracker found 1 object(s) that were not released!!! [HdfsTransactionLog]
Stack Trace:
java.lang.AssertionError: ObjectTracker found 1 object(s) that were not released!!! [HdfsTransactionLog]
at __randomizedtesting.SeedInfo.seed([D77AACF2B2B5CCE7]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNull(Assert.java:551)
at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:229)
at sun.reflect.GeneratedMethodAccessor30.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:834)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
FAILED: junit.framework.TestSuite.org.apache.solr.handler.TestReplicationHandler
Error Message:
ObjectTracker found 2 object(s) that were not released!!! [NRTCachingDirectory, NRTCachingDirectory]
Stack Trace:
java.lang.AssertionError: ObjectTracker found 2 object(s) that were not released!!! [NRTCachingDirectory, NRTCachingDirectory]
at __randomizedtesting.SeedInfo.seed([D77AACF2B2B5CCE7]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNull(Assert.java:551)
at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:229)
at sun.reflect.GeneratedMethodAccessor30.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:834)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 10412 lines...]
[junit4] Suite: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest_D77AACF2B2B5CCE7-001/init-core-data-001
[junit4] 2> 1341384 INFO (SUITE-ChaosMonkeySafeLeaderTest-seed#[D77AACF2B2B5CCE7]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false)
[junit4] 2> 1341384 INFO (SUITE-ChaosMonkeySafeLeaderTest-seed#[D77AACF2B2B5CCE7]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /a_y/
[junit4] 2> 1341387 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1341387 INFO (Thread-5363) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1341387 INFO (Thread-5363) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1341487 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.ZkTestServer start zk server on port:54397
[junit4] 2> 1341487 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1341488 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1341490 INFO (zkCallback-1523-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@298c9871 name:ZooKeeperConnection Watcher:127.0.0.1:54397 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1341490 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1341490 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1341490 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 1341492 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1341494 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1341496 INFO (zkCallback-1524-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@40d20658 name:ZooKeeperConnection Watcher:127.0.0.1:54397/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1341496 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1341496 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1341496 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
[junit4] 2> 1341500 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
[junit4] 2> 1341503 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
[junit4] 2> 1341505 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
[junit4] 2> 1341508 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 1341508 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 1341512 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 1341512 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
[junit4] 2> 1341514 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1341514 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1341516 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 1341516 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
[junit4] 2> 1341518 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 1341518 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
[junit4] 2> 1341520 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 1341520 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
[junit4] 2> 1341525 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 1341525 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 1341527 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1341527 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 1341530 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1341530 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1341533 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 1341533 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 1341537 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 1341537 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
[junit4] 2> 1341541 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1341542 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1341543 INFO (zkCallback-1525-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4544abca name:ZooKeeperConnection Watcher:127.0.0.1:54397/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1341543 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1341544 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1341872 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest_D77AACF2B2B5CCE7-001/control-001/cores/collection1
[junit4] 2> 1341874 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.e.j.s.Server jetty-9.3.6.v20151106
[junit4] 2> 1341876 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@18f912e1{/a_y,null,AVAILABLE}
[junit4] 2> 1341877 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.e.j.u.s.SslContextFactory x509=X509@2811708d(solrtest,h=[],w=[]) for SslContextFactory@24bac6db(file:///x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/server/etc/test/solrtest.keystore,file:///x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/server/etc/test/solrtest.keystore)
[junit4] 2> 1341880 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.e.j.s.ServerConnector Started ServerConnector@780f7fe3{SSL,[ssl, http/1.1]}{127.0.0.1:41101}
[junit4] 2> 1341880 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.e.j.s.Server Started @1344907ms
[junit4] 2> 1341880 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest_D77AACF2B2B5CCE7-001/tempDir-001/control/data, hostContext=/a_y, hostPort=41101, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest_D77AACF2B2B5CCE7-001/control-001/cores}
[junit4] 2> 1341880 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 1341881 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest_D77AACF2B2B5CCE7-001/control-001'
[junit4] 2> 1341881 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1341881 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 1341881 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1341883 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1341898 INFO (zkCallback-1526-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2aecd07c name:ZooKeeperConnection Watcher:127.0.0.1:54397/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1341898 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1341898 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1341899 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1341899 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest_D77AACF2B2B5CCE7-001/control-001/solr.xml
[junit4] 2> 1341909 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest_D77AACF2B2B5CCE7-001/control-001/cores
[junit4] 2> 1341909 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.CoreContainer New CoreContainer 926607776
[junit4] 2> 1341909 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest_D77AACF2B2B5CCE7-001/control-001]
[junit4] 2> 1341910 WARN (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest_D77AACF2B2B5CCE7-001/control-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest_D77AACF2B2B5CCE7-001/control-001/lib
[junit4] 2> 1341911 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 1341919 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1341921 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1341921 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1341922 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:54397/solr
[junit4] 2> 1341922 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 1341922 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1341923 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1341926 INFO (zkCallback-1529-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@10eca9e9 name:ZooKeeperConnection Watcher:127.0.0.1:54397 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1341927 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1341931 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1341936 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [n:127.0.0.1:41101_a_y ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1341941 INFO (zkCallback-1530-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7df0de35 name:ZooKeeperConnection Watcher:127.0.0.1:54397/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1341941 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [n:127.0.0.1:41101_a_y ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1341943 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [n:127.0.0.1:41101_a_y ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
[junit4] 2> 1341945 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [n:127.0.0.1:41101_a_y ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 1341949 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [n:127.0.0.1:41101_a_y ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 1341952 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [n:127.0.0.1:41101_a_y ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 1341955 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [n:127.0.0.1:41101_a_y ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 1341960 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [n:127.0.0.1:41101_a_y ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 1341961 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [n:127.0.0.1:41101_a_y ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 1341966 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [n:127.0.0.1:41101_a_y ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 1341967 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [n:127.0.0.1:41101_a_y ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 1341969 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [n:127.0.0.1:41101_a_y ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41101_a_y
[junit4] 2> 1341970 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [n:127.0.0.1:41101_a_y ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:41101_a_y
[junit4] 2> 1341972 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [n:127.0.0.1:41101_a_y ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 1341973 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [n:127.0.0.1:41101_a_y ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 1341975 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [n:127.0.0.1:41101_a_y ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1341975 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [n:127.0.0.1:41101_a_y ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95123646694686725-127.0.0.1:41101_a_y-n_0000000000
[junit4] 2> 1341976 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [n:127.0.0.1:41101_a_y ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:41101_a_y
[junit4] 2> 1341976 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [n:127.0.0.1:41101_a_y ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
[junit4] 2> 1341977 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [n:127.0.0.1:41101_a_y ] o.a.s.c.Overseer Overseer (id=95123646694686725-127.0.0.1:41101_a_y-n_0000000000) starting
[junit4] 2> 1341980 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [n:127.0.0.1:41101_a_y ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
[junit4] 2> 1341991 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [n:127.0.0.1:41101_a_y ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 1341992 INFO (OverseerStateUpdate-95123646694686725-127.0.0.1:41101_a_y-n_0000000000) [n:127.0.0.1:41101_a_y ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 1341993 INFO (OverseerStateUpdate-95123646694686725-127.0.0.1:41101_a_y-n_0000000000) [n:127.0.0.1:41101_a_y ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 1341996 INFO (OverseerCollectionConfigSetProcessor-95123646694686725-127.0.0.1:41101_a_y-n_0000000000) [n:127.0.0.1:41101_a_y ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
[junit4] 2> 1341999 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [n:127.0.0.1:41101_a_y ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 1342032 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [n:127.0.0.1:41101_a_y ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 1342032 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [n:127.0.0.1:41101_a_y ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 1342032 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [n:127.0.0.1:41101_a_y ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest_D77AACF2B2B5CCE7-001/control-001/cores
[junit4] 2> 1342033 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [n:127.0.0.1:41101_a_y ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=control_collection, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 1342033 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [n:127.0.0.1:41101_a_y ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest_D77AACF2B2B5CCE7-001/control-001/cores/collection1
[junit4] 2> 1342033 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [n:127.0.0.1:41101_a_y ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
[junit4] 2> 1342035 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [n:127.0.0.1:41101_a_y ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4] 2> 1342035 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [n:127.0.0.1:41101_a_y ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 1342036 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 1342036 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 1342037 INFO (OverseerStateUpdate-95123646694686725-127.0.0.1:41101_a_y-n_0000000000) [n:127.0.0.1:41101_a_y ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:41101/a_y",
[junit4] 2> "node_name":"127.0.0.1:41101_a_y",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 1342038 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 1342038 INFO (OverseerStateUpdate-95123646694686725-127.0.0.1:41101_a_y-n_0000000000) [n:127.0.0.1:41101_a_y ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:41101/a_y",
[junit4] 2> "node_name":"127.0.0.1:41101_a_y",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 1342039 INFO (OverseerStateUpdate-95123646694686725-127.0.0.1:41101_a_y-n_0000000000) [n:127.0.0.1:41101_a_y ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
[junit4] 2> 1342039 INFO (OverseerStateUpdate-95123646694686725-127.0.0.1:41101_a_y-n_0000000000) [n:127.0.0.1:41101_a_y ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 1342042 INFO (zkCallback-1530-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
[junit4] 2> 1342043 INFO (zkCallback-1530-thread-2-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
[junit4] 2> 1343038 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 1343038 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
[junit4] 2> 1343039 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 1343039 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/control_collection]
[junit4] 2> 1343040 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/control_collection] [configName]=[conf1] specified config exists in ZooKeeper
[junit4] 2> 1343040 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest_D77AACF2B2B5CCE7-001/control-001/cores/collection1'
[junit4] 2> 1343040 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1343040 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 1343041 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 1343047 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 1343051 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 1343062 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection x:collection1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1343069 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 1343182 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 1343183 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 1343184 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 1343187 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 1343210 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4] 2> 1343210 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 1343210 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore solr.StandardDirectoryFactory
[junit4] 2> 1343210 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest_D77AACF2B2B5CCE7-001/control-001/cores/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest_D77AACF2B2B5CCE7-001/control-001/cores/collection1/data/]
[junit4] 2> 1343210 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@30f1226b
[junit4] 2> 1343211 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest_D77AACF2B2B5CCE7-001/control-001/cores/collection1/data
[junit4] 2> 1343211 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest_D77AACF2B2B5CCE7-001/control-001/cores/collection1/data/index/
[junit4] 2> 1343212 WARN (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest_D77AACF2B2B5CCE7-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1343212 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest_D77AACF2B2B5CCE7-001/control-001/cores/collection1/data/index
[junit4] 2> 1343212 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=34, maxMergeAtOnceExplicit=48, maxMergedSegmentMB=69.69921875, floorSegmentMB=2.1015625, forceMergeDeletesPctAllowed=29.51221115478454, segmentsPerTier=27.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 1343222 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest_D77AACF2B2B5CCE7-001/control-001/cores/collection1/data/index,segFN=segments_1,generation=1}
[junit4] 2> 1343222 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 1343223 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest_D77AACF2B2B5CCE7-001/control-001/cores/collection1/data/
[junit4] 2> 1343227 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1343227 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1343227 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1343227 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1343227 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1343227 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1343228 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1343229 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1343229 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1343229 WARN (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,args = {defaults={a=A,b=B}}}
[junit4] 2> 1343232 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1343233 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1343233 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1343234 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1343237 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/dump,/update/csv,/sql,/update/json/docs,/admin/luke,/export,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/stream,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 1343238 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 1343238 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1343238 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1343240 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: if uncommited for 15000ms;
[junit4] 2> 1343240 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1343240 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=41, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 1343241 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest_D77AACF2B2B5CCE7-001/control-001/cores/collection1/data/index,segFN=segments_1,generation=1}
[junit4] 2> 1343241 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 1343241 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@7698919f[collection1] main
[junit4] 2> 1343241 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/control_collection]
[junit4] 2> 1343245 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/control_collection] [configName]=[conf1] specified config exists in ZooKeeper
[junit4] 2> 1343245 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 1343248 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1343248 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
[junit4] 2> 1343248 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1343248 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 1343248 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1343249 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 1343249 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 1343249 INFO (searcherExecutor-2511-thread-1-processing-n:127.0.0.1:41101_a_y x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@7698919f[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1343249 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
[junit4] 2> 1343249 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
[junit4] 2> 1343249 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
[junit4] 2> 1343249 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1521978349065338880
[junit4] 2> 1343252 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 3.0ms to seed version buckets with highest version 1521978349065338880
[junit4] 2> 1343252 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
[junit4] 2> 1343253 INFO (coreLoadExecutor-2510-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 1343254 INFO (coreZkRegister-2504-thread-1-processing-n:127.0.0.1:41101_a_y x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:https://127.0.0.1:41101/a_y collection:control_collection shard:shard1
[junit4] 2> 1343255 INFO (coreZkRegister-2504-thread-1-processing-n:127.0.0.1:41101_a_y x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 1343262 INFO (coreZkRegister-2504-thread-1-processing-n:127.0.0.1:41101_a_y x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/95123646694686725-core_node1-n_0000000000
[junit4] 2> 1343262 INFO (coreZkRegister-2504-thread-1-processing-n:127.0.0.1:41101_a_y x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard=shard1 and weAreReplacement=false and leaderVoteWait=10000
[junit4] 2> 1343264 INFO (coreZkRegister-2504-thread-1-processing-n:127.0.0.1:41101_a_y x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1343264 INFO (OverseerStateUpdate-95123646694686725-127.0.0.1:41101_a_y-n_0000000000) [n:127.0.0.1:41101_a_y ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection"} current state version: 1
[junit4] 2> 1343264 INFO (coreZkRegister-2504-thread-1-processing-n:127.0.0.1:41101_a_y x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1343264 INFO (coreZkRegister-2504-thread-1-processing-n:127.0.0.1:41101_a_y x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:41101/a_y/collection1/
[junit4] 2> 1343264 INFO (coreZkRegister-2504-thread-1-processing-n:127.0.0.1:41101_a_y x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1343264 INFO (coreZkRegister-2504-thread-1-processing-n:127.0.0.1:41101_a_y x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy https://127.0.0.1:41101/a_y/collection1/ has no replicas
[junit4] 2> 1343266 INFO (coreZkRegister-2504-thread-1-processing-n:127.0.0.1:41101_a_y x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 1343271 INFO (coreZkRegister-2504-thread-1-processing-n:127.0.0.1:41101_a_y x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
[junit4] 2> 1343274 INFO (coreZkRegister-2504-thread-1-processing-n:127.0.0.1:41101_a_y x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:41101/a_y/collection1/ shard1
[junit4] 2> 1343274 INFO (OverseerStateUpdate-95123646694686725-127.0.0.1:41101_a_y-n_0000000000) [n:127.0.0.1:41101_a_y ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"https://127.0.0.1:41101/a_y",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 1
[junit4] 2> 1343378 INFO (zkCallback-1530-thread-2-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
[junit4] 2> 1343378 INFO (zkCallback-1530-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
[junit4] 2> 1343427 INFO (coreZkRegister-2504-thread-1-processing-n:127.0.0.1:41101_a_y x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are https://127.0.0.1:41101/a_y/collection1/ and leader is https://127.0.0.1:41101/a_y/collection1/
[junit4] 2> 1343427 INFO (coreZkRegister-2504-thread-1-processing-n:127.0.0.1:41101_a_y x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:41101/a_y
[junit4] 2> 1343427 INFO (coreZkRegister-2504-thread-1-processing-n:127.0.0.1:41101_a_y x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1343427 INFO (coreZkRegister-2504-thread-1-processing-n:127.0.0.1:41101_a_y x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
[junit4] 2> 1343427 INFO (coreZkRegister-2504-thread-1-processing-n:127.0.0.1:41101_a_y x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41101_a_y c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 1343429 INFO (OverseerStateUpdate-95123646694686725-127.0.0.1:41101_a_y-n_0000000000) [n:127.0.0.1:41101_a_y ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:41101/a_y",
[junit4] 2> "node_name":"127.0.0.1:41101_a_y",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 2
[junit4] 2> 1343429 INFO (OverseerStateUpdate-95123646694686725-127.0.0.1:41101_a_y-n_0000000000) [n:127.0.0.1:41101_a_y ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:41101/a_y",
[junit4] 2> "node_name":"127.0.0.1:41101_a_y",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 1343532 INFO (zkCallback-1530-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
[junit4] 2> 1343532 INFO (zkCallback-1530-thread-2-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
[junit4] 2> 1343540 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1343559 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1343571 INFO (zkCallback-1532-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6c0cd8cd name:ZooKeeperConnection Watcher:127.0.0.1:54397/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1343572 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1343572 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1343572 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 1343574 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 1343574 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with stateFormat=2
[junit4] 2> 1343574 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1343587 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1343596 INFO (zkCallback-1533-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@54954eb4 name:ZooKeeperConnection Watcher:127.0.0.1:54397/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1343596 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1343596 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1343597 INFO (OverseerStateUpdate-95123646694686725-127.0.0.1:41101_a_y-n_0000000000) [n:127.0.0.1:41101_a_y ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"create",
[junit4] 2> "name":"collection1",
[junit4] 2> "numShards":"4",
[junit4] 2> "stateFormat":"2"} current state version: 3
[junit4] 2> 1343598 INFO (OverseerStateUpdate-95123646694686725-127.0.0.1:41101_a_y-n_0000000000) [n:127.0.0.1:41101_a_y ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
[junit4] 2> 1343700 INFO (OverseerStateUpdate-95123646694686725-127.0.0.1:41101_a_y-n_0000000000) [n:127.0.0.1:41101_a_y ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/collection1/state.json
[junit4] 2> 1343953 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest_D77AACF2B2B5CCE7-001/shard-1-001/cores/collection1
[junit4] 2> 1343954 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest_D77AACF2B2B5CCE7-001/shard-1-001
[junit4] 2> 1343955 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.e.j.s.Server jetty-9.3.6.v20151106
[junit4] 2> 1343957 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@58785e2a{/a_y,null,AVAILABLE}
[junit4] 2> 1343958 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.e.j.u.s.SslContextFactory x509=X509@25c57cf0(solrtest,h=[],w=[]) for SslContextFactory@1a05ce2c(file:///x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/server/etc/test/solrtest.keystore,file:///x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/server/etc/test/solrtest.keystore)
[junit4] 2> 1343977 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.e.j.s.ServerConnector Started ServerConnector@760b2cd8{SSL,[ssl, http/1.1]}{127.0.0.1:34831}
[junit4] 2> 1343980 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.e.j.s.Server Started @1347007ms
[junit4] 2> 1343980 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest_D77AACF2B2B5CCE7-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/a_y, hostPort=34831, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest_D77AACF2B2B5CCE7-001/shard-1-001/cores}
[junit4] 2> 1343980 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 1343981 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest_D77AACF2B2B5CCE7-001/shard-1-001'
[junit4] 2> 1343981 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1343981 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 1343981 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1343983 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1343985 INFO (zkCallback-1534-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@43114d97 name:ZooKeeperConnection Watcher:127.0.0.1:54397/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1343985 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1343985 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1343986 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1343986 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest_D77AACF2B2B5CCE7-001/shard-1-001/solr.xml
[junit4] 2> 1343991 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest_D77AACF2B2B5CCE7-001/shard-1-001/cores
[junit4] 2> 1343991 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.CoreContainer New CoreContainer 2085268738
[junit4] 2> 1343991 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest_D77AACF2B2B5CCE7-001/shard-1-001]
[junit4] 2> 1343991 WARN (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest_D77AACF2B2B5CCE7-001/shard-1-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest_D77AACF2B2B5CCE7-001/shard-1-001/lib
[junit4] 2> 1343995 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 1343997 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1343999 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1343999 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1343999 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:54397/solr
[junit4] 2> 1343999 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 1343999 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1343999 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1344001 INFO (zkCallback-1537-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@344336b5 name:ZooKeeperConnection Watcher:127.0.0.1:54397 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1344002 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1344002 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1344004 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [n:127.0.0.1:34831_a_y ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1344005 INFO (zkCallback-1538-thread-1-processing-n:127.0.0.1:34831_a_y) [n:127.0.0.1:34831_a_y ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7bc93874 name:ZooKeeperConnection Watcher:127.0.0.1:54397/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1344005 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [n:127.0.0.1:34831_a_y ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1344012 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [n:127.0.0.1:34831_a_y ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 1345018 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [n:127.0.0.1:34831_a_y ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34831_a_y
[junit4] 2> 1345019 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [n:127.0.0.1:34831_a_y ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:34831_a_y
[junit4] 2> 1345020 INFO (zkCallback-1532-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
[junit4] 2> 1345020 INFO (zkCallback-1538-thread-1-processing-n:127.0.0.1:34831_a_y) [n:127.0.0.1:34831_a_y ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
[junit4] 2> 1345020 INFO (zkCallback-1530-thread-2-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
[junit4] 2> 1345020 INFO (zkCallback-1530-thread-1-processing-n:127.0.0.1:41101_a_y) [n:127.0.0.1:41101_a_y ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
[junit4] 2> 1345022 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [n:127.0.0.1:34831_a_y ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1345022 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [n:127.0.0.1:34831_a_y ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95123646694686730-127.0.0.1:34831_a_y-n_0000000001
[junit4] 2> 1345023 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [n:127.0.0.1:34831_a_y ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/95123646694686725-127.0.0.1:41101_a_y-n_0000000000 to know if I could be the leader
[junit4] 2> 1345033 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [n:127.0.0.1:34831_a_y ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 1345033 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [n:127.0.0.1:34831_a_y ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 1345034 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [n:127.0.0.1:34831_a_y ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest_D77AACF2B2B5CCE7-001/shard-1-001/cores
[junit4] 2> 1345036 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [n:127.0.0.1:34831_a_y ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=collection1, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 1345036 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [n:127.0.0.1:34831_a_y ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest_D77AACF2B2B5CCE7-001/shard-1-001/cores/collection1
[junit4] 2> 1345036 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [n:127.0.0.1:34831_a_y ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
[junit4] 2> 1345054 INFO (coreLoadExecutor-2521-thread-1-processing-n:127.0.0.1:34831_a_y) [n:127.0.0.1:34831_a_y c:collection1 x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 1345054 INFO (coreLoadExecutor-2521-thread-1-processing-n:127.0.0.1:34831_a_y) [n:127.0.0.1:34831_a_y c:collection1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 1345055 INFO (OverseerStateUpdate-95123646694686725-127.0.0.1:41101_a_y-n_0000000000) [n:127.0.0.1:41101_a_y ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:34831/a_y",
[junit4] 2> "node_name":"127.0.0.1:34831_a_y",
[junit4] 2> "numShards":"4",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"} current state version: 3
[junit4] 2> 1345055 INFO (coreLoadExecutor-2521-thread-1-processing-n:127.0.0.1:34831_a_y) [n:127.0.0.1:34831_a_y c:collection1 x:collection1] o.a.s.c.ZkController Registering watch for collection collection1
[junit4] 2> 1345056 INFO (coreLoadExecutor-2521-thread-1-processing-n:127.0.0.1:34831_a_y) [n:127.0.0.1:34831_a_y c:collection1 x:collection1] o.a.s.c.c.ZkStateReader addZkWatch [collection1]
[junit4] 2> 1345056 INFO (coreLoadExecutor-2521-thread-1-processing-n:127.0.0.1:34831_a_y) [n:127.0.0.1:34831_a_y c:collection1 x:collection1] o.a.s.c.c.ZkStateReader Add data for [collection1] ver [0]
[junit4] 2> 1345056 INFO (coreLoadExecutor-2521-thread-1-processing-n:127.0.0.1:34831_a_y) [n:127.0.0.1:34831_a_y c:collection1 x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 1345056 INFO (OverseerStateUpdate-95123646694686725-127.0.0.1:41101_a_y-n_0000000000) [n:127.0.0.1:41101_a_y ] o.a.s.c.o.ReplicaMutator Update state numShards=4 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:34831/a_y",
[junit4] 2> "node_name":"127.0.0.1:34831_a_y",
[junit4] 2> "numShards":"4",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"}
[junit4] 2> 1345056 INFO (OverseerStateUpdate-95123646694686725-127.0.0.1:41101_a_y-n_0000000000) [n:127.0.0.1:41101_a_y ] o.a.s.c.o.ReplicaMutator Collection already exists with numShards=4
[junit4] 2> 1345056 INFO (OverseerStateUpdate-95123646694686725-127.0.0.1:41101_a_y-n_0000000000) [n:127.0.0.1:41101_a_y ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2
[junit4] 2> 1345058 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [n:127.0.0.1:34831_a_y ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4] 2> 1345058 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[D77AACF2B2B5CCE7]) [n:127.0.0.1:34831_a_y ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 1345168 INFO (OverseerStateUpdate-95123646694686725-127.0.0.1:41101_a_y-n_0000000000) [n:127.0.0.1:41101_a_y ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/collection1/state.json version: 0
[junit4] 2> 1345168 INFO (zkCallback-1538-thread-1-processing-n:127.0.0.1:34831_a_y) [n:127.0.0.1:34831_a_y ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1345169 INFO (zkCallback-1538-thread-1-processing-n:127.0.0.1:34831_a_y) [n:127.0.0.1:34831_a_y ] o.a.s.c.c.ZkStateReader Updating data for [collection1] from [0] to [1]
[junit4] 2> 1346058 INFO (coreLoadExecutor-2521-thread-1-processing-n:127.0.0.1:34831_a_y) [n:127.0.0.1:34831_a_y c:collection1 x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 1346058 INFO (coreLoadExecutor-2521-thread-1-processing-n:127.0.0.1:34831_a_y) [n:127.0.0.1:34831_a_y c:collection1 x:collection1] o.a.s.c.ZkController Check for collection zkNode:collection1
[junit4] 2> 1346059 INFO (coreLoadExecutor-2521-thread-1-processing-n:127.0.0.1:34831_a_y) [n:127.0.0.1:34831_a_y c:collection1 x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 1346059 INFO (coreLoadExecutor-2521-thread-1-processing-n:127.0.0.1:34831_a_y) [n:127.0.0.1:34831_a_y c:collection1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/collection1]
[junit4] 2> 1346059 INFO (coreLoadExecutor-2521-thread-1-processing-n:127.0.0.1:34831_a_y) [n:127.0.0.1:34831_a_y c:collection1 x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/collection1] [configName]=[conf1] specified config exists in ZooKeeper
[junit4] 2> 1346059 INFO (coreLoadExecutor-2521-thread-1-processing-n:127.0.0.1:34831_a_y) [n:127.0.0.1:34831_a_y c:collection1 x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest_D77AACF2B2B5CCE7-001/shard-1-001/cores/collection1'
[junit4] 2> 1346059 INFO (coreLoadExecutor-2521-thread-1-processing-n:127.0.0.1:34831_a_y) [n:127.0.0.1:34831_a_y c:collection1 x:collection1
[...truncated too long message...]
lr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:226)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:184)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1668)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:111)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1668)
[junit4] 2> at org.eclipse.jetty.servlets.GzipFilter.doFilter(GzipFilter.java:45)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1668)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:581)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1158)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:511)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1090)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
[junit4] 2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:375)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:119)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:517)
[junit4] 2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:308)
[junit4] 2> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:242)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:261)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)
[junit4] 2> at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:75)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceAndRun(ExecuteProduceConsume.java:213)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:147)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:654)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> Dec 30, 2015 11:12:55 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 2 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene60): {rnd_b=BlockTreeOrds(blocksize=128), _version_=PostingsFormat(name=Memory doPackFST= false), a_t=PostingsFormat(name=Memory doPackFST= false), a_i=BlockTreeOrds(blocksize=128), id=BlockTreeOrds(blocksize=128)}, docValues:{}, sim=ClassicSimilarity, locale=es_MX, timezone=Asia/Beirut
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_66 (64-bit)/cpus=4,threads=2,free=314799256,total=515899392
[junit4] 2> NOTE: All tests run in this JVM: [ForceLeaderTest, FullHLLTest, TestUtils, TestSweetSpotSimilarityFactory, TestDocBasedVersionConstraints, AnalysisErrorHandlingTest, TestRTimerTree, HardAutoCommitTest, TestJmxIntegration, UUIDUpdateProcessorFallbackTest, BlockJoinFacetSimpleTest, TestSolrIndexConfig, CloneFieldUpdateProcessorFactoryTest, TestDefaultStatsCache, TestShortCircuitedRequests, TestScoreJoinQPScore, AnalyticsMergeStrategyTest, TestCSVResponseWriter, DebugComponentTest, OverseerTest, TestComplexPhraseQParserPlugin, TestIndexSearcher, CoreAdminRequestStatusTest, HdfsChaosMonkeyNothingIsSafeTest, TestXIncludeConfig, XmlUpdateRequestHandlerTest, PrimitiveFieldTypeTest, DocValuesMultiTest, TestConfigSetsAPI, SuggestComponentTest, SolrTestCaseJ4Test, HdfsRestartWhileUpdatingTest, TestStressUserVersions, PluginInfoTest, TestInfoStreamLogging, ExitableDirectoryReaderTest, BadIndexSchemaTest, TestMiniSolrCloudClusterSSL, DirectUpdateHandlerTest, OverseerCollectionConfigSetProcessorTest, SmileWriterTest, TestExtendedDismaxParser, TestFieldTypeResource, CollectionTooManyReplicasTest, TestConfigSets, ScriptEngineTest, TestSolrJ, LukeRequestHandlerTest, BadCopyFieldTest, MergeStrategyTest, TestReloadDeadlock, TestCollationField, TestBulkSchemaConcurrent, TestRuleBasedAuthorizationPlugin, QueryParsingTest, TestBulkSchemaAPI, TestBlobHandler, DistributedExpandComponentTest, RequestHandlersTest, NoCacheHeaderTest, SolrCloudExampleTest, TestRawTransformer, VMParamsZkACLAndCredentialsProvidersTest, TestReqParamsAPI, TestUniqueKeyFieldResource, FieldMutatingUpdateProcessorTest, UnloadDistributedZkTest, TestClusterStateMutator, TestFieldCollectionResource, DistributedFacetPivotSmallAdvancedTest, SecurityConfHandlerTest, TestPHPSerializedResponseWriter, TestGroupingSearch, TestMaxScoreQueryParser, BlockCacheTest, BasicDistributedZk2Test, SolrCoreCheckLockOnStartupTest, ParsingFieldUpdateProcessorsTest, TestSchemaManager, DistribJoinFromCollectionTest, TestSerializedLuceneMatchVersion, TestExactStatsCache, DocValuesMissingTest, TestWriterPerf, TestOverriddenPrefixQueryForCustomFieldType, TestSolrQueryParser, DistributedQueryComponentCustomSortTest, BadComponentTest, TestDefaultSearchFieldResource, CircularListTest, DirectUpdateHandlerOptimizeTest, HighlighterMaxOffsetTest, TestFilteredDocIdSet, TestStressRecovery, BasicDistributedZkTest, CollectionsAPIDistributedZkTest, LeaderElectionIntegrationTest, TestReplicationHandler, DistributedTermsComponentTest, TestSolr4Spatial, StatsComponentTest, BasicFunctionalityTest, TestLazyCores, TestBadConfig, ShowFileRequestHandlerTest, DistributedQueryElevationComponentTest, SuggesterFSTTest, CoreAdminHandlerTest, TestStressLucene, SpatialFilterTest, WordBreakSolrSpellCheckerTest, TestWordDelimiterFilterFactory, TestSolrDeletionPolicy1, SolrInfoMBeanTest, CacheHeaderTest, TestQueryUtils, TestReversedWildcardFilterFactory, TestOmitPositions, TermsComponentTest, PathHierarchyTokenizerFactoryTest, TestIndexingPerformance, MoreLikeThisHandlerTest, TestArbitraryIndexDir, RegexBoostProcessorTest, SolrPluginUtilsTest, UniqFieldsUpdateProcessorFactoryTest, PingRequestHandlerTest, DirectSolrConnectionTest, SpellPossibilityIteratorTest, TestCharFilters, TestDFRSimilarityFactory, TestLMDirichletSimilarityFactory, TestIBSimilarityFactory, TestJmxMonitoredMap, URLClassifyProcessorTest, DateMathParserTest, TestSystemIdResolver, TestSuggestSpellingConverter, SpellingQueryConverterTest, DOMUtilTest, ClusterStateTest, TestDocumentBuilder, ZkNodePropsTest, SliceStateTest, SystemInfoHandlerTest, DistributedIntervalFacetingTest, TestCrossCoreJoin, TestCursorMarkWithoutUniqueKey, TestDistributedMissingSort, TestHighlightDedupGrouping, TestSimpleTrackingShardHandler, TestTolerantSearch, TestEmbeddedSolrServerConstructors, TestJettySolrRunner, ActionThrottleTest, AssignTest, AsyncCallRequestStatusResponseTest, CdcrReplicationDistributedZkTest, ReplicationFactorTest, SSLMigrationTest, SaslZkACLProviderTest, SimpleCollectionCreateDeleteTest, SolrXmlInZkTest, TestAuthenticationFramework, TestCloudInspectUtil, TestCloudPivotFacet, TestDistribDocBasedVersion, TestMiniSolrCloudCluster, HdfsChaosMonkeySafeLeaderTest]
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=HdfsChaosMonkeySafeLeaderTest -Dtests.seed=D77AACF2B2B5CCE7 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=es_MX -Dtests.timezone=Asia/Beirut -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] ERROR 0.00s J2 | HdfsChaosMonkeySafeLeaderTest (suite) <<<
[junit4] > Throwable #1: java.lang.AssertionError: ObjectTracker found 1 object(s) that were not released!!! [HdfsTransactionLog]
[junit4] > at __randomizedtesting.SeedInfo.seed([D77AACF2B2B5CCE7]:0)
[junit4] > at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:229)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] Completed [483/573 (3!)] on J2 in 118.03s, 1 test, 1 failure <<< FAILURES!
[...truncated 301 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:791: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:728: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1424: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:981: There were test failures: 573 suites (8 ignored), 2284 tests, 3 suite-level errors, 33 ignored (18 assumptions) [seed: D77AACF2B2B5CCE7]
Total time: 205 minutes 59 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Re: [JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 896 - Still Failing
Posted by Michael McCandless <lu...@mikemccandless.com>.
I'll dig, silly test bug!
Mike McCandless
http://blog.mikemccandless.com
On Tue, Dec 29, 2015 at 4:11 AM, Apache Jenkins Server
<je...@builds.apache.org> wrote:
> Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/896/
>
> 1 tests failed.
> FAILED: org.apache.lucene.search.TestDimensionalRangeQuery.testRandomBinaryTiny
>
> Error Message:
> maxMBSortInHeap=2.255092363313635 only allows for maxPointsSortInHeap=1443, but this is less than maxPointsInLeafNode=1606; either increase maxMBSortInHeap or decrease maxPointsInLeafNode
>
> Stack Trace:
> java.lang.IllegalArgumentException: maxMBSortInHeap=2.255092363313635 only allows for maxPointsSortInHeap=1443, but this is less than maxPointsInLeafNode=1606; either increase maxMBSortInHeap or decrease maxPointsInLeafNode
> at __randomizedtesting.SeedInfo.seed([B6A7B02C094A1978:181EDD6FE19860C1]:0)
> at org.apache.lucene.util.bkd.BKDWriter.<init>(BKDWriter.java:161)
> at org.apache.lucene.codecs.lucene60.Lucene60DimensionalWriter.writeField(Lucene60DimensionalWriter.java:88)
> at org.apache.lucene.index.DimensionalValuesWriter.flush(DimensionalValuesWriter.java:68)
> at org.apache.lucene.index.DefaultIndexingChain.writeDimensionalValues(DefaultIndexingChain.java:146)
> at org.apache.lucene.index.DefaultIndexingChain.flush(DefaultIndexingChain.java:96)
> at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:425)
> at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:502)
> at org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWriter.java:614)
> at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:3099)
> at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:3074)
> at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1727)
> at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1707)
> at org.apache.lucene.index.RandomIndexWriter.forceMerge(RandomIndexWriter.java:421)
> at org.apache.lucene.search.TestDimensionalRangeQuery.verifyBinary(TestDimensionalRangeQuery.java:508)
> at org.apache.lucene.search.TestDimensionalRangeQuery.doTestRandomBinary(TestDimensionalRangeQuery.java:419)
> at org.apache.lucene.search.TestDimensionalRangeQuery.testRandomBinaryTiny(TestDimensionalRangeQuery.java:375)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:497)
> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
> at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
> at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
> at java.lang.Thread.run(Thread.java:745)
>
>
>
>
> Build Log:
> [...truncated 1700 lines...]
> [junit4] Suite: org.apache.lucene.search.TestDimensionalRangeQuery
> [junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
> [junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestDimensionalRangeQuery -Dtests.method=testRandomBinaryTiny -Dtests.seed=B6A7B02C094A1978 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=es_BO -Dtests.timezone=SystemV/EST5 -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
> [junit4] ERROR 0.02s J0 | TestDimensionalRangeQuery.testRandomBinaryTiny <<<
> [junit4] > Throwable #1: java.lang.IllegalArgumentException: maxMBSortInHeap=2.255092363313635 only allows for maxPointsSortInHeap=1443, but this is less than maxPointsInLeafNode=1606; either increase maxMBSortInHeap or decrease maxPointsInLeafNode
> [junit4] > at __randomizedtesting.SeedInfo.seed([B6A7B02C094A1978:181EDD6FE19860C1]:0)
> [junit4] > at org.apache.lucene.util.bkd.BKDWriter.<init>(BKDWriter.java:161)
> [junit4] > at org.apache.lucene.codecs.lucene60.Lucene60DimensionalWriter.writeField(Lucene60DimensionalWriter.java:88)
> [junit4] > at org.apache.lucene.index.DimensionalValuesWriter.flush(DimensionalValuesWriter.java:68)
> [junit4] > at org.apache.lucene.index.DefaultIndexingChain.writeDimensionalValues(DefaultIndexingChain.java:146)
> [junit4] > at org.apache.lucene.index.DefaultIndexingChain.flush(DefaultIndexingChain.java:96)
> [junit4] > at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:425)
> [junit4] > at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:502)
> [junit4] > at org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWriter.java:614)
> [junit4] > at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:3099)
> [junit4] > at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:3074)
> [junit4] > at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1727)
> [junit4] > at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1707)
> [junit4] > at org.apache.lucene.index.RandomIndexWriter.forceMerge(RandomIndexWriter.java:421)
> [junit4] > at org.apache.lucene.search.TestDimensionalRangeQuery.verifyBinary(TestDimensionalRangeQuery.java:508)
> [junit4] > at org.apache.lucene.search.TestDimensionalRangeQuery.doTestRandomBinary(TestDimensionalRangeQuery.java:419)
> [junit4] > at org.apache.lucene.search.TestDimensionalRangeQuery.testRandomBinaryTiny(TestDimensionalRangeQuery.java:375)
> [junit4] > at java.lang.Thread.run(Thread.java:745)
> [junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/core/test/J0/temp/lucene.search.TestDimensionalRangeQuery_B6A7B02C094A1978-001
> [junit4] 2> NOTE: test params are: codec=Lucene60, sim=ClassicSimilarity, locale=es_BO, timezone=SystemV/EST5
> [junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_66 (64-bit)/cpus=4,threads=1,free=187269408,total=429391872
> [junit4] 2> NOTE: All tests run in this JVM: [TestSegmentInfos, TestConjunctionDISI, TestLucene54DocValuesFormat, TestMultiDocValues, TestBlockPostingsFormat3, TestPagedBytes, TestSentinelIntSet, TestNumericRangeQuery64, TestTermScorer, TestNativeFSLockFactory, TestLucene50FieldInfoFormat, TestVirtualMethod, TestFixedBitSet, TestIndexWriterUnicode, TestRollingBuffer, TestInfoStream, TestOrdinalMap, TestTerms, TestDocInverterPerFieldErrorInfo, Test2BNumericDocValues, TestGrowableByteArrayDataOutput, TestMergedIterator, FuzzyTermOnShortTermsTest, TestSegmentReader, TestAttributeSource, TestSloppyMath, TestWeakIdentityMap, TestDeterminism, TestIndexWriterExceptions2, TestTimeLimitingCollector, TestIndexSearcher, TestByteBlockPool, TestParallelTermEnum, TestIndexWriterCommit, TestDoc, TestCustomNorms, TestMinimize, TestIndexWriterOnVMError, TestBooleanMinShouldMatch, TestUniqueTermCount, TestFilterDirectory, TestOperations, TestStringHelper, FiniteStringsIteratorTest, TestNoMergePolicy, TestIndexWriterMergePolicy, TestMaxPosition, TestSizeBoundedForceMerge, TestSpanBoostQuery, TestAutomatonQuery, TestSimilarity2, TestSloppyPhraseQuery2, TestParallelCompositeReader, TestPerFieldPostingsFormat, MultiCollectorTest, Test2BSortedDocValuesOrds, TestUnicodeUtil, TestDocValuesIndexing, TestIndexWriterLockRelease, TestMultiTermConstantScore, TestThreadedForceMerge, TestForTooMuchCloning, TestPositionIncrement, TestMutableValues, TestReusableStringReader, TestIndexWriterConfig, TestSearcherManager, TestHighCompressionMode, TestDocumentsWriterStallControl, TestExceedMaxTermLength, TestFilterDirectoryReader, TestIndexReaderClose, TestIndexWriterFromReader, TestIndexWriterThreadsToSegments, TestReaderWrapperDVTypeCheck, TestStressDeletes, TestApproximationSearchEquivalence, TestBooleanCoord, TestBooleanRewrites, TestControlledRealTimeReopenThread, TestDimensionalRangeQuery]
> [junit4] Completed [403/403 (1!)] on J0 in 757.26s, 18 tests, 1 error <<< FAILURES!
>
> [...truncated 11 lines...]
> BUILD FAILED
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:791: The following error occurred while executing this line:
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:728: The following error occurred while executing this line:
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build.xml:50: The following error occurred while executing this line:
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1436: The following error occurred while executing this line:
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:991: There were test failures: 403 suites (1 ignored), 3317 tests, 1 error, 29 ignored (25 assumptions) [seed: B6A7B02C094A1978]
>
> Total time: 61 minutes 45 seconds
> Build step 'Invoke Ant' marked build as failure
> Archiving artifacts
> No prior successful build to compare, so performing full copy of artifacts
> Recording test results
> Email was triggered for: Failure - Any
> Sending email for trigger: Failure - Any
>
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 896 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/896/
1 tests failed.
FAILED: org.apache.lucene.search.TestDimensionalRangeQuery.testRandomBinaryTiny
Error Message:
maxMBSortInHeap=2.255092363313635 only allows for maxPointsSortInHeap=1443, but this is less than maxPointsInLeafNode=1606; either increase maxMBSortInHeap or decrease maxPointsInLeafNode
Stack Trace:
java.lang.IllegalArgumentException: maxMBSortInHeap=2.255092363313635 only allows for maxPointsSortInHeap=1443, but this is less than maxPointsInLeafNode=1606; either increase maxMBSortInHeap or decrease maxPointsInLeafNode
at __randomizedtesting.SeedInfo.seed([B6A7B02C094A1978:181EDD6FE19860C1]:0)
at org.apache.lucene.util.bkd.BKDWriter.<init>(BKDWriter.java:161)
at org.apache.lucene.codecs.lucene60.Lucene60DimensionalWriter.writeField(Lucene60DimensionalWriter.java:88)
at org.apache.lucene.index.DimensionalValuesWriter.flush(DimensionalValuesWriter.java:68)
at org.apache.lucene.index.DefaultIndexingChain.writeDimensionalValues(DefaultIndexingChain.java:146)
at org.apache.lucene.index.DefaultIndexingChain.flush(DefaultIndexingChain.java:96)
at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:425)
at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:502)
at org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWriter.java:614)
at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:3099)
at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:3074)
at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1727)
at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1707)
at org.apache.lucene.index.RandomIndexWriter.forceMerge(RandomIndexWriter.java:421)
at org.apache.lucene.search.TestDimensionalRangeQuery.verifyBinary(TestDimensionalRangeQuery.java:508)
at org.apache.lucene.search.TestDimensionalRangeQuery.doTestRandomBinary(TestDimensionalRangeQuery.java:419)
at org.apache.lucene.search.TestDimensionalRangeQuery.testRandomBinaryTiny(TestDimensionalRangeQuery.java:375)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 1700 lines...]
[junit4] Suite: org.apache.lucene.search.TestDimensionalRangeQuery
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestDimensionalRangeQuery -Dtests.method=testRandomBinaryTiny -Dtests.seed=B6A7B02C094A1978 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=es_BO -Dtests.timezone=SystemV/EST5 -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[junit4] ERROR 0.02s J0 | TestDimensionalRangeQuery.testRandomBinaryTiny <<<
[junit4] > Throwable #1: java.lang.IllegalArgumentException: maxMBSortInHeap=2.255092363313635 only allows for maxPointsSortInHeap=1443, but this is less than maxPointsInLeafNode=1606; either increase maxMBSortInHeap or decrease maxPointsInLeafNode
[junit4] > at __randomizedtesting.SeedInfo.seed([B6A7B02C094A1978:181EDD6FE19860C1]:0)
[junit4] > at org.apache.lucene.util.bkd.BKDWriter.<init>(BKDWriter.java:161)
[junit4] > at org.apache.lucene.codecs.lucene60.Lucene60DimensionalWriter.writeField(Lucene60DimensionalWriter.java:88)
[junit4] > at org.apache.lucene.index.DimensionalValuesWriter.flush(DimensionalValuesWriter.java:68)
[junit4] > at org.apache.lucene.index.DefaultIndexingChain.writeDimensionalValues(DefaultIndexingChain.java:146)
[junit4] > at org.apache.lucene.index.DefaultIndexingChain.flush(DefaultIndexingChain.java:96)
[junit4] > at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:425)
[junit4] > at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:502)
[junit4] > at org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWriter.java:614)
[junit4] > at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:3099)
[junit4] > at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:3074)
[junit4] > at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1727)
[junit4] > at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1707)
[junit4] > at org.apache.lucene.index.RandomIndexWriter.forceMerge(RandomIndexWriter.java:421)
[junit4] > at org.apache.lucene.search.TestDimensionalRangeQuery.verifyBinary(TestDimensionalRangeQuery.java:508)
[junit4] > at org.apache.lucene.search.TestDimensionalRangeQuery.doTestRandomBinary(TestDimensionalRangeQuery.java:419)
[junit4] > at org.apache.lucene.search.TestDimensionalRangeQuery.testRandomBinaryTiny(TestDimensionalRangeQuery.java:375)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/core/test/J0/temp/lucene.search.TestDimensionalRangeQuery_B6A7B02C094A1978-001
[junit4] 2> NOTE: test params are: codec=Lucene60, sim=ClassicSimilarity, locale=es_BO, timezone=SystemV/EST5
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_66 (64-bit)/cpus=4,threads=1,free=187269408,total=429391872
[junit4] 2> NOTE: All tests run in this JVM: [TestSegmentInfos, TestConjunctionDISI, TestLucene54DocValuesFormat, TestMultiDocValues, TestBlockPostingsFormat3, TestPagedBytes, TestSentinelIntSet, TestNumericRangeQuery64, TestTermScorer, TestNativeFSLockFactory, TestLucene50FieldInfoFormat, TestVirtualMethod, TestFixedBitSet, TestIndexWriterUnicode, TestRollingBuffer, TestInfoStream, TestOrdinalMap, TestTerms, TestDocInverterPerFieldErrorInfo, Test2BNumericDocValues, TestGrowableByteArrayDataOutput, TestMergedIterator, FuzzyTermOnShortTermsTest, TestSegmentReader, TestAttributeSource, TestSloppyMath, TestWeakIdentityMap, TestDeterminism, TestIndexWriterExceptions2, TestTimeLimitingCollector, TestIndexSearcher, TestByteBlockPool, TestParallelTermEnum, TestIndexWriterCommit, TestDoc, TestCustomNorms, TestMinimize, TestIndexWriterOnVMError, TestBooleanMinShouldMatch, TestUniqueTermCount, TestFilterDirectory, TestOperations, TestStringHelper, FiniteStringsIteratorTest, TestNoMergePolicy, TestIndexWriterMergePolicy, TestMaxPosition, TestSizeBoundedForceMerge, TestSpanBoostQuery, TestAutomatonQuery, TestSimilarity2, TestSloppyPhraseQuery2, TestParallelCompositeReader, TestPerFieldPostingsFormat, MultiCollectorTest, Test2BSortedDocValuesOrds, TestUnicodeUtil, TestDocValuesIndexing, TestIndexWriterLockRelease, TestMultiTermConstantScore, TestThreadedForceMerge, TestForTooMuchCloning, TestPositionIncrement, TestMutableValues, TestReusableStringReader, TestIndexWriterConfig, TestSearcherManager, TestHighCompressionMode, TestDocumentsWriterStallControl, TestExceedMaxTermLength, TestFilterDirectoryReader, TestIndexReaderClose, TestIndexWriterFromReader, TestIndexWriterThreadsToSegments, TestReaderWrapperDVTypeCheck, TestStressDeletes, TestApproximationSearchEquivalence, TestBooleanCoord, TestBooleanRewrites, TestControlledRealTimeReopenThread, TestDimensionalRangeQuery]
[junit4] Completed [403/403 (1!)] on J0 in 757.26s, 18 tests, 1 error <<< FAILURES!
[...truncated 11 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:791: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:728: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build.xml:50: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1436: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:991: There were test failures: 403 suites (1 ignored), 3317 tests, 1 error, 29 ignored (25 assumptions) [seed: B6A7B02C094A1978]
Total time: 61 minutes 45 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 895 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/895/
1 tests failed.
FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test
Error Message:
Captured an uncaught exception in thread: Thread[id=22616, name=collection4, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=22616, name=collection4, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: java.lang.RuntimeException: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[https://127.0.0.1:46930, https://127.0.0.1:59010, https://127.0.0.1:42959, https://127.0.0.1:40538, https://127.0.0.1:56851]
at __randomizedtesting.SeedInfo.seed([8AF97C780B82D319]:0)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:891)
Caused by: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[https://127.0.0.1:46930, https://127.0.0.1:59010, https://127.0.0.1:42959, https://127.0.0.1:40538, https://127.0.0.1:56851]
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:352)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:871)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:807)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1574)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1595)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:881)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:42959: KeeperErrorCode = Session expired for /overseer/collection-queue-work/qnr-
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
... 7 more
Build Log:
[...truncated 10867 lines...]
[junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_8AF97C780B82D319-001/init-core-data-001
[junit4] 2> 1557779 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[8AF97C780B82D319]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false)
[junit4] 2> 1557779 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[8AF97C780B82D319]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
[junit4] 2> 1557784 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1557784 INFO (Thread-13787) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1557784 INFO (Thread-13787) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1557885 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.ZkTestServer start zk server on port:54894
[junit4] 2> 1557885 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1557885 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1557888 INFO (zkCallback-2464-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@488a36d9 name:ZooKeeperConnection Watcher:127.0.0.1:54894 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1557888 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1557888 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1557888 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 1557895 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1557895 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1557896 INFO (zkCallback-2465-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7446a2cf name:ZooKeeperConnection Watcher:127.0.0.1:54894/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1557896 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1557896 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1557896 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
[junit4] 2> 1557898 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
[junit4] 2> 1557899 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
[junit4] 2> 1557903 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
[junit4] 2> 1557904 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 1557904 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 1557906 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 1557906 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
[junit4] 2> 1557908 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1557908 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1557910 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 1557910 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
[junit4] 2> 1557911 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 1557911 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
[junit4] 2> 1557913 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 1557913 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
[junit4] 2> 1557914 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 1557915 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 1557916 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1557916 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 1557918 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1557918 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1557919 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 1557919 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 1557921 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 1557921 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
[junit4] 2> 1557923 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1557923 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1557924 INFO (zkCallback-2466-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@50c2130c name:ZooKeeperConnection Watcher:127.0.0.1:54894/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1557924 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1557924 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1558249 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_8AF97C780B82D319-001/control-001/cores/collection1
[junit4] 2> 1558252 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.e.j.s.Server jetty-9.3.6.v20151106
[junit4] 2> 1558253 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@24725791{/,null,AVAILABLE}
[junit4] 2> 1558254 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.e.j.u.s.SslContextFactory x509=X509@287a6f2c(solrtest,h=[],w=[]) for SslContextFactory@40dd7394(file:///x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/server/etc/test/solrtest.keystore,file:///x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/server/etc/test/solrtest.keystore)
[junit4] 2> 1558256 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.e.j.s.ServerConnector Started ServerConnector@74f6f09b{SSL,[ssl, http/1.1]}{127.0.0.1:42959}
[junit4] 2> 1558256 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.e.j.s.Server Started @1561530ms
[junit4] 2> 1558257 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_8AF97C780B82D319-001/tempDir-001/control/data, hostContext=/, hostPort=42959, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_8AF97C780B82D319-001/control-001/cores}
[junit4] 2> 1558258 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 1558258 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_8AF97C780B82D319-001/control-001'
[junit4] 2> 1558258 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1558258 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 1558258 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1558259 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1558259 INFO (zkCallback-2467-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@163b032 name:ZooKeeperConnection Watcher:127.0.0.1:54894/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1558260 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1558260 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1558261 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1558261 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_8AF97C780B82D319-001/control-001/solr.xml
[junit4] 2> 1558265 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_8AF97C780B82D319-001/control-001/cores
[junit4] 2> 1558266 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.CoreContainer New CoreContainer 1350153798
[junit4] 2> 1558266 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_8AF97C780B82D319-001/control-001]
[junit4] 2> 1558266 WARN (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_8AF97C780B82D319-001/control-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_8AF97C780B82D319-001/control-001/lib
[junit4] 2> 1558266 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 1558268 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1558269 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1558269 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1558269 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:54894/solr
[junit4] 2> 1558269 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 1558269 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1558270 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1558271 INFO (zkCallback-2470-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4c7ba905 name:ZooKeeperConnection Watcher:127.0.0.1:54894 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1558271 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1558272 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1558273 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [n:127.0.0.1:42959_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1558274 INFO (zkCallback-2471-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@22e58e02 name:ZooKeeperConnection Watcher:127.0.0.1:54894/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1558274 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [n:127.0.0.1:42959_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1558275 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [n:127.0.0.1:42959_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
[junit4] 2> 1558277 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [n:127.0.0.1:42959_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 1558279 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [n:127.0.0.1:42959_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 1558281 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [n:127.0.0.1:42959_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 1558283 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [n:127.0.0.1:42959_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 1558285 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [n:127.0.0.1:42959_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 1558286 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [n:127.0.0.1:42959_ ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 1558287 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [n:127.0.0.1:42959_ ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 1558290 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [n:127.0.0.1:42959_ ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 1558291 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [n:127.0.0.1:42959_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42959_
[junit4] 2> 1558291 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [n:127.0.0.1:42959_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:42959_
[junit4] 2> 1558293 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [n:127.0.0.1:42959_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 1558295 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [n:127.0.0.1:42959_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 1558297 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [n:127.0.0.1:42959_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1558297 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [n:127.0.0.1:42959_ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95112366953725957-127.0.0.1:42959_-n_0000000000
[junit4] 2> 1558297 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [n:127.0.0.1:42959_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:42959_
[junit4] 2> 1558297 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [n:127.0.0.1:42959_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
[junit4] 2> 1558299 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [n:127.0.0.1:42959_ ] o.a.s.c.Overseer Overseer (id=95112366953725957-127.0.0.1:42959_-n_0000000000) starting
[junit4] 2> 1558300 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [n:127.0.0.1:42959_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
[junit4] 2> 1558305 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [n:127.0.0.1:42959_ ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 1558305 INFO (OverseerCollectionConfigSetProcessor-95112366953725957-127.0.0.1:42959_-n_0000000000) [n:127.0.0.1:42959_ ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
[junit4] 2> 1558306 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [n:127.0.0.1:42959_ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 1558306 INFO (OverseerStateUpdate-95112366953725957-127.0.0.1:42959_-n_0000000000) [n:127.0.0.1:42959_ ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 1558332 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [n:127.0.0.1:42959_ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 1558332 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [n:127.0.0.1:42959_ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 1558332 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [n:127.0.0.1:42959_ ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_8AF97C780B82D319-001/control-001/cores
[junit4] 2> 1558333 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [n:127.0.0.1:42959_ ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=control_collection, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 1558334 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [n:127.0.0.1:42959_ ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_8AF97C780B82D319-001/control-001/cores/collection1
[junit4] 2> 1558334 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [n:127.0.0.1:42959_ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
[junit4] 2> 1558335 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [n:127.0.0.1:42959_ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4] 2> 1558335 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [n:127.0.0.1:42959_ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 1558335 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 1558335 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 1558336 INFO (OverseerStateUpdate-95112366953725957-127.0.0.1:42959_-n_0000000000) [n:127.0.0.1:42959_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:42959",
[junit4] 2> "node_name":"127.0.0.1:42959_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 1558337 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 1558338 INFO (OverseerStateUpdate-95112366953725957-127.0.0.1:42959_-n_0000000000) [n:127.0.0.1:42959_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:42959",
[junit4] 2> "node_name":"127.0.0.1:42959_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 1558338 INFO (OverseerStateUpdate-95112366953725957-127.0.0.1:42959_-n_0000000000) [n:127.0.0.1:42959_ ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
[junit4] 2> 1558338 INFO (OverseerStateUpdate-95112366953725957-127.0.0.1:42959_-n_0000000000) [n:127.0.0.1:42959_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 1558340 INFO (zkCallback-2471-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
[junit4] 2> 1559338 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 1559338 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
[junit4] 2> 1559339 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 1559339 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/control_collection]
[junit4] 2> 1559339 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/control_collection] [configName]=[conf1] specified config exists in ZooKeeper
[junit4] 2> 1559339 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_8AF97C780B82D319-001/control-001/cores/collection1'
[junit4] 2> 1559340 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1559340 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 1559341 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 1559346 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 1559349 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 1559357 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection x:collection1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1559362 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 1559449 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 1559454 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 1559455 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 1559462 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 1559464 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 1559465 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1559466 WARN (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 1559466 WARN (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 1559466 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1559467 WARN (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 1559467 WARN (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 1559468 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4] 2> 1559468 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 1559468 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1559468 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_8AF97C780B82D319-001/control-001/cores/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_8AF97C780B82D319-001/control-001/cores/collection1/data/]
[junit4] 2> 1559468 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@38ba9796
[junit4] 2> 1559469 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_8AF97C780B82D319-001/control-001/cores/collection1/data
[junit4] 2> 1559469 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_8AF97C780B82D319-001/control-001/cores/collection1/data/index/
[junit4] 2> 1559469 WARN (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_8AF97C780B82D319-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1559470 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_8AF97C780B82D319-001/control-001/cores/collection1/data/index
[junit4] 2> 1559470 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=3, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5015402840642721]
[junit4] 2> 1559470 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@5819001c lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@52fb86c0),segFN=segments_1,generation=1}
[junit4] 2> 1559470 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 1559471 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_8AF97C780B82D319-001/control-001/cores/collection1/data/
[junit4] 2> 1559471 WARN (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_8AF97C780B82D319-001/control-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
[junit4] 2> 1559474 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1559474 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1559474 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1559474 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1559474 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1559474 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1559475 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1559475 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1559475 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1559475 WARN (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,args = {defaults={a=A,b=B}}}
[junit4] 2> 1559476 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1559477 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1559478 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1559479 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1559482 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/dump,/update/csv,/sql,/update/json/docs,/admin/luke,/export,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/stream,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 1559482 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 1559483 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1559483 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1559484 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1559484 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1559484 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=2, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 1559484 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@5819001c lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@52fb86c0),segFN=segments_1,generation=1}
[junit4] 2> 1559484 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 1559484 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@106834df[collection1] main
[junit4] 2> 1559485 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/control_collection]
[junit4] 2> 1559485 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/control_collection] [configName]=[conf1] specified config exists in ZooKeeper
[junit4] 2> 1559485 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 1559486 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1559486 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
[junit4] 2> 1559486 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1559486 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 1559486 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1559486 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 1559487 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 1559487 INFO (searcherExecutor-6003-thread-1-processing-n:127.0.0.1:42959_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@106834df[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1559487 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
[junit4] 2> 1559487 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
[junit4] 2> 1559487 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
[junit4] 2> 1559487 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1521797873044291584
[junit4] 2> 1559489 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 2.0ms to seed version buckets with highest version 1521797873044291584
[junit4] 2> 1559489 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
[junit4] 2> 1559490 INFO (coreLoadExecutor-6002-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 1559490 INFO (coreZkRegister-5996-thread-1-processing-n:127.0.0.1:42959_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:https://127.0.0.1:42959 collection:control_collection shard:shard1
[junit4] 2> 1559491 INFO (coreZkRegister-5996-thread-1-processing-n:127.0.0.1:42959_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 1559494 INFO (coreZkRegister-5996-thread-1-processing-n:127.0.0.1:42959_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/95112366953725957-core_node1-n_0000000000
[junit4] 2> 1559494 INFO (coreZkRegister-5996-thread-1-processing-n:127.0.0.1:42959_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard=shard1 and weAreReplacement=false and leaderVoteWait=180000
[junit4] 2> 1559496 INFO (coreZkRegister-5996-thread-1-processing-n:127.0.0.1:42959_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1559496 INFO (coreZkRegister-5996-thread-1-processing-n:127.0.0.1:42959_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1559496 INFO (OverseerStateUpdate-95112366953725957-127.0.0.1:42959_-n_0000000000) [n:127.0.0.1:42959_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection"} current state version: 1
[junit4] 2> 1559496 INFO (coreZkRegister-5996-thread-1-processing-n:127.0.0.1:42959_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:42959/collection1/
[junit4] 2> 1559496 INFO (coreZkRegister-5996-thread-1-processing-n:127.0.0.1:42959_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1559496 INFO (coreZkRegister-5996-thread-1-processing-n:127.0.0.1:42959_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy https://127.0.0.1:42959/collection1/ has no replicas
[junit4] 2> 1559497 INFO (coreZkRegister-5996-thread-1-processing-n:127.0.0.1:42959_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 1559499 INFO (coreZkRegister-5996-thread-1-processing-n:127.0.0.1:42959_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
[junit4] 2> 1559501 INFO (coreZkRegister-5996-thread-1-processing-n:127.0.0.1:42959_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:42959/collection1/ shard1
[junit4] 2> 1559501 INFO (OverseerStateUpdate-95112366953725957-127.0.0.1:42959_-n_0000000000) [n:127.0.0.1:42959_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"https://127.0.0.1:42959",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 1
[junit4] 2> 1559603 INFO (zkCallback-2471-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
[junit4] 2> 1559652 INFO (coreZkRegister-5996-thread-1-processing-n:127.0.0.1:42959_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are https://127.0.0.1:42959/collection1/ and leader is https://127.0.0.1:42959/collection1/
[junit4] 2> 1559652 INFO (coreZkRegister-5996-thread-1-processing-n:127.0.0.1:42959_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:42959
[junit4] 2> 1559652 INFO (coreZkRegister-5996-thread-1-processing-n:127.0.0.1:42959_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1559652 INFO (coreZkRegister-5996-thread-1-processing-n:127.0.0.1:42959_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
[junit4] 2> 1559652 INFO (coreZkRegister-5996-thread-1-processing-n:127.0.0.1:42959_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:42959_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 1559654 INFO (OverseerStateUpdate-95112366953725957-127.0.0.1:42959_-n_0000000000) [n:127.0.0.1:42959_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:42959",
[junit4] 2> "node_name":"127.0.0.1:42959_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 2
[junit4] 2> 1559654 INFO (OverseerStateUpdate-95112366953725957-127.0.0.1:42959_-n_0000000000) [n:127.0.0.1:42959_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:42959",
[junit4] 2> "node_name":"127.0.0.1:42959_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 1559757 INFO (zkCallback-2471-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
[junit4] 2> 1559838 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1559839 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1559840 INFO (zkCallback-2473-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3c0c4be2 name:ZooKeeperConnection Watcher:127.0.0.1:54894/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1559840 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1559840 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1559840 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 1559842 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 1559842 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with stateFormat=2
[junit4] 2> 1559842 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1559846 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1559846 INFO (zkCallback-2474-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2565db5e name:ZooKeeperConnection Watcher:127.0.0.1:54894/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1559846 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1559846 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1559850 INFO (OverseerStateUpdate-95112366953725957-127.0.0.1:42959_-n_0000000000) [n:127.0.0.1:42959_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"create",
[junit4] 2> "name":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "stateFormat":"2"} current state version: 3
[junit4] 2> 1559850 INFO (OverseerStateUpdate-95112366953725957-127.0.0.1:42959_-n_0000000000) [n:127.0.0.1:42959_ ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
[junit4] 2> 1559952 INFO (OverseerStateUpdate-95112366953725957-127.0.0.1:42959_-n_0000000000) [n:127.0.0.1:42959_ ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/collection1/state.json
[junit4] 2> 1560173 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_8AF97C780B82D319-001/shard-1-001/cores/collection1
[junit4] 2> 1560173 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_8AF97C780B82D319-001/shard-1-001
[junit4] 2> 1560175 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.e.j.s.Server jetty-9.3.6.v20151106
[junit4] 2> 1560176 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@22bd1a5d{/,null,AVAILABLE}
[junit4] 2> 1560177 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.e.j.u.s.SslContextFactory x509=X509@68e63a93(solrtest,h=[],w=[]) for SslContextFactory@2b242602(file:///x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/server/etc/test/solrtest.keystore,file:///x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/server/etc/test/solrtest.keystore)
[junit4] 2> 1560178 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.e.j.s.ServerConnector Started ServerConnector@2da5611c{SSL,[ssl, http/1.1]}{127.0.0.1:46930}
[junit4] 2> 1560179 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.e.j.s.Server Started @1563452ms
[junit4] 2> 1560179 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_8AF97C780B82D319-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/, hostPort=46930, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_8AF97C780B82D319-001/shard-1-001/cores}
[junit4] 2> 1560180 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 1560180 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_8AF97C780B82D319-001/shard-1-001'
[junit4] 2> 1560180 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1560180 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 1560180 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1560181 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1560182 INFO (zkCallback-2475-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2b107078 name:ZooKeeperConnection Watcher:127.0.0.1:54894/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1560182 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1560182 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1560183 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1560183 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_8AF97C780B82D319-001/shard-1-001/solr.xml
[junit4] 2> 1560187 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_8AF97C780B82D319-001/shard-1-001/cores
[junit4] 2> 1560188 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.CoreContainer New CoreContainer 1560035836
[junit4] 2> 1560188 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_8AF97C780B82D319-001/shard-1-001]
[junit4] 2> 1560188 WARN (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_8AF97C780B82D319-001/shard-1-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_8AF97C780B82D319-001/shard-1-001/lib
[junit4] 2> 1560188 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 1560190 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1560191 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1560191 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1560192 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:54894/solr
[junit4] 2> 1560192 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 1560192 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1560192 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1560193 INFO (zkCallback-2478-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6be596bd name:ZooKeeperConnection Watcher:127.0.0.1:54894 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1560194 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1560194 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1560196 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [n:127.0.0.1:46930_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1560196 INFO (zkCallback-2479-thread-1-processing-n:127.0.0.1:46930_) [n:127.0.0.1:46930_ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@47ae1e05 name:ZooKeeperConnection Watcher:127.0.0.1:54894/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1560196 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [n:127.0.0.1:46930_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1560201 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [n:127.0.0.1:46930_ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 1561206 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [n:127.0.0.1:46930_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46930_
[junit4] 2> 1561207 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [n:127.0.0.1:46930_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:46930_
[junit4] 2> 1561208 INFO (zkCallback-2473-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
[junit4] 2> 1561208 INFO (zkCallback-2471-thread-1-processing-n:127.0.0.1:42959_) [n:127.0.0.1:42959_ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
[junit4] 2> 1561208 INFO (zkCallback-2479-thread-1-processing-n:127.0.0.1:46930_) [n:127.0.0.1:46930_ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
[junit4] 2> 1561210 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [n:127.0.0.1:46930_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1561210 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [n:127.0.0.1:46930_ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95112366953725962-127.0.0.1:46930_-n_0000000001
[junit4] 2> 1561211 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [n:127.0.0.1:46930_ ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/95112366953725957-127.0.0.1:42959_-n_0000000000 to know if I could be the leader
[junit4] 2> 1561222 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [n:127.0.0.1:46930_ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 1561222 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [n:127.0.0.1:46930_ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 1561223 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [n:127.0.0.1:46930_ ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_8AF97C780B82D319-001/shard-1-001/cores
[junit4] 2> 1561223 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [n:127.0.0.1:46930_ ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=collection1, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 1561224 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [n:127.0.0.1:46930_ ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_8AF97C780B82D319-001/shard-1-001/cores/collection1
[junit4] 2> 1561224 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [n:127.0.0.1:46930_ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
[junit4] 2> 1561224 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [n:127.0.0.1:46930_ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4] 2> 1561224 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8AF97C780B82D319]) [n:127.0.0.1:46930_ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 1561225 INFO (coreLoadExecutor-6013-thread-1-processing-n:127.0.0.1:46930_) [n:127.0.0.1:46930_ c:collection1 x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 1561225 INFO (coreLoadExecutor-6013-thread-1-processing-n:127.0.0.1:46930_) [n:127.0.0.1:46930_ c:collection1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 1561226 INFO (coreLoadExecutor-6013-thread-1-processing-n:127.0.0.1:46930_) [n:127.0.0.1:46930_ c:collection1 x:collection1] o.a.s.c.ZkController Registering watch for collection collection1
[junit4] 2> 1561226 INFO (coreLoadExecutor-6013-thread-1-processing-n:127.0.0.1:46930_) [n:127.0.0.1:46930_ c:collection1 x:collection1] o.a.s.c.c.ZkStateReader addZkWatch [collection1]
[junit4] 2> 1561227 INFO (OverseerStateUpdate-95112366953725957-127.0.0.1:42959_-n_0000000000) [n:127.0.0.1:42959_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:46930",
[junit4] 2> "node_name":"127.0.0.1:46930_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"} current state version: 3
[junit4] 2> 1561227 INFO (coreLoadExecutor-6013-thread-1-processing-n:127.0.0.1:46930_) [n:127.0.0.1:46930_ c:collection1 x:collection1] o.a.s.c.c.ZkStateReader Add data for [collection1] ver [0]
[junit4] 2> 1561227 INFO (coreLoadExecutor-6013-thread-1-processing-n:127.0.0.1:46930_) [n:127.0.0.1:46930_ c:collection1 x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 1561227 INFO (OverseerStateUpdate-95112366953725957-127.0.0.1:42959_-n_0000000000) [n:127.0.0.1:42959_ ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:46930",
[junit4] 2> "node_name":"127.0.0.1:46930_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"}
[junit4] 2> 1561227 INFO (OverseerStateUpdate-95112366953725957-127.0.0.1:42959_-n_0000000000) [n:127.0.0.1:42959_ ] o.a.s.c.o.ReplicaMutator Collection already exists with numShards=2
[junit4] 2> 1561227 INFO (OverseerStateUpdate-95112366953725957-127.0.0.1:42959_-n_0000000000) [n:127.0.0.1:42959_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2
[junit4] 2> 1561329 INFO (OverseerStateUpdate-95112366953725957-127.0.0.1:42959_-n_0000000000) [n:127.0.0.1:42959_ ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/collection1/state.json version: 0
[junit4] 2> 1561330 INFO (zkCallback-2479-thread-1-processing-n:127.0.0.1:46930_) [n:127.0.0.1:46930_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1561330 INFO (zkCallback-2479-thread-1-processing-n:127.0.0.1:46930_) [n:127.0.0.1:46930_ ] o.a.s.c.c.ZkStateReader Updating data for [collection1] from [0] to [1]
[junit4] 2> 1562227 INFO (coreLoadExecutor-6013-thread-1-processing-n:127.0.0.1:46930_) [n:127.0.0.1:46930_ c:collection1 x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 1562227 INFO (coreLoadExecutor-6013-thread-1-processing-n:127.0.0.1:46930_) [n:127.0.0.1:46930_ c:collection1 x:collection1] o.a.s.c.ZkController Check for collection zkNode:collection1
[junit4] 2> 1562228 INFO (coreLoadExecutor-6013-thread-1-processing-n:127.0.0.1:46930_) [n:127.0.0.1:46930_ c:collection1 x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 1562228 INFO (coreLoadExecutor-6013-thread-1-processing-n:127.0.0.1:46930_) [n:127.0.0.1:46930_ c:collection1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/collection1]
[junit4] 2> 1562228 INFO (coreLoadExecutor-6013-thread-1-processing-n:127.0.0.1:46930_) [n:127.0.0.1:46930_ c:collection1 x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/collection1] [configName]=[conf1] specified config exists in ZooKeeper
[junit4] 2> 1562228 INFO (coreLoadExecutor-6013-thread-1-processing-n:127.0.0.1:46930_) [n:127.0.0.1:46930_ c:collection1 x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_8AF97C780B82D319-001/shard-1-001/cores/collection1'
[junit4] 2> 1562228 INFO (coreLoadExecutor-6013-thread-1-processing-n:127.0.0.1:46930_) [n:127.0.0.1:46930_ c:collection1 x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1562228 INFO (coreLoadExecutor-6013-thread-1-processing-n:127.0.0.1:46930_) [n:127.0.0.1:46930_ c:collection1 x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 1562230 INFO (coreLoadExecutor-6013-thread-1-processing-n:127.0.0.1:46930_) [n:127.0.0.1:46930_ c:collection1 x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 1562235 INFO (coreLoadExecutor-6013-thread-1-processing-n:127.0.0.1:46930_) [n:127.0.0.1:46930_ c:collection1 x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 1562239 INFO (coreLoadExecutor-6013-thread-1-processing-n:127.0.0.1:46930_) [n:127.0.0.1:46930_ c:collection1 x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 1562259 INFO (coreLoadExecutor-6013-thread-1-processing-n:127.0.0.1:46930_) [n:127.0.0.1:46930_ c:collection1 x:collection1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1562264 INFO (coreLoadExecutor-6013-thread-1-processing-n:127.0.0.1:46930_) [n:127.0.0.1:46930_ c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 1562341 INFO (coreLoadExecutor-6013-thread-1-processing-n:127.0.0.1:46930_) [n:127.0.0.1:46930_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 1562356 INFO (coreLoadExecutor-6013-thread-1-processing-n:127.0.0.1:46930_) [n:127.0.0.1:46930_ c:collection1 x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 1562357 INFO (coreLoadExecutor-6013-thread-1-processing-n:127.0.0.1:46930_) [n:127.0.0.1:46930_ c:collection1 x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 1562364 INFO (coreLoadExecutor-6013-thread-1-processing-n:127.0.0.1:46930_) [n:127.0.0.1:46930_ c:collection1 x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 1562366 INFO (coreLoadExecutor-6013-thread-1-processing-n:127.0.0.1:46930_) [n:127.0.0.1:46930_ c:collection1 x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 1562368 INFO (coreLoadExecutor-6013-thread-1-processing-n:127.0.0.1:46930_) [n:127.0.0.1:46930_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1562368 WARN (coreLoadExecutor-6013-thread-1-processing-n:127.0.0.1:46930_) [n:127.0.0.1:46930_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 1562369 WARN (coreLoadExecutor-6013-thread-1-processing-n:127.0.0.1:46930_) [n:127.0.0.1:46930_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 1562369 INFO (coreLoadExecutor-6013-thread-1-processing-n:127.0.0.1:46930_) [n:127.0.0.1:46930_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1562369 WARN (coreLoadExecutor-6013-thread-1-processing-n:127.0.0.1:46930_) [n:127.0.0.1:46930_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 1562369 WARN (coreLoadExecutor-6013-thread-1-processing-n:127.0.0.1:46930_) [n:127.0.0.1:46930_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 1562370 INFO (coreLoadExecutor-6013-thread-1-processing-n:127.0.0.1:46930_) [n:127.0.0.1:46930_ c:collection1 x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4] 2> 1562370 INFO (coreLoadExecutor-6013-thread-1-processing-n:127.0.0.1:46930_) [n:127.0.0.1:46930_ c:collection1 x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 1562370 INF
[...truncated too long message...]
o.seed([8AF97C780B82D319]:0)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:891)
[junit4] > Caused by: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[https://127.0.0.1:46930, https://127.0.0.1:59010, https://127.0.0.1:42959, https://127.0.0.1:40538, https://127.0.0.1:56851]
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:352)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:871)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:807)
[junit4] > at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1574)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1595)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:881)
[junit4] > Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:42959: KeeperErrorCode = Session expired for /overseer/collection-queue-work/qnr-
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
[junit4] > ... 7 moreThrowable #6: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=22617, name=collection5, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > Caused by: java.lang.RuntimeException: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[https://127.0.0.1:46930, https://127.0.0.1:59010, https://127.0.0.1:42959, https://127.0.0.1:40538, https://127.0.0.1:56851]
[junit4] > at __randomizedtesting.SeedInfo.seed([8AF97C780B82D319]:0)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:891)
[junit4] > Caused by: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[https://127.0.0.1:46930, https://127.0.0.1:59010, https://127.0.0.1:42959, https://127.0.0.1:40538, https://127.0.0.1:56851]
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:352)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:871)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:807)
[junit4] > at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1574)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1595)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:881)
[junit4] > Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:42959: KeeperErrorCode = Session expired for /overseer/collection-queue-work/qnr-
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
[junit4] > ... 7 more
[junit4] 2> 2158194 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[8AF97C780B82D319]-worker) [n:127.0.0.1:59010_ c:addReplicaColl s:shard1 r:core_node7 x:propertyDotName] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene60): {other_tl1=PostingsFormat(name=Memory doPackFST= false), range_facet_l_dv=PostingsFormat(name=Direct), _version_=PostingsFormat(name=Memory doPackFST= false), multiDefault=PostingsFormat(name=LuceneFixedGap), a_t=PostingsFormat(name=Memory doPackFST= false), intDefault=PostingsFormat(name=Memory doPackFST= false), a_i1=PostingsFormat(name=Memory doPackFST= false), id=PostingsFormat(name=Direct), range_facet_i_dv=PostingsFormat(name=Memory doPackFST= false), text=FSTOrd50, range_facet_l=PostingsFormat(name=Memory doPackFST= false), timestamp=PostingsFormat(name=Memory doPackFST= false)}, docValues:{range_facet_l_dv=DocValuesFormat(name=Lucene54), range_facet_i_dv=DocValuesFormat(name=Memory), timestamp=DocValuesFormat(name=Memory)}, sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=hu_HU, timezone=Atlantic/Faeroe
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_66 (64-bit)/cpus=4,threads=1,free=74825376,total=498597888
[junit4] 2> NOTE: All tests run in this JVM: [TestDistributedGrouping, TestCloudManagedSchemaConcurrent, ResponseHeaderTest, ShardRoutingTest, AtomicUpdatesTest, NumericFieldsTest, DocValuesTest, SolrCmdDistributorTest, ZkCLITest, TestSystemIdResolver, BigEndianAscendingWordDeserializerTest, TestBinaryResponseWriter, SolrIndexSplitterTest, TestNamedUpdateProcessors, DirectSolrSpellCheckerTest, SimplePostToolTest, TestNoOpRegenerator, SuggestComponentContextFilterQueryTest, TestSolrDeletionPolicy2, TestStressVersions, DistributedIntervalFacetingTest, UniqFieldsUpdateProcessorFactoryTest, TestConfigSetsAPIZkFailure, TestRandomMergePolicy, MigrateRouteKeyTest, ConcurrentDeleteAndCreateCollectionTest, TestUpdate, AssignTest, TestDFRSimilarityFactory, TestLMJelinekMercerSimilarityFactory, TestSQLHandler, ConvertedLegacyTest, JavabinLoaderTest, TestUseDocValuesAsStored2, TestExactSharedStatsCache, TestSchemaVersionResource, TestHdfsUpdateLog, OpenExchangeRatesOrgProviderTest, ZkStateWriterTest, UpdateRequestProcessorFactoryTest, TestRawResponseWriter, TestSortingResponseWriter, TestPKIAuthenticationPlugin, DistributedDebugComponentTest, RemoteQueryErrorTest, IndexBasedSpellCheckerTest, CachingDirectoryFactoryTest, TestInitQParser, CollectionStateFormat2Test, TermsComponentTest, TestSchemaNameResource, TestQueryUtils, DistributedFacetPivotWhiteBoxTest, BasicFunctionalityTest, ExplicitHLLTest, TestSolrCoreProperties, TestMacros, HdfsCollectionsAPIDistributedZkTest, TestRebalanceLeaders, TestScoreJoinQPNoScore, SchemaVersionSpecificBehaviorTest, SpellingQueryConverterTest, WordBreakSolrSpellCheckerTest, LeaderFailoverAfterPartitionTest, TestDynamicFieldResource, TestRequestStatusCollectionAPI, HighlighterTest, TriLevelCompositeIdRoutingTest, SoftAutoCommitTest, TestCopyFieldCollectionResource, DistributedSuggestComponentTest, TestNRTOpen, TestCollectionAPI, RequestLoggingTest, TestHighFrequencyDictionaryFactory, CSVRequestHandlerTest, SolrInfoMBeanTest, IgnoreCommitOptimizeUpdateProcessorFactoryTest, TestJettySolrRunner, ShardRoutingCustomTest, TestSolrQueryParserResource, TestCollapseQParserPlugin, CdcrRequestHandlerTest, NotRequiredUniqueKeyTest, TestBM25SimilarityFactory, TestDownShardTolerantSearch, TermVectorComponentTest, TestPartialUpdateDeduplication, DistributedTermsComponentTest, TestJsonFacets, DocumentBuilderTest, CustomCollectionTest, CollectionsAPIDistributedZkTest]
[junit4] Completed [295/573 (1!)] on J1 in 601.45s, 1 test, 1 error <<< FAILURES!
[...truncated 895 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:791: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:728: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1436: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:991: There were test failures: 573 suites (8 ignored), 2282 tests, 1 error, 33 ignored (18 assumptions) [seed: 8AF97C780B82D319]
Total time: 215 minutes 48 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 894 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/894/
2 tests failed.
FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test
Error Message:
Captured an uncaught exception in thread: Thread[id=14233, name=collection4, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=14233, name=collection4, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:53816: collection already exists: awholynewstresscollection_collection4_0
at __randomizedtesting.SeedInfo.seed([97DE1102D84D2B94]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:871)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:807)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1574)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1595)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:881)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.HttpPartitionTest
Error Message:
ObjectTracker found 3 object(s) that were not released!!! [RawDirectoryWrapper, RawDirectoryWrapper, RawDirectoryWrapper]
Stack Trace:
java.lang.AssertionError: ObjectTracker found 3 object(s) that were not released!!! [RawDirectoryWrapper, RawDirectoryWrapper, RawDirectoryWrapper]
at __randomizedtesting.SeedInfo.seed([97DE1102D84D2B94]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNull(Assert.java:551)
at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:229)
at sun.reflect.GeneratedMethodAccessor43.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:834)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 10748 lines...]
[junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_97DE1102D84D2B94-001/init-core-data-001
[junit4] 2> 1546950 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[97DE1102D84D2B94]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
[junit4] 2> 1546950 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[97DE1102D84D2B94]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
[junit4] 2> 1546954 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1546954 INFO (Thread-7664) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1546954 INFO (Thread-7664) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1547054 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.ZkTestServer start zk server on port:50964
[junit4] 2> 1547054 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1547055 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1547058 INFO (zkCallback-1721-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@40355090 name:ZooKeeperConnection Watcher:127.0.0.1:50964 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1547058 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1547059 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1547059 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 1547062 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1547072 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1547078 INFO (zkCallback-1722-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1db6f600 name:ZooKeeperConnection Watcher:127.0.0.1:50964/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1547078 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1547078 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1547078 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
[junit4] 2> 1547081 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
[junit4] 2> 1547082 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
[junit4] 2> 1547084 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
[junit4] 2> 1547087 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 1547087 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 1547090 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 1547090 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
[junit4] 2> 1547093 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1547094 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1547096 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 1547096 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
[junit4] 2> 1547097 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 1547098 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
[junit4] 2> 1547099 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 1547099 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
[junit4] 2> 1547102 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 1547102 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 1547105 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1547105 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 1547107 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1547107 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1547109 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 1547109 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 1547111 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 1547111 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
[junit4] 2> 1547492 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_97DE1102D84D2B94-001/control-001/cores/collection1
[junit4] 2> 1547494 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.e.j.s.Server jetty-9.3.6.v20151106
[junit4] 2> 1547496 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@64f3f7af{/,null,AVAILABLE}
[junit4] 2> 1547497 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.e.j.s.ServerConnector Started ServerConnector@25cb4cc0{HTTP/1.1,[http/1.1]}{127.0.0.1:59511}
[junit4] 2> 1547497 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.e.j.s.Server Started @1550643ms
[junit4] 2> 1547497 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_97DE1102D84D2B94-001/tempDir-001/control/data, hostContext=/, hostPort=59511, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_97DE1102D84D2B94-001/control-001/cores}
[junit4] 2> 1547497 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 1547497 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_97DE1102D84D2B94-001/control-001'
[junit4] 2> 1547497 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1547497 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 1547498 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1547500 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1547508 INFO (zkCallback-1723-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1dc0aa33 name:ZooKeeperConnection Watcher:127.0.0.1:50964/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1547508 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1547509 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1547520 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1547520 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_97DE1102D84D2B94-001/control-001/solr.xml
[junit4] 2> 1547525 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_97DE1102D84D2B94-001/control-001/cores
[junit4] 2> 1547526 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.CoreContainer New CoreContainer 1733974655
[junit4] 2> 1547526 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_97DE1102D84D2B94-001/control-001]
[junit4] 2> 1547526 WARN (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_97DE1102D84D2B94-001/control-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_97DE1102D84D2B94-001/control-001/lib
[junit4] 2> 1547526 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 1547527 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1547528 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1547528 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1547528 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:50964/solr
[junit4] 2> 1547528 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 1547528 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1547537 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1547548 INFO (zkCallback-1726-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7aa79a0d name:ZooKeeperConnection Watcher:127.0.0.1:50964 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1547548 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1547549 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1547552 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [n:127.0.0.1:59511_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1547553 INFO (zkCallback-1727-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@31d19590 name:ZooKeeperConnection Watcher:127.0.0.1:50964/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1547554 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [n:127.0.0.1:59511_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1547555 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [n:127.0.0.1:59511_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
[junit4] 2> 1547557 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [n:127.0.0.1:59511_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 1547559 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [n:127.0.0.1:59511_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 1547561 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [n:127.0.0.1:59511_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 1547563 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [n:127.0.0.1:59511_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 1547564 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [n:127.0.0.1:59511_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 1547566 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [n:127.0.0.1:59511_ ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 1547567 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [n:127.0.0.1:59511_ ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 1547568 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [n:127.0.0.1:59511_ ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 1547569 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [n:127.0.0.1:59511_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59511_
[junit4] 2> 1547570 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [n:127.0.0.1:59511_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:59511_
[junit4] 2> 1547571 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [n:127.0.0.1:59511_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 1547572 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [n:127.0.0.1:59511_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 1547573 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [n:127.0.0.1:59511_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1547574 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [n:127.0.0.1:59511_ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95107023152742404-127.0.0.1:59511_-n_0000000000
[junit4] 2> 1547574 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [n:127.0.0.1:59511_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:59511_
[junit4] 2> 1547574 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [n:127.0.0.1:59511_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
[junit4] 2> 1547576 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [n:127.0.0.1:59511_ ] o.a.s.c.Overseer Overseer (id=95107023152742404-127.0.0.1:59511_-n_0000000000) starting
[junit4] 2> 1547579 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [n:127.0.0.1:59511_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
[junit4] 2> 1547590 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [n:127.0.0.1:59511_ ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 1547590 INFO (OverseerCollectionConfigSetProcessor-95107023152742404-127.0.0.1:59511_-n_0000000000) [n:127.0.0.1:59511_ ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
[junit4] 2> 1547590 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [n:127.0.0.1:59511_ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 1547591 INFO (OverseerStateUpdate-95107023152742404-127.0.0.1:59511_-n_0000000000) [n:127.0.0.1:59511_ ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 1547602 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [n:127.0.0.1:59511_ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 1547602 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [n:127.0.0.1:59511_ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 1547603 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [n:127.0.0.1:59511_ ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_97DE1102D84D2B94-001/control-001/cores
[junit4] 2> 1547604 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [n:127.0.0.1:59511_ ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=control_collection, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 1547604 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [n:127.0.0.1:59511_ ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_97DE1102D84D2B94-001/control-001/cores/collection1
[junit4] 2> 1547604 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [n:127.0.0.1:59511_ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
[junit4] 2> 1547605 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [n:127.0.0.1:59511_ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4] 2> 1547605 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [n:127.0.0.1:59511_ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 1547605 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 1547606 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 1547607 INFO (OverseerStateUpdate-95107023152742404-127.0.0.1:59511_-n_0000000000) [n:127.0.0.1:59511_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:59511",
[junit4] 2> "node_name":"127.0.0.1:59511_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 1547607 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 1547608 INFO (OverseerStateUpdate-95107023152742404-127.0.0.1:59511_-n_0000000000) [n:127.0.0.1:59511_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:59511",
[junit4] 2> "node_name":"127.0.0.1:59511_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 1547608 INFO (OverseerStateUpdate-95107023152742404-127.0.0.1:59511_-n_0000000000) [n:127.0.0.1:59511_ ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
[junit4] 2> 1547609 INFO (OverseerStateUpdate-95107023152742404-127.0.0.1:59511_-n_0000000000) [n:127.0.0.1:59511_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 1547610 INFO (zkCallback-1727-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
[junit4] 2> 1548608 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 1548608 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
[junit4] 2> 1548613 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 1548613 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/control_collection]
[junit4] 2> 1548615 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/control_collection] [configName]=[conf1] specified config exists in ZooKeeper
[junit4] 2> 1548615 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_97DE1102D84D2B94-001/control-001/cores/collection1'
[junit4] 2> 1548615 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1548615 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 1548617 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 1548623 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 1548628 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 1548655 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection x:collection1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1548662 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 1548783 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 1548793 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 1548795 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 1548810 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 1548812 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 1548814 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1548815 WARN (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 1548815 WARN (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 1548815 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1548816 WARN (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 1548816 WARN (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 1548819 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4] 2> 1548819 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 1548821 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1548822 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_97DE1102D84D2B94-001/control-001/cores/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_97DE1102D84D2B94-001/control-001/cores/collection1/data/]
[junit4] 2> 1548822 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@497dfe92
[junit4] 2> 1548822 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_97DE1102D84D2B94-001/control-001/cores/collection1/data
[junit4] 2> 1548822 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_97DE1102D84D2B94-001/control-001/cores/collection1/data/index/
[junit4] 2> 1548822 WARN (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_97DE1102D84D2B94-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1548823 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_97DE1102D84D2B94-001/control-001/cores/collection1/data/index
[junit4] 2> 1548823 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@25e4cf5b
[junit4] 2> 1548823 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@791a6fdd lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2c81f324),segFN=segments_1,generation=1}
[junit4] 2> 1548824 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 1548827 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1548827 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1548827 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1548827 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1548827 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1548828 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1548828 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_97DE1102D84D2B94-001/control-001/cores/collection1/data/
[junit4] 2> 1548828 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1548828 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1548828 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1548828 WARN (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,args = {defaults={a=A,b=B}}}
[junit4] 2> 1548831 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1548832 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1548833 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1548834 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1548837 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/dump,/update/csv,/sql,/update/json/docs,/admin/luke,/export,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/stream,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 1548837 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 1548838 WARN (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_97DE1102D84D2B94-001/control-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
[junit4] 2> 1548842 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1548842 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1548844 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1548845 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1548845 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@6bb35391
[junit4] 2> 1548846 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@791a6fdd lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2c81f324),segFN=segments_1,generation=1}
[junit4] 2> 1548846 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 1548846 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@6be4007d[collection1] main
[junit4] 2> 1548846 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/control_collection]
[junit4] 2> 1548847 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/control_collection] [configName]=[conf1] specified config exists in ZooKeeper
[junit4] 2> 1548847 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 1548847 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1548847 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
[junit4] 2> 1548847 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1548848 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 1548848 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1548848 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 1548848 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 1548848 INFO (searcherExecutor-3702-thread-1-processing-n:127.0.0.1:59511_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@6be4007d[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1548849 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
[junit4] 2> 1548849 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
[junit4] 2> 1548849 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
[junit4] 2> 1548849 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1521712372428832768
[junit4] 2> 1548851 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 2.0ms to seed version buckets with highest version 1521712372428832768
[junit4] 2> 1548851 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
[junit4] 2> 1548852 INFO (coreLoadExecutor-3701-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 1548852 INFO (coreZkRegister-3695-thread-1-processing-n:127.0.0.1:59511_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:59511 collection:control_collection shard:shard1
[junit4] 2> 1548853 INFO (coreZkRegister-3695-thread-1-processing-n:127.0.0.1:59511_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 1548856 INFO (coreZkRegister-3695-thread-1-processing-n:127.0.0.1:59511_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/95107023152742404-core_node1-n_0000000000
[junit4] 2> 1548856 INFO (coreZkRegister-3695-thread-1-processing-n:127.0.0.1:59511_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard=shard1 and weAreReplacement=false and leaderVoteWait=180000
[junit4] 2> 1548858 INFO (OverseerStateUpdate-95107023152742404-127.0.0.1:59511_-n_0000000000) [n:127.0.0.1:59511_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection"} current state version: 1
[junit4] 2> 1548859 INFO (coreZkRegister-3695-thread-1-processing-n:127.0.0.1:59511_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1548859 INFO (coreZkRegister-3695-thread-1-processing-n:127.0.0.1:59511_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1548859 INFO (coreZkRegister-3695-thread-1-processing-n:127.0.0.1:59511_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:59511/collection1/
[junit4] 2> 1548859 INFO (coreZkRegister-3695-thread-1-processing-n:127.0.0.1:59511_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1548859 INFO (coreZkRegister-3695-thread-1-processing-n:127.0.0.1:59511_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:59511/collection1/ has no replicas
[junit4] 2> 1548863 INFO (coreZkRegister-3695-thread-1-processing-n:127.0.0.1:59511_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 1548867 INFO (coreZkRegister-3695-thread-1-processing-n:127.0.0.1:59511_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
[junit4] 2> 1548869 INFO (OverseerStateUpdate-95107023152742404-127.0.0.1:59511_-n_0000000000) [n:127.0.0.1:59511_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:59511",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 1
[junit4] 2> 1548870 INFO (coreZkRegister-3695-thread-1-processing-n:127.0.0.1:59511_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:59511/collection1/ shard1
[junit4] 2> 1548971 INFO (zkCallback-1727-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
[junit4] 2> 1549021 INFO (coreZkRegister-3695-thread-1-processing-n:127.0.0.1:59511_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:59511/collection1/ and leader is http://127.0.0.1:59511/collection1/
[junit4] 2> 1549021 INFO (coreZkRegister-3695-thread-1-processing-n:127.0.0.1:59511_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:59511
[junit4] 2> 1549021 INFO (coreZkRegister-3695-thread-1-processing-n:127.0.0.1:59511_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1549021 INFO (coreZkRegister-3695-thread-1-processing-n:127.0.0.1:59511_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
[junit4] 2> 1549021 INFO (coreZkRegister-3695-thread-1-processing-n:127.0.0.1:59511_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59511_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 1549023 INFO (OverseerStateUpdate-95107023152742404-127.0.0.1:59511_-n_0000000000) [n:127.0.0.1:59511_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:59511",
[junit4] 2> "node_name":"127.0.0.1:59511_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 2
[junit4] 2> 1549023 INFO (OverseerStateUpdate-95107023152742404-127.0.0.1:59511_-n_0000000000) [n:127.0.0.1:59511_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:59511",
[junit4] 2> "node_name":"127.0.0.1:59511_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 1549107 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1549108 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1549109 INFO (zkCallback-1729-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@39a676ba name:ZooKeeperConnection Watcher:127.0.0.1:50964/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1549109 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1549109 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1549109 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 1549112 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 1549112 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with stateFormat=2
[junit4] 2> 1549113 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1549113 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1549114 INFO (zkCallback-1730-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7ffa810c name:ZooKeeperConnection Watcher:127.0.0.1:50964/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1549115 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1549115 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1549121 INFO (OverseerStateUpdate-95107023152742404-127.0.0.1:59511_-n_0000000000) [n:127.0.0.1:59511_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"create",
[junit4] 2> "name":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "stateFormat":"2"} current state version: 2
[junit4] 2> 1549121 INFO (OverseerStateUpdate-95107023152742404-127.0.0.1:59511_-n_0000000000) [n:127.0.0.1:59511_ ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
[junit4] 2> 1549121 INFO (zkCallback-1729-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
[junit4] 2> 1549125 INFO (zkCallback-1727-thread-1-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
[junit4] 2> 1549229 INFO (OverseerStateUpdate-95107023152742404-127.0.0.1:59511_-n_0000000000) [n:127.0.0.1:59511_ ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/collection1/state.json
[junit4] 2> 1549513 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_97DE1102D84D2B94-001/shard-1-001/cores/collection1
[junit4] 2> 1549514 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_97DE1102D84D2B94-001/shard-1-001
[junit4] 2> 1549516 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.e.j.s.Server jetty-9.3.6.v20151106
[junit4] 2> 1549538 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2bc7b2f7{/,null,AVAILABLE}
[junit4] 2> 1549538 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.e.j.s.ServerConnector Started ServerConnector@38f9c918{HTTP/1.1,[http/1.1]}{127.0.0.1:49679}
[junit4] 2> 1549538 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.e.j.s.Server Started @1552685ms
[junit4] 2> 1549538 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_97DE1102D84D2B94-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/, hostPort=49679, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_97DE1102D84D2B94-001/shard-1-001/cores}
[junit4] 2> 1549539 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 1549539 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_97DE1102D84D2B94-001/shard-1-001'
[junit4] 2> 1549539 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1549539 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 1549539 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1549540 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1549546 INFO (zkCallback-1731-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4ca102b9 name:ZooKeeperConnection Watcher:127.0.0.1:50964/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1549546 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1549546 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1549561 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1549561 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_97DE1102D84D2B94-001/shard-1-001/solr.xml
[junit4] 2> 1549566 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_97DE1102D84D2B94-001/shard-1-001/cores
[junit4] 2> 1549566 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.CoreContainer New CoreContainer 2105025222
[junit4] 2> 1549566 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_97DE1102D84D2B94-001/shard-1-001]
[junit4] 2> 1549567 WARN (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_97DE1102D84D2B94-001/shard-1-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_97DE1102D84D2B94-001/shard-1-001/lib
[junit4] 2> 1549567 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 1549568 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1549569 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1549569 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1549569 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:50964/solr
[junit4] 2> 1549569 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 1549569 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1549574 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1549574 INFO (zkCallback-1734-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1aaa700a name:ZooKeeperConnection Watcher:127.0.0.1:50964 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1549574 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1549575 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1549579 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [n:127.0.0.1:49679_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1549580 INFO (zkCallback-1735-thread-1-processing-n:127.0.0.1:49679_) [n:127.0.0.1:49679_ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@596bcb0a name:ZooKeeperConnection Watcher:127.0.0.1:50964/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1549580 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [n:127.0.0.1:49679_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1549584 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [n:127.0.0.1:49679_ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 1550588 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [n:127.0.0.1:49679_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49679_
[junit4] 2> 1550589 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [n:127.0.0.1:49679_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:49679_
[junit4] 2> 1550590 INFO (zkCallback-1729-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
[junit4] 2> 1550590 INFO (zkCallback-1727-thread-2-processing-n:127.0.0.1:59511_) [n:127.0.0.1:59511_ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
[junit4] 2> 1550590 INFO (zkCallback-1735-thread-1-processing-n:127.0.0.1:49679_) [n:127.0.0.1:49679_ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
[junit4] 2> 1550592 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [n:127.0.0.1:49679_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1550592 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [n:127.0.0.1:49679_ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95107023152742409-127.0.0.1:49679_-n_0000000001
[junit4] 2> 1550593 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [n:127.0.0.1:49679_ ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/95107023152742404-127.0.0.1:59511_-n_0000000000 to know if I could be the leader
[junit4] 2> 1550603 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [n:127.0.0.1:49679_ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 1550603 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [n:127.0.0.1:49679_ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 1550604 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [n:127.0.0.1:49679_ ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_97DE1102D84D2B94-001/shard-1-001/cores
[junit4] 2> 1550605 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [n:127.0.0.1:49679_ ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=collection1, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 1550605 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [n:127.0.0.1:49679_ ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_97DE1102D84D2B94-001/shard-1-001/cores/collection1
[junit4] 2> 1550605 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [n:127.0.0.1:49679_ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
[junit4] 2> 1550607 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [n:127.0.0.1:49679_ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4] 2> 1550607 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[97DE1102D84D2B94]) [n:127.0.0.1:49679_ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 1550608 INFO (coreLoadExecutor-3712-thread-1-processing-n:127.0.0.1:49679_) [n:127.0.0.1:49679_ c:collection1 x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 1550608 INFO (coreLoadExecutor-3712-thread-1-processing-n:127.0.0.1:49679_) [n:127.0.0.1:49679_ c:collection1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 1550609 INFO (coreLoadExecutor-3712-thread-1-processing-n:127.0.0.1:49679_) [n:127.0.0.1:49679_ c:collection1 x:collection1] o.a.s.c.ZkController Registering watch for collection collection1
[junit4] 2> 1550609 INFO (coreLoadExecutor-3712-thread-1-processing-n:127.0.0.1:49679_) [n:127.0.0.1:49679_ c:collection1 x:collection1] o.a.s.c.c.ZkStateReader addZkWatch [collection1]
[junit4] 2> 1550609 INFO (OverseerStateUpdate-95107023152742404-127.0.0.1:59511_-n_0000000000) [n:127.0.0.1:59511_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:49679",
[junit4] 2> "node_name":"127.0.0.1:49679_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"} current state version: 3
[junit4] 2> 1550609 INFO (coreLoadExecutor-3712-thread-1-processing-n:127.0.0.1:49679_) [n:127.0.0.1:49679_ c:collection1 x:collection1] o.a.s.c.c.ZkStateReader Add data for [collection1] ver [0]
[junit4] 2> 1550610 INFO (coreLoadExecutor-3712-thread-1-processing-n:127.0.0.1:49679_) [n:127.0.0.1:49679_ c:collection1 x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 1550610 INFO (OverseerStateUpdate-95107023152742404-127.0.0.1:59511_-n_0000000000) [n:127.0.0.1:59511_ ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:49679",
[junit4] 2> "node_name":"127.0.0.1:49679_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"}
[junit4] 2> 1550610 INFO (OverseerStateUpdate-95107023152742404-127.0.0.1:59511_-n_0000000000) [n:127.0.0.1:59511_ ] o.a.s.c.o.ReplicaMutator Collection already exists with numShards=2
[junit4] 2> 1550610 INFO (OverseerStateUpdate-95107023152742404-127.0.0.1:59511_-n_0000000000) [n:127.0.0.1:59511_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2
[junit4] 2> 1550712 INFO (OverseerStateUpdate-95107023152742404-127.0.0.1:59511_-n_0000000000) [n:127.0.0.1:59511_ ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/collection1/state.json version: 0
[junit4] 2> 1550713 INFO (zkCallback-1735-thread-1-processing-n:127.0.0.1:49679_) [n:127.0.0.1:49679_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1550713 INFO (zkCallback-1735-thread-1-processing-n:127.0.0.1:49679_) [n:127.0.0.1:49679_ ] o.a.s.c.c.ZkStateReader Updating data for [collection1] from [0] to [1]
[junit4] 2> 1551610 INFO (coreLoadExecutor-3712-thread-1-processing-n:127.0.0.1:49679_) [n:127.0.0.1:49679_ c:collection1 x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 1551610 INFO (coreLoadExecutor-3712-thread-1-processing-n:127.0.0.1:49679_) [n:127.0.0.1:49679_ c:collection1 x:collection1] o.a.s.c.ZkController Check for collection zkNode:collection1
[junit4] 2> 1551610 INFO (coreLoadExecutor-3712-thread-1-processing-n:127.0.0.1:49679_) [n:127.0.0.1:49679_ c:collection1 x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 1551610 INFO (coreLoadExecutor-3712-thread-1-processing-n:127.0.0.1:49679_) [n:127.0.0.1:49679_ c:collection1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/collection1]
[junit4] 2> 1551611 INFO (coreLoadExecutor-3712-thread-1-processing-n:127.0.0.1:49679_) [n:127.0.0.1:49679_ c:collection1 x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/collection1] [configName]=[conf1] specified config exists in ZooKeeper
[junit4] 2> 1551611 INFO (coreLoadExecutor-3712-thread-1-processing-n:127.0.0.1:49679_) [n:127.0.0.1:49679_ c:collection1 x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_97DE1102D84D2B94-001/shard-1-001/cores/collection1'
[junit4] 2> 1551611 INFO (coreLoadExecutor-3712-thread-1-processing-n:127.0.0.1:49679_) [n:127.0.0.1:49679_ c:collection1 x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1551611 INFO (coreLoadExecutor-3712-thread-1-processing-n:127.0.0.1:49679_) [n:127.0.0.1:49679_ c:collection1 x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 1551613 INFO (coreLoadExecutor-3712-thread-1-processing-n:127.0.0.1:49679_) [n:127.0.0.1:49679_ c:collection1 x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 1551617 INFO (coreLoadExecutor-3712-thread-1-processing-n:127.0.0.1:49679_) [n:127.0.0.1:49679_ c:collection1 x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 1551622 INFO (coreLoadExecutor-3712-thread-1-processing-n:127.0.0.1:49679_) [n:127.0.0.1:49679_ c:collection1 x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 1551635 INFO (coreLoadExecutor-3712-thread-1-processing-n:127.0.0.1:49679_) [n:127.0.0.1:49679_ c:collection1 x:collection1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1551641 INFO (coreLoadExecutor-3712-thread-1-processing-n:127.0.0.1:49679_) [n:127.0.0.1:49679_ c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 1551768 INFO (coreLoadExecutor-3712-thread-1-processing-n:127.0.0.1:49679_) [n:127.0.0.1:49679_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 1551775 INFO (coreLoadExecutor-3712-thread-1-processing-n:127.0.0.1:49679_) [n:127.0.0.1:49679_ c:collection1 x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 1551776 INFO (coreLoadExecutor-3712-thread-1-processing-n:127.0.0.1:49679_) [n:127.0.0.1:49679_ c:collection1 x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 1551784 INFO (coreLoadExecutor-3712-thread-1-processing-n:127.0.0.1:49679_) [n:127.0.0.1:49679_ c:collection1 x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 1551787 INFO (coreLoadExecutor-3712-thread-1-processing-n:127.0.0.1:49679_) [n:127.0.0.1:49679_ c:collection1 x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 1551789 INFO (coreLoadExecutor-3712-thread-1-processing-n:127.0.0.1:49679_) [n:127.0.0.1:49679_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1551789 WARN (coreLoadExecutor-3712-thread-1-processing-n:127.0.0.1:49679_) [n:127.0.0.1:49679_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 1551789 WARN (coreLoadExecutor-3712-thread-1-processing-n:127.0.0.1:49679_) [n:127.0.0.1:49679_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 1551790 INFO (coreLoadExecutor-3712-thread-1-processing-n:127.0.0.1:49679_) [n:127.0.0.1:49679_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1551790 WARN (coreLoadExecutor-3712-thread-1-processing-n:127.0.0.1:49679_) [n:127.0.0.1:49679_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 1551791 WARN (coreLoadExecutor-3712-thread-1-processing-n:127.0.0.1:49679_) [n:127.0.0.1:49679_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 1551792 INFO (coreLoadExecutor-3712-thread-1-processing-n:127.0.0.1:49679_) [n:127.0.0.1:49679_ c:collection1 x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4] 2> 1551792 INFO (coreLoadExecutor-3712-thread-1-processing-n:127.0.0.1:49679_) [n:127.0.0.1:49679_ c:collection1 x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 1551792 INFO (coreLoadExecutor-3712-thread-1-processing-n:127.0.0.1:49679_) [n:127.0.0.1:49679_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1551792 INFO (coreLoadExecutor-3712-thread-1-processing-n:127.0.0.1:49679_) [n:127.0.0.1:49679_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_97DE1102D84D2B94-001/shard-1-001/cores/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_97DE1102D84D2B94-001/shard-1-001/cores/collection1/data/]
[junit4] 2> 1551792 INFO (coreLoadExecutor-3712-thread-1-processing-n:127.0.0.1:49679_) [n:127.0.0.1:49679_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@497dfe92
[junit4] 2> 1551793 INFO (coreLoadExecutor-3712-thread-1-processing-n:127.0.0.1:49679_) [n:127.0.0.1:49679_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_97DE1102D84D2B94-001/shard-1-001/cores/collection1/data
[junit4] 2> 1551793 INFO (coreLoadExecutor-3712-thread-1-processing-n:127.0.0.1:49679_) [n:127.0.0.1:49679_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/
[...truncated too long message...]
orUtil.java:232)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException
[junit4] 2> at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:43)
[junit4] 2> at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:352)
[junit4] 2> at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:386)
[junit4] 2> at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:270)
[junit4] 2> at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:387)
[junit4] 2> at org.apache.solr.cloud.RecoveryStrategy.replicate(RecoveryStrategy.java:160)
[junit4] 2> at org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:412)
[junit4] 2> at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:225)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:232)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException
[junit4] 2> at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:43)
[junit4] 2> at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:352)
[junit4] 2> at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:386)
[junit4] 2> at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:270)
[junit4] 2> at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:387)
[junit4] 2> at org.apache.solr.cloud.RecoveryStrategy.replicate(RecoveryStrategy.java:160)
[junit4] 2> at org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:412)
[junit4] 2> at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:225)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:232)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene60): {range_facet_l_dv=BlockTreeOrds(blocksize=128), _version_=PostingsFormat(name=Memory doPackFST= false), multiDefault=PostingsFormat(name=SimpleText), a_t=PostingsFormat(name=Memory doPackFST= false), intDefault=PostingsFormat(name=Memory doPackFST= false), id=BlockTreeOrds(blocksize=128), range_facet_i_dv=PostingsFormat(name=Memory doPackFST= false), text=PostingsFormat(name=Direct), range_facet_l=PostingsFormat(name=Memory doPackFST= false), timestamp=PostingsFormat(name=Memory doPackFST= false)}, docValues:{range_facet_l_dv=DocValuesFormat(name=Lucene54), range_facet_i_dv=DocValuesFormat(name=Lucene54), timestamp=DocValuesFormat(name=Lucene54)}, sim=RandomSimilarityProvider(queryNorm=true,coord=no): {}, locale=is_IS, timezone=PRT
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_66 (64-bit)/cpus=4,threads=1,free=29813936,total=526909440
[junit4] 2> NOTE: All tests run in this JVM: [HdfsChaosMonkeyNothingIsSafeTest, OverseerCollectionConfigSetProcessorTest, OverseerTest, TestRawTransformer, TestConfigSetsAPI, BadComponentTest, CdcrReplicationDistributedZkTest, HighlighterMaxOffsetTest, SSLMigrationTest, TestRandomCollapseQParserPlugin, LukeRequestHandlerTest, SmileWriterTest, RegexBoostProcessorTest, TestRecovery, TestShortCircuitedRequests, HardAutoCommitTest, TestCollationField, TestElisionMultitermQuery, TestIndexingPerformance, DirectSolrConnectionTest, TestSearchPerf, TestStressReorder, TestObjectReleaseTracker, BlockJoinFacetRandomTest, DistributedFacetPivotSmallAdvancedTest, TestInitQParser, TestSolrJ, ReplicationFactorTest, SolrTestCaseJ4Test, TestScoreJoinQPNoScore, HdfsNNFailoverTest, TestSchemaResource, SliceStateTest, BasicDistributedZk2Test, DateMathParserTest, OverseerTaskQueueTest, ScriptEngineTest, StatsComponentTest, StatelessScriptUpdateProcessorFactoryTest, TestChildDocTransformer, AddBlockUpdateTest, DeleteInactiveReplicaTest, TestManagedSchemaFieldTypeResource, TestBlobHandler, TestSuggestSpellingConverter, HighlighterConfigTest, DataDrivenBlockJoinTest, TestStressRecovery, VMParamsZkACLAndCredentialsProvidersTest, TestHighFrequencyDictionaryFactory, TestUtils, CdcrVersionReplicationTest, TestPKIAuthenticationPlugin, TestRecoveryHdfs, TestUniqueKeyFieldResource, TestCollapseQParserPlugin, CircularListTest, TestJsonFacets, TestFieldCollectionResource, TestPerFieldSimilarity, XmlUpdateRequestHandlerTest, TestSolrQueryParser, TestCryptoKeys, TestPivotHelperCode, TestReload, TestHdfsUpdateLog, TestTolerantSearch, TestConfigOverlay, DistributedQueryComponentCustomSortTest, TestSimpleQParserPlugin, TestFieldTypeResource, TestWriterPerf, CoreAdminHandlerTest, IgnoreCommitOptimizeUpdateProcessorFactoryTest, TestDefaultSearchFieldResource, SampleTest, SecurityConfHandlerTest, UnloadDistributedZkTest, BadCopyFieldTest, TestNamedUpdateProcessors, TestClusterStateMutator, TestJmxIntegration, TestExactSharedStatsCache, TestFastWriter, SolrCoreCheckLockOnStartupTest, ActionThrottleTest, AsyncCallRequestStatusResponseTest, CursorMarkTest, PluginInfoTest, NoCacheHeaderTest, TestCSVResponseWriter, BasicZkTest, RecoveryZkTest, FullSolrCloudDistribCmdsTest, ClusterStateUpdateTest, LeaderElectionTest, ZkSolrClientTest, TestZkChroot, ZkCLITest, ShardRoutingCustomTest, TestDistributedSearch, TestGroupingSearch, TestFiltering, SuggesterFSTTest, SuggesterTSTTest, SpatialFilterTest, TestCSVLoader, WordBreakSolrSpellCheckerTest, TestPseudoReturnFields, DirectUpdateHandlerOptimizeTest, TestRemoteStreaming, TestSolrDeletionPolicy1, StandardRequestHandlerTest, PrimitiveFieldTypeTest, RequestHandlersTest, PathHierarchyTokenizerFactoryTest, MoreLikeThisHandlerTest, FieldAnalysisRequestHandlerTest, FastVectorHighlighterTest, LoggingHandlerTest, QueryParsingTest, JsonLoaderTest, SearchHandlerTest, UpdateParamsTest, TestSolrIndexConfig, SolrIndexConfigTest, OutputWriterTest, TestPostingsSolrHighlighter, TestCharFilters, TestCodecSupport, TestXIncludeConfig, TestDFRSimilarityFactory, TestJmxMonitoredMap, OpenExchangeRatesOrgProviderTest, PreAnalyzedFieldTest, PrimUtilsTest, ClusterStateTest, DistributedIntervalFacetingTest, CleanupOldIndexTest, CloudExitableDirectoryReaderTest, CollectionStateFormat2Test, CollectionsAPIAsyncDistributedZkTest, ConfigSetsAPITest, CustomCollectionTest, HttpPartitionTest]
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=HttpPartitionTest -Dtests.seed=97DE1102D84D2B94 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=is_IS -Dtests.timezone=PRT -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[junit4] ERROR 0.00s J2 | HttpPartitionTest (suite) <<<
[junit4] > Throwable #1: java.lang.AssertionError: ObjectTracker found 3 object(s) that were not released!!! [RawDirectoryWrapper, RawDirectoryWrapper, RawDirectoryWrapper]
[junit4] > at __randomizedtesting.SeedInfo.seed([97DE1102D84D2B94]:0)
[junit4] > at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:229)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] Completed [437/571 (2!)] on J2 in 175.03s, 1 test, 1 failure <<< FAILURES!
[...truncated 453 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:791: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:728: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1436: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:991: There were test failures: 571 suites (8 ignored), 2276 tests, 1 suite-level error, 1 error, 33 ignored (18 assumptions) [seed: 97DE1102D84D2B94]
Total time: 208 minutes 32 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 893 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/893/
1 tests failed.
FAILED: org.apache.solr.core.OpenCloseCoreStressTest.test10MinutesOld
Error Message:
Captured an uncaught exception in thread: Thread[id=15567, name=Thread-10543, state=RUNNABLE, group=TGRP-OpenCloseCoreStressTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=15567, name=Thread-10543, state=RUNNABLE, group=TGRP-OpenCloseCoreStressTest]
Caused by: java.lang.OutOfMemoryError: GC overhead limit exceeded
Build Log:
[...truncated 10289 lines...]
[junit4] Suite: org.apache.solr.core.OpenCloseCoreStressTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/init-core-data-001
[junit4] 2> 856952 INFO (SUITE-OpenCloseCoreStressTest-seed#[F2D6F15CCEE2DB10]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true)
[junit4] IGNOR/A 0.00s J1 | OpenCloseCoreStressTest.test1Hour
[junit4] > Assumption #1: 'weekly' test group is disabled (@Weekly())
[junit4] 2> 856957 INFO (TEST-OpenCloseCoreStressTest.test15SecondsOld-seed#[F2D6F15CCEE2DB10]) [ ] o.a.s.SolrTestCaseJ4 ###Starting test15SecondsOld
[junit4] 2> 856973 INFO (TEST-OpenCloseCoreStressTest.test15SecondsOld-seed#[F2D6F15CCEE2DB10]) [ ] o.e.j.s.Server jetty-9.3.6.v20151106
[junit4] 2> 856974 INFO (TEST-OpenCloseCoreStressTest.test15SecondsOld-seed#[F2D6F15CCEE2DB10]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7725ef2b{/solr,null,AVAILABLE}
[junit4] 2> 856976 INFO (TEST-OpenCloseCoreStressTest.test15SecondsOld-seed#[F2D6F15CCEE2DB10]) [ ] o.e.j.s.ServerConnector Started ServerConnector@3a2abc6d{HTTP/1.1,[http/1.1]}{127.0.0.1:59245}
[junit4] 2> 856976 INFO (TEST-OpenCloseCoreStressTest.test15SecondsOld-seed#[F2D6F15CCEE2DB10]) [ ] o.e.j.s.Server Started @861140ms
[junit4] 2> 856976 INFO (TEST-OpenCloseCoreStressTest.test15SecondsOld-seed#[F2D6F15CCEE2DB10]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=59245}
[junit4] 2> 856976 INFO (TEST-OpenCloseCoreStressTest.test15SecondsOld-seed#[F2D6F15CCEE2DB10]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 856976 INFO (TEST-OpenCloseCoreStressTest.test15SecondsOld-seed#[F2D6F15CCEE2DB10]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001'
[junit4] 2> 856977 INFO (TEST-OpenCloseCoreStressTest.test15SecondsOld-seed#[F2D6F15CCEE2DB10]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 856977 INFO (TEST-OpenCloseCoreStressTest.test15SecondsOld-seed#[F2D6F15CCEE2DB10]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 856977 INFO (TEST-OpenCloseCoreStressTest.test15SecondsOld-seed#[F2D6F15CCEE2DB10]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/solr.xml
[junit4] 2> 856982 INFO (TEST-OpenCloseCoreStressTest.test15SecondsOld-seed#[F2D6F15CCEE2DB10]) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001
[junit4] 2> 856982 INFO (TEST-OpenCloseCoreStressTest.test15SecondsOld-seed#[F2D6F15CCEE2DB10]) [ ] o.a.s.c.CoreContainer New CoreContainer 444121789
[junit4] 2> 856982 INFO (TEST-OpenCloseCoreStressTest.test15SecondsOld-seed#[F2D6F15CCEE2DB10]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001]
[junit4] 2> 856982 WARN (TEST-OpenCloseCoreStressTest.test15SecondsOld-seed#[F2D6F15CCEE2DB10]) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/lib
[junit4] 2> 856982 INFO (TEST-OpenCloseCoreStressTest.test15SecondsOld-seed#[F2D6F15CCEE2DB10]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 856984 INFO (TEST-OpenCloseCoreStressTest.test15SecondsOld-seed#[F2D6F15CCEE2DB10]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=600000&connTimeout=60000&retry=true
[junit4] 2> 856984 INFO (TEST-OpenCloseCoreStressTest.test15SecondsOld-seed#[F2D6F15CCEE2DB10]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 856984 INFO (TEST-OpenCloseCoreStressTest.test15SecondsOld-seed#[F2D6F15CCEE2DB10]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 856984 INFO (TEST-OpenCloseCoreStressTest.test15SecondsOld-seed#[F2D6F15CCEE2DB10]) [ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 856984 INFO (TEST-OpenCloseCoreStressTest.test15SecondsOld-seed#[F2D6F15CCEE2DB10]) [ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 856985 INFO (TEST-OpenCloseCoreStressTest.test15SecondsOld-seed#[F2D6F15CCEE2DB10]) [ ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001
[junit4] 2> 856986 INFO (TEST-OpenCloseCoreStressTest.test15SecondsOld-seed#[F2D6F15CCEE2DB10]) [ ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=00000_core, config=solrconfig-minimal.xml, loadOnStartup=false, schema=schema-tiny.xml, configSetProperties=configsetprops.json, transient=true, dataDir=data/}
[junit4] 2> 856986 INFO (TEST-OpenCloseCoreStressTest.test15SecondsOld-seed#[F2D6F15CCEE2DB10]) [ ] o.a.s.c.CorePropertiesLocator Found core 00000_core in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00000_core
[junit4] 2> 856986 INFO (TEST-OpenCloseCoreStressTest.test15SecondsOld-seed#[F2D6F15CCEE2DB10]) [ ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=00004_core, config=solrconfig-minimal.xml, loadOnStartup=false, schema=schema-tiny.xml, configSetProperties=configsetprops.json, transient=true, dataDir=data/}
[junit4] 2> 856987 INFO (TEST-OpenCloseCoreStressTest.test15SecondsOld-seed#[F2D6F15CCEE2DB10]) [ ] o.a.s.c.CorePropertiesLocator Found core 00004_core in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00004_core
[junit4] 2> 856987 INFO (TEST-OpenCloseCoreStressTest.test15SecondsOld-seed#[F2D6F15CCEE2DB10]) [ ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=00003_core, config=solrconfig-minimal.xml, loadOnStartup=false, schema=schema-tiny.xml, configSetProperties=configsetprops.json, transient=true, dataDir=data/}
[junit4] 2> 856987 INFO (TEST-OpenCloseCoreStressTest.test15SecondsOld-seed#[F2D6F15CCEE2DB10]) [ ] o.a.s.c.CorePropertiesLocator Found core 00003_core in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00003_core
[junit4] 2> 856988 INFO (TEST-OpenCloseCoreStressTest.test15SecondsOld-seed#[F2D6F15CCEE2DB10]) [ ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=00002_core, config=solrconfig-minimal.xml, loadOnStartup=false, schema=schema-tiny.xml, configSetProperties=configsetprops.json, transient=true, dataDir=data/}
[junit4] 2> 856988 INFO (TEST-OpenCloseCoreStressTest.test15SecondsOld-seed#[F2D6F15CCEE2DB10]) [ ] o.a.s.c.CorePropertiesLocator Found core 00002_core in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00002_core
[junit4] 2> 856988 INFO (TEST-OpenCloseCoreStressTest.test15SecondsOld-seed#[F2D6F15CCEE2DB10]) [ ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=00006_core, config=solrconfig-minimal.xml, loadOnStartup=false, schema=schema-tiny.xml, configSetProperties=configsetprops.json, transient=true, dataDir=data/}
[junit4] 2> 856989 INFO (TEST-OpenCloseCoreStressTest.test15SecondsOld-seed#[F2D6F15CCEE2DB10]) [ ] o.a.s.c.CorePropertiesLocator Found core 00006_core in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00006_core
[junit4] 2> 856989 INFO (TEST-OpenCloseCoreStressTest.test15SecondsOld-seed#[F2D6F15CCEE2DB10]) [ ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=00001_core, config=solrconfig-minimal.xml, loadOnStartup=false, schema=schema-tiny.xml, configSetProperties=configsetprops.json, transient=true, dataDir=data/}
[junit4] 2> 856989 INFO (TEST-OpenCloseCoreStressTest.test15SecondsOld-seed#[F2D6F15CCEE2DB10]) [ ] o.a.s.c.CorePropertiesLocator Found core 00001_core in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00001_core
[junit4] 2> 856990 INFO (TEST-OpenCloseCoreStressTest.test15SecondsOld-seed#[F2D6F15CCEE2DB10]) [ ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=00005_core, config=solrconfig-minimal.xml, loadOnStartup=false, schema=schema-tiny.xml, configSetProperties=configsetprops.json, transient=true, dataDir=data/}
[junit4] 2> 856990 INFO (TEST-OpenCloseCoreStressTest.test15SecondsOld-seed#[F2D6F15CCEE2DB10]) [ ] o.a.s.c.CorePropertiesLocator Found core 00005_core in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00005_core
[junit4] 2> 856990 INFO (TEST-OpenCloseCoreStressTest.test15SecondsOld-seed#[F2D6F15CCEE2DB10]) [ ] o.a.s.c.CorePropertiesLocator Found 7 core definitions
[junit4] 2> 856990 INFO (TEST-OpenCloseCoreStressTest.test15SecondsOld-seed#[F2D6F15CCEE2DB10]) [ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4] 2> 856990 INFO (TEST-OpenCloseCoreStressTest.test15SecondsOld-seed#[F2D6F15CCEE2DB10]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 856998 INFO (TEST-OpenCloseCoreStressTest.test15SecondsOld-seed#[F2D6F15CCEE2DB10]) [ ] o.a.s.c.OpenCloseCoreStressTest Starting indexing and querying
[junit4] 2> 856999 INFO (TEST-OpenCloseCoreStressTest.test15SecondsOld-seed#[F2D6F15CCEE2DB10]) [ ] o.a.s.c.OpenCloseCoreStressTest
[junit4] 2>
[junit4] 2>
[junit4] 2>
[junit4] 2>
[junit4] 2> Starting a 15 second cycle, seconds left: 15. Seconds run so far: 0.
[junit4] 2> 857004 INFO (Thread-10236) [ ] o.a.s.c.OneIndexer Starting indexing thread: 15188
[junit4] 2> 857008 INFO (Thread-10237) [ ] o.a.s.c.OneIndexer Starting indexing thread: 15189
[junit4] 2> 857012 INFO (Thread-10238) [ ] o.a.s.c.OneIndexer Starting indexing thread: 15191
[junit4] 2> 857017 INFO (qtp103958222-15175) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00006_core'
[junit4] 2> 857017 INFO (qtp103958222-15175) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 857017 INFO (qtp103958222-15175) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 857020 INFO (Thread-10240) [ ] o.a.s.c.OneIndexer Starting indexing thread: 15193
[junit4] 2> 857020 INFO (Thread-10241) [ ] o.a.s.c.OneIndexer Starting indexing thread: 15194
[junit4] 2> 857025 INFO (qtp103958222-15175) [ ] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 857028 INFO (Thread-10239) [ ] o.a.s.c.OneIndexer Starting indexing thread: 15192
[junit4] 2> 857030 INFO (qtp103958222-15175) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 857030 INFO (Thread-10242) [ ] o.a.s.c.OneIndexer Starting indexing thread: 15195
[junit4] 2> 857031 INFO (qtp103958222-15176) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00001_core'
[junit4] 2> 857031 INFO (qtp103958222-15176) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 857031 INFO (qtp103958222-15176) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 857031 INFO (Thread-10243) [ ] o.a.s.c.OneIndexer Starting indexing thread: 15196
[junit4] 2> 857033 INFO (qtp103958222-15179) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00004_core'
[junit4] 2> 857033 INFO (qtp103958222-15179) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 857033 INFO (qtp103958222-15179) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 857033 INFO (qtp103958222-15180) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00000_core'
[junit4] 2> 857033 INFO (qtp103958222-15180) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 857033 INFO (qtp103958222-15180) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 857035 INFO (qtp103958222-15175) [ ] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig-minimal.xml
[junit4] 2> 857035 INFO (Thread-10244) [ ] o.a.s.c.OneIndexer Starting indexing thread: 15197
[junit4] 2> 857036 INFO (Thread-10245) [ ] o.a.s.c.OneQuery Starting query thread: 15198
[junit4] 2> 857037 INFO (Thread-10246) [ ] o.a.s.c.OneQuery Starting query thread: 15199
[junit4] 2> 857037 INFO (Thread-10247) [ ] o.a.s.c.OneQuery Starting query thread: 15200
[junit4] 2> 857037 INFO (Thread-10248) [ ] o.a.s.c.OneQuery Starting query thread: 15201
[junit4] 2> 857037 INFO (qtp103958222-15175) [ ] o.a.s.s.IndexSchema [00006_core] Schema name=tiny
[junit4] 2> 857038 INFO (Thread-10249) [ ] o.a.s.c.OneQuery Starting query thread: 15202
[junit4] 2> 857038 INFO (Thread-10250) [ ] o.a.s.c.OneQuery Starting query thread: 15203
[junit4] 2> 857038 INFO (Thread-10251) [ ] o.a.s.c.OneQuery Starting query thread: 15204
[junit4] 2> 857041 INFO (Thread-10252) [ ] o.a.s.c.OneQuery Starting query thread: 15205
[junit4] 2> 857041 INFO (qtp103958222-15175) [ ] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 857042 INFO (qtp103958222-15180) [ ] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 857043 INFO (qtp103958222-15175) [ ] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00006_core'
[junit4] 2> 857043 INFO (qtp103958222-15175) [ ] o.a.s.c.CoreContainer Creating SolrCore '00006_core' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00006_core
[junit4] 2> 857044 INFO (qtp103958222-15175) [ x:00006_core] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 857044 INFO (qtp103958222-15179) [ ] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 857044 INFO (qtp103958222-15176) [ ] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 857044 INFO (qtp103958222-15175) [ x:00006_core] o.a.s.c.SolrCore [[00006_core] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00006_core], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00006_core/data/]
[junit4] 2> 857044 INFO (qtp103958222-15175) [ x:00006_core] o.a.s.c.SolrCore JMX monitoring not detected for core: 00006_core
[junit4] 2> 857046 INFO (qtp103958222-15179) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 857046 INFO (qtp103958222-15176) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 857046 INFO (qtp103958222-15175) [ x:00006_core] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00006_core/data
[junit4] 2> 857047 INFO (qtp103958222-15175) [ x:00006_core] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00006_core/data/index/
[junit4] 2> 857047 WARN (qtp103958222-15175) [ x:00006_core] o.a.s.c.SolrCore [00006_core] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00006_core/data/index' doesn't exist. Creating new index...
[junit4] 2> 857048 INFO (qtp103958222-15180) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 857048 INFO (qtp103958222-15175) [ x:00006_core] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00006_core/data/index
[junit4] 2> 857048 INFO (qtp103958222-15175) [ x:00006_core] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@202064e3
[junit4] 2> 857048 INFO (Thread-10253) [ ] o.a.s.c.OneQuery Starting query thread: 15206
[junit4] 2> 857049 INFO (qtp103958222-15182) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00005_core'
[junit4] 2> 857049 INFO (qtp103958222-15182) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 857049 INFO (qtp103958222-15182) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 857050 INFO (qtp103958222-15175) [ x:00006_core] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@6368b4a4 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@53295188),segFN=segments_1,generation=1}
[junit4] 2> 857050 INFO (qtp103958222-15175) [ x:00006_core] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 857052 INFO (qtp103958222-15176) [ ] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig-minimal.xml
[junit4] 2> 857053 INFO (qtp103958222-15180) [ ] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig-minimal.xml
[junit4] 2> 857054 INFO (qtp103958222-15176) [ ] o.a.s.s.IndexSchema [00001_core] Schema name=tiny
[junit4] 2> 857055 INFO (qtp103958222-15182) [ ] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 857056 INFO (qtp103958222-15175) [ x:00006_core] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 857056 INFO (qtp103958222-15180) [ ] o.a.s.s.IndexSchema [00000_core] Schema name=tiny
[junit4] 2> 857057 INFO (qtp103958222-15176) [ ] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 857057 INFO (qtp103958222-15175) [ x:00006_core] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 857070 INFO (OldIndexDirectoryCleanupThreadForCore-00006_core) [ x:00006_core] o.a.s.c.SolrCore Looking for old index directories to cleanup for core 00006_core in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00006_core/data/
[junit4] 2> 857071 WARN (OldIndexDirectoryCleanupThreadForCore-00006_core) [ x:00006_core] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00006_core/data/ does not point to a valid data directory; skipping clean-up of old index directories.
[junit4] 2> 857071 INFO (qtp103958222-15175) [ x:00006_core] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 857071 INFO (qtp103958222-15176) [ ] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00001_core'
[junit4] 2> 857071 INFO (qtp103958222-15176) [ ] o.a.s.c.CoreContainer Creating SolrCore '00001_core' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00001_core
[junit4] 2> 857071 INFO (qtp103958222-15180) [ ] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 857071 INFO (qtp103958222-15176) [ x:00001_core] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 857072 INFO (qtp103958222-15176) [ x:00001_core] o.a.s.c.SolrCore [[00001_core] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00001_core], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00001_core/data/]
[junit4] 2> 857072 INFO (qtp103958222-15176) [ x:00001_core] o.a.s.c.SolrCore JMX monitoring not detected for core: 00001_core
[junit4] 2> 857072 INFO (qtp103958222-15175) [ x:00006_core] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 857073 INFO (qtp103958222-15180) [ ] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00000_core'
[junit4] 2> 857073 INFO (qtp103958222-15175) [ x:00006_core] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 857073 INFO (qtp103958222-15180) [ ] o.a.s.c.CoreContainer Creating SolrCore '00000_core' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00000_core
[junit4] 2> 857070 INFO (qtp103958222-15182) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 857073 INFO (qtp103958222-15180) [ x:00000_core] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 857073 INFO (qtp103958222-15180) [ x:00000_core] o.a.s.c.SolrCore [[00000_core] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00000_core], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00000_core/data/]
[junit4] 2> 857073 INFO (qtp103958222-15180) [ x:00000_core] o.a.s.c.SolrCore JMX monitoring not detected for core: 00000_core
[junit4] 2> 857074 INFO (qtp103958222-15175) [ x:00006_core] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,/update/csv,/sql,/update/json/docs,/admin/luke,/export,/select,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/stream,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 857075 INFO (qtp103958222-15175) [ x:00006_core] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 857075 INFO (qtp103958222-15176) [ x:00001_core] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00001_core/data
[junit4] 2> 857076 INFO (qtp103958222-15176) [ x:00001_core] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00001_core/data/index/
[junit4] 2> 857076 WARN (qtp103958222-15176) [ x:00001_core] o.a.s.c.SolrCore [00001_core] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00001_core/data/index' doesn't exist. Creating new index...
[junit4] 2> 857076 INFO (qtp103958222-15180) [ x:00000_core] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00000_core/data
[junit4] 2> 857076 INFO (qtp103958222-15176) [ x:00001_core] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00001_core/data/index
[junit4] 2> 857076 INFO (qtp103958222-15180) [ x:00000_core] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00000_core/data/index/
[junit4] 2> 857076 WARN (qtp103958222-15180) [ x:00000_core] o.a.s.c.SolrCore [00000_core] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00000_core/data/index' doesn't exist. Creating new index...
[junit4] 2> 857076 INFO (qtp103958222-15176) [ x:00001_core] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@50580e45
[junit4] 2> 857077 INFO (qtp103958222-15175) [ x:00006_core] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 857077 INFO (qtp103958222-15180) [ x:00000_core] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00000_core/data/index
[junit4] 2> 857077 INFO (qtp103958222-15175) [ x:00006_core] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 857077 INFO (qtp103958222-15180) [ x:00000_core] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@1b2dfca7
[junit4] 2> 857078 INFO (qtp103958222-15176) [ x:00001_core] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@21531412 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@300b805),segFN=segments_1,generation=1}
[junit4] 2> 857078 INFO (qtp103958222-15176) [ x:00001_core] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 857078 INFO (qtp103958222-15175) [ x:00006_core] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=38, maxMergeAtOnceExplicit=33, maxMergedSegmentMB=41.0859375, floorSegmentMB=0.3466796875, forceMergeDeletesPctAllowed=0.20317280994581743, segmentsPerTier=15.0, maxCFSSegmentSizeMB=0.4736328125, noCFSRatio=1.0
[junit4] 2> 857078 INFO (qtp103958222-15182) [ ] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig-minimal.xml
[junit4] 2> 857078 INFO (qtp103958222-15175) [ x:00006_core] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@6368b4a4 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@53295188),segFN=segments_1,generation=1}
[junit4] 2> 857079 INFO (qtp103958222-15175) [ x:00006_core] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 857079 INFO (qtp103958222-15175) [ x:00006_core] o.a.s.s.SolrIndexSearcher Opening Searcher@a8ed128[00006_core] main
[junit4] 2> 857080 INFO (qtp103958222-15175) [ x:00006_core] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00006_core/conf
[junit4] 2> 857080 INFO (qtp103958222-15175) [ x:00006_core] o.a.s.r.RestManager Initializing RestManager with initArgs: {storageDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00006_core/conf}
[junit4] 2> 857080 INFO (qtp103958222-15175) [ x:00006_core] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using file:dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00006_core/conf
[junit4] 2> 857080 INFO (qtp103958222-15175) [ x:00006_core] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 857080 INFO (qtp103958222-15175) [ x:00006_core] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 857080 INFO (OldIndexDirectoryCleanupThreadForCore-00001_core) [ x:00001_core] o.a.s.c.SolrCore Looking for old index directories to cleanup for core 00001_core in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00001_core/data/
[junit4] 2> 857081 WARN (OldIndexDirectoryCleanupThreadForCore-00001_core) [ x:00001_core] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00001_core/data/ does not point to a valid data directory; skipping clean-up of old index directories.
[junit4] 2> 857081 INFO (qtp103958222-15182) [ ] o.a.s.s.IndexSchema [00005_core] Schema name=tiny
[junit4] 2> 857081 INFO (searcherExecutor-3685-thread-1-processing-x:00006_core) [ x:00006_core] o.a.s.c.SolrCore [00006_core] Registered new searcher Searcher@a8ed128[00006_core] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 857081 INFO (qtp103958222-15175) [ x:00006_core] o.a.s.c.SolrCores Opening transient core 00006_core
[junit4] 2> 857081 INFO (qtp103958222-15175) [ x:00006_core] o.a.s.c.CoreContainer registering core: 00006_core
[junit4] 2> 857082 INFO (qtp103958222-15179) [ ] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig-minimal.xml
[junit4] 2> 857085 INFO (qtp103958222-15180) [ x:00000_core] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@27c9ab48 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@49bd3d76),segFN=segments_1,generation=1}
[junit4] 2> 857086 INFO (qtp103958222-15180) [ x:00000_core] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 857089 INFO (qtp103958222-15179) [ ] o.a.s.s.IndexSchema [00004_core] Schema name=tiny
[junit4] 2> 857089 INFO (qtp103958222-15182) [ ] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 857090 INFO (qtp103958222-15176) [ x:00001_core] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 857090 INFO (qtp103958222-15182) [ ] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00005_core'
[junit4] 2> 857090 INFO (qtp103958222-15182) [ ] o.a.s.c.CoreContainer Creating SolrCore '00005_core' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00005_core
[junit4] 2> 857090 INFO (qtp103958222-15182) [ x:00005_core] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 857090 INFO (qtp103958222-15182) [ x:00005_core] o.a.s.c.SolrCore [[00005_core] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00005_core], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00005_core/data/]
[junit4] 2> 857090 INFO (qtp103958222-15182) [ x:00005_core] o.a.s.c.SolrCore JMX monitoring not detected for core: 00005_core
[junit4] 2> 857091 INFO (qtp103958222-15179) [ ] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 857091 INFO (qtp103958222-15176) [ x:00001_core] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 857092 INFO (qtp103958222-15182) [ x:00005_core] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00005_core/data
[junit4] 2> 857092 INFO (qtp103958222-15176) [ x:00001_core] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 857092 INFO (qtp103958222-15182) [ x:00005_core] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00005_core/data/index/
[junit4] 2> 857092 WARN (qtp103958222-15182) [ x:00005_core] o.a.s.c.SolrCore [00005_core] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00005_core/data/index' doesn't exist. Creating new index...
[junit4] 2> 857092 INFO (qtp103958222-15179) [ ] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00004_core'
[junit4] 2> 857092 INFO (qtp103958222-15179) [ ] o.a.s.c.CoreContainer Creating SolrCore '00004_core' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00004_core
[junit4] 2> 857093 INFO (qtp103958222-15182) [ x:00005_core] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00005_core/data/index
[junit4] 2> 857093 INFO (qtp103958222-15179) [ x:00004_core] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 857093 INFO (qtp103958222-15182) [ x:00005_core] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@1f047de1
[junit4] 2> 857093 INFO (qtp103958222-15179) [ x:00004_core] o.a.s.c.SolrCore [[00004_core] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00004_core], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00004_core/data/]
[junit4] 2> 857093 INFO (qtp103958222-15179) [ x:00004_core] o.a.s.c.SolrCore JMX monitoring not detected for core: 00004_core
[junit4] 2> 857093 INFO (qtp103958222-15176) [ x:00001_core] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 857093 INFO (qtp103958222-15182) [ x:00005_core] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@4dfdde07 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3ce19307),segFN=segments_1,generation=1}
[junit4] 2> 857093 INFO (qtp103958222-15182) [ x:00005_core] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 857094 INFO (qtp103958222-15176) [ x:00001_core] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 857094 INFO (qtp103958222-15179) [ x:00004_core] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00004_core/data
[junit4] 2> 857094 INFO (qtp103958222-15179) [ x:00004_core] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00004_core/data/index/
[junit4] 2> 857094 WARN (qtp103958222-15179) [ x:00004_core] o.a.s.c.SolrCore [00004_core] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00004_core/data/index' doesn't exist. Creating new index...
[junit4] 2> 857095 INFO (qtp103958222-15179) [ x:00004_core] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00004_core/data/index
[junit4] 2> 857095 INFO (qtp103958222-15179) [ x:00004_core] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@75874e2f
[junit4] 2> 857097 INFO (qtp103958222-15176) [ x:00001_core] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,/update/csv,/sql,/update/json/docs,/admin/luke,/export,/select,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/stream,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 857098 INFO (OldIndexDirectoryCleanupThreadForCore-00000_core) [ x:00000_core] o.a.s.c.SolrCore Looking for old index directories to cleanup for core 00000_core in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00000_core/data/
[junit4] 2> 857098 INFO (qtp103958222-15210) [ x:00006_core] o.a.s.u.p.LogUpdateProcessorFactory [00006_core] webapp=/solr path=/update params={wt=javabin&version=2}{add=[id9]} 0 26
[junit4] 2> 857098 INFO (qtp103958222-15179) [ x:00004_core] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@13094447 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39ac24eb),segFN=segments_1,generation=1}
[junit4] 2> 857098 INFO (qtp103958222-15179) [ x:00004_core] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 857098 WARN (OldIndexDirectoryCleanupThreadForCore-00000_core) [ x:00000_core] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00000_core/data/ does not point to a valid data directory; skipping clean-up of old index directories.
[junit4] 2> 857098 INFO (qtp103958222-15178) [ x:00006_core] o.a.s.u.p.LogUpdateProcessorFactory [00006_core] webapp=/solr path=/update params={wt=javabin&version=2}{add=[id1]} 0 78
[junit4] 2> 857098 INFO (qtp103958222-15175) [ x:00006_core] o.a.s.u.p.LogUpdateProcessorFactory [00006_core] webapp=/solr path=/update params={wt=javabin&version=2}{add=[id3]} 0 81
[junit4] 2> 857100 INFO (qtp103958222-15182) [ x:00005_core] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 857101 INFO (qtp103958222-15182) [ x:00005_core] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 857102 INFO (qtp103958222-15182) [ x:00005_core] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 857102 INFO (qtp103958222-15182) [ x:00005_core] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 857103 INFO (qtp103958222-15182) [ x:00005_core] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 857103 INFO (OldIndexDirectoryCleanupThreadForCore-00005_core) [ x:00005_core] o.a.s.c.SolrCore Looking for old index directories to cleanup for core 00005_core in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00005_core/data/
[junit4] 2> 857098 INFO (qtp103958222-15176) [ x:00001_core] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 857103 WARN (OldIndexDirectoryCleanupThreadForCore-00005_core) [ x:00005_core] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00005_core/data/ does not point to a valid data directory; skipping clean-up of old index directories.
[junit4] 2> 857104 INFO (OldIndexDirectoryCleanupThreadForCore-00004_core) [ x:00004_core] o.a.s.c.SolrCore Looking for old index directories to cleanup for core 00004_core in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00004_core/data/
[junit4] 2> 857104 WARN (OldIndexDirectoryCleanupThreadForCore-00004_core) [ x:00004_core] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00004_core/data/ does not point to a valid data directory; skipping clean-up of old index directories.
[junit4] 2> 857104 INFO (qtp103958222-15213) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00002_core'
[junit4] 2> 857104 INFO (qtp103958222-15213) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 857104 INFO (qtp103958222-15213) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 857105 INFO (qtp103958222-15182) [ x:00005_core] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,/update/csv,/sql,/update/json/docs,/admin/luke,/export,/select,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/stream,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 857105 INFO (qtp103958222-15182) [ x:00005_core] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 857105 INFO (qtp103958222-15182) [ x:00005_core] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 857105 INFO (qtp103958222-15182) [ x:00005_core] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 857106 INFO (qtp103958222-15182) [ x:00005_core] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=38, maxMergeAtOnceExplicit=33, maxMergedSegmentMB=41.0859375, floorSegmentMB=0.3466796875, forceMergeDeletesPctAllowed=0.20317280994581743, segmentsPerTier=15.0, maxCFSSegmentSizeMB=0.4736328125, noCFSRatio=1.0
[junit4] 2> 857106 INFO (qtp103958222-15182) [ x:00005_core] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@4dfdde07 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3ce19307),segFN=segments_1,generation=1}
[junit4] 2> 857106 INFO (qtp103958222-15182) [ x:00005_core] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 857107 INFO (qtp103958222-15182) [ x:00005_core] o.a.s.s.SolrIndexSearcher Opening Searcher@69ac9619[00005_core] main
[junit4] 2> 857107 INFO (qtp103958222-15180) [ x:00000_core] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 857107 INFO (qtp103958222-15182) [ x:00005_core] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00005_core/conf
[junit4] 2> 857107 INFO (qtp103958222-15182) [ x:00005_core] o.a.s.r.RestManager Initializing RestManager with initArgs: {storageDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00005_core/conf}
[junit4] 2> 857107 INFO (qtp103958222-15182) [ x:00005_core] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using file:dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00005_core/conf
[junit4] 2> 857107 INFO (qtp103958222-15179) [ x:00004_core] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 857107 INFO (qtp103958222-15182) [ x:00005_core] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 857107 INFO (qtp103958222-15182) [ x:00005_core] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 857107 INFO (qtp103958222-15176) [ x:00001_core] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 857108 INFO (qtp103958222-15176) [ x:00001_core] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 857108 INFO (searcherExecutor-3691-thread-1-processing-x:00005_core) [ x:00005_core] o.a.s.c.SolrCore [00005_core] Registered new searcher Searcher@69ac9619[00005_core] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 857108 INFO (qtp103958222-15180) [ x:00000_core] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 857108 INFO (qtp103958222-15179) [ x:00004_core] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 857108 INFO (qtp103958222-15182) [ x:00005_core] o.a.s.c.SolrCores Opening transient core 00005_core
[junit4] 2> 857108 INFO (qtp103958222-15182) [ x:00005_core] o.a.s.c.CoreContainer registering core: 00005_core
[junit4] 2> 857109 INFO (qtp103958222-15180) [ x:00000_core] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 857109 INFO (qtp103958222-15179) [ x:00004_core] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 857110 INFO (qtp103958222-15176) [ x:00001_core] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=38, maxMergeAtOnceExplicit=33, maxMergedSegmentMB=41.0859375, floorSegmentMB=0.3466796875, forceMergeDeletesPctAllowed=0.20317280994581743, segmentsPerTier=15.0, maxCFSSegmentSizeMB=0.4736328125, noCFSRatio=1.0
[junit4] 2> 857110 INFO (qtp103958222-15176) [ x:00001_core] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@21531412 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@300b805),segFN=segments_1,generation=1}
[junit4] 2> 857110 INFO (qtp103958222-15180) [ x:00000_core] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 857110 INFO (qtp103958222-15176) [ x:00001_core] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 857110 INFO (qtp103958222-15176) [ x:00001_core] o.a.s.s.SolrIndexSearcher Opening Searcher@70f9ec7a[00001_core] main
[junit4] 2> 857110 INFO (qtp103958222-15213) [ ] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 857111 INFO (qtp103958222-15176) [ x:00001_core] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00001_core/conf
[junit4] 2> 857111 INFO (qtp103958222-15176) [ x:00001_core] o.a.s.r.RestManager Initializing RestManager with initArgs: {storageDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00001_core/conf}
[junit4] 2> 857111 INFO (qtp103958222-15180) [ x:00000_core] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 857111 INFO (qtp103958222-15176) [ x:00001_core] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using file:dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00001_core/conf
[junit4] 2> 857111 INFO (qtp103958222-15176) [ x:00001_core] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 857111 INFO (qtp103958222-15176) [ x:00001_core] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 857112 INFO (qtp103958222-15176) [ x:00001_core] o.a.s.c.SolrCores Opening transient core 00001_core
[junit4] 2> 857112 INFO (qtp103958222-15176) [ x:00001_core] o.a.s.c.CoreContainer registering core: 00001_core
[junit4] 2> 857112 INFO (searcherExecutor-3686-thread-1-processing-x:00001_core) [ x:00001_core] o.a.s.c.SolrCore [00001_core] Registered new searcher Searcher@70f9ec7a[00001_core] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 857113 INFO (qtp103958222-15213) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 857114 INFO (qtp103958222-15179) [ x:00004_core] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 857114 INFO (qtp103958222-15182) [ x:00005_core] o.a.s.u.p.LogUpdateProcessorFactory [00005_core] webapp=/solr path=/update params={wt=javabin&version=2}{add=[id5]} 0 65
[junit4] 2> 857114 INFO (qtp103958222-15179) [ x:00004_core] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 857116 INFO (qtp103958222-15179) [ x:00004_core] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,/update/csv,/sql,/update/json/docs,/admin/luke,/export,/select,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/stream,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 857116 INFO (qtp103958222-15179) [ x:00004_core] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 857116 INFO (qtp103958222-15180) [ x:00000_core] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,/update/csv,/sql,/update/json/docs,/admin/luke,/export,/select,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/stream,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 857116 INFO (qtp103958222-15180) [ x:00000_core] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 857117 INFO (qtp103958222-15179) [ x:00004_core] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 857117 INFO (qtp103958222-15179) [ x:00004_core] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 857117 INFO (qtp103958222-15180) [ x:00000_core] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 857117 INFO (qtp103958222-15180) [ x:00000_core] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 857121 INFO (qtp103958222-15211) [ x:00001_core] o.a.s.u.p.LogUpdateProcessorFactory [00001_core] webapp=/solr path=/update params={wt=javabin&version=2}{add=[id10]} 0 17
[junit4] 2> 857121 INFO (qtp103958222-15180) [ x:00000_core] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=38, maxMergeAtOnceExplicit=33, maxMergedSegmentMB=41.0859375, floorSegmentMB=0.3466796875, forceMergeDeletesPctAllowed=0.20317280994581743, segmentsPerTier=15.0, maxCFSSegmentSizeMB=0.4736328125, noCFSRatio=1.0
[junit4] 2> 857122 INFO (qtp103958222-15180) [ x:00000_core] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@27c9ab48 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@49bd3d76),segFN=segments_1,generation=1}
[junit4] 2> 857122 INFO (qtp103958222-15180) [ x:00000_core] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 857122 INFO (qtp103958222-15180) [ x:00000_core] o.a.s.s.SolrIndexSearcher Opening Searcher@6bdd2721[00000_core] main
[junit4] 2> 857122 INFO (qtp103958222-15180) [ x:00000_core] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00000_core/conf
[junit4] 2> 857122 INFO (qtp103958222-15180) [ x:00000_core] o.a.s.r.RestManager Initializing RestManager with initArgs: {storageDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00000_core/conf}
[junit4] 2> 857122 INFO (qtp103958222-15180) [ x:00000_core] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using file:dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00000_core/conf
[junit4] 2> 857122 INFO (qtp103958222-15180) [ x:00000_core] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 857123 INFO (qtp103958222-15180) [ x:00000_core] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 857123 INFO (searcherExecutor-3687-thread-1-processing-x:00000_core) [ x:00000_core] o.a.s.c.SolrCore [00000_core] Registered new searcher Searcher@6bdd2721[00000_core] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 857123 INFO (qtp103958222-15180) [ x:00000_core] o.a.s.c.SolrCores Opening transient core 00000_core
[junit4] 2> 857123 INFO (qtp103958222-15180) [ x:00000_core] o.a.s.c.CoreContainer registering core: 00000_core
[junit4] 2> 857123 INFO (qtp103958222-15210) [ x:00006_core] o.a.s.u.p.LogUpdateProcessorFactory [00006_core] webapp=/solr path=/update params={wt=javabin&version=2}{add=[id14]} 0 0
[junit4] 2> 857126 INFO (qtp103958222-15207) [ x:00001_core] o.a.s.u.p.LogUpdateProcessorFactory [00001_core] webapp=/solr path=/update params={wt=javabin&version=2}{add=[id8]} 0 55
[junit4] 2> 857126 INFO (qtp103958222-15176) [ x:00001_core] o.a.s.u.p.LogUpdateProcessorFactory [00001_core] webapp=/solr path=/update params={wt=javabin&version=2}{add=[id4]} 0 95
[junit4] 2> 857127 INFO (qtp103958222-15213) [ ] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig-minimal.xml
[junit4] 2> 857127 INFO (qtp103958222-15180) [ x:00000_core] o.a.s.u.p.LogUpdateProcessorFactory [00000_core] webapp=/solr path=/update params={wt=javabin&version=2}{add=[id7]} 0 93
[junit4] 2> 857127 INFO (qtp103958222-15179) [ x:00004_core] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=38, maxMergeAtOnceExplicit=33, maxMergedSegmentMB=41.0859375, floorSegmentMB=0.3466796875, forceMergeDeletesPctAllowed=0.20317280994581743, segmentsPerTier=15.0, maxCFSSegmentSizeMB=0.4736328125, noCFSRatio=1.0
[junit4] 2> 857128 INFO (qtp103958222-15209) [ x:00000_core] o.a.s.u.p.LogUpdateProcessorFactory [00000_core] webapp=/solr path=/update params={wt=javabin&version=2}{add=[id12]} 0 24
[junit4] 2> 857129 INFO (qtp103958222-15210) [ x:00006_core] o.a.s.u.p.LogUpdateProcessorFactory [00006_core] webapp=/solr path=/update params={wt=javabin&version=2}{add=[id17]} 0 0
[junit4] 2> 857129 INFO (qtp103958222-15207) [ x:00006_core] o.a.s.u.p.LogUpdateProcessorFactory [00006_core] webapp=/solr path=/update params={wt=javabin&version=2}{add=[id16]} 0 0
[junit4] 2> 857130 INFO (qtp103958222-15210) [ x:00005_core] o.a.s.u.p.LogUpdateProcessorFactory [00005_core] webapp=/solr path=/update params={wt=javabin&version=2}{add=[id15]} 0 1
[junit4] 2> 857131 INFO (qtp103958222-15176) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00003_core'
[junit4] 2> 857131 INFO (qtp103958222-15179) [ x:00004_core] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@13094447 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39ac24eb),segFN=segments_1,generation=1}
[junit4] 2> 857131 INFO (qtp103958222-15179) [ x:00004_core] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 857131 INFO (qtp103958222-15176) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 857131 INFO (qtp103958222-15176) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 857131 INFO (qtp103958222-15179) [ x:00004_core] o.a.s.s.SolrIndexSearcher Opening Searcher@4e01c71a[00004_core] main
[junit4] 2> 857132 INFO (qtp103958222-15179) [ x:00004_core] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00004_core/conf
[junit4] 2> 857132 INFO (qtp103958222-15179) [ x:00004_core] o.a.s.r.RestManager Initializing RestManager with initArgs: {storageDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00004_core/conf}
[junit4] 2> 857132 INFO (qtp103958222-15179) [ x:00004_core] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using file:dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00004_core/conf
[junit4] 2> 857132 INFO (qtp103958222-15179) [ x:00004_core] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 857132 INFO (qtp103958222-15182) [ x:00005_core] o.a.s.u.p.LogUpdateProcessorFactory [00005_core] webapp=/solr path=/update params={wt=javabin&version=2}{add=[id22]} 0 0
[junit4] 2> 857134 INFO (qtp103958222-15213) [ ] o.a.s.s.IndexSchema [00002_core] Schema name=tiny
[junit4] 2> 857134 INFO (qtp103958222-15182) [ x:00000_core] o.a.s.u.p.LogUpdateProcessorFactory [00000_core] webapp=/solr path=/update params={wt=javabin&version=2}{add=[id23]} 0 0
[junit4] 2> 857132 INFO (qtp103958222-15179) [ x:00004_core] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 857135 INFO (searcherExecutor-3692-thread-1-processing-x:00004_core) [ x:00004_core] o.a.s.c.SolrCore [00004_core] Registered new searcher Searcher@4e01c71a[00004_core] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 857135 INFO (qtp103958222-15179) [ x:00004_core] o.a.s.c.SolrCores Opening transient core 00004_core
[junit4] 2> 857135 INFO (qtp103958222-15179) [ x:00004_core] o.a.s.c.CoreContainer registering core: 00004_core
[junit4] 2> 857138 INFO (qtp103958222-15175) [ x:00001_core] o.a.s.u.p.LogUpdateProcessorFactory [00001_core] webapp=/solr path=/update params={wt=javabin&version=2}{add=[id18]} 0 9
[junit4] 2> 857139 INFO (qtp103958222-15210) [ x:00005_core] o.a.s.u.p.LogUpdateProcessorFactory [00005_core] webapp=/solr path=/update params={wt=javabin&version=2}{add=[id24]} 0 0
[junit4] 2> 857140 INFO (qtp103958222-15211) [ x:00001_core] o.a.s.u.p.LogUpdateProcessorFactory [00001_core] webapp=/solr path=/update params={wt=javabin&version=2}{add=[id25]} 0 0
[junit4] 2> 857141 INFO (qtp103958222-15211) [ x:00001_core] o.a.s.c.S.Request [00001_core] webapp=/solr path=/select params={q=*:*&qt=/select&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 857143 INFO (qtp103958222-15175) [ x:00001_core] o.a.s.c.S.Request [00001_core] webapp=/solr path=/select params={q=*:*&qt=/select&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 857143 INFO (qtp103958222-15211) [ x:00005_core] o.a.s.u.p.LogUpdateProcessorFactory [00005_core] webapp=/solr path=/update params={wt=javabin&version=2}{add=[id27]} 0 0
[junit4] 2> 857143 INFO (qtp103958222-15175) [ x:00001_core] o.a.s.c.S.Request [00001_core] webapp=/solr path=/select params={q=*:*&qt=/select&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 857148 INFO (qtp103958222-15181) [ x:00004_core] o.a.s.u.p.LogUpdateProcessorFactory [00004_core] webapp=/solr path=/update params={wt=javabin&version=2}{add=[id2]} 0 100
[junit4] 2> 857149 INFO (qtp103958222-15178) [ x:00004_core] o.a.s.u.p.LogUpdateProcessorFactory [00004_core] webapp=/solr path=/update params={wt=javabin&version=2}{add=[id13]} 0 32
[junit4] 2> 857150 INFO (qtp103958222-15182) [ x:00005_core] o.a.s.c.S.Request [00005_core] webapp=/solr path=/select params={q=*:*&qt=/select&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 857151 INFO (qtp103958222-15179) [ x:00004_core] o.a.s.u.p.LogUpdateProcessorFactory [00004_core] webapp=/solr path=/update params={wt=javabin&version=2}{add=[id6]} 0 118
[junit4] 2> 857153 INFO (qtp103958222-15176) [ ] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 857155 INFO (qtp103958222-15176) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 857158 INFO (qtp103958222-15213) [ ] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 857159 INFO (qtp103958222-15213) [ ] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00002_core'
[junit4] 2> 857159 INFO (qtp103958222-15213) [ ] o.a.s.c.CoreContainer Creating SolrCore '00002_core' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00002_core
[junit4] 2> 857159 INFO (qtp103958222-15213) [ x:00002_core] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 857160 INFO (qtp103958222-15213) [ x:00002_core] o.a.s.c.SolrCore [[00002_core] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00002_core], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00002_core/data/]
[junit4] 2> 857160 INFO (qtp103958222-15213) [ x:00002_core] o.a.s.c.SolrCore JMX monitoring not detected for core: 00002_core
[junit4] 2> 857161 INFO (qtp103958222-15213) [ x:00002_core] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00002_core/data
[junit4] 2> 857161 INFO (qtp103958222-15213) [ x:00002_core] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00002_core/data/index/
[junit4] 2> 857161 WARN (qtp103958222-15213) [ x:00002_core] o.a.s.c.SolrCore [00002_core] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00002_core/data/index' doesn't exist. Creating new index...
[junit4] 2> 857162 INFO (qtp103958222-15213) [ x:00002_core] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00002_core/data/index
[junit4] 2> 857162 INFO (qtp103958222-15176) [ ] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig-minimal.xml
[junit4] 2> 857162 INFO (qtp103958222-15213) [ x:00002_core] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@2e12edcc
[junit4] 2> 857173 INFO (qtp103958222-15175) [ x:00005_core] o.a.s.c.S.Request [00005_core] webapp=/solr path=/select params={q=*:*&qt=/select&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 857173 INFO (qtp103958222-15178) [ x:00001_core] o.a.s.c.S.Request [00001_core] webapp=/solr path=/select params={q=*:*&qt=/select&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 857174 INFO (qtp103958222-15178) [ x:00004_core] o.a.s.c.S.Request [00004_core] webapp=/solr path=/select params={q=*:*&qt=/select&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 857174 INFO (qtp103958222-15175) [ x:00005_core] o.a.s.u.p.LogUpdateProcessorFactory [00005_core] webapp=/solr path=/update params={wt=javabin&version=2}{add=[id29]} 0 0
[junit4] 2> 857174 INFO (qtp103958222-15213) [ x:00002_core] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@2ae2aefe lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@35fb9b7a),segFN=segments_1,generation=1}
[junit4] 2> 857175 INFO (qtp103958222-15213) [ x:00002_core] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 857175 INFO (OldIndexDirectoryCleanupThreadForCore-00002_core) [ x:00002_core] o.a.s.c.SolrCore Looking for old index directories to cleanup for core 00002_core in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00002_core/data/
[junit4] 2> 857175 WARN (OldIndexDirectoryCleanupThreadForCore-00002_core) [ x:00002_core] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00002_core/data/ does not point to a valid data directory; skipping clean-up of old index directories.
[junit4] 2> 857177 INFO (qtp103958222-15176) [ ] o.a.s.s.IndexSchema [00003_core] Schema name=tiny
[junit4] 2> 857177 INFO (qtp103958222-15213) [ x:00002_core] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 857178 INFO (qtp103958222-15213) [ x:00002_core] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 857179 INFO (qtp103958222-15213) [ x:00002_core] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 857180 INFO (qtp103958222-15213) [ x:00002_core] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 857180 INFO (qtp103958222-15176) [ ] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 857181 INFO (qtp103958222-15213) [ x:00002_core] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 857182 INFO (qtp103958222-15213) [ x:00002_core] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,/update/csv,/sql,/update/json/docs,/admin/luke,/export,/select,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/stream,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 857182 INFO (qtp103958222-15176) [ ] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00003_core'
[junit4] 2> 857182 INFO (qtp103958222-15213) [ x:00002_core] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 857183 INFO (qtp103958222-15213) [ x:00002_core] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 857183 INFO (qtp103958222-15213) [ x:00002_core] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 857183 INFO (qtp103958222-15176) [ ] o.a.s.c.CoreContainer Creating SolrCore '00003_core' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00003_core
[junit4] 2> 857183 INFO (qtp103958222-15213) [ x:00002_core] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=38, maxMergeAtOnceExplicit=33, maxMergedSegmentMB=41.0859375, floorSegmentMB=0.3466796875, forceMergeDeletesPctAllowed=0.20317280994581743, segmentsPerTier=15.0, maxCFSSegmentSizeMB=0.4736328125, noCFSRatio=1.0
[junit4] 2> 857183 INFO (qtp103958222-15176) [ x:00003_core] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 857183 INFO (qtp103958222-15213) [ x:00002_core] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@2ae2aefe lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@35fb9b7a),segFN=segments_1,generation=1}
[junit4] 2> 857183 INFO (qtp103958222-15213) [ x:00002_core] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 857184 INFO (qtp103958222-15176) [ x:00003_core] o.a.s.c.SolrCore [[00003_core] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00003_core], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00003_core/data/]
[junit4] 2> 857184 INFO (qtp103958222-15213) [ x:00002_core] o.a.s.s.SolrIndexSearcher Opening Searcher@780df2c3[00002_core] main
[junit4] 2> 857184 INFO (qtp103958222-15176) [ x:00003_core] o.a.s.c.SolrCore JMX monitoring not detected for core: 00003_core
[junit4] 2> 857184 INFO (qtp103958222-15213) [ x:00002_core] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00002_core/conf
[junit4] 2> 857184 INFO (qtp103958222-15213) [ x:00002_core] o.a.s.r.RestManager Initializing RestManager with initArgs: {storageDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00002_core/conf}
[junit4] 2> 857184 INFO (qtp103958222-15213) [ x:00002_core] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using file:dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00002_core/conf
[junit4] 2> 857184 INFO (qtp103958222-15213) [ x:00002_core] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 857184 INFO (qtp103958222-15213) [ x:00002_core] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 857185 INFO (qtp103958222-15213) [ x:00002_core] o.a.s.c.SolrCores Opening transient core 00002_core
[junit4] 2> 857185 INFO (qtp103958222-15176) [ x:00003_core] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00003_core/data
[junit4] 2> 857185 INFO (qtp103958222-15213) [ x:00002_core] o.a.s.c.CoreContainer registering core: 00002_core
[junit4] 2> 857185 INFO (qtp103958222-15176) [ x:00003_core] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00003_core/data/index/
[junit4] 2> 857185 WARN (qtp103958222-15176) [ x:00003_core] o.a.s.c.SolrCore [00003_core] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00003_core/data/index' doesn't exist. Creating new index...
[junit4] 2> 857185 INFO (searcherExecutor-3705-thread-1-processing-x:00002_core) [ x:00002_core] o.a.s.c.SolrCore [00002_core] Registered new searcher Searcher@780df2c3[00002_core] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 857185 INFO (qtp103958222-15176) [ x:00003_core] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00003_core/data/index
[junit4] 2> 857187 INFO (qtp103958222-15210) [ x:00002_core] o.a.s.c.S.Request [00002_core] webapp=/solr path=/select params={q=*:*&qt=/select&wt=javabin&version=2} hits=0 status=0 QTime=14
[junit4] 2> 857188 INFO (qtp103958222-15176) [ x:00003_core] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=7, maxMergeAtOnceExplicit=4, maxMergedSegmentMB=84.240234375, floorSegmentMB=2.0625, forceMergeDeletesPctAllowed=16.486488324252196, segmentsPerTier=27.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8596981312086202
[junit4] 2> 857188 INFO (qtp103958222-15176) [ x:00003_core] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=RawDirectoryWrapper(RAMDirectory@39416cc3 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@311bccc4),segFN=segments_1,generation=1}
[junit4] 2> 857188 INFO (qtp103958222-15176) [ x:00003_core] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 857189 INFO (qtp103958222-15175) [ x:00002_core] o.a.s.u.p.LogUpdateProcessorFactory [00002_core] webapp=/solr path=/update params={wt=javabin&version=2}{add=[id32]} 0 13
[junit4] 2> 857191 INFO (qtp103958222-15179) [ x:00006_core] o.a.s.u.p.LogUpdateProcessorFactory [00006_core] webapp=/solr path=/update params={wt=javabin&version=2}{add=[id33]} 0 0
[junit4] 2> 857192 INFO (qtp103958222-15213) [ x:00002_core] o.a.s.u.p.LogUpdateProcessorFactory [00002_core] webapp=/solr path=/update params={wt=javabin&version=2}{add=[id11]} 0 88
[junit4] 2> 857192 INFO (qtp103958222-15180) [ x:00002_core] o.a.s.u.p.LogUpdateProcessorFactory [00002_core] webapp=/solr path=/update params={wt=javabin&version=2}{add=[id26]} 0 49
[junit4] 2> 857193 INFO (qtp103958222-15207) [ x:00002_core] o.a.s.u.p.LogUpdateProcessorFactory [00002_core] webapp=/solr path=/update params={wt=javabin&version=2}{add=[id20]} 0 61
[junit4] 2> 857193 INFO (OldIndexDirectoryCleanupThreadForCore-00003_core) [ x:00003_core] o.a.s.c.SolrCore Looking for old index directories to cleanup for core 00003_core in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00003_core/data/
[junit4] 2> 857193 WARN (OldIndexDirectoryCleanupThreadForCore-00003_core) [ x:00003_core] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001/tempDir-001/00003_core/data/ does not point to a valid data directory; skipping clean-up of old index directories.
[junit4] 2> 857194 INFO (qtp103958222-15235) [ x:00001_core] o.a.s.u.p.LogUpdateProcessorFactory [00001_core] webapp=/solr path=/update params={wt=javabin&version=2}{add=[id34]} 0 0
[junit4] 2> 857196 INFO (qtp103958222-15210) [ x:00004_core] o.a.s.u.p.LogUpdateProcessorFactory [00004_core] webapp=/solr path=/update params={wt=javabin&version=2}{add=[id35]} 0 0
[junit4] 2> 857196 INFO (qtp103958222-15179) [ x:00006_core] o.a.s.u.p.LogUpdateProcessorFactory [00006_core] webapp=/solr path=/update params={wt=javabin&version=2}{add=[id36]} 0 0
[junit4] 2> 857196 INFO (qtp103958222-15182) [ x:00002_core] o.a.s.u.p.LogUpdateProcessorFactory [00002_core] webapp=/solr path=/update params={wt=javabin&version=2}{add=[id31]} 0 22
[junit4] 2> 857195 INFO (qtp103958222-15175) [ x:00001_core] o.a.s.u.p.LogUpdateProcessorFactory [00001_core] webapp=/solr path=/update params={wt=javabin&version=2}{add=[id37]} 0 0
[junit4] 2> 857203 INFO (qtp103958222-15180) [ x:00000_core] o.a.s.u.p.LogUpdateProcessorFactory [00000_core] webapp=/solr path=/update params={wt=javabin&version=2}{add=[id42]} 0 2
[junit4] 2> 857204 INFO (qtp103958222-15235) [ x:00000_core] o.a.s.u.p.LogUpdateProcessorFactory [00000_core] webapp=/solr path=/update params={wt=javabin&version=2}{add=[id41]} 0 2
[junit4] 2> 857204 INFO (qtp103958222-15210) [ x:00001_core] o.a.s.u.p.LogUpdateProcessorFactory [00001_core] webapp=/solr path=/update params={wt=javabin&version=2}{add=[id38]} 0 2
[junit4] 2> 857204 INFO (qtp103958222-15207) [ x:00000_core] o.a.s.u.p.LogUpdateProcessorFactory [00000_core] webapp=/solr path=/update params={wt=javabin&version=2}{add=[id40]} 0 3
[junit4] 2> 857207 INFO (qtp103958222-15180) [ x:00005_core] o.a.s.u.p.LogUpdateProcessorFactory [00005_core] webapp=/solr path=/update params={wt=javabin&version=2}{add=[id43]} 0 1
[junit4] 2> 857208 INFO (qtp103958222-15175) [ x:00004_core] o.a.s.u.p.LogUpdateProcessorFactory [00004_core] webapp=/solr path=/update params={wt=javabin&version=2}{add=[id45]} 0 0
[junit4] 2> 857209 INFO (qtp103958222-15179) [ x:00006_core] o.a.s.u.p.LogUpdateProcessorFactory [00006_core] webapp=/solr path=/update params={wt=javabin&version=2}{add=[id47]} 0 0
[junit4] 2> 857209 INFO (qtp103958222-15182) [ x:00001_core] o.a.s.u.p.LogUpdateProcessorFactory [00001_core] webapp=/solr path=/update params={wt=javabin&version=2}{add=[id44]} 0 3
[junit4] 2> 857210 INFO (qtp103958222-15180) [ x:00000_core] o.a.s.u.p.LogUpdateProcessorFactory [00000_core] webapp=/solr path=/update params={wt=javabin&version=2}{add=[id46]} 0 2
[junit4] 2> 857211 INFO (qtp103958222-15235) [ x:00000_core] o.a.s.u.p.LogUpdateProcessorFactory [00000_core] webapp=/solr path=/update params={wt=javabin&version=2}{add=[id49]} 0 0
[junit4] 2> 857212 INFO (qtp103958222-15235) [ x:00006_core] o.a.s.u.p.LogUpdateProcessorFactory [00006_core] webapp=/solr path=/update params={wt=javabin&version=2}{add=[id51]} 0 0
[junit4] 2> 857212 INFO (qtp103958222-15207) [ x:00000_core] o.a.s.u.p.LogUpdateProcessorFactory [00000_core] webapp=/solr path=/update params={wt=javabin&version=2}{add=[id48]} 0 0
[junit4] 2> 857213 INFO (qtp103958222-15175) [ x:00000_core] o.a.s.u.p.LogUpdateProcessorFactory [00000_core] webapp=/solr path=/update params={wt=javabin&version=2}{add=[id52]} 0 0
[junit4] 2> 857213 INFO (qtp103958222-15176) [ x:00003_core] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 857214 INFO (qtp103958222-15179) [ x:00000_core] o.a.s.u.p.LogUpdateProcessorFactory [00000_core] webapp=/solr path=/update params={wt=javabin&version=2}{add=[id53]} 0 0
[junit4] 2> 857214 INFO (qtp103958222-15182) [ x:00001_core] o.a.s.u.p.LogUpdateProcessorFactory [00001_core] webapp=/solr path=/update params={wt=javabin&version=2}{add=[id54]} 0 0
[junit4] 2> 857215 INFO (qtp103958222-15180) [ x:00000_core] o.a.s.u.p.LogUpdateProcessorFactory [00000_core] webapp=/solr path=/update params={wt=javabin&version=2}{add=[id55]} 0 0
[junit4] 2> 857216 INFO (qtp103958222-15235) [ x:00004_core] o.a.s.u.p.LogUpdateProcessorFactory [00004_core] webapp=/solr path=/update params={wt=javabin&version=2}{add=[id56]} 0 0
[junit4] 2> 857216 INFO (qtp103958222-15207) [ x:00006_core] o.a.s.u.p.LogUpdateProcessorFactory [00006_core] webapp=/solr path=/update params={wt=javabin&version=2}{add=[id57]} 0 0
[junit4] 2> 857217 INFO (qtp103958222-15176) [ x:00003_core] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 857217 INFO (qtp103958222-15175) [ x:00000_core] o.a.s.u.p.LogUpdateProcessorFactory [00000_core] webapp=/solr path=/update params={wt=javabin&version=2}{add=[id58]} 0 0
[junit4] 2> 857217 INFO (qtp103958222-15179) [ x:00004_core] o.a.s.u.p.LogUpdateProcessorFactory [00004_core] webapp=/solr path=/update params={wt=javabin&version=2}{add=[id59]} 0 0
[junit4] 2> 857218 INFO (qtp103958222-15175) [ x:00006_core] o.a.s.u.p.LogUpdateProcessorFactory [00006_core] webapp=/solr path=/update params={wt=javabin&version=2}{add=[id60]} 0 0
[junit4] 2> 857219 INFO (qtp103958222-15175) [ x:00006_core] o.a.s.u.p.LogUpdateProcessorFactory [00006_core] webapp=/solr path=/update params={wt=javabin&version=2}{add=[id61]} 0 0
[junit4] 2> 857219 INFO (qtp103958222-15235) [ x:00000_core] o.a.s.u.p.LogUpdateProcessorFactory [00000_core] webapp=/solr path=/update params={wt=javabin&version=2}{add=[id62]} 0 0
[junit4] 2> 857220 INFO (qtp103958222-15207) [ x:00005_core] o.a.s.u.p.LogUpdateProcessorFactory [00005_core] webapp=/solr path=/update params={wt=javabin&version=2}{add=[id63]} 0 0
[junit4] 2> 857221 INFO (qtp103958222-15179) [ x:00002_core] o.a.s.u.p.LogUpdateProcessorFactory [00002_core] webapp=/solr path=/update params={wt=javabin&version=2}{add=[id65]} 0 0
[junit4] 2> 857221 INFO (qtp103958222-15176) [ x:00003_core] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 857222 INFO (qtp103958222-15176) [ x:00003_core] o.a.s.h.l.XMLLoader xsltCacheLifetimeSecond
[...truncated too long message...]
4] ERROR 351s J1 | OpenCloseCoreStressTest.test10MinutesOld <<<
[junit4] > Throwable #1: java.lang.AssertionError: Core 00000_core bad! expected:<120701> but was:<120662>
[junit4] > at org.apache.solr.core.OpenCloseCoreStressTest.checkResults(OpenCloseCoreStressTest.java:298)
[junit4] > at org.apache.solr.core.OpenCloseCoreStressTest.doStress(OpenCloseCoreStressTest.java:197)
[junit4] > at org.apache.solr.core.OpenCloseCoreStressTest.test10MinutesOld(OpenCloseCoreStressTest.java:129)
[junit4] > at java.lang.Thread.run(Thread.java:745)Throwable #2: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=15567, name=Thread-10543, state=RUNNABLE, group=TGRP-OpenCloseCoreStressTest]
[junit4] > Caused by: java.lang.OutOfMemoryError: GC overhead limit exceededThrowable #3: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=15753, name=Lucene Merge Thread #27, state=RUNNABLE, group=TGRP-OpenCloseCoreStressTest]
[junit4] > Caused by: org.apache.lucene.index.MergePolicy$MergeException: org.apache.lucene.store.AlreadyClosedException: refusing to delete any files: this IndexWriter hit an unrecoverable exception
[junit4] > at __randomizedtesting.SeedInfo.seed([F2D6F15CCEE2DB10]:0)
[junit4] > at org.apache.lucene.index.ConcurrentMergeScheduler.handleMergeException(ConcurrentMergeScheduler.java:668)
[junit4] > at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:648)
[junit4] > Caused by: org.apache.lucene.store.AlreadyClosedException: refusing to delete any files: this IndexWriter hit an unrecoverable exception
[junit4] > at org.apache.lucene.index.IndexFileDeleter.ensureOpen(IndexFileDeleter.java:347)
[junit4] > at org.apache.lucene.index.IndexFileDeleter.deleteFile(IndexFileDeleter.java:731)
[junit4] > at org.apache.lucene.index.IndexFileDeleter.deletePendingFiles(IndexFileDeleter.java:520)
[junit4] > at org.apache.lucene.index.IndexFileDeleter.deleteNewFiles(IndexFileDeleter.java:723)
[junit4] > at org.apache.lucene.index.IndexWriter.deleteNewFiles(IndexWriter.java:4666)
[junit4] > at org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4140)
[junit4] > at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3642)
[junit4] > at org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:588)
[junit4] > at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:626)
[junit4] > Caused by: java.lang.OutOfMemoryError: GC overhead limit exceededThrowable #4: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=15760, name=Lucene Merge Thread #28, state=RUNNABLE, group=TGRP-OpenCloseCoreStressTest]
[junit4] > Caused by: org.apache.lucene.index.MergePolicy$MergeException: java.lang.OutOfMemoryError: GC overhead limit exceeded
[junit4] > at __randomizedtesting.SeedInfo.seed([F2D6F15CCEE2DB10]:0)
[junit4] > at org.apache.lucene.index.ConcurrentMergeScheduler.handleMergeException(ConcurrentMergeScheduler.java:668)
[junit4] > at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:648)
[junit4] > Caused by: java.lang.OutOfMemoryError: GC overhead limit exceededThrowable #5: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=15747, name=qtp2121050119-15747, state=RUNNABLE, group=TGRP-OpenCloseCoreStressTest]
[junit4] > Caused by: java.lang.OutOfMemoryError: GC overhead limit exceededThrowable #6: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=15766, name=Lucene Merge Thread #33, state=RUNNABLE, group=TGRP-OpenCloseCoreStressTest]
[junit4] > Caused by: org.apache.lucene.index.MergePolicy$MergeException: java.lang.IllegalStateException: this writer hit an unrecoverable error; cannot merge
[junit4] > at __randomizedtesting.SeedInfo.seed([F2D6F15CCEE2DB10]:0)
[junit4] > at org.apache.lucene.index.ConcurrentMergeScheduler.handleMergeException(ConcurrentMergeScheduler.java:668)
[junit4] > at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:648)
[junit4] > Caused by: java.lang.IllegalStateException: this writer hit an unrecoverable error; cannot merge
[junit4] > at org.apache.lucene.index.IndexWriter._mergeInit(IndexWriter.java:3799)
[junit4] > at org.apache.lucene.index.IndexWriter.mergeInit(IndexWriter.java:3779)
[junit4] > at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3633)
[junit4] > at org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:588)
[junit4] > at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:626)
[junit4] > Caused by: java.lang.OutOfMemoryError: GC overhead limit exceededThrowable #7: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=15755, name=Lucene Merge Thread #32, state=RUNNABLE, group=TGRP-OpenCloseCoreStressTest]
[junit4] > Caused by: org.apache.lucene.index.MergePolicy$MergeException: java.lang.OutOfMemoryError: GC overhead limit exceeded
[junit4] > at __randomizedtesting.SeedInfo.seed([F2D6F15CCEE2DB10]:0)
[junit4] > at org.apache.lucene.index.ConcurrentMergeScheduler.handleMergeException(ConcurrentMergeScheduler.java:668)
[junit4] > at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:648)
[junit4] > Caused by: java.lang.OutOfMemoryError: GC overhead limit exceeded
[junit4] 2> 1546848 INFO (SUITE-OpenCloseCoreStressTest-seed#[F2D6F15CCEE2DB10]-worker) [ ] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.core.OpenCloseCoreStressTest_F2D6F15CCEE2DB10-001
[junit4] 2> NOTE: test params are: codec=SimpleText, sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=de_CH, timezone=Pacific/Midway
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_66 (64-bit)/cpus=4,threads=1,free=61790640,total=477626368
[junit4] 2> NOTE: All tests run in this JVM: [TestFreeTextSuggestions, TestManagedSynonymFilterFactory, ZkControllerTest, TestSolrDeletionPolicy2, HLLSerializationTest, SolrInfoMBeanTest, SolrIndexSplitterTest, ChaosMonkeySafeLeaderTest, TestFiltering, DistributedIntervalFacetingTest, TestBinaryResponseWriter, InfoHandlerTest, TestCloudManagedSchemaConcurrent, TestSortingResponseWriter, CoreAdminCreateDiscoverTest, TestJsonRequest, TestJettySolrRunner, TestRebalanceLeaders, BitVectorTest, TestTrie, TestWordDelimiterFilterFactory, TestUpdate, TestPerFieldSimilarityWithDefaultOverride, TestSolrCoreProperties, TestLeaderInitiatedRecoveryThread, TestClassicSimilarityFactory, TestManagedSchema, AssignTest, DateRangeFieldTest, TestConfigSetProperties, TestReRankQParserPlugin, TriLevelCompositeIdRoutingTest, TestSolrQueryParserResource, DistributedSuggestComponentTest, DocValuesTest, TestPartialUpdateDeduplication, TestCodecSupport, UpdateRequestProcessorFactoryTest, HdfsCollectionsAPIDistributedZkTest, LoggingHandlerTest, HdfsLockFactoryTest, TestQueryWrapperFilter, OpenExchangeRatesOrgProviderTest, HdfsRecoveryZkTest, AddSchemaFieldsUpdateProcessorFactoryTest, TestLMJelinekMercerSimilarityFactory, TestSha256AuthenticationProvider, SolrCmdDistributorTest, TestSolr4Spatial2, OpenCloseCoreStressTest]
[junit4] Completed [137/571 (1!)] on J1 in 689.93s, 6 tests, 1 error, 1 skipped <<< FAILURES!
[...truncated 1359 lines...]
[junit4] JVM J1: stdout was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/temp/junit4-J1-20151226_123647_584.sysout
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] java.lang.OutOfMemoryError: GC overhead limit exceeded
[junit4] Dumping heap to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/heapdumps/java_pid8059.hprof ...
[junit4] Heap dump file created [443868679 bytes in 6.146 secs]
[junit4] <<< JVM J1: EOF ----
[...truncated 16 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:791: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:728: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1436: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:991: There were test failures: 571 suites (8 ignored), 2276 tests, 1 error, 33 ignored (18 assumptions) [seed: F2D6F15CCEE2DB10]
Total time: 206 minutes 1 second
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 892 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/892/
1 tests failed.
FAILED: org.apache.solr.cloud.hdfs.HdfsRecoveryZkTest.test
Error Message:
Address already in use
Stack Trace:
java.net.BindException: Address already in use
at __randomizedtesting.SeedInfo.seed([B49EC28476BD3CBD:3CCAFD5ED8415145]:0)
at sun.nio.ch.Net.bind0(Native Method)
at sun.nio.ch.Net.bind(Net.java:433)
at sun.nio.ch.Net.bind(Net.java:425)
at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)
at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
at org.eclipse.jetty.server.ServerConnector.open(ServerConnector.java:326)
at org.eclipse.jetty.server.AbstractNetworkConnector.doStart(AbstractNetworkConnector.java:80)
at org.eclipse.jetty.server.ServerConnector.doStart(ServerConnector.java:244)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
at org.eclipse.jetty.server.Server.doStart(Server.java:384)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:412)
at org.apache.solr.cloud.RecoveryZkTest.test(RecoveryZkTest.java:91)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:965)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:940)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 11452 lines...]
[junit4] Suite: org.apache.solr.cloud.hdfs.HdfsRecoveryZkTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_B49EC28476BD3CBD-001/init-core-data-001
[junit4] 2> 3577534 INFO (SUITE-HdfsRecoveryZkTest-seed#[B49EC28476BD3CBD]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
[junit4] 2> 3577534 INFO (SUITE-HdfsRecoveryZkTest-seed#[B49EC28476BD3CBD]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
[junit4] 1> Formatting using clusterid: testClusterID
[junit4] 2> 3577614 WARN (SUITE-HdfsRecoveryZkTest-seed#[B49EC28476BD3CBD]-worker) [ ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
[junit4] 2> 3577619 WARN (SUITE-HdfsRecoveryZkTest-seed#[B49EC28476BD3CBD]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 3577621 INFO (SUITE-HdfsRecoveryZkTest-seed#[B49EC28476BD3CBD]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 3577636 INFO (SUITE-HdfsRecoveryZkTest-seed#[B49EC28476BD3CBD]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_47408_hdfs____.edyanx/webapp
[junit4] 2> 3577747 INFO (SUITE-HdfsRecoveryZkTest-seed#[B49EC28476BD3CBD]-worker) [ ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
[junit4] 2> 3577949 INFO (SUITE-HdfsRecoveryZkTest-seed#[B49EC28476BD3CBD]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:47408
[junit4] 2> 3578090 WARN (SUITE-HdfsRecoveryZkTest-seed#[B49EC28476BD3CBD]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 3578103 INFO (SUITE-HdfsRecoveryZkTest-seed#[B49EC28476BD3CBD]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 3578142 INFO (SUITE-HdfsRecoveryZkTest-seed#[B49EC28476BD3CBD]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_55171_datanode____pvytua/webapp
[junit4] 2> 3578281 INFO (SUITE-HdfsRecoveryZkTest-seed#[B49EC28476BD3CBD]-worker) [ ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
[junit4] 2> 3578623 INFO (SUITE-HdfsRecoveryZkTest-seed#[B49EC28476BD3CBD]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:55171
[junit4] 2> 3578772 WARN (SUITE-HdfsRecoveryZkTest-seed#[B49EC28476BD3CBD]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 3578773 INFO (SUITE-HdfsRecoveryZkTest-seed#[B49EC28476BD3CBD]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 3578839 INFO (SUITE-HdfsRecoveryZkTest-seed#[B49EC28476BD3CBD]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_42039_datanode____.1gxght/webapp
[junit4] 2> 3578884 INFO (IPC Server handler 3 on 52056) [ ] BlockStateChange BLOCK* processReport: from storage DS-8c9de557-5e09-47af-a3c6-686be8aae2ec node DatanodeRegistration(127.0.0.1, datanodeUuid=e0bd79f9-fc78-4cf6-90d6-92b57484246b, infoPort=55171, ipcPort=51787, storageInfo=lv=-56;cid=testClusterID;nsid=1426836081;c=0), blocks: 0, hasStaleStorages: true, processing time: 0 msecs
[junit4] 2> 3578884 INFO (IPC Server handler 3 on 52056) [ ] BlockStateChange BLOCK* processReport: from storage DS-135f82ae-10b6-424f-9c1e-20e1ae53c3eb node DatanodeRegistration(127.0.0.1, datanodeUuid=e0bd79f9-fc78-4cf6-90d6-92b57484246b, infoPort=55171, ipcPort=51787, storageInfo=lv=-56;cid=testClusterID;nsid=1426836081;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
[junit4] 2> 3579180 INFO (SUITE-HdfsRecoveryZkTest-seed#[B49EC28476BD3CBD]-worker) [ ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
[junit4] 2> 3579458 INFO (SUITE-HdfsRecoveryZkTest-seed#[B49EC28476BD3CBD]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42039
[junit4] 2> 3579673 INFO (IPC Server handler 5 on 52056) [ ] BlockStateChange BLOCK* processReport: from storage DS-9ca899b2-5e33-4f0a-92bf-164577124e88 node DatanodeRegistration(127.0.0.1, datanodeUuid=91aa6a45-1d17-4562-831f-b714a2cac565, infoPort=42039, ipcPort=35292, storageInfo=lv=-56;cid=testClusterID;nsid=1426836081;c=0), blocks: 0, hasStaleStorages: true, processing time: 0 msecs
[junit4] 2> 3579674 INFO (IPC Server handler 5 on 52056) [ ] BlockStateChange BLOCK* processReport: from storage DS-4299d711-c066-4898-b227-aefb31f022c0 node DatanodeRegistration(127.0.0.1, datanodeUuid=91aa6a45-1d17-4562-831f-b714a2cac565, infoPort=42039, ipcPort=35292, storageInfo=lv=-56;cid=testClusterID;nsid=1426836081;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
[junit4] 2> 3579890 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 3579891 INFO (Thread-14444) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 3579891 INFO (Thread-14444) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 3579991 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.ZkTestServer start zk server on port:59246
[junit4] 2> 3579992 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 3579993 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 3579998 INFO (zkCallback-2836-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@743e874b name:ZooKeeperConnection Watcher:127.0.0.1:59246 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 3579998 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 3579998 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 3579998 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 3580001 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 3580003 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 3580006 INFO (zkCallback-2837-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@52ce9478 name:ZooKeeperConnection Watcher:127.0.0.1:59246/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 3580006 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 3580006 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 3580006 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
[junit4] 2> 3580010 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
[junit4] 2> 3580015 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
[junit4] 2> 3580017 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
[junit4] 2> 3580034 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 3580035 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 3580038 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 3580039 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
[junit4] 2> 3580041 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 3580041 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 3580049 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 3580049 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
[junit4] 2> 3580077 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 3580078 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
[junit4] 2> 3580097 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 3580097 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
[junit4] 2> 3580104 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 3580104 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 3580106 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 3580106 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 3580108 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 3580108 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 3580109 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 3580109 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 3580111 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 3580111 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
[junit4] 2> 3580927 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_B49EC28476BD3CBD-001/control-001/cores/collection1
[junit4] 2> 3580929 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.e.j.s.Server jetty-9.3.6.v20151106
[junit4] 2> 3580932 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6f5dfe2b{/,null,AVAILABLE}
[junit4] 2> 3580932 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.e.j.s.ServerConnector Started ServerConnector@52602ee0{HTTP/1.1,[http/1.1]}{127.0.0.1:47355}
[junit4] 2> 3580932 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.e.j.s.Server Started @3584136ms
[junit4] 2> 3580932 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:52056/hdfs__localhost_52056__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-trunk_solr_build_solr-core_test_J2_temp_solr.cloud.hdfs.HdfsRecoveryZkTest_B49EC28476BD3CBD-001_tempDir-002_control_data, hostContext=/, hostPort=47355, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_B49EC28476BD3CBD-001/control-001/cores}
[junit4] 2> 3580933 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 3580933 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_B49EC28476BD3CBD-001/control-001'
[junit4] 2> 3580933 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 3580933 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 3580933 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 3580936 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 3580938 INFO (zkCallback-2838-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@17ea5c8d name:ZooKeeperConnection Watcher:127.0.0.1:59246/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 3580938 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 3580939 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 3580940 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 3580940 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_B49EC28476BD3CBD-001/control-001/solr.xml
[junit4] 2> 3580951 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_B49EC28476BD3CBD-001/control-001/cores
[junit4] 2> 3580951 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.CoreContainer New CoreContainer 1305483320
[junit4] 2> 3580952 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_B49EC28476BD3CBD-001/control-001]
[junit4] 2> 3580952 WARN (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_B49EC28476BD3CBD-001/control-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_B49EC28476BD3CBD-001/control-001/lib
[junit4] 2> 3580952 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 3580954 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 3580956 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 3580956 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 3580956 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:59246/solr
[junit4] 2> 3580956 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 3580956 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 3580956 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 3580958 INFO (zkCallback-2841-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@48bc42ea name:ZooKeeperConnection Watcher:127.0.0.1:59246 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 3580958 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 3580958 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 3580960 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [n:127.0.0.1:47355_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 3580961 INFO (zkCallback-2842-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4301550b name:ZooKeeperConnection Watcher:127.0.0.1:59246/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 3580961 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [n:127.0.0.1:47355_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 3580962 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [n:127.0.0.1:47355_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
[junit4] 2> 3580965 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [n:127.0.0.1:47355_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 3580968 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [n:127.0.0.1:47355_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 3580970 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [n:127.0.0.1:47355_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 3580972 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [n:127.0.0.1:47355_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 3580974 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [n:127.0.0.1:47355_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 3580975 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [n:127.0.0.1:47355_ ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 3580976 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [n:127.0.0.1:47355_ ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 3580977 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [n:127.0.0.1:47355_ ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 3580979 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [n:127.0.0.1:47355_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47355_
[junit4] 2> 3580979 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [n:127.0.0.1:47355_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:47355_
[junit4] 2> 3580981 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [n:127.0.0.1:47355_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 3580982 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [n:127.0.0.1:47355_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 3580983 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [n:127.0.0.1:47355_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 3580983 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [n:127.0.0.1:47355_ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95097466067353604-127.0.0.1:47355_-n_0000000000
[junit4] 2> 3580984 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [n:127.0.0.1:47355_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:47355_
[junit4] 2> 3580984 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [n:127.0.0.1:47355_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
[junit4] 2> 3580985 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [n:127.0.0.1:47355_ ] o.a.s.c.Overseer Overseer (id=95097466067353604-127.0.0.1:47355_-n_0000000000) starting
[junit4] 2> 3580990 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [n:127.0.0.1:47355_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
[junit4] 2> 3580998 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [n:127.0.0.1:47355_ ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 3580999 INFO (OverseerCollectionConfigSetProcessor-95097466067353604-127.0.0.1:47355_-n_0000000000) [n:127.0.0.1:47355_ ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
[junit4] 2> 3581000 INFO (OverseerStateUpdate-95097466067353604-127.0.0.1:47355_-n_0000000000) [n:127.0.0.1:47355_ ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 3581001 INFO (OverseerStateUpdate-95097466067353604-127.0.0.1:47355_-n_0000000000) [n:127.0.0.1:47355_ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 3581006 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [n:127.0.0.1:47355_ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 3581030 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [n:127.0.0.1:47355_ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 3581031 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [n:127.0.0.1:47355_ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 3581031 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [n:127.0.0.1:47355_ ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_B49EC28476BD3CBD-001/control-001/cores
[junit4] 2> 3581032 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [n:127.0.0.1:47355_ ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=control_collection, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 3581032 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [n:127.0.0.1:47355_ ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_B49EC28476BD3CBD-001/control-001/cores/collection1
[junit4] 2> 3581033 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [n:127.0.0.1:47355_ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
[junit4] 2> 3581035 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [n:127.0.0.1:47355_ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2
[junit4] 2> 3581035 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [n:127.0.0.1:47355_ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 3581035 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 3581035 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 3581038 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 3581039 INFO (OverseerStateUpdate-95097466067353604-127.0.0.1:47355_-n_0000000000) [n:127.0.0.1:47355_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:47355",
[junit4] 2> "node_name":"127.0.0.1:47355_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 3581039 INFO (OverseerStateUpdate-95097466067353604-127.0.0.1:47355_-n_0000000000) [n:127.0.0.1:47355_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:47355",
[junit4] 2> "node_name":"127.0.0.1:47355_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 3581040 INFO (OverseerStateUpdate-95097466067353604-127.0.0.1:47355_-n_0000000000) [n:127.0.0.1:47355_ ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
[junit4] 2> 3581040 INFO (OverseerStateUpdate-95097466067353604-127.0.0.1:47355_-n_0000000000) [n:127.0.0.1:47355_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 3581042 INFO (zkCallback-2842-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
[junit4] 2> 3581042 INFO (zkCallback-2842-thread-2-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
[junit4] 2> 3582038 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 3582039 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
[junit4] 2> 3582039 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 3582039 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/control_collection]
[junit4] 2> 3582040 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/control_collection] [configName]=[conf1] specified config exists in ZooKeeper
[junit4] 2> 3582040 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_B49EC28476BD3CBD-001/control-001/cores/collection1'
[junit4] 2> 3582040 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 3582040 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 3582042 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 3582048 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 3582052 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 3582062 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection x:collection1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
[junit4] 2> 3582069 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 3582217 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 3582218 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 3582229 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 3582232 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 3582261 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2
[junit4] 2> 3582261 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 3582261 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.HdfsDirectoryFactory
[junit4] 2> 3582261 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:52056/solr_hdfs_home
[junit4] 2> 3582261 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 3582262 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_B49EC28476BD3CBD-001/control-001/cores/collection1], dataDir=[hdfs://localhost:52056/solr_hdfs_home/control_collection/core_node1/data/]
[junit4] 2> 3582262 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@af76dac
[junit4] 2> 3582262 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:52056/solr_hdfs_home/control_collection/core_node1/data
[junit4] 2> 3582280 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for hdfs://localhost:52056/solr_hdfs_home/control_collection/core_node1/data
[junit4] 2> 3582282 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=hdfs://localhost:52056/solr_hdfs_home/control_collection/core_node1/data/index/
[junit4] 2> 3582294 WARN (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory 'hdfs:/localhost:52056/solr_hdfs_home/control_collection/core_node1/data/index' doesn't exist. Creating new index...
[junit4] 2> 3582294 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:52056/solr_hdfs_home/control_collection/core_node1/data/index
[junit4] 2> 3582304 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 3582304 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [16777216] will allocate [1] slabs and use ~[16777216] bytes
[junit4] 2> 3582304 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Creating new single instance HDFS BlockCache
[junit4] 2> 3582319 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 3582321 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for hdfs://localhost:52056/solr_hdfs_home/control_collection/core_node1/data/index
[junit4] 2> 3582321 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=2, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.40380481239202115]
[junit4] 2> 3582372 INFO (IPC Server handler 5 on 52056) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:48975 is added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-135f82ae-10b6-424f-9c1e-20e1ae53c3eb:NORMAL:127.0.0.1:47902|RBW], ReplicaUnderConstruction[[DISK]DS-4299d711-c066-4898-b227-aefb31f022c0:NORMAL:127.0.0.1:48975|FINALIZED]]} size 0
[junit4] 2> 3582378 INFO (IPC Server handler 6 on 52056) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:47902 is added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-135f82ae-10b6-424f-9c1e-20e1ae53c3eb:NORMAL:127.0.0.1:47902|RBW], ReplicaUnderConstruction[[DISK]DS-4299d711-c066-4898-b227-aefb31f022c0:NORMAL:127.0.0.1:48975|FINALIZED]]} size 0
[junit4] 2> 3582380 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=NRTCachingDirectory(BlockDirectory(HdfsDirectory@hdfs://localhost:52056/solr_hdfs_home/control_collection/core_node1/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@78786eaf); maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
[junit4] 2> 3582380 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 3582383 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in hdfs://localhost:52056/solr_hdfs_home/control_collection/core_node1/data/
[junit4] 2> 3582385 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 3582385 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
[junit4] 2> 3582385 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 3582385 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 3582386 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 3582386 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 3582386 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 3582386 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 3582386 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 3582387 WARN (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,args = {defaults={a=A,b=B}}}
[junit4] 2> 3582389 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 3582390 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 3582390 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 3582401 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 3582415 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/dump,/update/csv,/sql,/update/json/docs,/admin/luke,/export,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/stream,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 3582417 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 3582418 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
[junit4] 2> 3582419 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 tlogDfsReplication=2
[junit4] 2> 3582446 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 3582446 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 3582449 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@7667994e
[junit4] 2> 3582463 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=NRTCachingDirectory(BlockDirectory(HdfsDirectory@hdfs://localhost:52056/solr_hdfs_home/control_collection/core_node1/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@78786eaf); maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
[junit4] 2> 3582463 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 3582463 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@4977c8b6[collection1] main
[junit4] 2> 3582463 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/control_collection]
[junit4] 2> 3582464 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/control_collection] [configName]=[conf1] specified config exists in ZooKeeper
[junit4] 2> 3582464 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 3582464 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 3582464 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
[junit4] 2> 3582464 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 3582465 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 3582465 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 3582465 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 3582465 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 3582466 INFO (searcherExecutor-6714-thread-1-processing-n:127.0.0.1:47355_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@4977c8b6[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 3582466 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
[junit4] 2> 3582466 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 256 version buckets from index
[junit4] 2> 3582466 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
[junit4] 2> 3582466 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1521559459775643648
[junit4] 2> 3582466 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 0.0ms to seed version buckets with highest version 1521559459775643648
[junit4] 2> 3582466 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
[junit4] 2> 3582467 INFO (coreLoadExecutor-6713-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 3582467 INFO (coreZkRegister-6707-thread-1-processing-n:127.0.0.1:47355_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:47355 collection:control_collection shard:shard1
[junit4] 2> 3582468 INFO (coreZkRegister-6707-thread-1-processing-n:127.0.0.1:47355_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 3582473 INFO (coreZkRegister-6707-thread-1-processing-n:127.0.0.1:47355_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/95097466067353604-core_node1-n_0000000000
[junit4] 2> 3582474 INFO (coreZkRegister-6707-thread-1-processing-n:127.0.0.1:47355_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard=shard1 and weAreReplacement=false and leaderVoteWait=10000
[junit4] 2> 3582476 INFO (OverseerStateUpdate-95097466067353604-127.0.0.1:47355_-n_0000000000) [n:127.0.0.1:47355_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection"} current state version: 1
[junit4] 2> 3582478 INFO (coreZkRegister-6707-thread-1-processing-n:127.0.0.1:47355_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 3582478 INFO (coreZkRegister-6707-thread-1-processing-n:127.0.0.1:47355_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 3582478 INFO (coreZkRegister-6707-thread-1-processing-n:127.0.0.1:47355_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:47355/collection1/
[junit4] 2> 3582478 INFO (coreZkRegister-6707-thread-1-processing-n:127.0.0.1:47355_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 3582479 INFO (coreZkRegister-6707-thread-1-processing-n:127.0.0.1:47355_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:47355/collection1/ has no replicas
[junit4] 2> 3582479 INFO (coreZkRegister-6707-thread-1-processing-n:127.0.0.1:47355_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 3582481 INFO (coreZkRegister-6707-thread-1-processing-n:127.0.0.1:47355_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
[junit4] 2> 3582483 INFO (OverseerStateUpdate-95097466067353604-127.0.0.1:47355_-n_0000000000) [n:127.0.0.1:47355_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:47355",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 1
[junit4] 2> 3582484 INFO (coreZkRegister-6707-thread-1-processing-n:127.0.0.1:47355_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:47355/collection1/ shard1
[junit4] 2> 3582542 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 3582544 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 3582545 INFO (zkCallback-2844-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@384b08f7 name:ZooKeeperConnection Watcher:127.0.0.1:59246/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 3582545 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 3582545 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 3582545 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 3582547 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 3582585 INFO (zkCallback-2844-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
[junit4] 2> 3582585 INFO (zkCallback-2842-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
[junit4] 2> 3582585 INFO (zkCallback-2842-thread-3-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
[junit4] 2> 3582635 INFO (coreZkRegister-6707-thread-1-processing-n:127.0.0.1:47355_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:47355/collection1/ and leader is http://127.0.0.1:47355/collection1/
[junit4] 2> 3582635 INFO (coreZkRegister-6707-thread-1-processing-n:127.0.0.1:47355_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:47355
[junit4] 2> 3582636 INFO (coreZkRegister-6707-thread-1-processing-n:127.0.0.1:47355_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 3582636 INFO (coreZkRegister-6707-thread-1-processing-n:127.0.0.1:47355_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
[junit4] 2> 3582636 INFO (coreZkRegister-6707-thread-1-processing-n:127.0.0.1:47355_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47355_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 3582637 INFO (OverseerStateUpdate-95097466067353604-127.0.0.1:47355_-n_0000000000) [n:127.0.0.1:47355_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:47355",
[junit4] 2> "node_name":"127.0.0.1:47355_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 2
[junit4] 2> 3582638 INFO (OverseerStateUpdate-95097466067353604-127.0.0.1:47355_-n_0000000000) [n:127.0.0.1:47355_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:47355",
[junit4] 2> "node_name":"127.0.0.1:47355_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 3582742 INFO (zkCallback-2844-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
[junit4] 2> 3582742 INFO (zkCallback-2842-thread-3-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
[junit4] 2> 3582742 INFO (zkCallback-2842-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
[junit4] 2> 3583164 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_B49EC28476BD3CBD-001/shard-1-001/cores/collection1
[junit4] 2> 3583165 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_B49EC28476BD3CBD-001/shard-1-001
[junit4] 2> 3583166 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.e.j.s.Server jetty-9.3.6.v20151106
[junit4] 2> 3583179 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3f6e26ed{/,null,AVAILABLE}
[junit4] 2> 3583180 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.e.j.s.ServerConnector Started ServerConnector@1222a842{HTTP/1.1,[http/1.1]}{127.0.0.1:52423}
[junit4] 2> 3583180 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.e.j.s.Server Started @3586384ms
[junit4] 2> 3583180 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:52056/hdfs__localhost_52056__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-trunk_solr_build_solr-core_test_J2_temp_solr.cloud.hdfs.HdfsRecoveryZkTest_B49EC28476BD3CBD-001_tempDir-002_jetty1, solrconfig=solrconfig.xml, hostContext=/, hostPort=52423, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_B49EC28476BD3CBD-001/shard-1-001/cores}
[junit4] 2> 3583180 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 3583180 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_B49EC28476BD3CBD-001/shard-1-001'
[junit4] 2> 3583180 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 3583181 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 3583181 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 3583185 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 3583192 INFO (zkCallback-2845-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@8304f8e name:ZooKeeperConnection Watcher:127.0.0.1:59246/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 3583192 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 3583192 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 3583199 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 3583200 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_B49EC28476BD3CBD-001/shard-1-001/solr.xml
[junit4] 2> 3583204 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_B49EC28476BD3CBD-001/shard-1-001/cores
[junit4] 2> 3583204 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.CoreContainer New CoreContainer 1120695613
[junit4] 2> 3583205 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_B49EC28476BD3CBD-001/shard-1-001]
[junit4] 2> 3583205 WARN (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_B49EC28476BD3CBD-001/shard-1-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_B49EC28476BD3CBD-001/shard-1-001/lib
[junit4] 2> 3583206 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 3583207 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 3583208 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 3583208 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 3583208 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:59246/solr
[junit4] 2> 3583208 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 3583208 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 3583223 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 3583227 INFO (zkCallback-2848-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1cf3234 name:ZooKeeperConnection Watcher:127.0.0.1:59246 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 3583227 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 3583227 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 3583233 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [n:127.0.0.1:52423_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 3583233 INFO (zkCallback-2849-thread-1-processing-n:127.0.0.1:52423_) [n:127.0.0.1:52423_ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@486f5829 name:ZooKeeperConnection Watcher:127.0.0.1:59246/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 3583234 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [n:127.0.0.1:52423_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 3583240 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [n:127.0.0.1:52423_ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 3584245 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [n:127.0.0.1:52423_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52423_
[junit4] 2> 3584245 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [n:127.0.0.1:52423_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:52423_
[junit4] 2> 3584247 INFO (zkCallback-2849-thread-1-processing-n:127.0.0.1:52423_) [n:127.0.0.1:52423_ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
[junit4] 2> 3584247 INFO (zkCallback-2844-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
[junit4] 2> 3584247 INFO (zkCallback-2842-thread-3-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
[junit4] 2> 3584247 INFO (zkCallback-2842-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
[junit4] 2> 3584248 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [n:127.0.0.1:52423_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 3584248 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [n:127.0.0.1:52423_ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95097466067353608-127.0.0.1:52423_-n_0000000001
[junit4] 2> 3584249 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [n:127.0.0.1:52423_ ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/95097466067353604-127.0.0.1:47355_-n_0000000000 to know if I could be the leader
[junit4] 2> 3584290 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [n:127.0.0.1:52423_ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 3584290 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [n:127.0.0.1:52423_ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 3584291 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [n:127.0.0.1:52423_ ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_B49EC28476BD3CBD-001/shard-1-001/cores
[junit4] 2> 3584292 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [n:127.0.0.1:52423_ ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=collection1, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 3584292 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [n:127.0.0.1:52423_ ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_B49EC28476BD3CBD-001/shard-1-001/cores/collection1
[junit4] 2> 3584292 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [n:127.0.0.1:52423_ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
[junit4] 2> 3584294 INFO (coreLoadExecutor-6724-thread-1-processing-n:127.0.0.1:52423_) [n:127.0.0.1:52423_ c:collection1 x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 3584294 INFO (coreLoadExecutor-6724-thread-1-processing-n:127.0.0.1:52423_) [n:127.0.0.1:52423_ c:collection1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 3584295 INFO (OverseerStateUpdate-95097466067353604-127.0.0.1:47355_-n_0000000000) [n:127.0.0.1:47355_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:52423",
[junit4] 2> "node_name":"127.0.0.1:52423_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"} current state version: 3
[junit4] 2> 3584296 INFO (OverseerStateUpdate-95097466067353604-127.0.0.1:47355_-n_0000000000) [n:127.0.0.1:47355_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:52423",
[junit4] 2> "node_name":"127.0.0.1:52423_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"}
[junit4] 2> 3584297 INFO (OverseerStateUpdate-95097466067353604-127.0.0.1:47355_-n_0000000000) [n:127.0.0.1:47355_ ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
[junit4] 2> 3584297 INFO (OverseerStateUpdate-95097466067353604-127.0.0.1:47355_-n_0000000000) [n:127.0.0.1:47355_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 3584300 INFO (zkCallback-2844-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [2])
[junit4] 2> 3584300 INFO (zkCallback-2842-thread-1-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [2])
[junit4] 2> 3584300 INFO (zkCallback-2842-thread-3-processing-n:127.0.0.1:47355_) [n:127.0.0.1:47355_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [2])
[junit4] 2> 3584301 INFO (zkCallback-2849-thread-1-processing-n:127.0.0.1:52423_) [n:127.0.0.1:52423_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [2])
[junit4] 2> 3584304 INFO (coreLoadExecutor-6724-thread-1-processing-n:127.0.0.1:52423_) [n:127.0.0.1:52423_ c:collection1 x:collection1] o.a.s.c.ZkController Registering watch for collection collection1
[junit4] 2> 3584304 INFO (coreLoadExecutor-6724-thread-1-processing-n:127.0.0.1:52423_) [n:127.0.0.1:52423_ c:collection1 x:collection1] o.a.s.c.c.ZkStateReader addZkWatch [collection1]
[junit4] 2> 3584305 INFO (coreLoadExecutor-6724-thread-1-processing-n:127.0.0.1:52423_) [n:127.0.0.1:52423_ c:collection1 x:collection1] o.a.s.c.c.ZkStateReader Deleting data for [collection1]
[junit4] 2> 3584305 INFO (coreLoadExecutor-6724-thread-1-processing-n:127.0.0.1:52423_) [n:127.0.0.1:52423_ c:collection1 x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 3584305 INFO (coreLoadExecutor-6724-thread-1-processing-n:127.0.0.1:52423_) [n:127.0.0.1:52423_ c:collection1 x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 3584305 INFO (coreLoadExecutor-6724-thread-1-processing-n:127.0.0.1:52423_) [n:127.0.0.1:52423_ c:collection1 x:collection1] o.a.s.c.ZkController Check for collection zkNode:collection1
[junit4] 2> 3584306 INFO (coreLoadExecutor-6724-thread-1-processing-n:127.0.0.1:52423_) [n:127.0.0.1:52423_ c:collection1 x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 3584306 INFO (coreLoadExecutor-6724-thread-1-processing-n:127.0.0.1:52423_) [n:127.0.0.1:52423_ c:collection1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/collection1]
[junit4] 2> 3584307 INFO (coreLoadExecutor-6724-thread-1-processing-n:127.0.0.1:52423_) [n:127.0.0.1:52423_ c:collection1 x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/collection1] [configName]=[conf1] specified config exists in ZooKeeper
[junit4] 2> 3584307 INFO (coreLoadExecutor-6724-thread-1-processing-n:127.0.0.1:52423_) [n:127.0.0.1:52423_ c:collection1 x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_B49EC28476BD3CBD-001/shard-1-001/cores/collection1'
[junit4] 2> 3584307 INFO (coreLoadExecutor-6724-thread-1-processing-n:127.0.0.1:52423_) [n:127.0.0.1:52423_ c:collection1 x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 3584307 INFO (coreLoadExecutor-6724-thread-1-processing-n:127.0.0.1:52423_) [n:127.0.0.1:52423_ c:collection1 x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 3584318 INFO (coreLoadExecutor-6724-thread-1-processing-n:127.0.0.1:52423_) [n:127.0.0.1:52423_ c:collection1 x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 3584327 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [n:127.0.0.1:52423_ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2
[junit4] 2> 3584327 INFO (TEST-HdfsRecoveryZkTest.test-seed#[B49EC28476BD3CBD]) [n:127.0.0.1:52423_ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 3584349 INFO (coreLoadExecutor-6724-thread-1-processing-n:127.0.0.1:52423_) [n:127.0.0.1:52423_ c:collection1 x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 3584356 INFO (coreLoadExecutor-6724-thread-1-processing-n:127.0.0.1:52423_) [n:127.0.0.1:52423_ c:collection1 x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 3584372 INFO (coreLoadExecutor-6724-thread-1-processing-n:127.0.0.1:52423_) [n:127.0.0.1:52423_ c:collection1 x:collection1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
[junit4] 2> 3584379 INFO (coreLoadExecutor-6724-thread-1-processing-n:127.0.0.1:52423_) [n:127.0.0.1:52423_ c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 3584576 INFO (coreLoadExecutor-6724-thread-1-processing-n:127.0.0.1:52423_) [n:127.0.0.1:52423_ c:collection1 x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 3584577 INFO (coreLoadExecutor-6724-thread-1-processing-n:127.0.0.1:52423_) [n:127.0.0.1:52423_ c:collection1 x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 3584579 INFO (coreLoadExecutor-6724-thread-1-processing-n:127.0.0.1:52423_) [n:127.0.0.1:52423_ c:collection1 x:collection1] o.a.s.s.FileExchangeRateProvider
[...truncated too long message...]
unit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stopMBeans(MetricsSourceAdapter.java:227)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stop(MetricsSourceAdapter.java:212)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stopSources(MetricsSystemImpl.java:461)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stop(MetricsSystemImpl.java:212)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.shutdown(MetricsSystemImpl.java:592)
[junit4] 2> at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdownInstance(DefaultMetricsSystem.java:72)
[junit4] 2> at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdown(DefaultMetricsSystem.java:68)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.metrics.NameNodeMetrics.shutdown(NameNodeMetrics.java:145)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.NameNode.stop(NameNode.java:822)
[junit4] 2> at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1720)
[junit4] 2> at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1699)
[junit4] 2> at org.apache.solr.cloud.hdfs.HdfsTestUtil.teardownClass(HdfsTestUtil.java:198)
[junit4] 2> at org.apache.solr.cloud.hdfs.HdfsRecoveryZkTest.teardownClass(HdfsRecoveryZkTest.java:48)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:497)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:834)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> Caused by: java.lang.NullPointerException
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlocksMap.size(BlocksMap.java:198)
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.getTotalBlocks(BlockManager.java:3291)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlocksTotal(FSNamesystem.java:6223)
[junit4] 2> ... 54 more
[junit4] 2> 3601011 INFO (SUITE-HdfsRecoveryZkTest-seed#[B49EC28476BD3CBD]-worker) [n:127.0.0.1:52423_ c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_B49EC28476BD3CBD-001
[junit4] 2> Dec 25, 2015 7:36:36 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 2 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene60): {rnd_b=PostingsFormat(name=MockRandom), _version_=PostingsFormat(name=LuceneFixedGap), a_t=PostingsFormat(name=LuceneFixedGap), a_i=PostingsFormat(name=MockRandom), id=PostingsFormat(name=MockRandom)}, docValues:{}, sim=ClassicSimilarity, locale=da_DK, timezone=Australia/Lindeman
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_66 (64-bit)/cpus=4,threads=2,free=382876096,total=523239424
[junit4] 2> NOTE: All tests run in this JVM: [TestExclusionRuleCollectionAccess, TestSolrDeletionPolicy1, CdcrVersionReplicationTest, TestReload, TestCollapseQParserPlugin, TestManagedResource, RuleEngineTest, OverseerTaskQueueTest, SuggesterTSTTest, HdfsChaosMonkeyNothingIsSafeTest, TestCloudSchemaless, TestSerializedLuceneMatchVersion, TestRawTransformer, TestPostingsSolrHighlighter, RegexBoostProcessorTest, ForceLeaderTest, StatsComponentTest, TestJmxMonitoredMap, TermVectorComponentDistributedTest, TestCloudInspectUtil, TestInfoStreamLogging, TestSearchPerf, VMParamsZkACLAndCredentialsProvidersTest, AtomicUpdatesTest, TestHighFrequencyDictionaryFactory, TestGroupingSearch, ExplicitHLLTest, SuggesterWFSTTest, TestTolerantSearch, TestDistributedMissingSort, TestPKIAuthenticationPlugin, TestPivotHelperCode, TestSortByMinMaxFunction, TestZkChroot, OverseerCollectionConfigSetProcessorTest, LeaderElectionTest, ScriptEngineTest, TestExactSharedStatsCache, BigEndianAscendingWordDeserializerTest, SmileWriterTest, FacetPivotSmallTest, TestNonDefinedSimilarityFactory, SolrCloudExampleTest, TestChildDocTransformer, DistribJoinFromCollectionTest, ShowFileRequestHandlerTest, TestSuggestSpellingConverter, TestElisionMultitermQuery, TestMiniSolrCloudClusterSSL, DeleteInactiveReplicaTest, BlockJoinFacetRandomTest, SimpleFacetsTest, RecoveryZkTest, IgnoreCommitOptimizeUpdateProcessorFactoryTest, TestShortCircuitedRequests, TestFieldCollectionResource, TestFuzzyAnalyzedSuggestions, TestCryptoKeys, TestSolrIndexConfig, HighlighterConfigTest, StatelessScriptUpdateProcessorFactoryTest, TestBlendedInfixSuggestions, LeaderInitiatedRecoveryOnCommitTest, AddBlockUpdateTest, FieldAnalysisRequestHandlerTest, TestIndexSearcher, TestInitQParser, TestJsonFacets, TestReplicaProperties, TestScoreJoinQPNoScore, BadIndexSchemaTest, TestReversedWildcardFilterFactory, TestSolrJ, SuggesterTest, TestRandomMergePolicy, MultiThreadedOCPTest, TestClusterStateMutator, ActionThrottleTest, TestCollationField, TestMiniSolrCloudCluster, SearchHandlerTest, TestRecoveryHdfs, DirectUpdateHandlerTest, AutoCommitTest, DistributedQueryComponentCustomSortTest, TestManagedSchemaFieldTypeResource, TestSchemaResource, DateMathParserTest, BasicAuthIntegrationTest, ClusterStateTest, TestNoOpRegenerator, CursorMarkTest, TestUtils, ChaosMonkeySafeLeaderTest, BasicDistributedZk2Test, UnloadDistributedZkTest, OverseerTest, LeaderElectionIntegrationTest, ShardRoutingTest, BasicZkTest, FullSolrCloudDistribCmdsTest, TestReplicationHandler, CdcrRequestHandlerTest, CloudExitableDirectoryReaderTest, CollectionStateFormat2Test, CollectionTooManyReplicasTest, ConfigSetsAPITest, DeleteLastCustomShardedReplicaTest, DeleteShardTest, DistribCursorPagingTest, DistributedVersionInfoTest, MigrateRouteKeyTest, OverriddenZkACLAndCredentialsProvidersTest, OverseerRolesTest, OverseerStatusTest, RecoveryAfterSoftCommitTest, ReplicationFactorTest, RestartWhileUpdatingTest, HdfsChaosMonkeySafeLeaderTest, HdfsNNFailoverTest, HdfsRecoverLeaseTest, HdfsRecoveryZkTest]
[junit4] Completed [457/571 (1!)] on J2 in 33.43s, 1 test, 1 error <<< FAILURES!
[...truncated 374 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:791: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:728: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1436: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:991: There were test failures: 571 suites (8 ignored), 2276 tests, 1 error, 33 ignored (18 assumptions) [seed: B49EC28476BD3CBD]
Total time: 211 minutes 18 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 891 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/891/
2 tests failed.
FAILED: org.apache.solr.hadoop.MorphlineBasicMiniMRTest.mrRun
Error Message:
Failed on local exception: java.io.IOException: Broken pipe; Host Details : local host is: "lucene1-us-west/10.41.0.5"; destination host is: "lucene1-us-west.apache.org":42772;
Stack Trace:
java.io.IOException: Failed on local exception: java.io.IOException: Broken pipe; Host Details : local host is: "lucene1-us-west/10.41.0.5"; destination host is: "lucene1-us-west.apache.org":42772;
at __randomizedtesting.SeedInfo.seed([EA31E86DB2487895:E4635C63B3DE4A9A]:0)
at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:772)
at org.apache.hadoop.ipc.Client.call(Client.java:1472)
at org.apache.hadoop.ipc.Client.call(Client.java:1399)
at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232)
at com.sun.proxy.$Proxy110.getClusterMetrics(Unknown Source)
at org.apache.hadoop.yarn.api.impl.pb.client.ApplicationClientProtocolPBClientImpl.getClusterMetrics(ApplicationClientProtocolPBClientImpl.java:202)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
at com.sun.proxy.$Proxy111.getClusterMetrics(Unknown Source)
at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.getYarnClusterMetrics(YarnClientImpl.java:461)
at org.apache.hadoop.mapred.ResourceMgrDelegate.getClusterMetrics(ResourceMgrDelegate.java:151)
at org.apache.hadoop.mapred.YARNRunner.getClusterMetrics(YARNRunner.java:179)
at org.apache.hadoop.mapreduce.Cluster.getClusterStatus(Cluster.java:246)
at org.apache.hadoop.mapred.JobClient$3.run(JobClient.java:719)
at org.apache.hadoop.mapred.JobClient$3.run(JobClient.java:717)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.hadoop.mapred.JobClient.getClusterStatus(JobClient.java:717)
at org.apache.solr.hadoop.MapReduceIndexerTool.run(MapReduceIndexerTool.java:645)
at org.apache.solr.hadoop.MapReduceIndexerTool.run(MapReduceIndexerTool.java:608)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.solr.hadoop.MorphlineBasicMiniMRTest.mrRun(MorphlineBasicMiniMRTest.java:363)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: Broken pipe
at sun.nio.ch.FileDispatcherImpl.write0(Native Method)
at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47)
at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)
at sun.nio.ch.IOUtil.write(IOUtil.java:65)
at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:471)
at org.apache.hadoop.net.SocketOutputStream$Writer.performIO(SocketOutputStream.java:63)
at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:142)
at org.apache.hadoop.net.SocketOutputStream.write(SocketOutputStream.java:159)
at org.apache.hadoop.net.SocketOutputStream.write(SocketOutputStream.java:117)
at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140)
at java.io.DataOutputStream.flush(DataOutputStream.java:123)
at org.apache.hadoop.ipc.Client$Connection$3.run(Client.java:1030)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
... 1 more
FAILED: org.apache.solr.hadoop.MorphlineGoLiveMiniMRTest.test
Error Message:
Failed on local exception: java.io.IOException: Connection reset by peer; Host Details : local host is: "lucene1-us-west/10.41.0.5"; destination host is: "lucene1-us-west.apache.org":38493;
Stack Trace:
java.io.IOException: Failed on local exception: java.io.IOException: Connection reset by peer; Host Details : local host is: "lucene1-us-west/10.41.0.5"; destination host is: "lucene1-us-west.apache.org":38493;
at __randomizedtesting.SeedInfo.seed([EA31E86DB2487895:6265D7B71CB4156D]:0)
at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:772)
at org.apache.hadoop.ipc.Client.call(Client.java:1472)
at org.apache.hadoop.ipc.Client.call(Client.java:1399)
at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232)
at com.sun.proxy.$Proxy111.getClusterMetrics(Unknown Source)
at org.apache.hadoop.yarn.api.impl.pb.client.ApplicationClientProtocolPBClientImpl.getClusterMetrics(ApplicationClientProtocolPBClientImpl.java:202)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
at com.sun.proxy.$Proxy112.getClusterMetrics(Unknown Source)
at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.getYarnClusterMetrics(YarnClientImpl.java:461)
at org.apache.hadoop.mapred.ResourceMgrDelegate.getClusterMetrics(ResourceMgrDelegate.java:151)
at org.apache.hadoop.mapred.YARNRunner.getClusterMetrics(YARNRunner.java:179)
at org.apache.hadoop.mapreduce.Cluster.getClusterStatus(Cluster.java:246)
at org.apache.hadoop.mapred.JobClient$3.run(JobClient.java:719)
at org.apache.hadoop.mapred.JobClient$3.run(JobClient.java:717)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.hadoop.mapred.JobClient.getClusterStatus(JobClient.java:717)
at org.apache.solr.hadoop.MapReduceIndexerTool.run(MapReduceIndexerTool.java:645)
at org.apache.solr.hadoop.MapReduceIndexerTool.run(MapReduceIndexerTool.java:608)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.solr.hadoop.MorphlineGoLiveMiniMRTest.test(MorphlineGoLiveMiniMRTest.java:402)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:965)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:940)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: Connection reset by peer
at sun.nio.ch.FileDispatcherImpl.write0(Native Method)
at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47)
at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)
at sun.nio.ch.IOUtil.write(IOUtil.java:65)
at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:471)
at org.apache.hadoop.net.SocketOutputStream$Writer.performIO(SocketOutputStream.java:63)
at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:142)
at org.apache.hadoop.net.SocketOutputStream.write(SocketOutputStream.java:159)
at org.apache.hadoop.net.SocketOutputStream.write(SocketOutputStream.java:117)
at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140)
at java.io.DataOutputStream.flush(DataOutputStream.java:123)
at org.apache.hadoop.ipc.Client$Connection$3.run(Client.java:1030)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
... 1 more
Build Log:
[...truncated 17879 lines...]
[junit4] Suite: org.apache.solr.hadoop.MorphlineBasicMiniMRTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/init-core-data-001
[junit4] 2> 0 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true)
[junit4] 2> 2711 WARN (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.u.NativeCodeLoader Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
[junit4] 1> Formatting using clusterid: testClusterID
[junit4] 2> 2875 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.n.FSNamesystem No KeyProvider found.
[junit4] 2> 2927 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.n.FSNamesystem fsLock is fair:true
[junit4] 2> 3010 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.c.C.deprecation hadoop.configured.node.mapping is deprecated. Instead, use net.topology.configured.node.mapping
[junit4] 2> 3010 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.b.DatanodeManager dfs.block.invalidate.limit=1000
[junit4] 2> 3011 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.b.DatanodeManager dfs.namenode.datanode.registration.ip-hostname-check=true
[junit4] 2> 3014 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.b.BlockManager dfs.namenode.startup.delay.block.deletion.sec is set to 000:00:00:00.000
[junit4] 2> 3019 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.b.BlockManager The block deletion will start around 2015 ديس 24 11:56:58
[junit4] 2> 3023 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.u.GSet Computing capacity for map BlocksMap
[junit4] 2> 3024 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.u.GSet VM type = 64-bit
[junit4] 2> 3026 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.u.GSet 2.0% max memory 455.5 MB = 9.1 MB
[junit4] 2> 3026 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.u.GSet capacity = 2^20 = 1048576 entries
[junit4] 2> 3054 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.b.BlockManager dfs.block.access.token.enable=false
[junit4] 2> 3054 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.b.BlockManager defaultReplication = 2
[junit4] 2> 3055 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.b.BlockManager maxReplication = 512
[junit4] 2> 3055 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.b.BlockManager minReplication = 1
[junit4] 2> 3055 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.b.BlockManager maxReplicationStreams = 2
[junit4] 2> 3055 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.b.BlockManager shouldCheckForEnoughRacks = false
[junit4] 2> 3055 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.b.BlockManager replicationRecheckInterval = 3000
[junit4] 2> 3055 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.b.BlockManager encryptDataTransfer = false
[junit4] 2> 3055 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.b.BlockManager maxNumBlocksToLog = 1000
[junit4] 2> 3065 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.n.FSNamesystem fsOwner = jenkins (auth:SIMPLE)
[junit4] 2> 3066 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.n.FSNamesystem supergroup = supergroup
[junit4] 2> 3066 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.n.FSNamesystem isPermissionEnabled = true
[junit4] 2> 3066 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.n.FSNamesystem HA Enabled: false
[junit4] 2> 3071 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.n.FSNamesystem Append Enabled: true
[junit4] 2> 3546 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.u.GSet Computing capacity for map INodeMap
[junit4] 2> 3547 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.u.GSet VM type = 64-bit
[junit4] 2> 3547 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.u.GSet 1.0% max memory 455.5 MB = 4.6 MB
[junit4] 2> 3547 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.u.GSet capacity = 2^19 = 524288 entries
[junit4] 2> 3549 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.n.NameNode Caching file names occuring more than 10 times
[junit4] 2> 3569 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.u.GSet Computing capacity for map cachedBlocks
[junit4] 2> 3569 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.u.GSet VM type = 64-bit
[junit4] 2> 3569 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.u.GSet 0.25% max memory 455.5 MB = 1.1 MB
[junit4] 2> 3570 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.u.GSet capacity = 2^17 = 131072 entries
[junit4] 2> 3574 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.n.FSNamesystem dfs.namenode.safemode.threshold-pct = 0.9990000128746033
[junit4] 2> 3581 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.n.FSNamesystem dfs.namenode.safemode.min.datanodes = 0
[junit4] 2> 3583 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.n.FSNamesystem dfs.namenode.safemode.extension = 0
[junit4] 2> 3588 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.n.FSNamesystem Retry cache on namenode is enabled
[junit4] 2> 3588 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.n.FSNamesystem Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000 millis
[junit4] 2> 3596 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.u.GSet Computing capacity for map NameNodeRetryCache
[junit4] 2> 3615 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.u.GSet VM type = 64-bit
[junit4] 2> 3615 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.u.GSet 0.029999999329447746% max memory 455.5 MB = 139.9 KB
[junit4] 2> 3615 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.u.GSet capacity = 2^14 = 16384 entries
[junit4] 2> 3627 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.n.NNConf ACLs enabled? false
[junit4] 2> 3627 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.n.NNConf XAttrs enabled? true
[junit4] 2> 3627 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.n.NNConf Maximum size of an xattr: 16384
[junit4] 2> 3875 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.n.FSImage Allocated new BlockPoolId: BP-502400512-10.41.0.5-1450969019025
[junit4] 2> 3913 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/name1 has been successfully formatted.
[junit4] 2> 3917 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/name2 has been successfully formatted.
[junit4] 2> 4329 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.n.NNStorageRetentionManager Going to retain 1 images with txid >= 0
[junit4] 2> 4336 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.n.NameNode createNameNode []
[junit4] 2> 4399 WARN (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
[junit4] 2> 4536 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.m.i.MetricsSystemImpl Scheduled snapshot period at 10 second(s).
[junit4] 2> 4536 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.m.i.MetricsSystemImpl NameNode metrics system started
[junit4] 2> 4539 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.n.NameNode fs.defaultFS is hdfs://127.0.0.1:0
[junit4] 2> 4682 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.DFSUtil Starting Web-server for hdfs at: http://localhost:0
[junit4] 2> 4843 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.m.log Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
[junit4] 2> 4856 WARN (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 4889 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.HttpServer2 Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
[junit4] 2> 4893 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.HttpServer2 Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context hdfs
[junit4] 2> 4893 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.HttpServer2 Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
[junit4] 2> 4893 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.HttpServer2 Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
[junit4] 2> 4963 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.HttpServer2 Added filter 'org.apache.hadoop.hdfs.web.AuthFilter' (class=org.apache.hadoop.hdfs.web.AuthFilter)
[junit4] 2> 4977 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.HttpServer2 addJerseyResourcePackage: packageName=org.apache.hadoop.hdfs.server.namenode.web.resources;org.apache.hadoop.hdfs.web.resources, pathSpec=/webhdfs/v1/*
[junit4] 2> 5035 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.HttpServer2 Jetty bound to port 56203
[junit4] 2> 5035 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 5144 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_56203_hdfs____.pkjvmq/webapp
[junit4] 2> 5393 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
[junit4] 2> 6484 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:56203
[junit4] 2> 6495 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.n.FSNamesystem No KeyProvider found.
[junit4] 2> 6495 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.n.FSNamesystem fsLock is fair:true
[junit4] 2> 6496 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.b.DatanodeManager dfs.block.invalidate.limit=1000
[junit4] 2> 6496 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.b.DatanodeManager dfs.namenode.datanode.registration.ip-hostname-check=true
[junit4] 2> 6496 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.b.BlockManager dfs.namenode.startup.delay.block.deletion.sec is set to 000:00:00:00.000
[junit4] 2> 6496 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.b.BlockManager The block deletion will start around 2015 ديس 24 11:57:01
[junit4] 2> 6497 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.u.GSet Computing capacity for map BlocksMap
[junit4] 2> 6497 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.u.GSet VM type = 64-bit
[junit4] 2> 6497 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.u.GSet 2.0% max memory 455.5 MB = 9.1 MB
[junit4] 2> 6497 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.u.GSet capacity = 2^20 = 1048576 entries
[junit4] 2> 6498 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.b.BlockManager dfs.block.access.token.enable=false
[junit4] 2> 6499 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.b.BlockManager defaultReplication = 2
[junit4] 2> 6499 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.b.BlockManager maxReplication = 512
[junit4] 2> 6499 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.b.BlockManager minReplication = 1
[junit4] 2> 6499 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.b.BlockManager maxReplicationStreams = 2
[junit4] 2> 6499 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.b.BlockManager shouldCheckForEnoughRacks = false
[junit4] 2> 6499 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.b.BlockManager replicationRecheckInterval = 3000
[junit4] 2> 6499 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.b.BlockManager encryptDataTransfer = false
[junit4] 2> 6499 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.b.BlockManager maxNumBlocksToLog = 1000
[junit4] 2> 6499 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.n.FSNamesystem fsOwner = jenkins (auth:SIMPLE)
[junit4] 2> 6499 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.n.FSNamesystem supergroup = supergroup
[junit4] 2> 6500 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.n.FSNamesystem isPermissionEnabled = true
[junit4] 2> 6500 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.n.FSNamesystem HA Enabled: false
[junit4] 2> 6500 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.n.FSNamesystem Append Enabled: true
[junit4] 2> 6500 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.u.GSet Computing capacity for map INodeMap
[junit4] 2> 6501 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.u.GSet VM type = 64-bit
[junit4] 2> 6501 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.u.GSet 1.0% max memory 455.5 MB = 4.6 MB
[junit4] 2> 6501 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.u.GSet capacity = 2^19 = 524288 entries
[junit4] 2> 6501 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.n.NameNode Caching file names occuring more than 10 times
[junit4] 2> 6502 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.u.GSet Computing capacity for map cachedBlocks
[junit4] 2> 6502 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.u.GSet VM type = 64-bit
[junit4] 2> 6502 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.u.GSet 0.25% max memory 455.5 MB = 1.1 MB
[junit4] 2> 6502 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.u.GSet capacity = 2^17 = 131072 entries
[junit4] 2> 6502 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.n.FSNamesystem dfs.namenode.safemode.threshold-pct = 0.9990000128746033
[junit4] 2> 6502 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.n.FSNamesystem dfs.namenode.safemode.min.datanodes = 0
[junit4] 2> 6502 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.n.FSNamesystem dfs.namenode.safemode.extension = 0
[junit4] 2> 6503 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.n.FSNamesystem Retry cache on namenode is enabled
[junit4] 2> 6503 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.n.FSNamesystem Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000 millis
[junit4] 2> 6503 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.u.GSet Computing capacity for map NameNodeRetryCache
[junit4] 2> 6503 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.u.GSet VM type = 64-bit
[junit4] 2> 6503 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.u.GSet 0.029999999329447746% max memory 455.5 MB = 139.9 KB
[junit4] 2> 6503 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.u.GSet capacity = 2^14 = 16384 entries
[junit4] 2> 6505 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.n.NNConf ACLs enabled? false
[junit4] 2> 6505 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.n.NNConf XAttrs enabled? true
[junit4] 2> 6521 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.n.NNConf Maximum size of an xattr: 16384
[junit4] 2> 6529 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.c.Storage Lock on /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/name1/in_use.lock acquired by nodename 5044@lucene1-us-west
[junit4] 2> 6535 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.c.Storage Lock on /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/name2/in_use.lock acquired by nodename 5044@lucene1-us-west
[junit4] 2> 6540 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.n.FileJournalManager Recovering unfinalized segments in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/name1/current
[junit4] 2> 6540 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.n.FileJournalManager Recovering unfinalized segments in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/name2/current
[junit4] 2> 6541 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.n.FSImage No edit log streams selected.
[junit4] 2> 6570 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.n.FSImageFormatPBINode Loading 1 INodes.
[junit4] 2> 6637 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.n.FSImageFormatProtobuf Loaded FSImage in 0 seconds.
[junit4] 2> 6642 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.n.FSImage Loaded image for txid 0 from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/name1/current/fsimage_0000000000000000000
[junit4] 2> 6667 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.n.FSNamesystem Need to save fs image? false (staleImage=false, haEnabled=false, isRollingUpgrade=false)
[junit4] 2> 6668 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.n.FSEditLog Starting log segment at 1
[junit4] 2> 6734 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.n.NameCache initialized with 0 entries 0 lookups
[junit4] 2> 6734 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.n.FSNamesystem Finished loading FSImage in 213 msecs
[junit4] 2> 7237 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.n.NameNode RPC server is binding to localhost:0
[junit4] 2> 7258 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.i.CallQueueManager Using callQueue class java.util.concurrent.LinkedBlockingQueue
[junit4] 2> 7299 INFO (Socket Reader #1 for port 33451) [ ] o.a.h.i.Server Starting Socket Reader #1 for port 33451
[junit4] 2> 7377 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.n.NameNode Clients are to use localhost:33451 to access this namenode/service.
[junit4] 2> 7381 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.n.FSNamesystem Registered FSNamesystemState MBean
[junit4] 2> 7410 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.n.FSNamesystem Number of blocks under construction: 0
[junit4] 2> 7410 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.n.FSNamesystem Number of blocks under construction: 0
[junit4] 2> 7410 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.n.FSNamesystem initializing replication queues
[junit4] 2> 7411 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.StateChange STATE* Leaving safe mode after 0 secs
[junit4] 2> 7411 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.StateChange STATE* Network topology has 0 racks and 0 datanodes
[junit4] 2> 7411 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.StateChange STATE* UnderReplicatedBlocks has 0 blocks
[junit4] 2> 7426 INFO (Replication Queue Initializer) [ ] o.a.h.h.s.b.BlockManager Total number of blocks = 0
[junit4] 2> 7427 INFO (Replication Queue Initializer) [ ] o.a.h.h.s.b.BlockManager Number of invalid blocks = 0
[junit4] 2> 7427 INFO (Replication Queue Initializer) [ ] o.a.h.h.s.b.BlockManager Number of under-replicated blocks = 0
[junit4] 2> 7427 INFO (Replication Queue Initializer) [ ] o.a.h.h.s.b.BlockManager Number of over-replicated blocks = 0
[junit4] 2> 7427 INFO (Replication Queue Initializer) [ ] o.a.h.h.s.b.BlockManager Number of blocks being written = 0
[junit4] 2> 7427 INFO (Replication Queue Initializer) [ ] o.a.h.h.StateChange STATE* Replication Queue initialization scan for invalid, over- and under-replicated blocks completed in 14 msec
[junit4] 2> 7500 INFO (IPC Server Responder) [ ] o.a.h.i.Server IPC Server Responder: starting
[junit4] 2> 7500 INFO (IPC Server listener on 33451) [ ] o.a.h.i.Server IPC Server listener on 33451: starting
[junit4] 2> 7517 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.n.NameNode NameNode RPC up at: localhost/127.0.0.1:33451
[junit4] 2> 7517 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.n.FSNamesystem Starting services required for active state
[junit4] 2> 7536 INFO (CacheReplicationMonitor(163652510)) [ ] o.a.h.h.s.b.CacheReplicationMonitor Starting CacheReplicationMonitor with interval 30000 milliseconds
[junit4] 2> 7537 INFO (CacheReplicationMonitor(163652510)) [ ] o.a.h.h.s.b.CacheReplicationMonitor Rescanning after 19429318122 milliseconds
[junit4] 2> 7541 INFO (CacheReplicationMonitor(163652510)) [ ] o.a.h.h.s.b.CacheReplicationMonitor Scanned 0 directive(s) and 0 block(s) in 4 millisecond(s).
[junit4] 2> 7550 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.MiniDFSCluster Starting DataNode 0 with dfs.datanode.data.dir: [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data1,[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data2
[junit4] 2> 7675 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.m.i.MetricsSystemImpl DataNode metrics system started (again)
[junit4] 2> 7677 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.d.DataNode Configured hostname is 127.0.0.1
[junit4] 2> 7686 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.d.DataNode Starting DataNode with maxLockedMemory = 0
[junit4] 2> 7702 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.d.DataNode Opened streaming server at /127.0.0.1:38280
[junit4] 2> 7708 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.d.DataNode Balancing bandwith is 1048576 bytes/s
[junit4] 2> 7708 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.d.DataNode Number threads for balancing is 5
[junit4] 2> 7728 WARN (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 7729 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.HttpServer2 Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
[junit4] 2> 7730 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.HttpServer2 Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context datanode
[junit4] 2> 7732 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.HttpServer2 Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
[junit4] 2> 7733 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.HttpServer2 Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
[junit4] 2> 7751 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.HttpServer2 addJerseyResourcePackage: packageName=org.apache.hadoop.hdfs.server.datanode.web.resources;org.apache.hadoop.hdfs.web.resources, pathSpec=/webhdfs/v1/*
[junit4] 2> 7764 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.HttpServer2 Jetty bound to port 47447
[junit4] 2> 7764 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 7817 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_47447_datanode____.dn8fd1/webapp
[junit4] 2> 7981 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
[junit4] 2> 8476 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:47447
[junit4] 2> 8489 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.d.DataNode dnUserName = jenkins
[junit4] 2> 8489 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.d.DataNode supergroup = supergroup
[junit4] 2> 8543 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.i.CallQueueManager Using callQueue class java.util.concurrent.LinkedBlockingQueue
[junit4] 2> 8544 INFO (Socket Reader #1 for port 38868) [ ] o.a.h.i.Server Starting Socket Reader #1 for port 38868
[junit4] 2> 8560 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.d.DataNode Opened IPC server at /127.0.0.1:38868
[junit4] 2> 8576 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.d.DataNode Refresh request received for nameservices: null
[junit4] 2> 8581 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.d.DataNode Starting BPOfferServices for nameservices: <default>
[junit4] 2> 8656 INFO (IPC Server Responder) [ ] o.a.h.i.Server IPC Server Responder: starting
[junit4] 2> 8657 INFO (IPC Server listener on 38868) [ ] o.a.h.i.Server IPC Server listener on 38868: starting
[junit4] 2> 8662 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.MiniDFSCluster Starting DataNode 1 with dfs.datanode.data.dir: [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data3,[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data4
[junit4] 2> 8650 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:33451) [ ] o.a.h.h.s.d.DataNode Block pool <registering> (Datanode Uuid unassigned) service to localhost/127.0.0.1:33451 starting to offer service
[junit4] 2> 8803 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.m.i.MetricsSystemImpl DataNode metrics system started (again)
[junit4] 2> 8804 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.d.DataNode Configured hostname is 127.0.0.1
[junit4] 2> 8804 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.d.DataNode Starting DataNode with maxLockedMemory = 0
[junit4] 2> 8805 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.d.DataNode Opened streaming server at /127.0.0.1:34359
[junit4] 2> 8805 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.d.DataNode Balancing bandwith is 1048576 bytes/s
[junit4] 2> 8805 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.d.DataNode Number threads for balancing is 5
[junit4] 2> 8807 WARN (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 8808 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.HttpServer2 Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
[junit4] 2> 8809 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.HttpServer2 Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context datanode
[junit4] 2> 8809 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.HttpServer2 Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
[junit4] 2> 8809 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.HttpServer2 Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
[junit4] 2> 8810 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.HttpServer2 addJerseyResourcePackage: packageName=org.apache.hadoop.hdfs.server.datanode.web.resources;org.apache.hadoop.hdfs.web.resources, pathSpec=/webhdfs/v1/*
[junit4] 2> 8810 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.HttpServer2 Jetty bound to port 52532
[junit4] 2> 8810 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 8843 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_52532_datanode____.xjyneq/webapp
[junit4] 2> 9101 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
[junit4] 2> 9529 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:33451) [ ] o.a.h.h.s.c.Storage DataNode version: -56 and NameNode layout version: -60
[junit4] 2> 9536 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:33451) [ ] o.a.h.h.s.c.Storage Lock on /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data1/in_use.lock acquired by nodename 5044@lucene1-us-west
[junit4] 2> 9539 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:33451) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data1 is not formatted for BP-502400512-10.41.0.5-1450969019025
[junit4] 2> 9539 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:33451) [ ] o.a.h.h.s.c.Storage Formatting ...
[junit4] 2> 9555 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:33451) [ ] o.a.h.h.s.c.Storage Lock on /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data2/in_use.lock acquired by nodename 5044@lucene1-us-west
[junit4] 2> 9556 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:33451) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data2 is not formatted for BP-502400512-10.41.0.5-1450969019025
[junit4] 2> 9557 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:33451) [ ] o.a.h.h.s.c.Storage Formatting ...
[junit4] 2> 9712 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:52532
[junit4] 2> 9719 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.d.DataNode dnUserName = jenkins
[junit4] 2> 9719 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.d.DataNode supergroup = supergroup
[junit4] 2> 9726 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.i.CallQueueManager Using callQueue class java.util.concurrent.LinkedBlockingQueue
[junit4] 2> 9739 INFO (Socket Reader #1 for port 58163) [ ] o.a.h.i.Server Starting Socket Reader #1 for port 58163
[junit4] 2> 9753 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.d.DataNode Opened IPC server at /127.0.0.1:58163
[junit4] 2> 9757 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.d.DataNode Refresh request received for nameservices: null
[junit4] 2> 9757 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[EA31E86DB2487895]-worker) [ ] o.a.h.h.s.d.DataNode Starting BPOfferServices for nameservices: <default>
[junit4] 2> 9770 INFO (IPC Server Responder) [ ] o.a.h.i.Server IPC Server Responder: starting
[junit4] 2> 9780 INFO (IPC Server listener on 58163) [ ] o.a.h.i.Server IPC Server listener on 58163: starting
[junit4] 2> 9787 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:33451) [ ] o.a.h.h.s.d.DataNode Block pool <registering> (Datanode Uuid unassigned) service to localhost/127.0.0.1:33451 starting to offer service
[junit4] 2> 9894 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:33451) [ ] o.a.h.h.s.c.Storage DataNode version: -56 and NameNode layout version: -60
[junit4] 2> 9898 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:33451) [ ] o.a.h.h.s.c.Storage Lock on /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data3/in_use.lock acquired by nodename 5044@lucene1-us-west
[junit4] 2> 9900 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:33451) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data3 is not formatted for BP-502400512-10.41.0.5-1450969019025
[junit4] 2> 9900 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:33451) [ ] o.a.h.h.s.c.Storage Formatting ...
[junit4] 2> 9919 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:33451) [ ] o.a.h.h.s.c.Storage Lock on /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data4/in_use.lock acquired by nodename 5044@lucene1-us-west
[junit4] 2> 9920 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:33451) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data4 is not formatted for BP-502400512-10.41.0.5-1450969019025
[junit4] 2> 9920 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:33451) [ ] o.a.h.h.s.c.Storage Formatting ...
[junit4] 2> 9994 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:33451) [ ] o.a.h.h.s.c.Storage Analyzing storage directories for bpid BP-502400512-10.41.0.5-1450969019025
[junit4] 2> 9994 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:33451) [ ] o.a.h.h.s.c.Storage Locking is disabled
[junit4] 2> 9996 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:33451) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data1/current/BP-502400512-10.41.0.5-1450969019025 is not formatted.
[junit4] 2> 9997 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:33451) [ ] o.a.h.h.s.c.Storage Formatting ...
[junit4] 2> 9997 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:33451) [ ] o.a.h.h.s.c.Storage Formatting block pool BP-502400512-10.41.0.5-1450969019025 directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data1/current/BP-502400512-10.41.0.5-1450969019025/current
[junit4] 2> 10000 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:33451) [ ] o.a.h.h.s.c.Storage Locking is disabled
[junit4] 2> 10001 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:33451) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data2/current/BP-502400512-10.41.0.5-1450969019025 is not formatted.
[junit4] 2> 10001 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:33451) [ ] o.a.h.h.s.c.Storage Formatting ...
[junit4] 2> 10001 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:33451) [ ] o.a.h.h.s.c.Storage Formatting block pool BP-502400512-10.41.0.5-1450969019025 directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data2/current/BP-502400512-10.41.0.5-1450969019025/current
[junit4] 2> 10004 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:33451) [ ] o.a.h.h.s.c.Storage Restored 0 block files from trash.
[junit4] 2> 10004 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:33451) [ ] o.a.h.h.s.c.Storage Restored 0 block files from trash.
[junit4] 2> 10007 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:33451) [ ] o.a.h.h.s.d.DataNode Setting up storage: nsid=562801273;bpid=BP-502400512-10.41.0.5-1450969019025;lv=-56;nsInfo=lv=-60;cid=testClusterID;nsid=562801273;c=0;bpid=BP-502400512-10.41.0.5-1450969019025;dnuuid=null
[junit4] 2> 10010 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:33451) [ ] o.a.h.h.s.d.DataNode Generated and persisted new Datanode UUID 3790fa31-ae7e-477f-ad50-0e740b862f18
[junit4] 2> 10154 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:33451) [ ] o.a.h.h.s.c.Storage Analyzing storage directories for bpid BP-502400512-10.41.0.5-1450969019025
[junit4] 2> 10154 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:33451) [ ] o.a.h.h.s.c.Storage Locking is disabled
[junit4] 2> 10155 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:33451) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data3/current/BP-502400512-10.41.0.5-1450969019025 is not formatted.
[junit4] 2> 10155 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:33451) [ ] o.a.h.h.s.c.Storage Formatting ...
[junit4] 2> 10156 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:33451) [ ] o.a.h.h.s.c.Storage Formatting block pool BP-502400512-10.41.0.5-1450969019025 directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data3/current/BP-502400512-10.41.0.5-1450969019025/current
[junit4] 2> 10162 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:33451) [ ] o.a.h.h.s.c.Storage Locking is disabled
[junit4] 2> 10163 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:33451) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data4/current/BP-502400512-10.41.0.5-1450969019025 is not formatted.
[junit4] 2> 10164 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:33451) [ ] o.a.h.h.s.c.Storage Formatting ...
[junit4] 2> 10164 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:33451) [ ] o.a.h.h.s.c.Storage Formatting block pool BP-502400512-10.41.0.5-1450969019025 directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data4/current/BP-502400512-10.41.0.5-1450969019025/current
[junit4] 2> 10167 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:33451) [ ] o.a.h.h.s.c.Storage Restored 0 block files from trash.
[junit4] 2> 10168 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:33451) [ ] o.a.h.h.s.c.Storage Restored 0 block files from trash.
[junit4] 2> 10169 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:33451) [ ] o.a.h.h.s.d.DataNode Setting up storage: nsid=562801273;bpid=BP-502400512-10.41.0.5-1450969019025;lv=-56;nsInfo=lv=-60;cid=testClusterID;nsid=562801273;c=0;bpid=BP-502400512-10.41.0.5-1450969019025;dnuuid=null
[junit4] 2> 10173 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:33451) [ ] o.a.h.h.s.d.DataNode Generated and persisted new Datanode UUID 7b190681-ab4b-4429-974b-c3fd54ff33fc
[junit4] 2> 10186 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:33451) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Added new volume: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data3/current
[junit4] 2> 10189 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:33451) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Added volume - /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data3/current, StorageType: DISK
[junit4] 2> 10190 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:33451) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Added new volume: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data4/current
[junit4] 2> 10190 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:33451) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Added volume - /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data4/current, StorageType: DISK
[junit4] 2> 10192 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:33451) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Added new volume: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data1/current
[junit4] 2> 10199 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:33451) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Added volume - /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data1/current, StorageType: DISK
[junit4] 2> 10201 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:33451) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Added new volume: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data2/current
[junit4] 2> 10201 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:33451) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Added volume - /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data2/current, StorageType: DISK
[junit4] 2> 10263 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:33451) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Registered FSDatasetState MBean
[junit4] 2> 10266 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_EA31E86DB2487895-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.Morphl
[...truncated too long message...]
ollection1] o.a.h.h.s.n.FSNamesystem Stopping services started for standby state
[junit4] 2> 73218 INFO (SUITE-MorphlineGoLiveMiniMRTest-seed#[EA31E86DB2487895]-worker) [n:127.0.0.1:58920_ c:collection1 s:shard1 r:core_node5 x:collection1] o.m.log Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0
[junit4] 2> 73219 INFO (SUITE-MorphlineGoLiveMiniMRTest-seed#[EA31E86DB2487895]-worker) [n:127.0.0.1:58920_ c:collection1 s:shard1 r:core_node5 x:collection1] o.a.h.m.i.MetricsSystemImpl Stopping JobHistoryServer metrics system...
[junit4] 2> 73222 ERROR (SUITE-MorphlineGoLiveMiniMRTest-seed#[EA31E86DB2487895]-worker) [n:127.0.0.1:58920_ c:collection1 s:shard1 r:core_node5 x:collection1] o.a.h.m.l.MethodMetric Error invoking method getBlocksTotal
[junit4] 2> java.lang.reflect.InvocationTargetException
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:497)
[junit4] 2> at org.apache.hadoop.metrics2.lib.MethodMetric$2.snapshot(MethodMetric.java:111)
[junit4] 2> at org.apache.hadoop.metrics2.lib.MethodMetric.snapshot(MethodMetric.java:144)
[junit4] 2> at org.apache.hadoop.metrics2.lib.MetricsRegistry.snapshot(MetricsRegistry.java:387)
[junit4] 2> at org.apache.hadoop.metrics2.lib.MetricsSourceBuilder$1.getMetrics(MetricsSourceBuilder.java:79)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.getMetrics(MetricsSourceAdapter.java:195)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.updateJmxCache(MetricsSourceAdapter.java:172)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.getMBeanInfo(MetricsSourceAdapter.java:151)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getClassName(DefaultMBeanServerInterceptor.java:1804)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.safeGetClassName(DefaultMBeanServerInterceptor.java:1595)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.checkMBeanPermission(DefaultMBeanServerInterceptor.java:1813)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.exclusiveUnregisterMBean(DefaultMBeanServerInterceptor.java:430)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.unregisterMBean(DefaultMBeanServerInterceptor.java:415)
[junit4] 2> at com.sun.jmx.mbeanserver.JmxMBeanServer.unregisterMBean(JmxMBeanServer.java:546)
[junit4] 2> at org.apache.hadoop.metrics2.util.MBeans.unregister(MBeans.java:81)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stopMBeans(MetricsSourceAdapter.java:227)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stop(MetricsSourceAdapter.java:212)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stopSources(MetricsSystemImpl.java:461)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stop(MetricsSystemImpl.java:212)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.shutdown(MetricsSystemImpl.java:592)
[junit4] 2> at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdownInstance(DefaultMetricsSystem.java:72)
[junit4] 2> at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdown(DefaultMetricsSystem.java:68)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.metrics.NameNodeMetrics.shutdown(NameNodeMetrics.java:145)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.NameNode.stop(NameNode.java:822)
[junit4] 2> at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1720)
[junit4] 2> at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1699)
[junit4] 2> at org.apache.solr.hadoop.MorphlineGoLiveMiniMRTest.teardownClass(MorphlineGoLiveMiniMRTest.java:236)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:497)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:834)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> Caused by: java.lang.NullPointerException
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlocksMap.size(BlocksMap.java:198)
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.getTotalBlocks(BlockManager.java:3291)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlocksTotal(FSNamesystem.java:6223)
[junit4] 2> ... 53 more
[junit4] 2> 73236 INFO (SUITE-MorphlineGoLiveMiniMRTest-seed#[EA31E86DB2487895]-worker) [n:127.0.0.1:58920_ c:collection1 s:shard1 r:core_node5 x:collection1] o.a.h.m.i.MetricsSystemImpl JobHistoryServer metrics system stopped.
[junit4] 2> 73237 INFO (SUITE-MorphlineGoLiveMiniMRTest-seed#[EA31E86DB2487895]-worker) [n:127.0.0.1:58920_ c:collection1 s:shard1 r:core_node5 x:collection1] o.a.h.m.i.MetricsSystemImpl JobHistoryServer metrics system shutdown complete.
[junit4] 2> 73242 INFO (SUITE-MorphlineGoLiveMiniMRTest-seed#[EA31E86DB2487895]-worker) [n:127.0.0.1:58920_ c:collection1 s:shard1 r:core_node5 x:collection1] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J1/temp/solr.hadoop.MorphlineGoLiveMiniMRTest_EA31E86DB2487895-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene60): {}, docValues:{}, sim=ClassicSimilarity, locale=es_ES, timezone=America/Managua
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_66 (64-bit)/cpus=4,threads=8,free=294448864,total=370671616
[junit4] 2> NOTE: All tests run in this JVM: [MorphlineGoLiveMiniMRTest]
[junit4] Completed [7/7 (2!)] on J1 in 74.46s, 2 tests, 1 error <<< FAILURES!
[...truncated 12 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:791: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:728: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:253: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:457: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1436: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:991: There were test failures: 7 suites, 35 tests, 2 errors, 1 ignored [seed: EA31E86DB2487895]
Total time: 221 minutes 38 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 890 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/890/
1 tests failed.
FAILED: org.apache.lucene.search.TestGeoPointQuery.testRandomBig
Error Message:
Java heap space
Stack Trace:
java.lang.OutOfMemoryError: Java heap space
at __randomizedtesting.SeedInfo.seed([BA52D210B88BBB04:3D05AF9F29D2C784]:0)
at org.apache.lucene.util.ArrayUtil.grow(ArrayUtil.java:354)
at org.apache.lucene.codecs.memory.DirectPostingsFormat$DirectField.<init>(DirectPostingsFormat.java:352)
at org.apache.lucene.codecs.memory.DirectPostingsFormat$DirectFields.<init>(DirectPostingsFormat.java:130)
at org.apache.lucene.codecs.memory.DirectPostingsFormat.fieldsProducer(DirectPostingsFormat.java:114)
at org.apache.lucene.codecs.perfield.PerFieldPostingsFormat$FieldsReader.<init>(PerFieldPostingsFormat.java:261)
at org.apache.lucene.codecs.perfield.PerFieldPostingsFormat.fieldsProducer(PerFieldPostingsFormat.java:341)
at org.apache.lucene.index.SegmentCoreReaders.<init>(SegmentCoreReaders.java:106)
at org.apache.lucene.index.SegmentReader.<init>(SegmentReader.java:66)
at org.apache.lucene.index.ReadersAndUpdates.getReader(ReadersAndUpdates.java:145)
at org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4199)
at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3642)
at org.apache.lucene.index.SerialMergeScheduler.merge(SerialMergeScheduler.java:40)
at org.apache.lucene.index.IndexWriter.maybeMerge(IndexWriter.java:1917)
at org.apache.lucene.index.IndexWriter.doAfterSegmentFlushed(IndexWriter.java:4706)
at org.apache.lucene.index.DocumentsWriter$MergePendingEvent.process(DocumentsWriter.java:689)
at org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:4737)
at org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:4728)
at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1464)
at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1242)
at org.apache.lucene.util.BaseGeoPointTestCase.verify(BaseGeoPointTestCase.java:590)
at org.apache.lucene.util.BaseGeoPointTestCase.doTestRandom(BaseGeoPointTestCase.java:411)
at org.apache.lucene.util.BaseGeoPointTestCase.testRandomBig(BaseGeoPointTestCase.java:340)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
Build Log:
[...truncated 8281 lines...]
[junit4] Suite: org.apache.lucene.search.TestGeoPointQuery
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestGeoPointQuery -Dtests.method=testRandomBig -Dtests.seed=BA52D210B88BBB04 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=mk -Dtests.timezone=Atlantic/Madeira -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] ERROR 54.7s J0 | TestGeoPointQuery.testRandomBig <<<
[junit4] > Throwable #1: java.lang.OutOfMemoryError: Java heap space
[junit4] > at __randomizedtesting.SeedInfo.seed([BA52D210B88BBB04:3D05AF9F29D2C784]:0)
[junit4] > at org.apache.lucene.util.ArrayUtil.grow(ArrayUtil.java:354)
[junit4] > at org.apache.lucene.codecs.memory.DirectPostingsFormat$DirectField.<init>(DirectPostingsFormat.java:352)
[junit4] > at org.apache.lucene.codecs.memory.DirectPostingsFormat$DirectFields.<init>(DirectPostingsFormat.java:130)
[junit4] > at org.apache.lucene.codecs.memory.DirectPostingsFormat.fieldsProducer(DirectPostingsFormat.java:114)
[junit4] > at org.apache.lucene.codecs.perfield.PerFieldPostingsFormat$FieldsReader.<init>(PerFieldPostingsFormat.java:261)
[junit4] > at org.apache.lucene.codecs.perfield.PerFieldPostingsFormat.fieldsProducer(PerFieldPostingsFormat.java:341)
[junit4] > at org.apache.lucene.index.SegmentCoreReaders.<init>(SegmentCoreReaders.java:106)
[junit4] > at org.apache.lucene.index.SegmentReader.<init>(SegmentReader.java:66)
[junit4] > at org.apache.lucene.index.ReadersAndUpdates.getReader(ReadersAndUpdates.java:145)
[junit4] > at org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4199)
[junit4] > at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3642)
[junit4] > at org.apache.lucene.index.SerialMergeScheduler.merge(SerialMergeScheduler.java:40)
[junit4] > at org.apache.lucene.index.IndexWriter.maybeMerge(IndexWriter.java:1917)
[junit4] > at org.apache.lucene.index.IndexWriter.doAfterSegmentFlushed(IndexWriter.java:4706)
[junit4] > at org.apache.lucene.index.DocumentsWriter$MergePendingEvent.process(DocumentsWriter.java:689)
[junit4] > at org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:4737)
[junit4] > at org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:4728)
[junit4] > at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1464)
[junit4] > at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1242)
[junit4] > at org.apache.lucene.util.BaseGeoPointTestCase.verify(BaseGeoPointTestCase.java:590)
[junit4] > at org.apache.lucene.util.BaseGeoPointTestCase.doTestRandom(BaseGeoPointTestCase.java:411)
[junit4] > at org.apache.lucene.util.BaseGeoPointTestCase.testRandomBig(BaseGeoPointTestCase.java:340)
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/sandbox/test/J0/temp/lucene.search.TestGeoPointQuery_BA52D210B88BBB04-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene60): {string=PostingsFormat(name=Memory doPackFST= false), id=PostingsFormat(name=Memory doPackFST= false), point=PostingsFormat(name=Direct)}, docValues:{id=DocValuesFormat(name=Asserting), point=DocValuesFormat(name=Lucene54)}, sim=ClassicSimilarity, locale=mk, timezone=Atlantic/Madeira
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_66 (64-bit)/cpus=4,threads=1,free=286203640,total=364904448
[junit4] 2> NOTE: All tests run in this JVM: [TestIDVersionPostingsFormat, TestGeoPointQuery]
[junit4] Completed [12/13 (1!)] on J0 in 176.06s, 23 tests, 1 error <<< FAILURES!
[...truncated 1 lines...]
[junit4] JVM J0: stdout was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/sandbox/test/temp/junit4-J0-20151223_115704_761.sysout
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] java.lang.OutOfMemoryError: Java heap space
[junit4] Dumping heap to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/heapdumps/java_pid10247.hprof ...
[junit4] Heap dump file created [561797381 bytes in 3.482 secs]
[junit4] <<< JVM J0: EOF ----
[...truncated 13 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:791: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:728: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build.xml:472: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:2166: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/module-build.xml:58: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1436: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:991: There were test failures: 13 suites, 97 tests, 1 error [seed: BA52D210B88BBB04]
Total time: 177 minutes 21 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 889 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/889/
123 tests failed.
FAILED: org.apache.solr.client.solrj.SolrExampleBinaryTest.testAugmentFields
Error Message:
IOException occured when talking to server at: http://127.0.0.1:33585/solr/collection1
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:33585/solr/collection1
at __randomizedtesting.SeedInfo.seed([BBFB197EC0553C4B:BFB0BA9C985E3D04]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:590)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:150)
at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:896)
at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:859)
at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:874)
at org.apache.solr.client.solrj.SolrExampleTests.testAugmentFields(SolrExampleTests.java:477)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.SocketException: Connection reset
at java.net.SocketInputStream.read(SocketInputStream.java:209)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:480)
... 46 more
FAILED: org.apache.solr.client.solrj.SolrExampleBinaryTest.testRawFields
Error Message:
IOException occured when talking to server at: http://127.0.0.1:33585/solr/collection1
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:33585/solr/collection1
at __randomizedtesting.SeedInfo.seed([BBFB197EC0553C4B:805BD7A45D42DA56]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:590)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:150)
at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:896)
at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:859)
at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:874)
at org.apache.solr.client.solrj.SolrExampleTests.testRawFields(SolrExampleTests.java:532)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.http.client.ClientProtocolException
at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:886)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:480)
... 46 more
Caused by: org.apache.http.client.NonRepeatableRequestException: Cannot retry request with a non-repeatable request entity. The cause lists the reason the original request failed.
at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:659)
at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
... 50 more
Caused by: java.net.SocketException: Connection reset
at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:113)
at java.net.SocketOutputStream.write(SocketOutputStream.java:153)
at org.apache.http.impl.io.AbstractSessionOutputBuffer.flushBuffer(AbstractSessionOutputBuffer.java:159)
at org.apache.http.impl.io.AbstractSessionOutputBuffer.flush(AbstractSessionOutputBuffer.java:166)
at org.apache.http.impl.io.ChunkedOutputStream.close(ChunkedOutputStream.java:205)
at org.apache.http.impl.entity.EntitySerializer.serialize(EntitySerializer.java:118)
at org.apache.http.impl.AbstractHttpClientConnection.sendRequestEntity(AbstractHttpClientConnection.java:265)
at org.apache.http.impl.conn.ManagedClientConnectionImpl.sendRequestEntity(ManagedClientConnectionImpl.java:203)
at org.apache.http.protocol.HttpRequestExecutor.doSendRequest(HttpRequestExecutor.java:237)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:122)
at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
... 52 more
FAILED: org.apache.solr.client.solrj.SolrExampleBinaryTest.testUpdateRequestWithParameters
Error Message:
IOException occured when talking to server at: http://127.0.0.1:33585/solr/collection1
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:33585/solr/collection1
at __randomizedtesting.SeedInfo.seed([BBFB197EC0553C4B:F98DB7ABEF901C8B]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:590)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:150)
at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:896)
at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:859)
at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:874)
at org.apache.solr.client.solrj.SolrExampleTests.testUpdateRequestWithParameters(SolrExampleTests.java:610)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.SocketException: Connection reset
at java.net.SocketInputStream.read(SocketInputStream.java:209)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:480)
... 46 more
FAILED: org.apache.solr.client.solrj.SolrExampleBinaryTest.testStreamingRequest
Error Message:
IOException occured when talking to server at: http://127.0.0.1:33585/solr/collection1
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:33585/solr/collection1
at __randomizedtesting.SeedInfo.seed([BBFB197EC0553C4B:7C126170E25E9718]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:590)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:150)
at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:896)
at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:859)
at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:874)
at org.apache.solr.client.solrj.SolrExampleTestsBase.testStreamingRequest(SolrExampleTestsBase.java:215)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.SocketException: Connection reset
at java.net.SocketInputStream.read(SocketInputStream.java:209)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:480)
... 46 more
FAILED: org.apache.solr.client.solrj.SolrExampleBinaryTest.testExampleConfig
Error Message:
IOException occured when talking to server at: http://127.0.0.1:33585/solr/collection1
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:33585/solr/collection1
at __randomizedtesting.SeedInfo.seed([BBFB197EC0553C4B:CD60DE60752DA92]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:590)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:150)
at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:896)
at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:859)
at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:874)
at org.apache.solr.client.solrj.SolrExampleTests.testExampleConfig(SolrExampleTests.java:99)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.http.client.ClientProtocolException
at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:886)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:480)
... 46 more
Caused by: org.apache.http.client.NonRepeatableRequestException: Cannot retry request with a non-repeatable request entity. The cause lists the reason the original request failed.
at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:659)
at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
... 50 more
Caused by: java.net.SocketException: Connection reset
at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:113)
at java.net.SocketOutputStream.write(SocketOutputStream.java:153)
at org.apache.http.impl.io.AbstractSessionOutputBuffer.flushBuffer(AbstractSessionOutputBuffer.java:159)
at org.apache.http.impl.io.AbstractSessionOutputBuffer.flush(AbstractSessionOutputBuffer.java:166)
at org.apache.http.impl.io.ChunkedOutputStream.close(ChunkedOutputStream.java:205)
at org.apache.http.impl.entity.EntitySerializer.serialize(EntitySerializer.java:118)
at org.apache.http.impl.AbstractHttpClientConnection.sendRequestEntity(AbstractHttpClientConnection.java:265)
at org.apache.http.impl.conn.ManagedClientConnectionImpl.sendRequestEntity(ManagedClientConnectionImpl.java:203)
at org.apache.http.protocol.HttpRequestExecutor.doSendRequest(HttpRequestExecutor.java:237)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:122)
at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
... 52 more
FAILED: org.apache.solr.client.solrj.SolrExampleBinaryTest.testChildDoctransformer
Error Message:
IOException occured when talking to server at: http://127.0.0.1:33585/solr/collection1
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:33585/solr/collection1
at __randomizedtesting.SeedInfo.seed([BBFB197EC0553C4B:C82106E44C4D4B4D]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:590)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:150)
at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:896)
at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:859)
at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:874)
at org.apache.solr.client.solrj.SolrExampleTests.testChildDoctransformer(SolrExampleTests.java:1756)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.SocketException: Connection reset
at java.net.SocketInputStream.read(SocketInputStream.java:209)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:480)
... 46 more
FAILED: org.apache.solr.client.solrj.SolrExampleBinaryTest.testContentStreamRequest
Error Message:
IOException occured when talking to server at: http://127.0.0.1:33585/solr/collection1
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:33585/solr/collection1
at __randomizedtesting.SeedInfo.seed([BBFB197EC0553C4B:4E55912A21B6DAA6]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:590)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:150)
at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:896)
at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:859)
at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:874)
at org.apache.solr.client.solrj.SolrExampleTests.testContentStreamRequest(SolrExampleTests.java:639)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.http.client.ClientProtocolException
at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:886)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:480)
... 46 more
Caused by: org.apache.http.client.NonRepeatableRequestException: Cannot retry request with a non-repeatable request entity. The cause lists the reason the original request failed.
at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:659)
at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
... 50 more
Caused by: java.net.SocketException: Connection reset
at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:113)
at java.net.SocketOutputStream.write(SocketOutputStream.java:153)
at org.apache.http.impl.io.AbstractSessionOutputBuffer.flushBuffer(AbstractSessionOutputBuffer.java:159)
at org.apache.http.impl.io.AbstractSessionOutputBuffer.flush(AbstractSessionOutputBuffer.java:166)
at org.apache.http.impl.io.ChunkedOutputStream.close(ChunkedOutputStream.java:205)
at org.apache.http.impl.entity.EntitySerializer.serialize(EntitySerializer.java:118)
at org.apache.http.impl.AbstractHttpClientConnection.sendRequestEntity(AbstractHttpClientConnection.java:265)
at org.apache.http.impl.conn.ManagedClientConnectionImpl.sendRequestEntity(ManagedClientConnectionImpl.java:203)
at org.apache.http.protocol.HttpRequestExecutor.doSendRequest(HttpRequestExecutor.java:237)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:122)
at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
... 52 more
FAILED: org.apache.solr.client.solrj.SolrExampleBinaryTest.testFaceting
Error Message:
IOException occured when talking to server at: http://127.0.0.1:33585/solr/collection1
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:33585/solr/collection1
at __randomizedtesting.SeedInfo.seed([BBFB197EC0553C4B:94F7102E37A939AC]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:590)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:150)
at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:896)
at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:859)
at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:874)
at org.apache.solr.client.solrj.SolrExampleTests.testFaceting(SolrExampleTests.java:830)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.SocketException: Connection reset
at java.net.SocketInputStream.read(SocketInputStream.java:209)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:480)
... 46 more
FAILED: org.apache.solr.client.solrj.SolrExampleBinaryTest.testMoreLikeThis
Error Message:
IOException occured when talking to server at: http://127.0.0.1:33585/solr/collection1
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:33585/solr/collection1
at __randomizedtesting.SeedInfo.seed([BBFB197EC0553C4B:9A3B8A40F54B058F]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:590)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:150)
at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:896)
at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:859)
at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:874)
at org.apache.solr.client.solrj.SolrExampleTests.testMoreLikeThis(SolrExampleTests.java:1982)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.SocketException: Connection reset by peer
at java.net.PlainSocketImpl.socketConnect(Native Method)
at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350)
at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
at java.net.Socket.connect(Socket.java:589)
at org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:117)
at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:177)
at org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:304)
at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:611)
at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:446)
at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:480)
... 46 more
FAILED: org.apache.solr.client.solrj.SolrExampleBinaryTest.testUnicode
Error Message:
IOException occured when talking to server at: http://127.0.0.1:33585/solr/collection1
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:33585/solr/collection1
at __randomizedtesting.SeedInfo.seed([BBFB197EC0553C4B:A237AD7462EFEDBC]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:590)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:150)
at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:896)
at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:859)
at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:874)
at org.apache.solr.client.solrj.SolrExampleTests.testUnicode(SolrExampleTests.java:372)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.SocketException: Connection reset by peer
at java.net.PlainSocketImpl.socketConnect(Native Method)
at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350)
at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
at java.net.Socket.connect(Socket.java:589)
at org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:117)
at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:177)
at org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:304)
at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:611)
at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:446)
at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:480)
... 46 more
FAILED: org.apache.solr.client.solrj.SolrExampleBinaryTest.testPivotFacetsStatsNotSupported
Error Message:
IOException occured when talking to server at: http://127.0.0.1:33585/solr/collection1
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:33585/solr/collection1
at __randomizedtesting.SeedInfo.seed([BBFB197EC0553C4B:B76A71992E4F868]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:590)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:150)
at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:896)
at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:859)
at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:874)
at org.apache.solr.client.solrj.SolrExampleTests.testPivotFacetsStatsNotSupported(SolrExampleTests.java:1030)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.SocketException: Connection reset
at java.net.SocketInputStream.read(SocketInputStream.java:209)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:480)
... 46 more
FAILED: org.apache.solr.client.solrj.SolrExampleBinaryTest.testQueryWithParams
Error Message:
IOException occured when talking to server at: http://127.0.0.1:33585/solr/collection1
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:33585/solr/collection1
at __randomizedtesting.SeedInfo.seed([BBFB197EC0553C4B:C01574FD2B6A23DF]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:590)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:150)
at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:943)
at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:958)
at org.apache.solr.client.solrj.SolrExampleTests.testQueryWithParams(SolrExampleTests.java:1745)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.SocketException: Connection reset
at java.net.SocketInputStream.read(SocketInputStream.java:209)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:480)
... 45 more
FAILED: org.apache.solr.client.solrj.SolrExampleBinaryTest.testMultiContentStreamRequest
Error Message:
IOException occured when talking to server at: http://127.0.0.1:33585/solr/collection1
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:33585/solr/collection1
at __randomizedtesting.SeedInfo.seed([BBFB197EC0553C4B:54CF344C9E056442]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:590)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:150)
at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:896)
at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:859)
at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:874)
at org.apache.solr.client.solrj.SolrExampleTests.testMultiContentStreamRequest(SolrExampleTests.java:656)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.http.client.ClientProtocolException
at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:886)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:480)
... 46 more
Caused by: org.apache.http.client.NonRepeatableRequestException: Cannot retry request with a non-repeatable request entity. The cause lists the reason the original request failed.
at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:659)
at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
... 50 more
Caused by: java.net.SocketException: Connection reset
at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:113)
at java.net.SocketOutputStream.write(SocketOutputStream.java:153)
at org.apache.http.impl.io.AbstractSessionOutputBuffer.flushBuffer(AbstractSessionOutputBuffer.java:159)
at org.apache.http.impl.io.AbstractSessionOutputBuffer.flush(AbstractSessionOutputBuffer.java:166)
at org.apache.http.impl.io.ChunkedOutputStream.close(ChunkedOutputStream.java:205)
at org.apache.http.impl.entity.EntitySerializer.serialize(EntitySerializer.java:118)
at org.apache.http.impl.AbstractHttpClientConnection.sendRequestEntity(AbstractHttpClientConnection.java:265)
at org.apache.http.impl.conn.ManagedClientConnectionImpl.sendRequestEntity(ManagedClientConnectionImpl.java:203)
at org.apache.http.protocol.HttpRequestExecutor.doSendRequest(HttpRequestExecutor.java:237)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:122)
at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
... 52 more
FAILED: org.apache.solr.client.solrj.SolrExampleBinaryTest.testErrorHandling
Error Message:
should have thrown a SolrException! not: org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:33585/solr/collection1
Stack Trace:
junit.framework.AssertionFailedError: should have thrown a SolrException! not: org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:33585/solr/collection1
at __randomizedtesting.SeedInfo.seed([BBFB197EC0553C4B:8E0F67409683BD9F]:0)
at junit.framework.Assert.fail(Assert.java:50)
at org.apache.solr.client.solrj.SolrExampleTests.testErrorHandling(SolrExampleTests.java:425)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsea
[...truncated too long message...]
.1:57624_s_%2Fq x:collection1 s:shard1 c:collection1 r:core_node4) [n:127.0.0.1:57624_s_%2Fq c:collection1 s:shard1 r:core_node4 x:collection1] o.a.s.c.CachingDirectoryFactory Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 402747 INFO (recoveryExecutor-115-thread-1-processing-n:127.0.0.1:57624_s_%2Fq x:collection1 s:shard1 c:collection1 r:core_node4) [n:127.0.0.1:57624_s_%2Fq c:collection1 s:shard1 r:core_node4 x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-solrj/test/J2/temp/solr.client.solrj.io.stream.StreamExpressionTest_BBFB197EC0553C4B-001/shard-4-001/cores/collection1/data [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-solrj/test/J2/temp/solr.client.solrj.io.stream.StreamExpressionTest_BBFB197EC0553C4B-001/shard-4-001/cores/collection1/data;done=false>>]
[junit4] 2> 402748 INFO (recoveryExecutor-115-thread-1-processing-n:127.0.0.1:57624_s_%2Fq x:collection1 s:shard1 c:collection1 r:core_node4) [n:127.0.0.1:57624_s_%2Fq c:collection1 s:shard1 r:core_node4 x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-solrj/test/J2/temp/solr.client.solrj.io.stream.StreamExpressionTest_BBFB197EC0553C4B-001/shard-4-001/cores/collection1/data
[junit4] 2> 402748 INFO (recoveryExecutor-115-thread-1-processing-n:127.0.0.1:57624_s_%2Fq x:collection1 s:shard1 c:collection1 r:core_node4) [n:127.0.0.1:57624_s_%2Fq c:collection1 s:shard1 r:core_node4 x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-solrj/test/J2/temp/solr.client.solrj.io.stream.StreamExpressionTest_BBFB197EC0553C4B-001/shard-4-001/cores/collection1/data/index [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-solrj/test/J2/temp/solr.client.solrj.io.stream.StreamExpressionTest_BBFB197EC0553C4B-001/shard-4-001/cores/collection1/data/index;done=false>>]
[junit4] 2> 402748 INFO (recoveryExecutor-115-thread-1-processing-n:127.0.0.1:57624_s_%2Fq x:collection1 s:shard1 c:collection1 r:core_node4) [n:127.0.0.1:57624_s_%2Fq c:collection1 s:shard1 r:core_node4 x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-solrj/test/J2/temp/solr.client.solrj.io.stream.StreamExpressionTest_BBFB197EC0553C4B-001/shard-4-001/cores/collection1/data/index
[junit4] 2> 402748 INFO (TEST-StreamExpressionTest.testAll-seed#[BBFB197EC0553C4B]) [n:127.0.0.1:57624_s_%2Fq c:collection1 s:shard1 r:core_node4 x:collection1] o.a.s.c.Overseer Overseer (id=95078940497608721-127.0.0.1:57624_s_%2Fq-n_0000000004) closing
[junit4] 2> 402748 INFO (OverseerStateUpdate-95078940497608721-127.0.0.1:57624_s_%2Fq-n_0000000004) [n:127.0.0.1:57624_s_%2Fq ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:57624_s_%2Fq
[junit4] 2> 402750 INFO (zkCallback-117-thread-3-processing-n:127.0.0.1:57624_s_%2Fq) [n:127.0.0.1:57624_s_%2Fq ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 402752 WARN (zkCallback-117-thread-3-processing-n:127.0.0.1:57624_s_%2Fq) [n:127.0.0.1:57624_s_%2Fq ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 402761 INFO (TEST-StreamExpressionTest.testAll-seed#[BBFB197EC0553C4B]) [ ] o.e.j.s.ServerConnector Stopped ServerConnector@34ffda5d{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 402762 INFO (TEST-StreamExpressionTest.testAll-seed#[BBFB197EC0553C4B]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@7cac4b57{/s_/q,null,UNAVAILABLE}
[junit4] 2> 402768 INFO (TEST-StreamExpressionTest.testAll-seed#[BBFB197EC0553C4B]) [n:127.0.0.1:57624_s_%2Fq c:collection1 s:shard1 r:core_node4 x:collection1] o.a.s.c.ZkTestServer connecting to 127.0.0.1:48312 48312
[junit4] 2> 402925 INFO (Thread-279) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:48312 48312
[junit4] 2> 402927 WARN (Thread-279) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 6 /solr/aliases.json
[junit4] 2> 5 /solr/security.json
[junit4] 2> 5 /solr/configs/conf1
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 6 /solr/clusterstate.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 6 /solr/live_nodes
[junit4] 2> 6 /solr/collections
[junit4] 2> 5 /solr/overseer/collection-queue-work
[junit4] 2> 4 /solr/overseer/queue
[junit4] 2> 2 /solr/overseer/queue-work
[junit4] 2>
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=StreamExpressionTest -Dtests.method=testAll -Dtests.seed=BBFB197EC0553C4B -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=nl_BE -Dtests.timezone=America/Argentina/Cordoba -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[junit4] FAILURE 353s J2 | StreamExpressionTest.testAll <<<
[junit4] > Throwable #1: java.lang.AssertionError: There are still nodes recoverying - waited for 330 seconds
[junit4] > at __randomizedtesting.SeedInfo.seed([BBFB197EC0553C4B:F7A53707BBC5638E]:0)
[junit4] > at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:175)
[junit4] > at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:136)
[junit4] > at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:131)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:825)
[junit4] > at org.apache.solr.client.solrj.io.stream.StreamExpressionTest.testAll(StreamExpressionTest.java:122)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:965)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:940)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 402931 INFO (SUITE-StreamExpressionTest-seed#[BBFB197EC0553C4B]-worker) [n:127.0.0.1:57624_s_%2Fq c:collection1 s:shard1 r:core_node4 x:collection1] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-solrj/test/J2/temp/solr.client.solrj.io.stream.StreamExpressionTest_BBFB197EC0553C4B-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene60), sim=RandomSimilarityProvider(queryNorm=true,coord=yes): {}, locale=nl_BE, timezone=America/Argentina/Cordoba
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_66 (64-bit)/cpus=4,threads=1,free=203881776,total=331350016
[junit4] 2> NOTE: All tests run in this JVM: [JettyWebappTest, SolrExampleXMLTest, FacetFieldTest, SolrParamTest, ClientUtilsTest, SolrExceptionTest, StreamExpressionParserTest, NoOpResponseParserTest, ModifiableSolrParamsTest, TestJavaBinCodec, SolrPingTest, SolrExampleBinaryTest, ExternalHttpClientTest, SolrExampleJettyTest, LargeVolumeBinaryJettyTest, TestBatchUpdate, LargeVolumeEmbeddedTest, LargeVolumeJettyTest, TermsResponseTest, MergeIndexesEmbeddedTest, QueryResponseTest, TestCoreAdmin, TestNamedListCodec, TestDocumentObjectBinder, TestHash, ContentStreamTest, TestFastInputStream, TestUpdateRequestCodec, AnlysisResponseBaseTest, SolrSchemalessExampleTest, CloudSolrClientMultiConstructorTest, ConcurrentUpdateSolrClientTest, TestCloudSolrClientConnections, JdbcDriverTest, JdbcTest, StreamExpressionTest]
[junit4] Completed [72/72 (14!)] on J2 in 352.74s, 1 test, 1 failure <<< FAILURES!
[...truncated 20 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:791: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:728: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:246: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1436: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:991: There were test failures: 72 suites, 496 tests, 117 errors, 6 failures, 6 ignored (6 assumptions) [seed: BBFB197EC0553C4B]
Total time: 213 minutes 8 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 888 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/888/
22 tests failed.
FAILED: org.apache.solr.cloud.CdcrRequestHandlerTest.testCheckpointActions
Error Message:
The collection (tmp_collection) is still present - waited for 15 seconds
Stack Trace:
java.lang.AssertionError: The collection (tmp_collection) is still present - waited for 15 seconds
at __randomizedtesting.SeedInfo.seed([555E655157030D89:D19496F2E71BE200]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForCollectionToDisappear(AbstractDistribZkTestBase.java:207)
at org.apache.solr.cloud.BaseCdcrDistributedZkTest.waitForCollectionToDisappear(BaseCdcrDistributedZkTest.java:490)
at org.apache.solr.cloud.BaseCdcrDistributedZkTest.startServers(BaseCdcrDistributedZkTest.java:590)
at org.apache.solr.cloud.BaseCdcrDistributedZkTest.createSourceCollection(BaseCdcrDistributedZkTest.java:340)
at org.apache.solr.cloud.BaseCdcrDistributedZkTest.baseBefore(BaseCdcrDistributedZkTest.java:162)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:905)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:965)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:940)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.CdcrRequestHandlerTest.testBufferActions
Error Message:
The collection (tmp_collection) is still present - waited for 15 seconds
Stack Trace:
java.lang.AssertionError: The collection (tmp_collection) is still present - waited for 15 seconds
at __randomizedtesting.SeedInfo.seed([555E655157030D89:C5883ADE91977983]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForCollectionToDisappear(AbstractDistribZkTestBase.java:207)
at org.apache.solr.cloud.BaseCdcrDistributedZkTest.waitForCollectionToDisappear(BaseCdcrDistributedZkTest.java:490)
at org.apache.solr.cloud.BaseCdcrDistributedZkTest.startServers(BaseCdcrDistributedZkTest.java:590)
at org.apache.solr.cloud.BaseCdcrDistributedZkTest.createSourceCollection(BaseCdcrDistributedZkTest.java:340)
at org.apache.solr.cloud.BaseCdcrDistributedZkTest.baseBefore(BaseCdcrDistributedZkTest.java:162)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:905)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:965)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:940)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.CdcrRequestHandlerTest.testLifeCycleActions
Error Message:
The collection (tmp_collection) is still present - waited for 15 seconds
Stack Trace:
java.lang.AssertionError: The collection (tmp_collection) is still present - waited for 15 seconds
at __randomizedtesting.SeedInfo.seed([555E655157030D89:26963798F005132]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForCollectionToDisappear(AbstractDistribZkTestBase.java:207)
at org.apache.solr.cloud.BaseCdcrDistributedZkTest.waitForCollectionToDisappear(BaseCdcrDistributedZkTest.java:490)
at org.apache.solr.cloud.BaseCdcrDistributedZkTest.startServers(BaseCdcrDistributedZkTest.java:590)
at org.apache.solr.cloud.BaseCdcrDistributedZkTest.createSourceCollection(BaseCdcrDistributedZkTest.java:340)
at org.apache.solr.cloud.BaseCdcrDistributedZkTest.baseBefore(BaseCdcrDistributedZkTest.java:162)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:905)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:965)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:940)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.DeleteReplicaTest.deleteLiveReplicaTest
Error Message:
No live SolrServers available to handle this request:[http://127.0.0.1:55994/u_lgw, http://127.0.0.1:39421/u_lgw, http://127.0.0.1:47437/u_lgw, http://127.0.0.1:39748/u_lgw, http://127.0.0.1:44389/u_lgw]
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:55994/u_lgw, http://127.0.0.1:39421/u_lgw, http://127.0.0.1:47437/u_lgw, http://127.0.0.1:39748/u_lgw, http://127.0.0.1:44389/u_lgw]
at __randomizedtesting.SeedInfo.seed([555E655157030D89:F83ED15A4A3CA5FC]:0)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:352)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:871)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:807)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1574)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1528)
at org.apache.solr.cloud.DeleteReplicaTest.createCollection(DeleteReplicaTest.java:172)
at org.apache.solr.cloud.DeleteReplicaTest.deleteLiveReplicaTest(DeleteReplicaTest.java:71)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:965)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:940)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:47437/u_lgw
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:590)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
... 49 more
Caused by: java.net.SocketException: Connection reset
at java.net.SocketInputStream.read(SocketInputStream.java:209)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:480)
... 53 more
FAILED: org.apache.solr.cloud.DistribDocExpirationUpdateProcessorTest.test
Error Message:
IOException occured when talking to server at: http://127.0.0.1:39581/mam/d/collection1
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:39581/mam/d/collection1
at __randomizedtesting.SeedInfo.seed([555E655157030D89:DD0A5A8BF9FF6071]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:590)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:150)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:167)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.indexDoc(AbstractFullDistribZkTestBase.java:750)
at org.apache.solr.cloud.DistribDocExpirationUpdateProcessorTest.test(DistribDocExpirationUpdateProcessorTest.java:70)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:965)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:940)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.http.client.ClientProtocolException
at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:886)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:480)
... 47 more
Caused by: org.apache.http.client.NonRepeatableRequestException: Cannot retry request with a non-repeatable request entity. The cause lists the reason the original request failed.
at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:659)
at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
... 51 more
Caused by: java.net.SocketException: Connection reset
at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:113)
at java.net.SocketOutputStream.write(SocketOutputStream.java:153)
at org.apache.http.impl.io.AbstractSessionOutputBuffer.flushBuffer(AbstractSessionOutputBuffer.java:159)
at org.apache.http.impl.io.AbstractSessionOutputBuffer.flush(AbstractSessionOutputBuffer.java:166)
at org.apache.http.impl.io.ChunkedOutputStream.close(ChunkedOutputStream.java:205)
at org.apache.http.impl.entity.EntitySerializer.serialize(EntitySerializer.java:118)
at org.apache.http.impl.AbstractHttpClientConnection.sendRequestEntity(AbstractHttpClientConnection.java:265)
at org.apache.http.impl.conn.ManagedClientConnectionImpl.sendRequestEntity(ManagedClientConnectionImpl.java:203)
at org.apache.http.protocol.HttpRequestExecutor.doSendRequest(HttpRequestExecutor.java:237)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:122)
at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
... 53 more
FAILED: org.apache.solr.cloud.DistributedVersionInfoTest.test
Error Message:
Test abandoned because suite timeout was reached.
Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
at __randomizedtesting.SeedInfo.seed([555E655157030D89]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.DistributedVersionInfoTest
Error Message:
Suite timeout exceeded (>= 7200000 msec).
Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
at __randomizedtesting.SeedInfo.seed([555E655157030D89]:0)
FAILED: org.apache.solr.cloud.TestRequestStatusCollectionAPI.test
Error Message:
Task 1000 not found in completed tasks. expected:<found 1000 in completed tasks> but was:<null>
Stack Trace:
java.lang.AssertionError: Task 1000 not found in completed tasks. expected:<found 1000 in completed tasks> but was:<null>
at __randomizedtesting.SeedInfo.seed([555E655157030D89:DD0A5A8BF9FF6071]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.apache.solr.cloud.TestRequestStatusCollectionAPI.test(TestRequestStatusCollectionAPI.java:74)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:965)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:940)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest.test
Error Message:
shard1 is not consistent. Got 873 from http://127.0.0.1:36310/collection1 (previous client) and got 843 from http://127.0.0.1:58251/collection1
Stack Trace:
java.lang.AssertionError: shard1 is not consistent. Got 873 from http://127.0.0.1:36310/collection1 (previous client) and got 843 from http://127.0.0.1:58251/collection1
at __randomizedtesting.SeedInfo.seed([555E655157030D89:DD0A5A8BF9FF6071]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1246)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1225)
at org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.test(ChaosMonkeySafeLeaderTest.java:174)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:965)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:940)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.core.OpenCloseCoreStressTest.test10MinutesOld
Error Message:
Core 00000_core bad! expected:<392> but was:<0>
Stack Trace:
java.lang.AssertionError: Core 00000_core bad! expected:<392> but was:<0>
at __randomizedtesting.SeedInfo.seed([555E655157030D89:97763E87CBD48B0D]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.apache.solr.core.OpenCloseCoreStressTest.checkResults(OpenCloseCoreStressTest.java:298)
at org.apache.solr.core.OpenCloseCoreStressTest.doStress(OpenCloseCoreStressTest.java:197)
at org.apache.solr.core.OpenCloseCoreStressTest.test10MinutesOld(OpenCloseCoreStressTest.java:129)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.core.OpenCloseCoreStressTest.test15SecondsNew
Error Message:
Core 00000_core bad! expected:<22> but was:<0>
Stack Trace:
java.lang.AssertionError: Core 00000_core bad! expected:<22> but was:<0>
at __randomizedtesting.SeedInfo.seed([555E655157030D89:D9A37DD1D56CA999]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.apache.solr.core.OpenCloseCoreStressTest.checkResults(OpenCloseCoreStressTest.java:298)
at org.apache.solr.core.OpenCloseCoreStressTest.doStress(OpenCloseCoreStressTest.java:197)
at org.apache.solr.core.OpenCloseCoreStressTest.test15SecondsNew(OpenCloseCoreStressTest.java:123)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.core.OpenCloseCoreStressTest.test10MinutesNew
Error Message:
Core 00000_core bad! expected:<344> but was:<0>
Stack Trace:
java.lang.AssertionError: Core 00000_core bad! expected:<344> but was:<0>
at __randomizedtesting.SeedInfo.seed([555E655157030D89:6F7BDD7025CDE73D]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.apache.solr.core.OpenCloseCoreStressTest.checkResults(OpenCloseCoreStressTest.java:298)
at org.apache.solr.core.OpenCloseCoreStressTest.doStress(OpenCloseCoreStressTest.java:197)
at org.apache.solr.core.OpenCloseCoreStressTest.test10MinutesNew(OpenCloseCoreStressTest.java:135)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.core.OpenCloseCoreStressTest.test15SecondsOld
Error Message:
Core 00000_core bad! expected:<19> but was:<0>
Stack Trace:
java.lang.AssertionError: Core 00000_core bad! expected:<19> but was:<0>
at __randomizedtesting.SeedInfo.seed([555E655157030D89:EF42185D99697796]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.apache.solr.core.OpenCloseCoreStressTest.checkResults(OpenCloseCoreStressTest.java:298)
at org.apache.solr.core.OpenCloseCoreStressTest.doStress(OpenCloseCoreStressTest.java:197)
at org.apache.solr.core.OpenCloseCoreStressTest.test15SecondsOld(OpenCloseCoreStressTest.java:117)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.core.OpenCloseCoreStressTest.test5Seconds
Error Message:
Core 00000_core bad! expected:<5> but was:<0>
Stack Trace:
java.lang.AssertionError: Core 00000_core bad! expected:<5> but was:<0>
at __randomizedtesting.SeedInfo.seed([555E655157030D89:B3713514366DAB1D]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.apache.solr.core.OpenCloseCoreStressTest.checkResults(OpenCloseCoreStressTest.java:298)
at org.apache.solr.core.OpenCloseCoreStressTest.doStress(OpenCloseCoreStressTest.java:197)
at org.apache.solr.core.OpenCloseCoreStressTest.test5Seconds(OpenCloseCoreStressTest.java:111)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
FAILED: junit.framework.TestSuite.org.apache.solr.handler.TestReplicationHandler
Error Message:
ObjectTracker found 1 object(s) that were not released!!! [NRTCachingDirectory]
Stack Trace:
java.lang.AssertionError: ObjectTracker found 1 object(s) that were not released!!! [NRTCachingDirectory]
at __randomizedtesting.SeedInfo.seed([555E655157030D89]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNull(Assert.java:551)
at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:229)
at sun.reflect.GeneratedMethodAccessor52.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:834)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.handler.component.DistributedFacetPivotWhiteBoxTest.test
Error Message:
IOException occured when talking to server at: http://127.0.0.1:49945//collection1
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:49945//collection1
at __randomizedtesting.SeedInfo.seed([555E655157030D89:DD0A5A8BF9FF6071]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:590)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:150)
at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:896)
at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:859)
at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:874)
at org.apache.solr.BaseDistributedSearchTestCase.del(BaseDistributedSearchTestCase.java:545)
at org.apache.solr.handler.component.DistributedFacetPivotWhiteBoxTest.test(DistributedFacetPivotWhiteBoxTest.java:35)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:965)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:940)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.SocketException: Connection reset
at java.net.SocketInputStream.read(SocketInputStream.java:209)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:480)
... 49 more
FAILED: org.apache.solr.handler.component.DistributedMLTComponentTest.test
Error Message:
IOException occured when talking to server at: http://127.0.0.1:53690/gm/q/collection1
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:53690/gm/q/collection1
at __randomizedtesting.SeedInfo.seed([555E655157030D89:DD0A5A8BF9FF6071]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:590)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:150)
at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:896)
at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:859)
at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:874)
at org.apache.solr.BaseDistributedSearchTestCase.del(BaseDistributedSearchTestCase.java:545)
at org.apache.solr.handler.component.DistributedMLTComponentTest.test(DistributedMLTComponentTest.java:58)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:965)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:940)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.SocketException: Connection reset
at java.net.SocketInputStream.read(SocketInputStream.java:209)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:480)
... 49 more
FAILED: org.apache.solr.handler.component.DistributedTermsComponentTest.test
Error Message:
IOException occured when talking to server at: http://127.0.0.1:56549//collection1
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:56549//collection1
at __randomizedtesting.SeedInfo.seed([555E655157030D89:DD0A5A8BF9FF6071]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:590)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:150)
at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:896)
at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:859)
at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:874)
at org.apache.solr.BaseDistributedSearchTestCase.del(BaseDistributedSearchTestCase.java:545)
at org.apache.solr.handler.component.DistributedTermsComponentTest.test(DistributedTermsComponentTest.java:33)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsRepeatStatement.callStatement(BaseDistributedSearchTestCase.java:991)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:940)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.http.client.ClientProtocolException
at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:886)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:480)
... 49 more
Caused by: org.apache.http.client.NonRepeatableRequestException: Cannot retry request with a non-repeatable request entity. The cause lists the reason the original request failed.
at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:659)
at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
... 53 more
Caused by: java.net.SocketException: Connection reset
at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:113)
at java.net.SocketOutputStream.write(SocketOutputStream.java:153)
at org.apache.http.impl.io.AbstractSessionOutputBuffer.flushBuffer(AbstractSessionOutputBuffer.java:159)
at org.apache.http.impl.io.AbstractSessionOutputBuffer.flush(AbstractSessionOutputBuffer.java:166)
at org.apache.http.impl.io.ChunkedOutputStream.close(ChunkedOutputStream.java:205)
at org.apache.http.impl.entity.EntitySerializer.serialize(EntitySerializer.java:118)
at org.apache.http.impl.AbstractHttpClientConnection.sendRequestEntity(AbstractHttpClientConnection.java:265)
at org.apache.http.impl.conn.ManagedClientConnectionImpl.sendRequestEntity(ManagedClientConnectionImpl.java:203)
at org.apache.http.protocol.HttpRequestExecutor.doSendRequest(HttpRequestExecutor.java:237)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:122)
at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
... 55 more
FAILED: org.apache.solr.rest.schema.TestSchemaNameResource.testGetSchemaName
Error Message:
Exception during query
Stack Trace:
java.lang.RuntimeException: Exception during query
at __randomizedtesting.SeedInfo.seed([555E655157030D89:3BDD951CCE15F556]:0)
at org.apache.solr.util.RestTestBase.assertQ(RestTestBase.java:155)
at org.apache.solr.rest.schema.TestSchemaNameResource.testGetSchemaName(TestSchemaNameResource.java:25)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAft
[...truncated too long message...]
nit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 13) Thread[id=2603, name=qtp1455027619-2603, state=RUNNABLE, group=TGRP-DistributedVersionInfoTest]
[junit4] 2> at sun.nio.ch.EPollArrayWrapper.interrupt(Native Method)
[junit4] 2> at sun.nio.ch.EPollArrayWrapper.interrupt(EPollArrayWrapper.java:317)
[junit4] 2> at sun.nio.ch.EPollSelectorImpl.wakeup(EPollSelectorImpl.java:193)
[junit4] 2> at java.nio.channels.spi.AbstractSelector$1.interrupt(AbstractSelector.java:213)
[junit4] 2> at java.nio.channels.spi.AbstractSelector.begin(AbstractSelector.java:219)
[junit4] 2> at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:78)
[junit4] 2> at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
[junit4] 2> at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
[junit4] 2> at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
[junit4] 2> at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:232)
[junit4] 2> at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:180)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceAndRun(ExecuteProduceConsume.java:162)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.execute(ExecuteProduceConsume.java:101)
[junit4] 2> at org.eclipse.jetty.io.ManagedSelector.run(ManagedSelector.java:136)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:654)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 14) Thread[id=2665, name=updateExecutor-393-thread-1, state=TIMED_WAITING, group=TGRP-DistributedVersionInfoTest]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] 2> at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] 2> at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] 2> at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 15) Thread[id=2604, name=qtp1455027619-2604, state=RUNNABLE, group=TGRP-DistributedVersionInfoTest]
[junit4] 2> at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
[junit4] 2> at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
[junit4] 2> at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
[junit4] 2> at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
[junit4] 2> at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
[junit4] 2> at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
[junit4] 2> at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:232)
[junit4] 2> at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:180)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceAndRun(ExecuteProduceConsume.java:162)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.execute(ExecuteProduceConsume.java:101)
[junit4] 2> at org.eclipse.jetty.io.ManagedSelector.run(ManagedSelector.java:136)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:654)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene60): {}, docValues:{}, sim=ClassicSimilarity, locale=fr_CH, timezone=Pacific/Nauru
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_66 (64-bit)/cpus=4,threads=29,free=107272952,total=389545984
[junit4] 2> NOTE: All tests run in this JVM: [SolrPluginUtilsTest, TestQueryWrapperFilter, PreAnalyzedUpdateProcessorTest, OverriddenZkACLAndCredentialsProvidersTest, CdcrRequestHandlerTest, TestFiltering, DeleteReplicaTest, SortByFunctionTest, TestStressVersions, OpenCloseCoreStressTest, DocExpirationUpdateProcessorFactoryTest, TimeZoneUtilsTest, InfoHandlerTest, TestSha256AuthenticationProvider, DistribDocExpirationUpdateProcessorTest, DistributedMLTComponentTest, CachingDirectoryFactoryTest, DistributedFacetPivotWhiteBoxTest, ConvertedLegacyTest, TestFastLRUCache, TestSchemaNameResource, SpellCheckCollatorTest, TestRequestStatusCollectionAPI, DistributedTermsComponentTest, ZkStateWriterTest, TestManagedSynonymFilterFactory, TestCloudManagedSchemaConcurrent, TestPartialUpdateDeduplication, TestSearcherReuse, AssignTest, TestQueryTypes, NumericFieldsTest, DistributedVersionInfoTest]
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=DistributedVersionInfoTest -Dtests.seed=555E655157030D89 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=fr_CH -Dtests.timezone=Pacific/Nauru -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] ERROR 0.00s J1 | DistributedVersionInfoTest (suite) <<<
[junit4] > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
[junit4] > at __randomizedtesting.SeedInfo.seed([555E655157030D89]:0)
[junit4] Completed [507/568 (14!)] on J1 in 7223.65s, 1 test, 2 errors <<< FAILURES!
[...truncated 200 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:791: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:728: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1436: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:991: There were test failures: 568 suites (8 ignored), 2263 tests, 2 suite-level errors, 10 errors, 10 failures, 182 ignored (14 assumptions) [seed: 555E655157030D89]
Total time: 261 minutes 36 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Re: [JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 887 - Still Failing
Posted by Mark Miller <ma...@gmail.com>.
For the Collections API test fail, we probably want to either raise the
session timeout or raise the session timeout for nightly runs.
On Sun, Dec 20, 2015 at 7:27 AM Apache Jenkins Server <
jenkins@builds.apache.org> wrote:
> Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/887/
>
> 2 tests failed.
> FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test
>
> Error Message:
> Captured an uncaught exception in thread: Thread[id=15169,
> name=collection5, state=RUNNABLE,
> group=TGRP-CollectionsAPIDistributedZkTest]
>
> Stack Trace:
> com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an
> uncaught exception in thread: Thread[id=15169, name=collection5,
> state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
> Caused by: java.lang.RuntimeException:
> org.apache.solr.client.solrj.SolrServerException: No live SolrServers
> available to handle this request:[http://127.0.0.1:42569/hi/jf,
> http://127.0.0.1:58154/hi/jf, http://127.0.0.1:59250/hi/jf,
> http://127.0.0.1:57798/hi/jf, http://127.0.0.1:36779/hi/jf]
> at __randomizedtesting.SeedInfo.seed([D2C9FCE857647949]:0)
> at
> org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:891)
> Caused by: org.apache.solr.client.solrj.SolrServerException: No live
> SolrServers available to handle this request:[http://127.0.0.1:42569/hi/jf,
> http://127.0.0.1:58154/hi/jf, http://127.0.0.1:59250/hi/jf,
> http://127.0.0.1:57798/hi/jf, http://127.0.0.1:36779/hi/jf]
> at
> org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:352)
> at
> org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
> at
> org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:871)
> at
> org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:807)
> at
> org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
> at
> org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1574)
> at
> org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1595)
> at
> org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:881)
> Caused by:
> org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error
> from server at http://127.0.0.1:57798/hi/jf: KeeperErrorCode = Session
> expired for /overseer/collection-queue-work/qnr-
> at
> org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575)
> at
> org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
> at
> org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
> at
> org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
> at
> org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
> ... 7 more
>
>
> FAILED:
> org.apache.solr.handler.TestReplicationHandler.doTestReplicateAfterCoreReload
>
> Error Message:
> expected:<[{indexVersion=1450611181635,generation=2,filelist=[_1mu.cfe,
> _1mu.cfs, _1mu.si, _38v.cfe, _38v.cfs, _38v.si, _42o.doc, _42o.fdt,
> _42o.fdx, _42o.fnm, _42o.nvd, _42o.nvm, _42o.si, _42o.tim, _42o.tip,
> _42p.cfe, _42p.cfs, _42p.si, _42q.doc, _42q.fdt, _42q.fdx, _42q.fnm,
> _42q.nvd, _42q.nvm, _42q.si, _42q.tim, _42q.tip, _42r.doc, _42r.fdt,
> _42r.fdx, _42r.fnm, _42r.nvd, _42r.nvm, _42r.si, _42r.tim, _42r.tip,
> _42s.doc, _42s.fdt, _42s.fdx, _42s.fnm, _42s.nvd, _42s.nvm, _42s.si,
> _42s.tim, _42s.tip, _42t.doc, _42t.fdt, _42t.fdx, _42t.fnm, _42t.nvd,
> _42t.nvm, _42t.si, _42t.tim, _42t.tip, _42u.doc, _42u.fdt, _42u.fdx,
> _42u.fnm, _42u.nvd, _42u.nvm, _42u.si, _42u.tim, _42u.tip, _42v.doc,
> _42v.fdt, _42v.fdx, _42v.fnm, _42v.nvd, _42v.nvm, _42v.si, _42v.tim,
> _42v.tip, _42w.doc, _42w.fdt, _42w.fdx, _42w.fnm, _42w.nvd, _42w.nvm, _
> 42w.si, _42w.tim, _42w.tip, _42x.doc, _42x.fdt, _42x.fdx, _42x.fnm,
> _42x.nvd, _42x.nvm, _42x.si, _42x.tim, _42x.tip, _42y.doc, _42y.fdt,
> _42y.fdx, _42y.fnm, _42y.nvd, _42y.nvm, _42y.si, _42y.tim, _42y.tip,
> _42z.doc, _42z.fdt, _42z.fdx, _42z.fnm, _42z.nvd, _42z.nvm, _42z.si,
> _42z.tim, _42z.tip, _430.doc, _430.fdt, _430.fdx, _430.fnm, _430.nvd,
> _430.nvm, _430.si, _430.tim, _430.tip, _431.doc, _431.fdt, _431.fdx,
> _431.fnm, _431.nvd, _431.nvm, _431.si, _431.tim, _431.tip, _432.doc,
> _432.fdt, _432.fdx, _432.fnm, _432.nvd, _432.nvm, _432.si, _432.tim,
> _432.tip, _433.doc, _433.fdt, _433.fdx, _433.fnm, _433.nvd, _433.nvm, _
> 433.si, _433.tim, _433.tip, _434.doc, _434.fdt, _434.fdx, _434.fnm,
> _434.nvd, _434.nvm, _434.si, _434.tim, _434.tip, _435.doc, _435.fdt,
> _435.fdx, _435.fnm, _435.nvd, _435.nvm, _435.si, _435.tim, _435.tip,
> _436.doc, _436.fdt, _436.fdx, _436.fnm, _436.nvd, _436.nvm, _436.si,
> _436.tim, _436.tip, _437.doc, _437.fdt, _437.fdx, _437.fnm, _437.nvd,
> _437.nvm, _437.si, _437.tim, _437.tip, _438.doc, _438.fdt, _438.fdx,
> _438.fnm, _438.nvd, _438.nvm, _438.si, _438.tim, _438.tip, _439.doc,
> _439.fdt, _439.fdx, _439.fnm, _439.nvd, _439.nvm, _439.si, _439.tim,
> _439.tip, _43a.doc, _43a.fdt, _43a.fdx, _43a.fnm, _43a.nvd, _43a.nvm, _
> 43a.si, _43a.tim, _43a.tip, _43b.doc, _43b.fdt, _43b.fdx, _43b.fnm,
> _43b.nvd, _43b.nvm, _43b.si, _43b.tim, _43b.tip, _43c.doc, _43c.fdt,
> _43c.fdx, _43c.fnm, _43c.nvd, _43c.nvm, _43c.si, _43c.tim, _43c.tip,
> _43d.doc, _43d.fdt, _43d.fdx, _43d.fnm, _43d.nvd, _43d.nvm, _43d.si,
> _43d.tim, _43d.tip, _43e.doc, _43e.fdt, _43e.fdx, _43e.fnm, _43e.nvd,
> _43e.nvm, _43e.si, _43e.tim, _43e.tip, _43f.doc, _43f.fdt, _43f.fdx,
> _43f.fnm, _43f.nvd, _43f.nvm, _43f.si, _43f.tim, _43f.tip, _43g.doc,
> _43g.fdt, _43g.fdx, _43g.fnm, _43g.nvd, _43g.nvm, _43g.si, _43g.tim,
> _43g.tip, _43h.doc, _43h.fdt, _43h.fdx, _43h.fnm, _43h.nvd, _43h.nvm, _
> 43h.si, _43h.tim, _43h.tip, _43j.doc, _43j.fdt, _43j.fdx, _43j.fnm,
> _43j.nvd, _43j.nvm, _43j.si, _43j.tim, _43j.tip, segments_2]}]> but
> was:<[{indexVersion=1450611181635,generation=2,filelist=[_1mu.cfe,
> _1mu.cfs, _1mu.si, _38v.cfe, _38v.cfs, _38v.si, _42o.doc, _42o.fdt,
> _42o.fdx, _42o.fnm, _42o.nvd, _42o.nvm, _42o.si, _42o.tim, _42o.tip,
> _42p.cfe, _42p.cfs, _42p.si, _42q.doc, _42q.fdt, _42q.fdx, _42q.fnm,
> _42q.nvd, _42q.nvm, _42q.si, _42q.tim, _42q.tip, _42r.doc, _42r.fdt,
> _42r.fdx, _42r.fnm, _42r.nvd, _42r.nvm, _42r.si, _42r.tim, _42r.tip,
> _42s.doc, _42s.fdt, _42s.fdx, _42s.fnm, _42s.nvd, _42s.nvm, _42s.si,
> _42s.tim, _42s.tip, _42t.doc, _42t.fdt, _42t.fdx, _42t.fnm, _42t.nvd,
> _42t.nvm, _42t.si, _42t.tim, _42t.tip, _42u.doc, _42u.fdt, _42u.fdx,
> _42u.fnm, _42u.nvd, _42u.nvm, _42u.si, _42u.tim, _42u.tip, _42v.doc,
> _42v.fdt, _42v.fdx, _42v.fnm, _42v.nvd, _42v.nvm, _42v.si, _42v.tim,
> _42v.tip, _42w.doc, _42w.fdt, _42w.fdx, _42w.fnm, _42w.nvd, _42w.nvm, _
> 42w.si, _42w.tim, _42w.tip, _42x.doc, _42x.fdt, _42x.fdx, _42x.fnm,
> _42x.nvd, _42x.nvm, _42x.si, _42x.tim, _42x.tip, _42y.doc, _42y.fdt,
> _42y.fdx, _42y.fnm, _42y.nvd, _42y.nvm, _42y.si, _42y.tim, _42y.tip,
> _42z.doc, _42z.fdt, _42z.fdx, _42z.fnm, _42z.nvd, _42z.nvm, _42z.si,
> _42z.tim, _42z.tip, _430.doc, _430.fdt, _430.fdx, _430.fnm, _430.nvd,
> _430.nvm, _430.si, _430.tim, _430.tip, _431.doc, _431.fdt, _431.fdx,
> _431.fnm, _431.nvd, _431.nvm, _431.si, _431.tim, _431.tip, _432.doc,
> _432.fdt, _432.fdx, _432.fnm, _432.nvd, _432.nvm, _432.si, _432.tim,
> _432.tip, _433.doc, _433.fdt, _433.fdx, _433.fnm, _433.nvd, _433.nvm, _
> 433.si, _433.tim, _433.tip, _434.doc, _434.fdt, _434.fdx, _434.fnm,
> _434.nvd, _434.nvm, _434.si, _434.tim, _434.tip, _435.doc, _435.fdt,
> _435.fdx, _435.fnm, _435.nvd, _435.nvm, _435.si, _435.tim, _435.tip,
> _436.doc, _436.fdt, _436.fdx, _436.fnm, _436.nvd, _436.nvm, _436.si,
> _436.tim, _436.tip, _437.doc, _437.fdt, _437.fdx, _437.fnm, _437.nvd,
> _437.nvm, _437.si, _437.tim, _437.tip, _438.doc, _438.fdt, _438.fdx,
> _438.fnm, _438.nvd, _438.nvm, _438.si, _438.tim, _438.tip, _439.doc,
> _439.fdt, _439.fdx, _439.fnm, _439.nvd, _439.nvm, _439.si, _439.tim,
> _439.tip, _43a.doc, _43a.fdt, _43a.fdx, _43a.fnm, _43a.nvd, _43a.nvm, _
> 43a.si, _43a.tim, _43a.tip, _43b.doc, _43b.fdt, _43b.fdx, _43b.fnm,
> _43b.nvd, _43b.nvm, _43b.si, _43b.tim, _43b.tip, _43c.doc, _43c.fdt,
> _43c.fdx, _43c.fnm, _43c.nvd, _43c.nvm, _43c.si, _43c.tim, _43c.tip,
> _43d.doc, _43d.fdt, _43d.fdx, _43d.fnm, _43d.nvd, _43d.nvm, _43d.si,
> _43d.tim, _43d.tip, _43e.doc, _43e.fdt, _43e.fdx, _43e.fnm, _43e.nvd,
> _43e.nvm, _43e.si, _43e.tim, _43e.tip, _43f.doc, _43f.fdt, _43f.fdx,
> _43f.fnm, _43f.nvd, _43f.nvm, _43f.si, _43f.tim, _43f.tip, _43g.doc,
> _43g.fdt, _43g.fdx, _43g.fnm, _43g.nvd, _43g.nvm, _43g.si, _43g.tim,
> _43g.tip, _43h.doc, _43h.fdt, _43h.fdx, _43h.fnm, _43h.nvd, _43h.nvm, _
> 43h.si, _43h.tim, _43h.tip, _43j.doc, _43j.fdt, _43j.fdx, _43j.fnm,
> _43j.nvd, _43j.nvm, _43j.si, _43j.tim, _43j.tip, segments_2]},
> {indexVersion=1450611181635,generation=3,filelist=[_1mu.cfe, _1mu.cfs, _
> 1mu.si, _38v.cfe, _38v.cfs, _38v.si, _43h.doc, _43h.fdt, _43h.fdx,
> _43h.fnm, _43h.nvd, _43h.nvm, _43h.si, _43h.tim, _43h.tip, _43i.cfe,
> _43i.cfs, _43i.si, _43j.doc, _43j.fdt, _43j.fdx, _43j.fnm, _43j.nvd,
> _43j.nvm, _43j.si, _43j.tim, _43j.tip, segments_3]}]>
>
> Stack Trace:
> java.lang.AssertionError:
> expected:<[{indexVersion=1450611181635,generation=2,filelist=[_1mu.cfe,
> _1mu.cfs, _1mu.si, _38v.cfe, _38v.cfs, _38v.si, _42o.doc, _42o.fdt,
> _42o.fdx, _42o.fnm, _42o.nvd, _42o.nvm, _42o.si, _42o.tim, _42o.tip,
> _42p.cfe, _42p.cfs, _42p.si, _42q.doc, _42q.fdt, _42q.fdx, _42q.fnm,
> _42q.nvd, _42q.nvm, _42q.si, _42q.tim, _42q.tip, _42r.doc, _42r.fdt,
> _42r.fdx, _42r.fnm, _42r.nvd, _42r.nvm, _42r.si, _42r.tim, _42r.tip,
> _42s.doc, _42s.fdt, _42s.fdx, _42s.fnm, _42s.nvd, _42s.nvm, _42s.si,
> _42s.tim, _42s.tip, _42t.doc, _42t.fdt, _42t.fdx, _42t.fnm, _42t.nvd,
> _42t.nvm, _42t.si, _42t.tim, _42t.tip, _42u.doc, _42u.fdt, _42u.fdx,
> _42u.fnm, _42u.nvd, _42u.nvm, _42u.si, _42u.tim, _42u.tip, _42v.doc,
> _42v.fdt, _42v.fdx, _42v.fnm, _42v.nvd, _42v.nvm, _42v.si, _42v.tim,
> _42v.tip, _42w.doc, _42w.fdt, _42w.fdx, _42w.fnm, _42w.nvd, _42w.nvm, _
> 42w.si, _42w.tim, _42w.tip, _42x.doc, _42x.fdt, _42x.fdx, _42x.fnm,
> _42x.nvd, _42x.nvm, _42x.si, _42x.tim, _42x.tip, _42y.doc, _42y.fdt,
> _42y.fdx, _42y.fnm, _42y.nvd, _42y.nvm, _42y.si, _42y.tim, _42y.tip,
> _42z.doc, _42z.fdt, _42z.fdx, _42z.fnm, _42z.nvd, _42z.nvm, _42z.si,
> _42z.tim, _42z.tip, _430.doc, _430.fdt, _430.fdx, _430.fnm, _430.nvd,
> _430.nvm, _430.si, _430.tim, _430.tip, _431.doc, _431.fdt, _431.fdx,
> _431.fnm, _431.nvd, _431.nvm, _431.si, _431.tim, _431.tip, _432.doc,
> _432.fdt, _432.fdx, _432.fnm, _432.nvd, _432.nvm, _432.si, _432.tim,
> _432.tip, _433.doc, _433.fdt, _433.fdx, _433.fnm, _433.nvd, _433.nvm, _
> 433.si, _433.tim, _433.tip, _434.doc, _434.fdt, _434.fdx, _434.fnm,
> _434.nvd, _434.nvm, _434.si, _434.tim, _434.tip, _435.doc, _435.fdt,
> _435.fdx, _435.fnm, _435.nvd, _435.nvm, _435.si, _435.tim, _435.tip,
> _436.doc, _436.fdt, _436.fdx, _436.fnm, _436.nvd, _436.nvm, _436.si,
> _436.tim, _436.tip, _437.doc, _437.fdt, _437.fdx, _437.fnm, _437.nvd,
> _437.nvm, _437.si, _437.tim, _437.tip, _438.doc, _438.fdt, _438.fdx,
> _438.fnm, _438.nvd, _438.nvm, _438.si, _438.tim, _438.tip, _439.doc,
> _439.fdt, _439.fdx, _439.fnm, _439.nvd, _439.nvm, _439.si, _439.tim,
> _439.tip, _43a.doc, _43a.fdt, _43a.fdx, _43a.fnm, _43a.nvd, _43a.nvm, _
> 43a.si, _43a.tim, _43a.tip, _43b.doc, _43b.fdt, _43b.fdx, _43b.fnm,
> _43b.nvd, _43b.nvm, _43b.si, _43b.tim, _43b.tip, _43c.doc, _43c.fdt,
> _43c.fdx, _43c.fnm, _43c.nvd, _43c.nvm, _43c.si, _43c.tim, _43c.tip,
> _43d.doc, _43d.fdt, _43d.fdx, _43d.fnm, _43d.nvd, _43d.nvm, _43d.si,
> _43d.tim, _43d.tip, _43e.doc, _43e.fdt, _43e.fdx, _43e.fnm, _43e.nvd,
> _43e.nvm, _43e.si, _43e.tim, _43e.tip, _43f.doc, _43f.fdt, _43f.fdx,
> _43f.fnm, _43f.nvd, _43f.nvm, _43f.si, _43f.tim, _43f.tip, _43g.doc,
> _43g.fdt, _43g.fdx, _43g.fnm, _43g.nvd, _43g.nvm, _43g.si, _43g.tim,
> _43g.tip, _43h.doc, _43h.fdt, _43h.fdx, _43h.fnm, _43h.nvd, _43h.nvm, _
> 43h.si, _43h.tim, _43h.tip, _43j.doc, _43j.fdt, _43j.fdx, _43j.fnm,
> _43j.nvd, _43j.nvm, _43j.si, _43j.tim, _43j.tip, segments_2]}]> but
> was:<[{indexVersion=1450611181635,generation=2,filelist=[_1mu.cfe,
> _1mu.cfs, _1mu.si, _38v.cfe, _38v.cfs, _38v.si, _42o.doc, _42o.fdt,
> _42o.fdx, _42o.fnm, _42o.nvd, _42o.nvm, _42o.si, _42o.tim, _42o.tip,
> _42p.cfe, _42p.cfs, _42p.si, _42q.doc, _42q.fdt, _42q.fdx, _42q.fnm,
> _42q.nvd, _42q.nvm, _42q.si, _42q.tim, _42q.tip, _42r.doc, _42r.fdt,
> _42r.fdx, _42r.fnm, _42r.nvd, _42r.nvm, _42r.si, _42r.tim, _42r.tip,
> _42s.doc, _42s.fdt, _42s.fdx, _42s.fnm, _42s.nvd, _42s.nvm, _42s.si,
> _42s.tim, _42s.tip, _42t.doc, _42t.fdt, _42t.fdx, _42t.fnm, _42t.nvd,
> _42t.nvm, _42t.si, _42t.tim, _42t.tip, _42u.doc, _42u.fdt, _42u.fdx,
> _42u.fnm, _42u.nvd, _42u.nvm, _42u.si, _42u.tim, _42u.tip, _42v.doc,
> _42v.fdt, _42v.fdx, _42v.fnm, _42v.nvd, _42v.nvm, _42v.si, _42v.tim,
> _42v.tip, _42w.doc, _42w.fdt, _42w.fdx, _42w.fnm, _42w.nvd, _42w.nvm, _
> 42w.si, _42w.tim, _42w.tip, _42x.doc, _42x.fdt, _42x.fdx, _42x.fnm,
> _42x.nvd, _42x.nvm, _42x.si, _42x.tim, _42x.tip, _42y.doc, _42y.fdt,
> _42y.fdx, _42y.fnm, _42y.nvd, _42y.nvm, _42y.si, _42y.tim, _42y.tip,
> _42z.doc, _42z.fdt, _42z.fdx, _42z.fnm, _42z.nvd, _42z.nvm, _42z.si,
> _42z.tim, _42z.tip, _430.doc, _430.fdt, _430.fdx, _430.fnm, _430.nvd,
> _430.nvm, _430.si, _430.tim, _430.tip, _431.doc, _431.fdt, _431.fdx,
> _431.fnm, _431.nvd, _431.nvm, _431.si, _431.tim, _431.tip, _432.doc,
> _432.fdt, _432.fdx, _432.fnm, _432.nvd, _432.nvm, _432.si, _432.tim,
> _432.tip, _433.doc, _433.fdt, _433.fdx, _433.fnm, _433.nvd, _433.nvm, _
> 433.si, _433.tim, _433.tip, _434.doc, _434.fdt, _434.fdx, _434.fnm,
> _434.nvd, _434.nvm, _434.si, _434.tim, _434.tip, _435.doc, _435.fdt,
> _435.fdx, _435.fnm, _435.nvd, _435.nvm, _435.si, _435.tim, _435.tip,
> _436.doc, _436.fdt, _436.fdx, _436.fnm, _436.nvd, _436.nvm, _436.si,
> _436.tim, _436.tip, _437.doc, _437.fdt, _437.fdx, _437.fnm, _437.nvd,
> _437.nvm, _437.si, _437.tim, _437.tip, _438.doc, _438.fdt, _438.fdx,
> _438.fnm, _438.nvd, _438.nvm, _438.si, _438.tim, _438.tip, _439.doc,
> _439.fdt, _439.fdx, _439.fnm, _439.nvd, _439.nvm, _439.si, _439.tim,
> _439.tip, _43a.doc, _43a.fdt, _43a.fdx, _43a.fnm, _43a.nvd, _43a.nvm, _
> 43a.si, _43a.tim, _43a.tip, _43b.doc, _43b.fdt, _43b.fdx, _43b.fnm,
> _43b.nvd, _43b.nvm, _43b.si, _43b.tim, _43b.tip, _43c.doc, _43c.fdt,
> _43c.fdx, _43c.fnm, _43c.nvd, _43c.nvm, _43c.si, _43c.tim, _43c.tip,
> _43d.doc, _43d.fdt, _43d.fdx, _43d.fnm, _43d.nvd, _43d.nvm, _43d.si,
> _43d.tim, _43d.tip, _43e.doc, _43e.fdt, _43e.fdx, _43e.fnm, _43e.nvd,
> _43e.nvm, _43e.si, _43e.tim, _43e.tip, _43f.doc, _43f.fdt, _43f.fdx,
> _43f.fnm, _43f.nvd, _43f.nvm, _43f.si, _43f.tim, _43f.tip, _43g.doc,
> _43g.fdt, _43g.fdx, _43g.fnm, _43g.nvd, _43g.nvm, _43g.si, _43g.tim,
> _43g.tip, _43h.doc, _43h.fdt, _43h.fdx, _43h.fnm, _43h.nvd, _43h.nvm, _
> 43h.si, _43h.tim, _43h.tip, _43j.doc, _43j.fdt, _43j.fdx, _43j.fnm,
> _43j.nvd, _43j.nvm, _43j.si, _43j.tim, _43j.tip, segments_2]},
> {indexVersion=1450611181635,generation=3,filelist=[_1mu.cfe, _1mu.cfs, _
> 1mu.si, _38v.cfe, _38v.cfs, _38v.si, _43h.doc, _43h.fdt, _43h.fdx,
> _43h.fnm, _43h.nvd, _43h.nvm, _43h.si, _43h.tim, _43h.tip, _43i.cfe,
> _43i.cfs, _43i.si, _43j.doc, _43j.fdt, _43j.fdx, _43j.fnm, _43j.nvd,
> _43j.nvm, _43j.si, _43j.tim, _43j.tip, segments_3]}]>
> at
> __randomizedtesting.SeedInfo.seed([D2C9FCE857647949:F71EE7D8272C774A]:0)
> at org.junit.Assert.fail(Assert.java:93)
> at org.junit.Assert.failNotEquals(Assert.java:647)
> at org.junit.Assert.assertEquals(Assert.java:128)
> at org.junit.Assert.assertEquals(Assert.java:147)
> at
> org.apache.solr.handler.TestReplicationHandler.doTestReplicateAfterCoreReload(TestReplicationHandler.java:1140)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:497)
> at
> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
> at
> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
> at
> com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
> at
> com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
> at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
> at
> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
> at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> at
> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
> at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
> at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
> at
> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
> at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
> at
> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
> at
> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
> at
> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
> at
> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
> at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
> at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> at
> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
> at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
> at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
> at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> at
> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
> at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
> at
> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
> at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
> at java.lang.Thread.run(Thread.java:745)
>
>
>
>
> Build Log:
> [...truncated 10367 lines...]
> [junit4] Suite: org.apache.solr.handler.TestReplicationHandler
> [junit4] 2> Creating dataDir:
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/init-core-data-001
> [junit4] 2> 930080 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.SolrTestCaseJ4 ###Starting doTestReplicateAfterStartup
> [junit4] 2> 930080 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/collection1
> [junit4] 2> 930084 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.e.j.s.Server jetty-9.3.6.v20151106
> [junit4] 2> 930086 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.e.j.s.h.ContextHandler Started
> o.e.j.s.ServletContextHandler@255125ed{/solr,null,AVAILABLE}
> [junit4] 2> 930088 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.e.j.s.ServerConnector Started ServerConnector@7ea56aaf
> {HTTP/1.1,[http/1.1]}{127.0.0.1:37114}
> [junit4] 2> 930088 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.e.j.s.Server Started @933986ms
> [junit4] 2> 930088 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties:
> {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/collection1/data,
> hostContext=/solr, hostPort=37114}
> [junit4] 2> 930088 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init():
> sun.misc.Launcher$AppClassLoader@4e0e2f2a
> [junit4] 2> 930088 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory:
> '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001'
> [junit4] 2> 930088 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr
> (NoInitialContextEx)
> [junit4] 2> 930088 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not
> find system property or JNDI)
> [junit4] 2> 930089 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.c.SolrXmlConfig Loading container configuration from
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/solr.xml
> [junit4] 2> 930093 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory:
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/.
> [junit4] 2> 930093 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.c.CoreContainer New CoreContainer 626084757
> [junit4] 2> 930093 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer
> [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001]
> [junit4] 2> 930093 WARN
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.c.CoreContainer Couldn't add files from
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/lib
> to classpath:
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/lib
> [junit4] 2> 930093 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout :
> 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost :
> 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize :
> 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy :
> false,useRetries : false,
> [junit4] 2> 930095 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client
> with params: socketTimeout=340000&connTimeout=45000&retry=true
> [junit4] 2> 930095 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
> [junit4] 2> 930095 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j
> (org.slf4j.impl.Log4jLoggerFactory)]
> [junit4] 2> 930095 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup
> for authorization module.
> [junit4] 2> 930095 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.c.CoreContainer No authentication plugin used.
> [junit4] 2> 930096 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.c.CorePropertiesLocator Looking for core definitions
> underneath
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/.
> [junit4] 2> 930097 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1,
> config=solrconfig.xml, loadOnStartup=true, schema=schema.xml,
> configSetProperties=configsetprops.json, transient=false, dataDir=data/}
> [junit4] 2> 930097 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.c.CorePropertiesLocator Found core collection1 in
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/./collection1
> [junit4] 2> 930097 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
> [junit4] 2> 930098 INFO (coreLoadExecutor-2276-thread-1) [ ]
> o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory:
> '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/collection1'
> [junit4] 2> 930098 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.s.SolrDispatchFilter
> user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
> [junit4] 2> 930098 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
> [junit4] 2> 930098 INFO (coreLoadExecutor-2276-thread-1) [ ]
> o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
> [junit4] 2> 930098 INFO (coreLoadExecutor-2276-thread-1) [ ]
> o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find
> system property or JNDI)
> [junit4] 2> 930105 INFO (coreLoadExecutor-2276-thread-1) [ ]
> o.a.s.c.SolrConfig current version of requestparams : -1
> [junit4] 2> 930108 INFO (coreLoadExecutor-2276-thread-1) [ ]
> o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
> [junit4] 2> 930114 INFO (coreLoadExecutor-2276-thread-1) [ ]
> o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
> [junit4] 2> 930117 INFO (coreLoadExecutor-2276-thread-1) [ ]
> o.a.s.s.IndexSchema [collection1] Schema name=test
> [junit4] 2> 930119 INFO (coreLoadExecutor-2276-thread-1) [ ]
> o.a.s.s.IndexSchema unique key field: id
> [junit4] 2> 930121 INFO (coreLoadExecutor-2276-thread-1) [ ]
> o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming
> default properties: Can't find resource 'configsetprops.json' in classpath
> or
> '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/collection1'
> [junit4] 2> 930121 INFO (coreLoadExecutor-2276-thread-1) [ ]
> o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration
> from instancedir
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/./collection1
> [junit4] 2> 930121 INFO (coreLoadExecutor-2276-thread-1) [
> x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
> [junit4] 2> 930121 INFO (coreLoadExecutor-2276-thread-1) [
> x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at
> [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/collection1],
> dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/./collection1/data/]
> [junit4] 2> 930121 INFO (coreLoadExecutor-2276-thread-1) [
> x:collection1] o.a.s.c.SolrCore JMX monitoring not detected for core:
> collection1
> [junit4] 2> 930121 INFO (coreLoadExecutor-2276-thread-1) [
> x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/./collection1/data
> [junit4] 2> 930122 INFO (coreLoadExecutor-2276-thread-1) [
> x:collection1] o.a.s.c.SolrCore New index directory detected: old=null
> new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/./collection1/data/index/
> [junit4] 2> 930122 WARN (coreLoadExecutor-2276-thread-1) [
> x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory
> '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/./collection1/data/index'
> doesn't exist. Creating new index...
> [junit4] 2> 930122 INFO (coreLoadExecutor-2276-thread-1) [
> x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/./collection1/data/index
> [junit4] 2> 930122 INFO (coreLoadExecutor-2276-thread-1) [
> x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
> org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy:
> maxMergeAtOnce=41, maxMergeAtOnceExplicit=44,
> maxMergedSegmentMB=2.59765625, floorSegmentMB=1.2158203125,
> forceMergeDeletesPctAllowed=24.325695306775234, segmentsPerTier=37.0,
> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6331213847609353
> [junit4] 2> 930123 INFO (coreLoadExecutor-2276-thread-1) [
> x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit:
> commits: num=1
> [junit4] 2>
> commit{dir=MockDirectoryWrapper(RAMDirectory@cc2a809
> lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@63df9f09
> ),segFN=segments_1,generation=1}
> [junit4] 2> 930123 INFO (coreLoadExecutor-2276-thread-1) [
> x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
> [junit4] 2> 930123 INFO
> (OldIndexDirectoryCleanupThreadForCore-collection1) [ x:collection1]
> o.a.s.c.SolrCore Looking for old index directories to cleanup for core
> collection1 in
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/./collection1/data/
> [junit4] 2> 930125 INFO (coreLoadExecutor-2276-thread-1) [
> x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as
> default, creating implicit default
> [junit4] 2> 930126 INFO (coreLoadExecutor-2276-thread-1) [
> x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
> [junit4] 2> 930127 INFO (coreLoadExecutor-2276-thread-1) [
> x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
> [junit4] 2> 930128 INFO (coreLoadExecutor-2276-thread-1) [
> x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
> [junit4] 2> 930128 INFO (coreLoadExecutor-2276-thread-1) [
> x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
> [junit4] 2> 930130 INFO (coreLoadExecutor-2276-thread-1) [
> x:collection1] o.a.s.c.PluginBag requestHandler : 'lazy' created with
> startup=lazy
> [junit4] 2> 930130 INFO (coreLoadExecutor-2276-thread-1) [
> x:collection1] o.a.s.c.RequestHandlers Registered paths:
> /admin/mbeans,standard,lazy,/update/json/docs,/admin/luke,/export,/get,/admin/properties,/update/json,/admin/threads,/update/csv,/sql,/admin/segments,/admin/system,/replication,defaults,/config,/stream,/schema,/admin/plugins,/admin/logging,/admin/ping,/update,/admin/file
> [junit4] 2> 930130 INFO (coreLoadExecutor-2276-thread-1) [
> x:collection1] o.a.s.c.SolrCore Using default statsCache cache:
> org.apache.solr.search.stats.LocalStatsCache
> [junit4] 2> 930130 INFO (coreLoadExecutor-2276-thread-1) [
> x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
> [junit4] 2> 930130 INFO (coreLoadExecutor-2276-thread-1) [
> x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
> [junit4] 2> 930131 INFO (coreLoadExecutor-2276-thread-1) [
> x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
> org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy:
> minMergeSize=1677721, mergeFactor=29, maxMergeSize=2147483648,
> maxMergeSizeForForcedMerge=9223372036854775807,
> calibrateSizeByDeletes=true, maxMergeDocs=2147483647,
> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
> [junit4] 2> 930131 INFO (coreLoadExecutor-2276-thread-1) [
> x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit:
> commits: num=1
> [junit4] 2>
> commit{dir=MockDirectoryWrapper(RAMDirectory@cc2a809
> lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@63df9f09
> ),segFN=segments_1,generation=1}
> [junit4] 2> 930131 INFO (coreLoadExecutor-2276-thread-1) [
> x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
> [junit4] 2> 930131 INFO (coreLoadExecutor-2276-thread-1) [
> x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@25e07633[collection1]
> main
> [junit4] 2> 930131 INFO (coreLoadExecutor-2276-thread-1) [
> x:collection1] o.a.s.r.ManagedResourceStorage File-based storage
> initialized to use dir:
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/collection1/conf
> [junit4] 2> 930131 INFO (coreLoadExecutor-2276-thread-1) [
> x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs:
> {storageDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/collection1/conf}
> [junit4] 2> 930131 INFO (coreLoadExecutor-2276-thread-1) [
> x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json
> using
> file:dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/collection1/conf
> [junit4] 2> 930131 INFO (coreLoadExecutor-2276-thread-1) [
> x:collection1] o.a.s.r.RestManager Initializing 0 registered
> ManagedResources
> [junit4] 2> 930132 INFO (coreLoadExecutor-2276-thread-1) [
> x:collection1] o.a.s.h.ReplicationHandler Replication enabled for following
> config files: schema.xml,xslt/dummy.xsl
> [junit4] 2> 930132 INFO (coreLoadExecutor-2276-thread-1) [
> x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for
> 10000
> [junit4] 2> 930132 INFO
> (searcherExecutor-2277-thread-1-processing-x:collection1) [
> x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher
> Searcher@25e07633[collection1]
> main{ExitableDirectoryReader(UninvertingDirectoryReader())}
> [junit4] 2> 930132 INFO (coreLoadExecutor-2276-thread-1) [
> x:collection1] o.a.s.c.CoreContainer registering core: collection1
> [junit4] 2> 930600 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-002/collection1
> [junit4] 2> 930604 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.e.j.s.Server jetty-9.3.6.v20151106
> [junit4] 2> 930605 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.e.j.s.h.ContextHandler Started
> o.e.j.s.ServletContextHandler@28ad9241{/solr,null,AVAILABLE}
> [junit4] 2> 930606 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.e.j.s.ServerConnector Started ServerConnector@34cfdf21
> {HTTP/1.1,[http/1.1]}{127.0.0.1:48654}
> [junit4] 2> 930606 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.e.j.s.Server Started @934505ms
> [junit4] 2> 930606 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties:
> {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-002/collection1/data,
> hostContext=/solr, hostPort=48654}
> [junit4] 2> 930607 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init():
> sun.misc.Launcher$AppClassLoader@4e0e2f2a
> [junit4] 2> 930607 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory:
> '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-002'
> [junit4] 2> 930607 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr
> (NoInitialContextEx)
> [junit4] 2> 930607 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not
> find system property or JNDI)
> [junit4] 2> 930607 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.c.SolrXmlConfig Loading container configuration from
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-002/solr.xml
> [junit4] 2> 930611 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory:
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-002/.
> [junit4] 2> 930612 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.c.CoreContainer New CoreContainer 1405931777
> [junit4] 2> 930612 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer
> [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-002]
> [junit4] 2> 930612 WARN
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.c.CoreContainer Couldn't add files from
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-002/lib
> to classpath:
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-002/lib
> [junit4] 2> 930613 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout :
> 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost :
> 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize :
> 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy :
> false,useRetries : false,
> [junit4] 2> 930613 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client
> with params: socketTimeout=340000&connTimeout=45000&retry=true
> [junit4] 2> 930614 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
> [junit4] 2> 930614 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j
> (org.slf4j.impl.Log4jLoggerFactory)]
> [junit4] 2> 930614 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup
> for authorization module.
> [junit4] 2> 930614 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.c.CoreContainer No authentication plugin used.
> [junit4] 2> 930614 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.c.CorePropertiesLocator Looking for core definitions
> underneath
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-002/.
> [junit4] 2> 930615 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1,
> config=solrconfig.xml, loadOnStartup=true, schema=schema.xml,
> configSetProperties=configsetprops.json, transient=false, dataDir=data/}
> [junit4] 2> 930616 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.c.CorePropertiesLocator Found core collection1 in
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-002/./collection1
> [junit4] 2> 930616 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
> [junit4] 2> 930616 INFO (coreLoadExecutor-2286-thread-1) [ ]
> o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory:
> '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-002/collection1'
> [junit4] 2> 930617 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.s.SolrDispatchFilter
> user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
> [junit4] 2> 930617 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
> [junit4] 2> 930617 INFO (coreLoadExecutor-2286-thread-1) [ ]
> o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
> [junit4] 2> 930617 INFO (coreLoadExecutor-2286-thread-1) [ ]
> o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find
> system property or JNDI)
> [junit4] 2> 930622 INFO (coreLoadExecutor-2286-thread-1) [ ]
> o.a.s.c.SolrConfig current version of requestparams : -1
> [junit4] 2> 930624 INFO (coreLoadExecutor-2286-thread-1) [ ]
> o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
> [junit4] 2> 930630 INFO (coreLoadExecutor-2286-thread-1) [ ]
> o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
> [junit4] 2> 930633 INFO (coreLoadExecutor-2286-thread-1) [ ]
> o.a.s.s.IndexSchema [collection1] Schema name=test
> [junit4] 2> 930635 INFO (coreLoadExecutor-2286-thread-1) [ ]
> o.a.s.s.IndexSchema unique key field: id
> [junit4] 2> 930636 INFO (coreLoadExecutor-2286-thread-1) [ ]
> o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming
> default properties: Can't find resource 'configsetprops.json' in classpath
> or
> '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-002/collection1'
> [junit4] 2> 930636 INFO (coreLoadExecutor-2286-thread-1) [ ]
> o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration
> from instancedir
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-002/./collection1
> [junit4] 2> 930636 INFO (coreLoadExecutor-2286-thread-1) [
> x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
> [junit4] 2> 930636 INFO (coreLoadExecutor-2286-thread-1) [
> x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at
> [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-002/collection1],
> dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-002/./collection1/data/]
> [junit4] 2> 930636 INFO (coreLoadExecutor-2286-thread-1) [
> x:collection1] o.a.s.c.SolrCore JMX monitoring not detected for core:
> collection1
> [junit4] 2> 930637 INFO (coreLoadExecutor-2286-thread-1) [
> x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-002/./collection1/data
> [junit4] 2> 930637 INFO (coreLoadExecutor-2286-thread-1) [
> x:collection1] o.a.s.c.SolrCore New index directory detected: old=null
> new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-002/./collection1/data/index/
> [junit4] 2> 930637 WARN (coreLoadExecutor-2286-thread-1) [
> x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory
> '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-002/./collection1/data/index'
> doesn't exist. Creating new index...
> [junit4] 2> 930637 INFO (coreLoadExecutor-2286-thread-1) [
> x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-002/./collection1/data/index
> [junit4] 2> 930637 INFO (coreLoadExecutor-2286-thread-1) [
> x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
> org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy:
> maxMergeAtOnce=41, maxMergeAtOnceExplicit=44,
> maxMergedSegmentMB=2.59765625, floorSegmentMB=1.2158203125,
> forceMergeDeletesPctAllowed=24.325695306775234, segmentsPerTier=37.0,
> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6331213847609353
> [junit4] 2> 930638 INFO (coreLoadExecutor-2286-thread-1) [
> x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit:
> commits: num=1
> [junit4] 2>
> commit{dir=MockDirectoryWrapper(RAMDirectory@6bf91c61
> lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@25b046aa
> ),segFN=segments_1,generation=1}
> [junit4] 2> 930638 INFO (coreLoadExecutor-2286-thread-1) [
> x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
> [junit4] 2> 930638 INFO
> (OldIndexDirectoryCleanupThreadForCore-collection1) [ x:collection1]
> o.a.s.c.SolrCore Looking for old index directories to cleanup for core
> collection1 in
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-002/./collection1/data/
> [junit4] 2> 930640 INFO (coreLoadExecutor-2286-thread-1) [
> x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as
> default, creating implicit default
> [junit4] 2> 930641 INFO (coreLoadExecutor-2286-thread-1) [
> x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
> [junit4] 2> 930642 INFO (coreLoadExecutor-2286-thread-1) [
> x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
> [junit4] 2> 930642 INFO (coreLoadExecutor-2286-thread-1) [
> x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
> [junit4] 2> 930643 INFO (coreLoadExecutor-2286-thread-1) [
> x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
> [junit4] 2> 930644 INFO (coreLoadExecutor-2286-thread-1) [
> x:collection1] o.a.s.c.PluginBag requestHandler : 'lazy' created with
> startup=lazy
> [junit4] 2> 930644 INFO (coreLoadExecutor-2286-thread-1) [
> x:collection1] o.a.s.c.RequestHandlers Registered paths:
> /admin/mbeans,standard,lazy,/update/json/docs,/admin/luke,/export,/get,/admin/properties,/update/json,/admin/threads,/update/csv,/sql,/admin/segments,/admin/system,/replication,defaults,/config,/stream,/schema,/admin/plugins,/admin/logging,/admin/ping,/update,/admin/file
> [junit4] 2> 930645 INFO (coreLoadExecutor-2286-thread-1) [
> x:collection1] o.a.s.c.SolrCore Using default statsCache cache:
> org.apache.solr.search.stats.LocalStatsCache
> [junit4] 2> 930645 INFO (coreLoadExecutor-2286-thread-1) [
> x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
> [junit4] 2> 930645 INFO (coreLoadExecutor-2286-thread-1) [
> x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
> [junit4] 2> 930645 INFO (coreLoadExecutor-2286-thread-1) [
> x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
> org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy:
> minMergeSize=1677721, mergeFactor=29, maxMergeSize=2147483648,
> maxMergeSizeForForcedMerge=9223372036854775807,
> calibrateSizeByDeletes=true, maxMergeDocs=2147483647,
> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
> [junit4] 2> 930645 INFO (coreLoadExecutor-2286-thread-1) [
> x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit:
> commits: num=1
> [junit4] 2>
> commit{dir=MockDirectoryWrapper(RAMDirectory@6bf91c61
> lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@25b046aa
> ),segFN=segments_1,generation=1}
> [junit4] 2> 930646 INFO (coreLoadExecutor-2286-thread-1) [
> x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
> [junit4] 2> 930646 INFO (coreLoadExecutor-2286-thread-1) [
> x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@17c8081b[collection1]
> main
> [junit4] 2> 930646 INFO (coreLoadExecutor-2286-thread-1) [
> x:collection1] o.a.s.r.ManagedResourceStorage File-based storage
> initialized to use dir:
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-002/collection1/conf
> [junit4] 2> 930646 INFO (coreLoadExecutor-2286-thread-1) [
> x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs:
> {storageDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-002/collection1/conf}
> [junit4] 2> 930646 INFO (coreLoadExecutor-2286-thread-1) [
> x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json
> using
> file:dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-002/collection1/conf
> [junit4] 2> 930646 INFO (coreLoadExecutor-2286-thread-1) [
> x:collection1] o.a.s.r.RestManager Initializing 0 registered
> ManagedResources
> [junit4] 2> 930648 INFO (coreLoadExecutor-2286-thread-1) [
> x:collection1] o.a.s.h.ReplicationHandler Poll scheduled at an interval of
> 1000ms
> [junit4] 2> 930648 INFO
> (searcherExecutor-2287-thread-1-processing-x:collection1) [
> x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher
> Searcher@17c8081b[collection1]
> main{ExitableDirectoryReader(UninvertingDirectoryReader())}
> [junit4] 2> 930649 INFO (coreLoadExecutor-2286-thread-1) [
> x:collection1] o.a.s.c.CoreContainer registering core: collection1
> [junit4] 2> 930651 INFO (qtp352348546-7076) [ x:collection1]
> o.a.s.c.S.Request [collection1] webapp=/solr path=/replication
> params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0
> QTime=0
> [junit4] 2> 931119 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.e.j.s.ServerConnector Stopped ServerConnector@34cfdf21
> {HTTP/1.1,[http/1.1]}{127.0.0.1:0}
> [junit4] 2> 931119 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1405931777
> [junit4] 2> 931119 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ x:collection1] o.a.s.c.SolrCore [collection1] CLOSING SolrCore
> org.apache.solr.core.SolrCore@734a167d
> [junit4] 2> 931120 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ x:collection1] o.a.s.u.DirectUpdateHandler2 closing
> DirectUpdateHandler2{commits=0,autocommits=0,soft
> autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
> [junit4] 2> 931120 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ x:collection1] o.a.s.u.SolrCoreState Closing SolrCoreState
> [junit4] 2> 931120 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ x:collection1] o.a.s.u.DefaultSolrCoreState SolrCoreState ref count
> has reached 0 - closing IndexWriter
> [junit4] 2> 931120 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ x:collection1] o.a.s.u.DefaultSolrCoreState closing IndexWriter with
> IndexWriterCloser
> [junit4] 2> 931121 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ x:collection1] o.a.s.c.SolrCore [collection1] Closing main searcher on
> request.
> [junit4] 2> 931121 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing
> MockDirectoryFactory - 2 directories currently being tracked
> [junit4] 2> 931121 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ x:collection1] o.a.s.c.CachingDirectoryFactory looking to close
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-002/./collection1/data
> [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-002/./collection1/data;done=false>>]
> [junit4] 2> 931121 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory:
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-002/./collection1/data
> [junit4] 2> 931121 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ x:collection1] o.a.s.c.CachingDirectoryFactory looking to close
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-002/./collection1/data/index
> [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-002/./collection1/data/index;done=false>>]
> [junit4] 2> 931122 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory:
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-002/./collection1/data/index
> [junit4] 2> 931122 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ x:collection1] o.e.j.s.h.ContextHandler Stopped
> o.e.j.s.ServletContextHandler@28ad9241{/solr,null,UNAVAILABLE}
> [junit4] 2> 931124 INFO (qtp352348546-7080) [ x:collection1]
> o.a.s.u.DirectUpdateHandler2 [collection1] REMOVING ALL DOCUMENTS FROM INDEX
> [junit4] 2> 931124 INFO (qtp352348546-7080) [ x:collection1]
> o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr
> path=/update params={wt=javabin&version=2}{deleteByQuery=*:*} 0 0
> [junit4] 2> 931126 INFO (qtp352348546-7073) [ x:collection1]
> o.a.s.u.DirectUpdateHandler2 start
> commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
> [junit4] 2> 931126 INFO (qtp352348546-7073) [ x:collection1]
> o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=2
> [junit4] 2>
> commit{dir=MockDirectoryWrapper(RAMDirectory@cc2a809
> lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@63df9f09
> ),segFN=segments_1,generation=1}
> [junit4] 2>
> commit{dir=MockDirectoryWrapper(RAMDirectory@cc2a809
> lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@63df9f09
> ),segFN=segments_2,generation=2}
> [junit4] 2> 931127 INFO (qtp352348546-7073) [ x:collection1]
> o.a.s.c.SolrDeletionPolicy newest commit generation = 2
> [junit4] 2> 931128 INFO (qtp352348546-7073) [ x:collection1]
> o.a.s.s.SolrIndexSearcher Opening Searcher@fc6c71f[collection1] main
> [junit4] 2> 931128 INFO (qtp352348546-7073) [ x:collection1]
> o.a.s.u.DirectUpdateHandler2 end_commit_flush
> [junit4] 2> 931128 INFO
> (searcherExecutor-2277-thread-1-processing-x:collection1) [
> x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher
> Searcher@fc6c71f[collection1]
> main{ExitableDirectoryReader(UninvertingDirectoryReader())}
> [junit4] 2> 931128 INFO (qtp352348546-7073) [ x:collection1]
> o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr
> path=/update
> params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=}
> 0 1
> [junit4] 2> 931130 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.e.j.s.ServerConnector Stopped ServerConnector@7ea56aaf
> {HTTP/1.1,[http/1.1]}{127.0.0.1:0}
> [junit4] 2> 931130 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=626084757
> [junit4] 2> 931130 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ x:collection1] o.a.s.c.SolrCore [collection1] CLOSING SolrCore
> org.apache.solr.core.SolrCore@379fa46
> [junit4] 2> 931130 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ x:collection1] o.a.s.u.DirectUpdateHandler2 closing
> DirectUpdateHandler2{commits=1,autocommits=0,soft
> autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0}
> [junit4] 2> 931130 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ x:collection1] o.a.s.u.SolrCoreState Closing SolrCoreState
> [junit4] 2> 931130 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ x:collection1] o.a.s.u.DefaultSolrCoreState SolrCoreState ref count
> has reached 0 - closing IndexWriter
> [junit4] 2> 931130 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ x:collection1] o.a.s.u.DefaultSolrCoreState closing IndexWriter with
> IndexWriterCloser
> [junit4] 2> 931131 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ x:collection1] o.a.s.c.SolrCore [collection1] Closing main searcher on
> request.
> [junit4] 2> 931131 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing
> MockDirectoryFactory - 2 directories currently being tracked
> [junit4] 2> 931131 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ x:collection1] o.a.s.c.CachingDirectoryFactory looking to close
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/./collection1/data
> [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/./collection1/data;done=false>>]
> [junit4] 2> 931131 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory:
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/./collection1/data
> [junit4] 2> 931131 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ x:collection1] o.a.s.c.CachingDirectoryFactory looking to close
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/./collection1/data/index
> [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/./collection1/data/index;done=false>>]
> [junit4] 2> 931131 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory:
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/./collection1/data/index
> [junit4] 2> 931132 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ x:collection1] o.e.j.s.h.ContextHandler Stopped
> o.e.j.s.ServletContextHandler@255125ed{/solr,null,UNAVAILABLE}
> [junit4] 2> 931134 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.e.j.s.Server jetty-9.3.6.v20151106
> [junit4] 2> 931135 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.e.j.s.h.ContextHandler Started
> o.e.j.s.ServletContextHandler@33d9490a{/solr,null,AVAILABLE}
> [junit4] 2> 931136 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.e.j.s.ServerConnector Started ServerConnector@4cd43bed
> {HTTP/1.1,[http/1.1]}{127.0.0.1:38841}
> [junit4] 2> 931136 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.e.j.s.Server Started @935035ms
> [junit4] 2> 931136 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties:
> {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/collection1/data,
> hostContext=/solr, hostPort=38841}
> [junit4] 2> 931136 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init():
> sun.misc.Launcher$AppClassLoader@4e0e2f2a
> [junit4] 2> 931137 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory:
> '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001'
> [junit4] 2> 931137 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr
> (NoInitialContextEx)
> [junit4] 2> 931137 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not
> find system property or JNDI)
> [junit4] 2> 931137 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.c.SolrXmlConfig Loading container configuration from
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/solr.xml
> [junit4] 2> 931141 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory:
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/.
> [junit4] 2> 931141 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.c.CoreContainer New CoreContainer 720444629
> [junit4] 2> 931141 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer
> [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001]
> [junit4] 2> 931141 WARN
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.c.CoreContainer Couldn't add files from
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/lib
> to classpath:
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/lib
> [junit4] 2> 931142 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout :
> 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost :
> 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize :
> 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy :
> false,useRetries : false,
> [junit4] 2> 931143 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client
> with params: socketTimeout=340000&connTimeout=45000&retry=true
> [junit4] 2> 931143 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
> [junit4] 2> 931143 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j
> (org.slf4j.impl.Log4jLoggerFactory)]
> [junit4] 2> 931143 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup
> for authorization module.
> [junit4] 2> 931143 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.c.CoreContainer No authentication plugin used.
> [junit4] 2> 931144 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.c.CorePropertiesLocator Looking for core definitions
> underneath
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/.
> [junit4] 2> 931145 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1,
> config=solrconfig.xml, loadOnStartup=true, schema=schema.xml,
> configSetProperties=configsetprops.json, transient=false, dataDir=data/}
> [junit4] 2> 931145 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.c.CorePropertiesLocator Found core collection1 in
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/./collection1
> [junit4] 2> 931145 INFO
> (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949])
> [ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
> [junit4] 2> 931145 INFO (coreLoadExecutor-2297-thread-1) [ ]
> o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory:
> '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/collection1'
> [junit4] 2> 931146 INFO (coreLoadExecutor-2297-thread-1) [ ]
> o.a.s.c.So
--
- Mark
about.me/markrmiller
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 887 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/887/
2 tests failed.
FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test
Error Message:
Captured an uncaught exception in thread: Thread[id=15169, name=collection5, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=15169, name=collection5, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: java.lang.RuntimeException: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:42569/hi/jf, http://127.0.0.1:58154/hi/jf, http://127.0.0.1:59250/hi/jf, http://127.0.0.1:57798/hi/jf, http://127.0.0.1:36779/hi/jf]
at __randomizedtesting.SeedInfo.seed([D2C9FCE857647949]:0)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:891)
Caused by: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:42569/hi/jf, http://127.0.0.1:58154/hi/jf, http://127.0.0.1:59250/hi/jf, http://127.0.0.1:57798/hi/jf, http://127.0.0.1:36779/hi/jf]
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:352)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:871)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:807)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1574)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1595)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:881)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:57798/hi/jf: KeeperErrorCode = Session expired for /overseer/collection-queue-work/qnr-
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
... 7 more
FAILED: org.apache.solr.handler.TestReplicationHandler.doTestReplicateAfterCoreReload
Error Message:
expected:<[{indexVersion=1450611181635,generation=2,filelist=[_1mu.cfe, _1mu.cfs, _1mu.si, _38v.cfe, _38v.cfs, _38v.si, _42o.doc, _42o.fdt, _42o.fdx, _42o.fnm, _42o.nvd, _42o.nvm, _42o.si, _42o.tim, _42o.tip, _42p.cfe, _42p.cfs, _42p.si, _42q.doc, _42q.fdt, _42q.fdx, _42q.fnm, _42q.nvd, _42q.nvm, _42q.si, _42q.tim, _42q.tip, _42r.doc, _42r.fdt, _42r.fdx, _42r.fnm, _42r.nvd, _42r.nvm, _42r.si, _42r.tim, _42r.tip, _42s.doc, _42s.fdt, _42s.fdx, _42s.fnm, _42s.nvd, _42s.nvm, _42s.si, _42s.tim, _42s.tip, _42t.doc, _42t.fdt, _42t.fdx, _42t.fnm, _42t.nvd, _42t.nvm, _42t.si, _42t.tim, _42t.tip, _42u.doc, _42u.fdt, _42u.fdx, _42u.fnm, _42u.nvd, _42u.nvm, _42u.si, _42u.tim, _42u.tip, _42v.doc, _42v.fdt, _42v.fdx, _42v.fnm, _42v.nvd, _42v.nvm, _42v.si, _42v.tim, _42v.tip, _42w.doc, _42w.fdt, _42w.fdx, _42w.fnm, _42w.nvd, _42w.nvm, _42w.si, _42w.tim, _42w.tip, _42x.doc, _42x.fdt, _42x.fdx, _42x.fnm, _42x.nvd, _42x.nvm, _42x.si, _42x.tim, _42x.tip, _42y.doc, _42y.fdt, _42y.fdx, _42y.fnm, _42y.nvd, _42y.nvm, _42y.si, _42y.tim, _42y.tip, _42z.doc, _42z.fdt, _42z.fdx, _42z.fnm, _42z.nvd, _42z.nvm, _42z.si, _42z.tim, _42z.tip, _430.doc, _430.fdt, _430.fdx, _430.fnm, _430.nvd, _430.nvm, _430.si, _430.tim, _430.tip, _431.doc, _431.fdt, _431.fdx, _431.fnm, _431.nvd, _431.nvm, _431.si, _431.tim, _431.tip, _432.doc, _432.fdt, _432.fdx, _432.fnm, _432.nvd, _432.nvm, _432.si, _432.tim, _432.tip, _433.doc, _433.fdt, _433.fdx, _433.fnm, _433.nvd, _433.nvm, _433.si, _433.tim, _433.tip, _434.doc, _434.fdt, _434.fdx, _434.fnm, _434.nvd, _434.nvm, _434.si, _434.tim, _434.tip, _435.doc, _435.fdt, _435.fdx, _435.fnm, _435.nvd, _435.nvm, _435.si, _435.tim, _435.tip, _436.doc, _436.fdt, _436.fdx, _436.fnm, _436.nvd, _436.nvm, _436.si, _436.tim, _436.tip, _437.doc, _437.fdt, _437.fdx, _437.fnm, _437.nvd, _437.nvm, _437.si, _437.tim, _437.tip, _438.doc, _438.fdt, _438.fdx, _438.fnm, _438.nvd, _438.nvm, _438.si, _438.tim, _438.tip, _439.doc, _439.fdt, _439.fdx, _439.fnm, _439.nvd, _439.nvm, _439.si, _439.tim, _439.tip, _43a.doc, _43a.fdt, _43a.fdx, _43a.fnm, _43a.nvd, _43a.nvm, _43a.si, _43a.tim, _43a.tip, _43b.doc, _43b.fdt, _43b.fdx, _43b.fnm, _43b.nvd, _43b.nvm, _43b.si, _43b.tim, _43b.tip, _43c.doc, _43c.fdt, _43c.fdx, _43c.fnm, _43c.nvd, _43c.nvm, _43c.si, _43c.tim, _43c.tip, _43d.doc, _43d.fdt, _43d.fdx, _43d.fnm, _43d.nvd, _43d.nvm, _43d.si, _43d.tim, _43d.tip, _43e.doc, _43e.fdt, _43e.fdx, _43e.fnm, _43e.nvd, _43e.nvm, _43e.si, _43e.tim, _43e.tip, _43f.doc, _43f.fdt, _43f.fdx, _43f.fnm, _43f.nvd, _43f.nvm, _43f.si, _43f.tim, _43f.tip, _43g.doc, _43g.fdt, _43g.fdx, _43g.fnm, _43g.nvd, _43g.nvm, _43g.si, _43g.tim, _43g.tip, _43h.doc, _43h.fdt, _43h.fdx, _43h.fnm, _43h.nvd, _43h.nvm, _43h.si, _43h.tim, _43h.tip, _43j.doc, _43j.fdt, _43j.fdx, _43j.fnm, _43j.nvd, _43j.nvm, _43j.si, _43j.tim, _43j.tip, segments_2]}]> but was:<[{indexVersion=1450611181635,generation=2,filelist=[_1mu.cfe, _1mu.cfs, _1mu.si, _38v.cfe, _38v.cfs, _38v.si, _42o.doc, _42o.fdt, _42o.fdx, _42o.fnm, _42o.nvd, _42o.nvm, _42o.si, _42o.tim, _42o.tip, _42p.cfe, _42p.cfs, _42p.si, _42q.doc, _42q.fdt, _42q.fdx, _42q.fnm, _42q.nvd, _42q.nvm, _42q.si, _42q.tim, _42q.tip, _42r.doc, _42r.fdt, _42r.fdx, _42r.fnm, _42r.nvd, _42r.nvm, _42r.si, _42r.tim, _42r.tip, _42s.doc, _42s.fdt, _42s.fdx, _42s.fnm, _42s.nvd, _42s.nvm, _42s.si, _42s.tim, _42s.tip, _42t.doc, _42t.fdt, _42t.fdx, _42t.fnm, _42t.nvd, _42t.nvm, _42t.si, _42t.tim, _42t.tip, _42u.doc, _42u.fdt, _42u.fdx, _42u.fnm, _42u.nvd, _42u.nvm, _42u.si, _42u.tim, _42u.tip, _42v.doc, _42v.fdt, _42v.fdx, _42v.fnm, _42v.nvd, _42v.nvm, _42v.si, _42v.tim, _42v.tip, _42w.doc, _42w.fdt, _42w.fdx, _42w.fnm, _42w.nvd, _42w.nvm, _42w.si, _42w.tim, _42w.tip, _42x.doc, _42x.fdt, _42x.fdx, _42x.fnm, _42x.nvd, _42x.nvm, _42x.si, _42x.tim, _42x.tip, _42y.doc, _42y.fdt, _42y.fdx, _42y.fnm, _42y.nvd, _42y.nvm, _42y.si, _42y.tim, _42y.tip, _42z.doc, _42z.fdt, _42z.fdx, _42z.fnm, _42z.nvd, _42z.nvm, _42z.si, _42z.tim, _42z.tip, _430.doc, _430.fdt, _430.fdx, _430.fnm, _430.nvd, _430.nvm, _430.si, _430.tim, _430.tip, _431.doc, _431.fdt, _431.fdx, _431.fnm, _431.nvd, _431.nvm, _431.si, _431.tim, _431.tip, _432.doc, _432.fdt, _432.fdx, _432.fnm, _432.nvd, _432.nvm, _432.si, _432.tim, _432.tip, _433.doc, _433.fdt, _433.fdx, _433.fnm, _433.nvd, _433.nvm, _433.si, _433.tim, _433.tip, _434.doc, _434.fdt, _434.fdx, _434.fnm, _434.nvd, _434.nvm, _434.si, _434.tim, _434.tip, _435.doc, _435.fdt, _435.fdx, _435.fnm, _435.nvd, _435.nvm, _435.si, _435.tim, _435.tip, _436.doc, _436.fdt, _436.fdx, _436.fnm, _436.nvd, _436.nvm, _436.si, _436.tim, _436.tip, _437.doc, _437.fdt, _437.fdx, _437.fnm, _437.nvd, _437.nvm, _437.si, _437.tim, _437.tip, _438.doc, _438.fdt, _438.fdx, _438.fnm, _438.nvd, _438.nvm, _438.si, _438.tim, _438.tip, _439.doc, _439.fdt, _439.fdx, _439.fnm, _439.nvd, _439.nvm, _439.si, _439.tim, _439.tip, _43a.doc, _43a.fdt, _43a.fdx, _43a.fnm, _43a.nvd, _43a.nvm, _43a.si, _43a.tim, _43a.tip, _43b.doc, _43b.fdt, _43b.fdx, _43b.fnm, _43b.nvd, _43b.nvm, _43b.si, _43b.tim, _43b.tip, _43c.doc, _43c.fdt, _43c.fdx, _43c.fnm, _43c.nvd, _43c.nvm, _43c.si, _43c.tim, _43c.tip, _43d.doc, _43d.fdt, _43d.fdx, _43d.fnm, _43d.nvd, _43d.nvm, _43d.si, _43d.tim, _43d.tip, _43e.doc, _43e.fdt, _43e.fdx, _43e.fnm, _43e.nvd, _43e.nvm, _43e.si, _43e.tim, _43e.tip, _43f.doc, _43f.fdt, _43f.fdx, _43f.fnm, _43f.nvd, _43f.nvm, _43f.si, _43f.tim, _43f.tip, _43g.doc, _43g.fdt, _43g.fdx, _43g.fnm, _43g.nvd, _43g.nvm, _43g.si, _43g.tim, _43g.tip, _43h.doc, _43h.fdt, _43h.fdx, _43h.fnm, _43h.nvd, _43h.nvm, _43h.si, _43h.tim, _43h.tip, _43j.doc, _43j.fdt, _43j.fdx, _43j.fnm, _43j.nvd, _43j.nvm, _43j.si, _43j.tim, _43j.tip, segments_2]}, {indexVersion=1450611181635,generation=3,filelist=[_1mu.cfe, _1mu.cfs, _1mu.si, _38v.cfe, _38v.cfs, _38v.si, _43h.doc, _43h.fdt, _43h.fdx, _43h.fnm, _43h.nvd, _43h.nvm, _43h.si, _43h.tim, _43h.tip, _43i.cfe, _43i.cfs, _43i.si, _43j.doc, _43j.fdt, _43j.fdx, _43j.fnm, _43j.nvd, _43j.nvm, _43j.si, _43j.tim, _43j.tip, segments_3]}]>
Stack Trace:
java.lang.AssertionError: expected:<[{indexVersion=1450611181635,generation=2,filelist=[_1mu.cfe, _1mu.cfs, _1mu.si, _38v.cfe, _38v.cfs, _38v.si, _42o.doc, _42o.fdt, _42o.fdx, _42o.fnm, _42o.nvd, _42o.nvm, _42o.si, _42o.tim, _42o.tip, _42p.cfe, _42p.cfs, _42p.si, _42q.doc, _42q.fdt, _42q.fdx, _42q.fnm, _42q.nvd, _42q.nvm, _42q.si, _42q.tim, _42q.tip, _42r.doc, _42r.fdt, _42r.fdx, _42r.fnm, _42r.nvd, _42r.nvm, _42r.si, _42r.tim, _42r.tip, _42s.doc, _42s.fdt, _42s.fdx, _42s.fnm, _42s.nvd, _42s.nvm, _42s.si, _42s.tim, _42s.tip, _42t.doc, _42t.fdt, _42t.fdx, _42t.fnm, _42t.nvd, _42t.nvm, _42t.si, _42t.tim, _42t.tip, _42u.doc, _42u.fdt, _42u.fdx, _42u.fnm, _42u.nvd, _42u.nvm, _42u.si, _42u.tim, _42u.tip, _42v.doc, _42v.fdt, _42v.fdx, _42v.fnm, _42v.nvd, _42v.nvm, _42v.si, _42v.tim, _42v.tip, _42w.doc, _42w.fdt, _42w.fdx, _42w.fnm, _42w.nvd, _42w.nvm, _42w.si, _42w.tim, _42w.tip, _42x.doc, _42x.fdt, _42x.fdx, _42x.fnm, _42x.nvd, _42x.nvm, _42x.si, _42x.tim, _42x.tip, _42y.doc, _42y.fdt, _42y.fdx, _42y.fnm, _42y.nvd, _42y.nvm, _42y.si, _42y.tim, _42y.tip, _42z.doc, _42z.fdt, _42z.fdx, _42z.fnm, _42z.nvd, _42z.nvm, _42z.si, _42z.tim, _42z.tip, _430.doc, _430.fdt, _430.fdx, _430.fnm, _430.nvd, _430.nvm, _430.si, _430.tim, _430.tip, _431.doc, _431.fdt, _431.fdx, _431.fnm, _431.nvd, _431.nvm, _431.si, _431.tim, _431.tip, _432.doc, _432.fdt, _432.fdx, _432.fnm, _432.nvd, _432.nvm, _432.si, _432.tim, _432.tip, _433.doc, _433.fdt, _433.fdx, _433.fnm, _433.nvd, _433.nvm, _433.si, _433.tim, _433.tip, _434.doc, _434.fdt, _434.fdx, _434.fnm, _434.nvd, _434.nvm, _434.si, _434.tim, _434.tip, _435.doc, _435.fdt, _435.fdx, _435.fnm, _435.nvd, _435.nvm, _435.si, _435.tim, _435.tip, _436.doc, _436.fdt, _436.fdx, _436.fnm, _436.nvd, _436.nvm, _436.si, _436.tim, _436.tip, _437.doc, _437.fdt, _437.fdx, _437.fnm, _437.nvd, _437.nvm, _437.si, _437.tim, _437.tip, _438.doc, _438.fdt, _438.fdx, _438.fnm, _438.nvd, _438.nvm, _438.si, _438.tim, _438.tip, _439.doc, _439.fdt, _439.fdx, _439.fnm, _439.nvd, _439.nvm, _439.si, _439.tim, _439.tip, _43a.doc, _43a.fdt, _43a.fdx, _43a.fnm, _43a.nvd, _43a.nvm, _43a.si, _43a.tim, _43a.tip, _43b.doc, _43b.fdt, _43b.fdx, _43b.fnm, _43b.nvd, _43b.nvm, _43b.si, _43b.tim, _43b.tip, _43c.doc, _43c.fdt, _43c.fdx, _43c.fnm, _43c.nvd, _43c.nvm, _43c.si, _43c.tim, _43c.tip, _43d.doc, _43d.fdt, _43d.fdx, _43d.fnm, _43d.nvd, _43d.nvm, _43d.si, _43d.tim, _43d.tip, _43e.doc, _43e.fdt, _43e.fdx, _43e.fnm, _43e.nvd, _43e.nvm, _43e.si, _43e.tim, _43e.tip, _43f.doc, _43f.fdt, _43f.fdx, _43f.fnm, _43f.nvd, _43f.nvm, _43f.si, _43f.tim, _43f.tip, _43g.doc, _43g.fdt, _43g.fdx, _43g.fnm, _43g.nvd, _43g.nvm, _43g.si, _43g.tim, _43g.tip, _43h.doc, _43h.fdt, _43h.fdx, _43h.fnm, _43h.nvd, _43h.nvm, _43h.si, _43h.tim, _43h.tip, _43j.doc, _43j.fdt, _43j.fdx, _43j.fnm, _43j.nvd, _43j.nvm, _43j.si, _43j.tim, _43j.tip, segments_2]}]> but was:<[{indexVersion=1450611181635,generation=2,filelist=[_1mu.cfe, _1mu.cfs, _1mu.si, _38v.cfe, _38v.cfs, _38v.si, _42o.doc, _42o.fdt, _42o.fdx, _42o.fnm, _42o.nvd, _42o.nvm, _42o.si, _42o.tim, _42o.tip, _42p.cfe, _42p.cfs, _42p.si, _42q.doc, _42q.fdt, _42q.fdx, _42q.fnm, _42q.nvd, _42q.nvm, _42q.si, _42q.tim, _42q.tip, _42r.doc, _42r.fdt, _42r.fdx, _42r.fnm, _42r.nvd, _42r.nvm, _42r.si, _42r.tim, _42r.tip, _42s.doc, _42s.fdt, _42s.fdx, _42s.fnm, _42s.nvd, _42s.nvm, _42s.si, _42s.tim, _42s.tip, _42t.doc, _42t.fdt, _42t.fdx, _42t.fnm, _42t.nvd, _42t.nvm, _42t.si, _42t.tim, _42t.tip, _42u.doc, _42u.fdt, _42u.fdx, _42u.fnm, _42u.nvd, _42u.nvm, _42u.si, _42u.tim, _42u.tip, _42v.doc, _42v.fdt, _42v.fdx, _42v.fnm, _42v.nvd, _42v.nvm, _42v.si, _42v.tim, _42v.tip, _42w.doc, _42w.fdt, _42w.fdx, _42w.fnm, _42w.nvd, _42w.nvm, _42w.si, _42w.tim, _42w.tip, _42x.doc, _42x.fdt, _42x.fdx, _42x.fnm, _42x.nvd, _42x.nvm, _42x.si, _42x.tim, _42x.tip, _42y.doc, _42y.fdt, _42y.fdx, _42y.fnm, _42y.nvd, _42y.nvm, _42y.si, _42y.tim, _42y.tip, _42z.doc, _42z.fdt, _42z.fdx, _42z.fnm, _42z.nvd, _42z.nvm, _42z.si, _42z.tim, _42z.tip, _430.doc, _430.fdt, _430.fdx, _430.fnm, _430.nvd, _430.nvm, _430.si, _430.tim, _430.tip, _431.doc, _431.fdt, _431.fdx, _431.fnm, _431.nvd, _431.nvm, _431.si, _431.tim, _431.tip, _432.doc, _432.fdt, _432.fdx, _432.fnm, _432.nvd, _432.nvm, _432.si, _432.tim, _432.tip, _433.doc, _433.fdt, _433.fdx, _433.fnm, _433.nvd, _433.nvm, _433.si, _433.tim, _433.tip, _434.doc, _434.fdt, _434.fdx, _434.fnm, _434.nvd, _434.nvm, _434.si, _434.tim, _434.tip, _435.doc, _435.fdt, _435.fdx, _435.fnm, _435.nvd, _435.nvm, _435.si, _435.tim, _435.tip, _436.doc, _436.fdt, _436.fdx, _436.fnm, _436.nvd, _436.nvm, _436.si, _436.tim, _436.tip, _437.doc, _437.fdt, _437.fdx, _437.fnm, _437.nvd, _437.nvm, _437.si, _437.tim, _437.tip, _438.doc, _438.fdt, _438.fdx, _438.fnm, _438.nvd, _438.nvm, _438.si, _438.tim, _438.tip, _439.doc, _439.fdt, _439.fdx, _439.fnm, _439.nvd, _439.nvm, _439.si, _439.tim, _439.tip, _43a.doc, _43a.fdt, _43a.fdx, _43a.fnm, _43a.nvd, _43a.nvm, _43a.si, _43a.tim, _43a.tip, _43b.doc, _43b.fdt, _43b.fdx, _43b.fnm, _43b.nvd, _43b.nvm, _43b.si, _43b.tim, _43b.tip, _43c.doc, _43c.fdt, _43c.fdx, _43c.fnm, _43c.nvd, _43c.nvm, _43c.si, _43c.tim, _43c.tip, _43d.doc, _43d.fdt, _43d.fdx, _43d.fnm, _43d.nvd, _43d.nvm, _43d.si, _43d.tim, _43d.tip, _43e.doc, _43e.fdt, _43e.fdx, _43e.fnm, _43e.nvd, _43e.nvm, _43e.si, _43e.tim, _43e.tip, _43f.doc, _43f.fdt, _43f.fdx, _43f.fnm, _43f.nvd, _43f.nvm, _43f.si, _43f.tim, _43f.tip, _43g.doc, _43g.fdt, _43g.fdx, _43g.fnm, _43g.nvd, _43g.nvm, _43g.si, _43g.tim, _43g.tip, _43h.doc, _43h.fdt, _43h.fdx, _43h.fnm, _43h.nvd, _43h.nvm, _43h.si, _43h.tim, _43h.tip, _43j.doc, _43j.fdt, _43j.fdx, _43j.fnm, _43j.nvd, _43j.nvm, _43j.si, _43j.tim, _43j.tip, segments_2]}, {indexVersion=1450611181635,generation=3,filelist=[_1mu.cfe, _1mu.cfs, _1mu.si, _38v.cfe, _38v.cfs, _38v.si, _43h.doc, _43h.fdt, _43h.fdx, _43h.fnm, _43h.nvd, _43h.nvm, _43h.si, _43h.tim, _43h.tip, _43i.cfe, _43i.cfs, _43i.si, _43j.doc, _43j.fdt, _43j.fdx, _43j.fnm, _43j.nvd, _43j.nvm, _43j.si, _43j.tim, _43j.tip, segments_3]}]>
at __randomizedtesting.SeedInfo.seed([D2C9FCE857647949:F71EE7D8272C774A]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:147)
at org.apache.solr.handler.TestReplicationHandler.doTestReplicateAfterCoreReload(TestReplicationHandler.java:1140)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 10367 lines...]
[junit4] Suite: org.apache.solr.handler.TestReplicationHandler
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/init-core-data-001
[junit4] 2> 930080 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.SolrTestCaseJ4 ###Starting doTestReplicateAfterStartup
[junit4] 2> 930080 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/collection1
[junit4] 2> 930084 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.e.j.s.Server jetty-9.3.6.v20151106
[junit4] 2> 930086 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@255125ed{/solr,null,AVAILABLE}
[junit4] 2> 930088 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.e.j.s.ServerConnector Started ServerConnector@7ea56aaf{HTTP/1.1,[http/1.1]}{127.0.0.1:37114}
[junit4] 2> 930088 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.e.j.s.Server Started @933986ms
[junit4] 2> 930088 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/collection1/data, hostContext=/solr, hostPort=37114}
[junit4] 2> 930088 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 930088 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001'
[junit4] 2> 930088 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 930088 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 930089 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/solr.xml
[junit4] 2> 930093 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/.
[junit4] 2> 930093 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.c.CoreContainer New CoreContainer 626084757
[junit4] 2> 930093 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001]
[junit4] 2> 930093 WARN (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/lib
[junit4] 2> 930093 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 930095 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 930095 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 930095 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 930095 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 930095 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 930096 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/.
[junit4] 2> 930097 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, loadOnStartup=true, schema=schema.xml, configSetProperties=configsetprops.json, transient=false, dataDir=data/}
[junit4] 2> 930097 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/./collection1
[junit4] 2> 930097 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
[junit4] 2> 930098 INFO (coreLoadExecutor-2276-thread-1) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/collection1'
[junit4] 2> 930098 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4] 2> 930098 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 930098 INFO (coreLoadExecutor-2276-thread-1) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 930098 INFO (coreLoadExecutor-2276-thread-1) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 930105 INFO (coreLoadExecutor-2276-thread-1) [ ] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 930108 INFO (coreLoadExecutor-2276-thread-1) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 930114 INFO (coreLoadExecutor-2276-thread-1) [ ] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
[junit4] 2> 930117 INFO (coreLoadExecutor-2276-thread-1) [ ] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 930119 INFO (coreLoadExecutor-2276-thread-1) [ ] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 930121 INFO (coreLoadExecutor-2276-thread-1) [ ] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/collection1'
[junit4] 2> 930121 INFO (coreLoadExecutor-2276-thread-1) [ ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/./collection1
[junit4] 2> 930121 INFO (coreLoadExecutor-2276-thread-1) [ x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 930121 INFO (coreLoadExecutor-2276-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/./collection1/data/]
[junit4] 2> 930121 INFO (coreLoadExecutor-2276-thread-1) [ x:collection1] o.a.s.c.SolrCore JMX monitoring not detected for core: collection1
[junit4] 2> 930121 INFO (coreLoadExecutor-2276-thread-1) [ x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/./collection1/data
[junit4] 2> 930122 INFO (coreLoadExecutor-2276-thread-1) [ x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/./collection1/data/index/
[junit4] 2> 930122 WARN (coreLoadExecutor-2276-thread-1) [ x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/./collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 930122 INFO (coreLoadExecutor-2276-thread-1) [ x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/./collection1/data/index
[junit4] 2> 930122 INFO (coreLoadExecutor-2276-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=41, maxMergeAtOnceExplicit=44, maxMergedSegmentMB=2.59765625, floorSegmentMB=1.2158203125, forceMergeDeletesPctAllowed=24.325695306775234, segmentsPerTier=37.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6331213847609353
[junit4] 2> 930123 INFO (coreLoadExecutor-2276-thread-1) [ x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@cc2a809 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@63df9f09),segFN=segments_1,generation=1}
[junit4] 2> 930123 INFO (coreLoadExecutor-2276-thread-1) [ x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 930123 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [ x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/./collection1/data/
[junit4] 2> 930125 INFO (coreLoadExecutor-2276-thread-1) [ x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 930126 INFO (coreLoadExecutor-2276-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 930127 INFO (coreLoadExecutor-2276-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 930128 INFO (coreLoadExecutor-2276-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 930128 INFO (coreLoadExecutor-2276-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 930130 INFO (coreLoadExecutor-2276-thread-1) [ x:collection1] o.a.s.c.PluginBag requestHandler : 'lazy' created with startup=lazy
[junit4] 2> 930130 INFO (coreLoadExecutor-2276-thread-1) [ x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,lazy,/update/json/docs,/admin/luke,/export,/get,/admin/properties,/update/json,/admin/threads,/update/csv,/sql,/admin/segments,/admin/system,/replication,defaults,/config,/stream,/schema,/admin/plugins,/admin/logging,/admin/ping,/update,/admin/file
[junit4] 2> 930130 INFO (coreLoadExecutor-2276-thread-1) [ x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 930130 INFO (coreLoadExecutor-2276-thread-1) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 930130 INFO (coreLoadExecutor-2276-thread-1) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 930131 INFO (coreLoadExecutor-2276-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=29, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 930131 INFO (coreLoadExecutor-2276-thread-1) [ x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@cc2a809 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@63df9f09),segFN=segments_1,generation=1}
[junit4] 2> 930131 INFO (coreLoadExecutor-2276-thread-1) [ x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 930131 INFO (coreLoadExecutor-2276-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@25e07633[collection1] main
[junit4] 2> 930131 INFO (coreLoadExecutor-2276-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/collection1/conf
[junit4] 2> 930131 INFO (coreLoadExecutor-2276-thread-1) [ x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {storageDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/collection1/conf}
[junit4] 2> 930131 INFO (coreLoadExecutor-2276-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using file:dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/collection1/conf
[junit4] 2> 930131 INFO (coreLoadExecutor-2276-thread-1) [ x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 930132 INFO (coreLoadExecutor-2276-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Replication enabled for following config files: schema.xml,xslt/dummy.xsl
[junit4] 2> 930132 INFO (coreLoadExecutor-2276-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 930132 INFO (searcherExecutor-2277-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@25e07633[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 930132 INFO (coreLoadExecutor-2276-thread-1) [ x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 930600 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-002/collection1
[junit4] 2> 930604 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.e.j.s.Server jetty-9.3.6.v20151106
[junit4] 2> 930605 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@28ad9241{/solr,null,AVAILABLE}
[junit4] 2> 930606 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.e.j.s.ServerConnector Started ServerConnector@34cfdf21{HTTP/1.1,[http/1.1]}{127.0.0.1:48654}
[junit4] 2> 930606 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.e.j.s.Server Started @934505ms
[junit4] 2> 930606 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-002/collection1/data, hostContext=/solr, hostPort=48654}
[junit4] 2> 930607 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 930607 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-002'
[junit4] 2> 930607 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 930607 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 930607 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-002/solr.xml
[junit4] 2> 930611 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-002/.
[junit4] 2> 930612 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.c.CoreContainer New CoreContainer 1405931777
[junit4] 2> 930612 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-002]
[junit4] 2> 930612 WARN (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-002/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-002/lib
[junit4] 2> 930613 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 930613 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 930614 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 930614 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 930614 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 930614 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 930614 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-002/.
[junit4] 2> 930615 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, loadOnStartup=true, schema=schema.xml, configSetProperties=configsetprops.json, transient=false, dataDir=data/}
[junit4] 2> 930616 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-002/./collection1
[junit4] 2> 930616 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
[junit4] 2> 930616 INFO (coreLoadExecutor-2286-thread-1) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-002/collection1'
[junit4] 2> 930617 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4] 2> 930617 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 930617 INFO (coreLoadExecutor-2286-thread-1) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 930617 INFO (coreLoadExecutor-2286-thread-1) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 930622 INFO (coreLoadExecutor-2286-thread-1) [ ] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 930624 INFO (coreLoadExecutor-2286-thread-1) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 930630 INFO (coreLoadExecutor-2286-thread-1) [ ] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
[junit4] 2> 930633 INFO (coreLoadExecutor-2286-thread-1) [ ] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 930635 INFO (coreLoadExecutor-2286-thread-1) [ ] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 930636 INFO (coreLoadExecutor-2286-thread-1) [ ] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-002/collection1'
[junit4] 2> 930636 INFO (coreLoadExecutor-2286-thread-1) [ ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-002/./collection1
[junit4] 2> 930636 INFO (coreLoadExecutor-2286-thread-1) [ x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 930636 INFO (coreLoadExecutor-2286-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-002/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-002/./collection1/data/]
[junit4] 2> 930636 INFO (coreLoadExecutor-2286-thread-1) [ x:collection1] o.a.s.c.SolrCore JMX monitoring not detected for core: collection1
[junit4] 2> 930637 INFO (coreLoadExecutor-2286-thread-1) [ x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-002/./collection1/data
[junit4] 2> 930637 INFO (coreLoadExecutor-2286-thread-1) [ x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-002/./collection1/data/index/
[junit4] 2> 930637 WARN (coreLoadExecutor-2286-thread-1) [ x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-002/./collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 930637 INFO (coreLoadExecutor-2286-thread-1) [ x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-002/./collection1/data/index
[junit4] 2> 930637 INFO (coreLoadExecutor-2286-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=41, maxMergeAtOnceExplicit=44, maxMergedSegmentMB=2.59765625, floorSegmentMB=1.2158203125, forceMergeDeletesPctAllowed=24.325695306775234, segmentsPerTier=37.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6331213847609353
[junit4] 2> 930638 INFO (coreLoadExecutor-2286-thread-1) [ x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@6bf91c61 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@25b046aa),segFN=segments_1,generation=1}
[junit4] 2> 930638 INFO (coreLoadExecutor-2286-thread-1) [ x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 930638 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [ x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-002/./collection1/data/
[junit4] 2> 930640 INFO (coreLoadExecutor-2286-thread-1) [ x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 930641 INFO (coreLoadExecutor-2286-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 930642 INFO (coreLoadExecutor-2286-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 930642 INFO (coreLoadExecutor-2286-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 930643 INFO (coreLoadExecutor-2286-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 930644 INFO (coreLoadExecutor-2286-thread-1) [ x:collection1] o.a.s.c.PluginBag requestHandler : 'lazy' created with startup=lazy
[junit4] 2> 930644 INFO (coreLoadExecutor-2286-thread-1) [ x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,lazy,/update/json/docs,/admin/luke,/export,/get,/admin/properties,/update/json,/admin/threads,/update/csv,/sql,/admin/segments,/admin/system,/replication,defaults,/config,/stream,/schema,/admin/plugins,/admin/logging,/admin/ping,/update,/admin/file
[junit4] 2> 930645 INFO (coreLoadExecutor-2286-thread-1) [ x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 930645 INFO (coreLoadExecutor-2286-thread-1) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 930645 INFO (coreLoadExecutor-2286-thread-1) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 930645 INFO (coreLoadExecutor-2286-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=29, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 930645 INFO (coreLoadExecutor-2286-thread-1) [ x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@6bf91c61 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@25b046aa),segFN=segments_1,generation=1}
[junit4] 2> 930646 INFO (coreLoadExecutor-2286-thread-1) [ x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 930646 INFO (coreLoadExecutor-2286-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@17c8081b[collection1] main
[junit4] 2> 930646 INFO (coreLoadExecutor-2286-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-002/collection1/conf
[junit4] 2> 930646 INFO (coreLoadExecutor-2286-thread-1) [ x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {storageDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-002/collection1/conf}
[junit4] 2> 930646 INFO (coreLoadExecutor-2286-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using file:dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-002/collection1/conf
[junit4] 2> 930646 INFO (coreLoadExecutor-2286-thread-1) [ x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 930648 INFO (coreLoadExecutor-2286-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 1000ms
[junit4] 2> 930648 INFO (searcherExecutor-2287-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@17c8081b[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 930649 INFO (coreLoadExecutor-2286-thread-1) [ x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 930651 INFO (qtp352348546-7076) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
[junit4] 2> 931119 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.e.j.s.ServerConnector Stopped ServerConnector@34cfdf21{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 931119 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1405931777
[junit4] 2> 931119 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ x:collection1] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@734a167d
[junit4] 2> 931120 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ x:collection1] o.a.s.u.DirectUpdateHandler2 closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 931120 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ x:collection1] o.a.s.u.SolrCoreState Closing SolrCoreState
[junit4] 2> 931120 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ x:collection1] o.a.s.u.DefaultSolrCoreState SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 931120 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ x:collection1] o.a.s.u.DefaultSolrCoreState closing IndexWriter with IndexWriterCloser
[junit4] 2> 931121 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ x:collection1] o.a.s.c.SolrCore [collection1] Closing main searcher on request.
[junit4] 2> 931121 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 931121 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-002/./collection1/data [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-002/./collection1/data;done=false>>]
[junit4] 2> 931121 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-002/./collection1/data
[junit4] 2> 931121 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-002/./collection1/data/index [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-002/./collection1/data/index;done=false>>]
[junit4] 2> 931122 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-002/./collection1/data/index
[junit4] 2> 931122 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ x:collection1] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@28ad9241{/solr,null,UNAVAILABLE}
[junit4] 2> 931124 INFO (qtp352348546-7080) [ x:collection1] o.a.s.u.DirectUpdateHandler2 [collection1] REMOVING ALL DOCUMENTS FROM INDEX
[junit4] 2> 931124 INFO (qtp352348546-7080) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{deleteByQuery=*:*} 0 0
[junit4] 2> 931126 INFO (qtp352348546-7073) [ x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 931126 INFO (qtp352348546-7073) [ x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=2
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@cc2a809 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@63df9f09),segFN=segments_1,generation=1}
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@cc2a809 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@63df9f09),segFN=segments_2,generation=2}
[junit4] 2> 931127 INFO (qtp352348546-7073) [ x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 2
[junit4] 2> 931128 INFO (qtp352348546-7073) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@fc6c71f[collection1] main
[junit4] 2> 931128 INFO (qtp352348546-7073) [ x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 931128 INFO (searcherExecutor-2277-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@fc6c71f[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 931128 INFO (qtp352348546-7073) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 1
[junit4] 2> 931130 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.e.j.s.ServerConnector Stopped ServerConnector@7ea56aaf{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 931130 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=626084757
[junit4] 2> 931130 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ x:collection1] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@379fa46
[junit4] 2> 931130 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ x:collection1] o.a.s.u.DirectUpdateHandler2 closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0}
[junit4] 2> 931130 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ x:collection1] o.a.s.u.SolrCoreState Closing SolrCoreState
[junit4] 2> 931130 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ x:collection1] o.a.s.u.DefaultSolrCoreState SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 931130 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ x:collection1] o.a.s.u.DefaultSolrCoreState closing IndexWriter with IndexWriterCloser
[junit4] 2> 931131 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ x:collection1] o.a.s.c.SolrCore [collection1] Closing main searcher on request.
[junit4] 2> 931131 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 931131 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/./collection1/data [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/./collection1/data;done=false>>]
[junit4] 2> 931131 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/./collection1/data
[junit4] 2> 931131 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/./collection1/data/index [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/./collection1/data/index;done=false>>]
[junit4] 2> 931131 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/./collection1/data/index
[junit4] 2> 931132 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ x:collection1] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@255125ed{/solr,null,UNAVAILABLE}
[junit4] 2> 931134 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.e.j.s.Server jetty-9.3.6.v20151106
[junit4] 2> 931135 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@33d9490a{/solr,null,AVAILABLE}
[junit4] 2> 931136 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.e.j.s.ServerConnector Started ServerConnector@4cd43bed{HTTP/1.1,[http/1.1]}{127.0.0.1:38841}
[junit4] 2> 931136 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.e.j.s.Server Started @935035ms
[junit4] 2> 931136 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/collection1/data, hostContext=/solr, hostPort=38841}
[junit4] 2> 931136 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 931137 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001'
[junit4] 2> 931137 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 931137 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 931137 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/solr.xml
[junit4] 2> 931141 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/.
[junit4] 2> 931141 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.c.CoreContainer New CoreContainer 720444629
[junit4] 2> 931141 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001]
[junit4] 2> 931141 WARN (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/lib
[junit4] 2> 931142 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 931143 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 931143 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 931143 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 931143 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 931143 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 931144 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/.
[junit4] 2> 931145 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, loadOnStartup=true, schema=schema.xml, configSetProperties=configsetprops.json, transient=false, dataDir=data/}
[junit4] 2> 931145 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/./collection1
[junit4] 2> 931145 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
[junit4] 2> 931145 INFO (coreLoadExecutor-2297-thread-1) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/collection1'
[junit4] 2> 931146 INFO (coreLoadExecutor-2297-thread-1) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 931146 INFO (coreLoadExecutor-2297-thread-1) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 931148 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4] 2> 931148 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[D2C9FCE857647949]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 931151 INFO (coreLoadExecutor-2297-thread-1) [ ] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 931155 INFO (coreLoadExecutor-2297-thread-1) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 931161 INFO (coreLoadExecutor-2297-thread-1) [ ] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
[junit4] 2> 931164 INFO (coreLoadExecutor-2297-thread-1) [ ] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 931166 INFO (coreLoadExecutor-2297-thread-1) [ ] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 931167 INFO (coreLoadExecutor-2297-thread-1) [ ] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/collection1'
[junit4] 2> 931167 INFO (coreLoadExecutor-2297-thread-1) [ ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/./collection1
[junit4] 2> 931167 INFO (coreLoadExecutor-2297-thread-1) [ x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 931167 INFO (coreLoadExecutor-2297-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/./collection1/data/]
[junit4] 2> 931168 INFO (coreLoadExecutor-2297-thread-1) [ x:collection1] o.a.s.c.SolrCore JMX monitoring not detected for core: collection1
[junit4] 2> 931168 INFO (coreLoadExecutor-2297-thread-1) [ x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/./collection1/data
[junit4] 2> 931168 INFO (coreLoadExecutor-2297-thread-1) [ x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/./collection1/data/index/
[junit4] 2> 931168 WARN (coreLoadExecutor-2297-thread-1) [ x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/./collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 931168 INFO (coreLoadExecutor-2297-thread-1) [ x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/./collection1/data/index
[junit4] 2> 931168 INFO (coreLoadExecutor-2297-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=41, maxMergeAtOnceExplicit=44, maxMergedSegmentMB=2.59765625, floorSegmentMB=1.2158203125, forceMergeDeletesPctAllowed=24.325695306775234, segmentsPerTier=37.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6331213847609353
[junit4] 2> 931169 INFO (coreLoadExecutor-2297-thread-1) [ x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@50f0b45e lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@54c4ef76),segFN=segments_1,generation=1}
[junit4] 2> 931169 INFO (coreLoadExecutor-2297-thread-1) [ x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 931169 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [ x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/./collection1/data/
[junit4] 2> 931171 INFO (coreLoadExecutor-2297-thread-1) [ x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 931172 INFO (coreLoadExecutor-2297-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 931173 INFO (coreLoadExecutor-2297-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 931173 INFO (coreLoadExecutor-2297-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 931174 INFO (coreLoadExecutor-2297-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 931175 INFO (coreLoadExecutor-2297-thread-1) [ x:collection1] o.a.s.c.PluginBag requestHandler : 'lazy' created with startup=lazy
[junit4] 2> 931175 INFO (coreLoadExecutor-2297-thread-1) [ x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,lazy,/update/json/docs,/admin/luke,/export,/get,/admin/properties,/update/json,/admin/threads,/update/csv,/sql,/admin/segments,/admin/system,/replication,defaults,/config,/stream,/schema,/admin/plugins,/admin/logging,/admin/ping,/update,/admin/file
[junit4] 2> 931176 INFO (coreLoadExecutor-2297-thread-1) [ x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 931176 INFO (coreLoadExecutor-2297-thread-1) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 931176 INFO (coreLoadExecutor-2297-thread-1) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 931176 INFO (coreLoadExecutor-2297-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=29, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 931176 INFO (coreLoadExecutor-2297-thread-1) [ x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@50f0b45e lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@54c4ef76),segFN=segments_1,generation=1}
[junit4] 2> 931176 INFO (coreLoadExecutor-2297-thread-1) [ x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 931177 INFO (coreLoadExecutor-2297-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@572ee27b[collection1] main
[junit4] 2> 931177 INFO (coreLoadExecutor-2297-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/collection1/conf
[junit4] 2> 931177 INFO (coreLoadExecutor-2297-thread-1) [ x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {storageDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/collection1/conf}
[junit4] 2> 931177 INFO (coreLoadExecutor-2297-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using file:dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_D2C9FCE857647949-001/solr-instance-001/collection1/conf
[junit4] 2> 931177 INFO (coreLoadExecutor-2297-thread-1) [ x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 931177 INFO (coreLoadExecutor-2297-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Replication enabled for following config files: schema.xml
[junit4] 2> 931177 INFO (coreLoadExecutor-2297-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 931177 INFO (searcherExecutor-2298-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@572ee27b[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 931177 INFO (coreLoadExecutor-2297-thread-1) [ x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 931651 INFO (qtp765290217-7116) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[0]} 0 0
[junit4] 2> 931652 INFO (qtp765290217-7117) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[1]} 0 0
[junit4] 2> 931654 INFO (qtp765290217-7118) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[2]} 0 0
[junit4] 2> 931656 INFO (qtp765290217-7119) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[3]} 0 0
[junit4] 2> 931658 INFO (qtp765290217-7120) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[4]} 0 0
[junit4] 2> 931659 INFO (qtp765290217-7113) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[5]} 0 0
[junit4] 2> 931661 INFO (qtp765290217-7116) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[6]} 0 0
[junit4] 2> 931663 INFO (qtp765290217-7116) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[7]} 0 0
[junit4] 2> 931664 INFO (qtp765290217-7118) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[8]} 0 0
[junit4] 2> 931666 INFO (qtp765290217-7119) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[9]} 0 0
[junit4] 2> 931668 INFO (qtp765290217-7120) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[10]} 0 0
[junit4] 2> 931669 INFO (qtp765290217-7113) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[11]} 0 0
[junit4] 2> 931671 INFO (qtp765290217-7117) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[12]} 0 0
[junit4] 2> 931673 INFO (qtp765290217-7117) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[13]} 0 0
[junit4] 2> 931674 INFO (qtp765290217-7117) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[14]} 0 0
[junit4] 2> 931676 INFO (qtp765290217-7117) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[15]} 0 0
[junit4] 2> 931678 INFO (qtp765290217-7117) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[16]} 0 0
[junit4] 2> 931680 INFO (qtp765290217-7113) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[17]} 0 0
[junit4] 2> 931682 INFO (qtp765290217-7116) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[18]} 0 0
[junit4] 2> 931684 INFO (qtp765290217-7118) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[19]} 0 0
[junit4] 2> 931686 INFO (qtp765290217-7119) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[20]} 0 0
[junit4] 2> 931688 INFO (qtp765290217-7120) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[21]} 0 0
[junit4] 2> 931690 INFO (qtp765290217-7120) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[22]} 0 0
[junit4] 2> 931691 INFO (qtp765290217-7113) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[23]} 0 0
[junit4] 2> 931693 INFO (qtp765290217-7116) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[24]} 0 0
[junit4] 2> 931695 INFO (qtp765290217-7116) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[25]} 0 0
[junit4] 2> 931696 INFO (qtp765290217-7119) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[26]} 0 0
[junit4] 2> 931698 INFO (qtp765290217-7117) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[27]} 0 0
[junit4] 2> 931700 INFO (qtp765290217-7120) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[28]} 0 0
[junit4] 2> 931701 INFO (qtp765290217-7120) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[29]} 0 0
[junit4] 2> 931703 INFO (qtp765290217-7118) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[30]} 0 0
[junit4] 2> 931704 INFO (qtp765290217-7118) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[31]} 0 0
[junit4] 2> 931706 INFO (qtp765290217-7119) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[32]} 0 0
[junit4] 2> 931708 INFO (qtp765290217-7117) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[33]} 0 0
[junit4] 2> 931710 INFO (qtp765290217-7113) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[34]} 0 0
[junit4] 2> 931711 INFO (qtp765290217-7120) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[35]} 0 0
[junit4] 2> 931713 INFO (qtp765290217-7116) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[36]} 0 0
[junit4] 2> 931715 INFO (qtp765290217-7116) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[37]} 0 0
[junit4] 2> 931718 INFO (qtp765290217-7119) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[38]} 0 1
[junit4] 2> 931720 INFO (qtp765290217-7117) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr
[...truncated too long message...]
st(LBHttpSolrClient.java:325)
[junit4] > ... 5 moreThrowable #4: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=15168, name=collection4, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > Caused by: java.lang.RuntimeException: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:42569/hi/jf, http://127.0.0.1:58154/hi/jf, http://127.0.0.1:59250/hi/jf, http://127.0.0.1:57798/hi/jf, http://127.0.0.1:36779/hi/jf]
[junit4] > at __randomizedtesting.SeedInfo.seed([D2C9FCE857647949]:0)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:891)
[junit4] > Caused by: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:42569/hi/jf, http://127.0.0.1:58154/hi/jf, http://127.0.0.1:59250/hi/jf, http://127.0.0.1:57798/hi/jf, http://127.0.0.1:36779/hi/jf]
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:352)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:871)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:807)
[junit4] > at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1574)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1595)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:881)
[junit4] > Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:57798/hi/jf: KeeperErrorCode = Session expired for /overseer/collection-queue-work/qnr-
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
[junit4] > ... 7 moreThrowable #5: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=15166, name=collection2, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > Caused by: java.lang.RuntimeException: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:42569/hi/jf, http://127.0.0.1:58154/hi/jf, http://127.0.0.1:59250/hi/jf, http://127.0.0.1:57798/hi/jf, http://127.0.0.1:36779/hi/jf]
[junit4] > at __randomizedtesting.SeedInfo.seed([D2C9FCE857647949]:0)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:891)
[junit4] > Caused by: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:42569/hi/jf, http://127.0.0.1:58154/hi/jf, http://127.0.0.1:59250/hi/jf, http://127.0.0.1:57798/hi/jf, http://127.0.0.1:36779/hi/jf]
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:352)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:871)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:807)
[junit4] > at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1574)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1595)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:881)
[junit4] > Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:57798/hi/jf: KeeperErrorCode = Session expired for /overseer/collection-queue-work/qnr-
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
[junit4] > ... 7 more
[junit4] 2> 3254411 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[D2C9FCE857647949]-worker) [n:127.0.0.1:42569_hi%2Fjf c:addReplicaColl s:shard2 r:core_node1 x:addReplicaColl_shard2_replica2] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene60), sim=ClassicSimilarity, locale=be_BY, timezone=Kwajalein
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_66 (64-bit)/cpus=4,threads=1,free=44668632,total=484966400
[junit4] 2> NOTE: All tests run in this JVM: [CollectionsAPIAsyncDistributedZkTest, OutputWriterTest, TestReloadDeadlock, TestArbitraryIndexDir, SaslZkACLProviderTest, DistribCursorPagingTest, JSONWriterTest, CopyFieldTest, CollectionReloadTest, AnalysisAfterCoreReloadTest, TestDocBasedVersionConstraints, QueryEqualityTest, JsonLoaderTest, TestLuceneMatchVersion, TestStressUserVersions, CursorPagingTest, SynonymTokenizerTest, TestComplexPhraseQParserPlugin, TestComponentsName, TestFastOutputStream, ConjunctionSolrSpellCheckerTest, TestBinaryField, AnalysisErrorHandlingTest, RequiredFieldsTest, RestartWhileUpdatingTest, DistributedQueryComponentOptimizationTest, HdfsDirectoryTest, TestRemoteStreaming, SegmentsInfoRequestHandlerTest, DeleteLastCustomShardedReplicaTest, AliasIntegrationTest, HdfsWriteToMultipleCollectionsTest, TestIBSimilarityFactory, DistributedSpellCheckComponentTest, TestRequestForwarding, TestClassNameShortening, TestInitParams, TestFoldingMultitermQuery, TestRestoreCore, TestCloudManagedSchema, TestCSVLoader, TestTrackingShardHandlerFactory, OverseerRolesTest, TestRangeQuery, TestScoreJoinQPScore, TestOverriddenPrefixQueryForCustomFieldType, SyncSliceTest, TestMaxScoreQueryParser, ExternalFileFieldSortTest, TestExactStatsCache, TestRTimerTree, QueryElevationComponentTest, TestManagedSchemaDynamicFieldResource, MergeStrategyTest, TestSolrCloudWithKerberosAlt, ReturnFieldsTest, FileBasedSpellCheckerTest, StandardRequestHandlerTest, TestDefaultStatsCache, SolrXmlInZkTest, PathHierarchyTokenizerFactoryTest, TestDynamicFieldCollectionResource, TestMinMaxOnMultiValuedField, TestConfig, TestRandomRequestDistribution, TestCollationFieldDocValues, TestAddFieldRealTimeGet, TestHighlightDedupGrouping, TestSolrXml, ZkNodePropsTest, TestReplicationHandler, OutOfBoxZkACLAndCredentialsProvidersTest, TestRandomFaceting, SharedFSAutoReplicaFailoverUtilsTest, TestConfigSetsAPIExclusivity, SolrCoreTest, RulesTest, TestFunctionQuery, EchoParamsTest, HdfsSyncSliceTest, TestFilteredDocIdSet, TestRealTimeGet, RAMDirectoryFactoryTest, TestDistribDocBasedVersion, HdfsDirectoryFactoryTest, LeaderInitiatedRecoveryOnShardRestartTest, PeerSyncTest, HdfsRecoverLeaseTest, PreAnalyzedFieldTest, SpatialHeatmapFacetsTest, SystemInfoHandlerTest, TestConfigReload, DocumentAnalysisRequestHandlerTest, TestFieldResource, TestManagedStopFilterFactory, BasicDistributedZkTest, ChaosMonkeySafeLeaderTest, CollectionsAPIDistributedZkTest]
[junit4] Completed [304/568 (2!)] on J0 in 902.96s, 1 test, 1 error <<< FAILURES!
[...truncated 824 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:791: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:728: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1436: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:991: There were test failures: 568 suites (8 ignored), 2263 tests, 1 error, 1 failure, 33 ignored (18 assumptions) [seed: D2C9FCE857647949]
Total time: 206 minutes 49 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 886 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/886/
1 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.handler.TestReplicationHandler
Error Message:
ObjectTracker found 9 object(s) that were not released!!! [NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory]
Stack Trace:
java.lang.AssertionError: ObjectTracker found 9 object(s) that were not released!!! [NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory]
at __randomizedtesting.SeedInfo.seed([503A246F46768822]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNull(Assert.java:551)
at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:229)
at sun.reflect.GeneratedMethodAccessor50.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:834)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 10745 lines...]
[junit4] Suite: org.apache.solr.handler.TestReplicationHandler
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/init-core-data-001
[junit4] 2> 2007019 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.SolrTestCaseJ4 ###Starting doTestRepeater
[junit4] 2> 2007020 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-001/collection1
[junit4] 2> 2007036 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.e.j.s.Server jetty-9.3.6.v20151106
[junit4] 2> 2007062 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@16177fde{/solr,null,AVAILABLE}
[junit4] 2> 2007079 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.e.j.s.ServerConnector Started ServerConnector@1fec667b{HTTP/1.1,[http/1.1]}{127.0.0.1:35050}
[junit4] 2> 2007079 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.e.j.s.Server Started @2010183ms
[junit4] 2> 2007079 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-001/collection1/data, hostContext=/solr, hostPort=35050}
[junit4] 2> 2007079 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 2007079 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-001'
[junit4] 2> 2007079 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2007080 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 2007080 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-001/solr.xml
[junit4] 2> 2007085 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-001/.
[junit4] 2> 2007085 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.c.CoreContainer New CoreContainer 283985088
[junit4] 2> 2007085 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-001]
[junit4] 2> 2007085 WARN (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-001/lib
[junit4] 2> 2007085 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 2007087 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 2007087 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2007087 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2007087 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 2007087 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 2007088 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-001/.
[junit4] 2> 2007090 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, loadOnStartup=true, schema=schema.xml, configSetProperties=configsetprops.json, transient=false, dataDir=data/}
[junit4] 2> 2007090 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-001/./collection1
[junit4] 2> 2007090 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
[junit4] 2> 2007090 INFO (coreLoadExecutor-4463-thread-1) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-001/collection1'
[junit4] 2> 2007090 INFO (coreLoadExecutor-4463-thread-1) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2007090 INFO (coreLoadExecutor-4463-thread-1) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 2007113 INFO (coreLoadExecutor-4463-thread-1) [ ] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 2007120 INFO (coreLoadExecutor-4463-thread-1) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 2007150 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2
[junit4] 2> 2007150 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 2007152 INFO (coreLoadExecutor-4463-thread-1) [ ] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2007158 INFO (coreLoadExecutor-4463-thread-1) [ ] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 2007162 INFO (coreLoadExecutor-4463-thread-1) [ ] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 2007164 INFO (coreLoadExecutor-4463-thread-1) [ ] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-001/collection1'
[junit4] 2> 2007164 INFO (coreLoadExecutor-4463-thread-1) [ ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-001/./collection1
[junit4] 2> 2007164 INFO (coreLoadExecutor-4463-thread-1) [ x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 2007165 INFO (coreLoadExecutor-4463-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-001/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-001/./collection1/data/]
[junit4] 2> 2007165 INFO (coreLoadExecutor-4463-thread-1) [ x:collection1] o.a.s.c.SolrCore JMX monitoring not detected for core: collection1
[junit4] 2> 2007165 INFO (coreLoadExecutor-4463-thread-1) [ x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-001/./collection1/data
[junit4] 2> 2007165 INFO (coreLoadExecutor-4463-thread-1) [ x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-001/./collection1/data/index/
[junit4] 2> 2007165 WARN (coreLoadExecutor-4463-thread-1) [ x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-001/./collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 2007166 INFO (coreLoadExecutor-4463-thread-1) [ x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-001/./collection1/data/index
[junit4] 2> 2007166 INFO (coreLoadExecutor-4463-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=50, maxMergeAtOnceExplicit=15, maxMergedSegmentMB=67.7880859375, floorSegmentMB=2.0234375, forceMergeDeletesPctAllowed=14.357579647500632, segmentsPerTier=16.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 2007166 INFO (coreLoadExecutor-4463-thread-1) [ x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@468381ef lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@51cae963),segFN=segments_1,generation=1}
[junit4] 2> 2007166 INFO (coreLoadExecutor-4463-thread-1) [ x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 2007168 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [ x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-001/./collection1/data/
[junit4] 2> 2007169 INFO (coreLoadExecutor-4463-thread-1) [ x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 2007171 INFO (coreLoadExecutor-4463-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 2007172 INFO (coreLoadExecutor-4463-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 2007173 INFO (coreLoadExecutor-4463-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 2007173 INFO (coreLoadExecutor-4463-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 2007178 INFO (coreLoadExecutor-4463-thread-1) [ x:collection1] o.a.s.c.PluginBag requestHandler : 'lazy' created with startup=lazy
[junit4] 2> 2007178 INFO (coreLoadExecutor-4463-thread-1) [ x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,lazy,/update/json/docs,/admin/luke,/export,/get,/admin/properties,/update/json,/admin/threads,/update/csv,/sql,/admin/segments,/admin/system,/replication,defaults,/config,/stream,/schema,/admin/plugins,/admin/logging,/admin/ping,/update,/admin/file
[junit4] 2> 2007178 INFO (coreLoadExecutor-4463-thread-1) [ x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 2007179 INFO (coreLoadExecutor-4463-thread-1) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2007179 INFO (coreLoadExecutor-4463-thread-1) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2007179 INFO (coreLoadExecutor-4463-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=24, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 2007180 INFO (coreLoadExecutor-4463-thread-1) [ x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@468381ef lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@51cae963),segFN=segments_1,generation=1}
[junit4] 2> 2007180 INFO (coreLoadExecutor-4463-thread-1) [ x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 2007180 INFO (coreLoadExecutor-4463-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@6857d051[collection1] main
[junit4] 2> 2007199 INFO (coreLoadExecutor-4463-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-001/collection1/conf
[junit4] 2> 2007199 INFO (coreLoadExecutor-4463-thread-1) [ x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {storageDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-001/collection1/conf}
[junit4] 2> 2007199 INFO (coreLoadExecutor-4463-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using file:dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-001/collection1/conf
[junit4] 2> 2007200 INFO (coreLoadExecutor-4463-thread-1) [ x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 2007200 INFO (coreLoadExecutor-4463-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Replication enabled for following config files: schema.xml,xslt/dummy.xsl
[junit4] 2> 2007201 INFO (coreLoadExecutor-4463-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 2007201 INFO (coreLoadExecutor-4463-thread-1) [ x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 2007201 INFO (searcherExecutor-4464-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@6857d051[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2007651 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-002/collection1
[junit4] 2> 2007655 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.e.j.s.Server jetty-9.3.6.v20151106
[junit4] 2> 2007668 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4cdc94aa{/solr,null,AVAILABLE}
[junit4] 2> 2007668 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.e.j.s.ServerConnector Started ServerConnector@65357bad{HTTP/1.1,[http/1.1]}{127.0.0.1:54027}
[junit4] 2> 2007668 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.e.j.s.Server Started @2010772ms
[junit4] 2> 2007668 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-002/collection1/data, hostContext=/solr, hostPort=54027}
[junit4] 2> 2007669 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 2007669 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-002'
[junit4] 2> 2007669 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2007669 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 2007669 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-002/solr.xml
[junit4] 2> 2007673 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-002/.
[junit4] 2> 2007673 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.c.CoreContainer New CoreContainer 1191723553
[junit4] 2> 2007673 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-002]
[junit4] 2> 2007673 WARN (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-002/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-002/lib
[junit4] 2> 2007674 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 2007675 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 2007675 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2007675 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2007675 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 2007675 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 2007676 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-002/.
[junit4] 2> 2007677 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, loadOnStartup=true, schema=schema.xml, configSetProperties=configsetprops.json, transient=false, dataDir=data/}
[junit4] 2> 2007677 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-002/./collection1
[junit4] 2> 2007677 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
[junit4] 2> 2007678 INFO (coreLoadExecutor-4473-thread-1) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-002/collection1'
[junit4] 2> 2007678 INFO (coreLoadExecutor-4473-thread-1) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2007678 INFO (coreLoadExecutor-4473-thread-1) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 2007692 INFO (coreLoadExecutor-4473-thread-1) [ ] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 2007726 INFO (coreLoadExecutor-4473-thread-1) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 2007732 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2
[junit4] 2> 2007732 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 2007749 INFO (coreLoadExecutor-4473-thread-1) [ ] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2007752 INFO (coreLoadExecutor-4473-thread-1) [ ] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 2007754 INFO (coreLoadExecutor-4473-thread-1) [ ] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 2007755 INFO (coreLoadExecutor-4473-thread-1) [ ] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-002/collection1'
[junit4] 2> 2007755 INFO (coreLoadExecutor-4473-thread-1) [ ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-002/./collection1
[junit4] 2> 2007755 INFO (coreLoadExecutor-4473-thread-1) [ x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 2007755 INFO (coreLoadExecutor-4473-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-002/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-002/./collection1/data/]
[junit4] 2> 2007755 INFO (coreLoadExecutor-4473-thread-1) [ x:collection1] o.a.s.c.SolrCore JMX monitoring not detected for core: collection1
[junit4] 2> 2007756 INFO (coreLoadExecutor-4473-thread-1) [ x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-002/./collection1/data
[junit4] 2> 2007756 INFO (coreLoadExecutor-4473-thread-1) [ x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-002/./collection1/data/index/
[junit4] 2> 2007756 WARN (coreLoadExecutor-4473-thread-1) [ x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-002/./collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 2007756 INFO (coreLoadExecutor-4473-thread-1) [ x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-002/./collection1/data/index
[junit4] 2> 2007756 INFO (coreLoadExecutor-4473-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=50, maxMergeAtOnceExplicit=15, maxMergedSegmentMB=67.7880859375, floorSegmentMB=2.0234375, forceMergeDeletesPctAllowed=14.357579647500632, segmentsPerTier=16.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 2007757 INFO (coreLoadExecutor-4473-thread-1) [ x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@39917034 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4c7ea5b4),segFN=segments_1,generation=1}
[junit4] 2> 2007757 INFO (coreLoadExecutor-4473-thread-1) [ x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 2007759 INFO (coreLoadExecutor-4473-thread-1) [ x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 2007760 INFO (coreLoadExecutor-4473-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 2007761 INFO (coreLoadExecutor-4473-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 2007761 INFO (coreLoadExecutor-4473-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 2007762 INFO (coreLoadExecutor-4473-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 2007763 INFO (coreLoadExecutor-4473-thread-1) [ x:collection1] o.a.s.c.PluginBag requestHandler : 'lazy' created with startup=lazy
[junit4] 2> 2007763 INFO (coreLoadExecutor-4473-thread-1) [ x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,lazy,/update/json/docs,/admin/luke,/export,/get,/admin/properties,/update/json,/admin/threads,/update/csv,/sql,/admin/segments,/admin/system,/replication,defaults,/config,/stream,/schema,/admin/plugins,/admin/logging,/admin/ping,/update,/admin/file
[junit4] 2> 2007764 INFO (coreLoadExecutor-4473-thread-1) [ x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 2007764 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [ x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-002/./collection1/data/
[junit4] 2> 2007764 INFO (coreLoadExecutor-4473-thread-1) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2007764 INFO (coreLoadExecutor-4473-thread-1) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2007764 INFO (coreLoadExecutor-4473-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=24, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 2007765 INFO (coreLoadExecutor-4473-thread-1) [ x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@39917034 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4c7ea5b4),segFN=segments_1,generation=1}
[junit4] 2> 2007765 INFO (coreLoadExecutor-4473-thread-1) [ x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 2007765 INFO (coreLoadExecutor-4473-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@7f26615b[collection1] main
[junit4] 2> 2007765 INFO (coreLoadExecutor-4473-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-002/collection1/conf
[junit4] 2> 2007765 INFO (coreLoadExecutor-4473-thread-1) [ x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {storageDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-002/collection1/conf}
[junit4] 2> 2007765 INFO (coreLoadExecutor-4473-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using file:dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-002/collection1/conf
[junit4] 2> 2007766 INFO (coreLoadExecutor-4473-thread-1) [ x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 2007768 INFO (coreLoadExecutor-4473-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 1000ms
[junit4] 2> 2007768 INFO (coreLoadExecutor-4473-thread-1) [ x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 2007778 INFO (searcherExecutor-4474-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@7f26615b[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2007779 INFO (qtp1585287444-19221) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
[junit4] 2> 2008237 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.e.j.s.ServerConnector Stopped ServerConnector@65357bad{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 2008237 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1191723553
[junit4] 2> 2008247 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ x:collection1] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@3c45f679
[junit4] 2> 2008248 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ x:collection1] o.a.s.u.DirectUpdateHandler2 closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 2008248 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ x:collection1] o.a.s.u.SolrCoreState Closing SolrCoreState
[junit4] 2> 2008248 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ x:collection1] o.a.s.u.DefaultSolrCoreState SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 2008248 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ x:collection1] o.a.s.u.DefaultSolrCoreState closing IndexWriter with IndexWriterCloser
[junit4] 2> 2008255 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ x:collection1] o.a.s.c.SolrCore [collection1] Closing main searcher on request.
[junit4] 2> 2008255 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 2008255 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-002/./collection1/data [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-002/./collection1/data;done=false>>]
[junit4] 2> 2008255 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-002/./collection1/data
[junit4] 2> 2008255 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-002/./collection1/data/index [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-002/./collection1/data/index;done=false>>]
[junit4] 2> 2008255 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-002/./collection1/data/index
[junit4] 2> 2008256 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ x:collection1] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@4cdc94aa{/solr,null,UNAVAILABLE}
[junit4] 2> 2008270 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.e.j.s.Server jetty-9.3.6.v20151106
[junit4] 2> 2008273 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@28bfef0f{/solr,null,AVAILABLE}
[junit4] 2> 2008274 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.e.j.s.ServerConnector Started ServerConnector@3e37feb4{HTTP/1.1,[http/1.1]}{127.0.0.1:47923}
[junit4] 2> 2008274 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.e.j.s.Server Started @2011378ms
[junit4] 2> 2008274 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-002/collection1/data, hostContext=/solr, hostPort=47923}
[junit4] 2> 2008274 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 2008274 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-002'
[junit4] 2> 2008274 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2008274 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 2008275 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-002/solr.xml
[junit4] 2> 2008280 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-002/.
[junit4] 2> 2008280 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.c.CoreContainer New CoreContainer 1397716977
[junit4] 2> 2008280 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-002]
[junit4] 2> 2008280 WARN (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-002/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-002/lib
[junit4] 2> 2008281 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 2008286 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 2008287 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2008288 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2008288 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 2008288 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 2008289 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-002/.
[junit4] 2> 2008296 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, loadOnStartup=true, schema=schema.xml, configSetProperties=configsetprops.json, transient=false, dataDir=data/}
[junit4] 2> 2008296 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-002/./collection1
[junit4] 2> 2008296 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
[junit4] 2> 2008298 INFO (coreLoadExecutor-4484-thread-1) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-002/collection1'
[junit4] 2> 2008298 INFO (coreLoadExecutor-4484-thread-1) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2008299 INFO (coreLoadExecutor-4484-thread-1) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 2008303 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2
[junit4] 2> 2008303 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 2008305 INFO (coreLoadExecutor-4484-thread-1) [ ] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 2008308 INFO (coreLoadExecutor-4484-thread-1) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 2008313 INFO (coreLoadExecutor-4484-thread-1) [ ] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2008316 INFO (coreLoadExecutor-4484-thread-1) [ ] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 2008318 INFO (coreLoadExecutor-4484-thread-1) [ ] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 2008319 INFO (coreLoadExecutor-4484-thread-1) [ ] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-002/collection1'
[junit4] 2> 2008319 INFO (coreLoadExecutor-4484-thread-1) [ ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-002/./collection1
[junit4] 2> 2008319 INFO (coreLoadExecutor-4484-thread-1) [ x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 2008320 INFO (coreLoadExecutor-4484-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-002/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-002/./collection1/data/]
[junit4] 2> 2008320 INFO (coreLoadExecutor-4484-thread-1) [ x:collection1] o.a.s.c.SolrCore JMX monitoring not detected for core: collection1
[junit4] 2> 2008320 INFO (coreLoadExecutor-4484-thread-1) [ x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-002/./collection1/data
[junit4] 2> 2008320 INFO (coreLoadExecutor-4484-thread-1) [ x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-002/./collection1/data/index/
[junit4] 2> 2008320 WARN (coreLoadExecutor-4484-thread-1) [ x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-002/./collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 2008320 INFO (coreLoadExecutor-4484-thread-1) [ x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-002/./collection1/data/index
[junit4] 2> 2008321 INFO (coreLoadExecutor-4484-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=50, maxMergeAtOnceExplicit=15, maxMergedSegmentMB=67.7880859375, floorSegmentMB=2.0234375, forceMergeDeletesPctAllowed=14.357579647500632, segmentsPerTier=16.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 2008321 INFO (coreLoadExecutor-4484-thread-1) [ x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@4330455c lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@13291e60),segFN=segments_1,generation=1}
[junit4] 2> 2008321 INFO (coreLoadExecutor-4484-thread-1) [ x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 2008360 INFO (coreLoadExecutor-4484-thread-1) [ x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 2008362 INFO (coreLoadExecutor-4484-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 2008362 INFO (coreLoadExecutor-4484-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 2008363 INFO (coreLoadExecutor-4484-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 2008364 INFO (coreLoadExecutor-4484-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 2008365 INFO (coreLoadExecutor-4484-thread-1) [ x:collection1] o.a.s.c.PluginBag requestHandler : 'lazy' created with startup=lazy
[junit4] 2> 2008365 INFO (coreLoadExecutor-4484-thread-1) [ x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,lazy,/update/json/docs,/admin/luke,/export,/get,/admin/properties,/update/json,/admin/threads,/update/csv,/sql,/admin/segments,/admin/system,/replication,defaults,/config,/stream,/schema,/admin/plugins,/admin/logging,/admin/ping,/update,/admin/file
[junit4] 2> 2008365 INFO (coreLoadExecutor-4484-thread-1) [ x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 2008365 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [ x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-002/./collection1/data/
[junit4] 2> 2008366 INFO (coreLoadExecutor-4484-thread-1) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2008366 INFO (coreLoadExecutor-4484-thread-1) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2008366 INFO (coreLoadExecutor-4484-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=24, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 2008366 INFO (coreLoadExecutor-4484-thread-1) [ x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@4330455c lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@13291e60),segFN=segments_1,generation=1}
[junit4] 2> 2008366 INFO (coreLoadExecutor-4484-thread-1) [ x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 2008366 INFO (coreLoadExecutor-4484-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@4ad56cc3[collection1] main
[junit4] 2> 2008367 INFO (coreLoadExecutor-4484-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-002/collection1/conf
[junit4] 2> 2008367 INFO (coreLoadExecutor-4484-thread-1) [ x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {storageDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-002/collection1/conf}
[junit4] 2> 2008367 INFO (coreLoadExecutor-4484-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using file:dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-002/collection1/conf
[junit4] 2> 2008367 INFO (coreLoadExecutor-4484-thread-1) [ x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 2008367 INFO (coreLoadExecutor-4484-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 2008367 INFO (coreLoadExecutor-4484-thread-1) [ x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 2008368 INFO (searcherExecutor-4485-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@4ad56cc3[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2008805 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-003/collection1
[junit4] 2> 2008810 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.e.j.s.Server jetty-9.3.6.v20151106
[junit4] 2> 2008836 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1490cce8{/solr,null,AVAILABLE}
[junit4] 2> 2008836 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.e.j.s.ServerConnector Started ServerConnector@6399070a{HTTP/1.1,[http/1.1]}{127.0.0.1:47250}
[junit4] 2> 2008836 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.e.j.s.Server Started @2011940ms
[junit4] 2> 2008836 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-003/collection1/data, hostContext=/solr, hostPort=47250}
[junit4] 2> 2008837 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 2008837 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-003'
[junit4] 2> 2008837 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2008837 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 2008837 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-003/solr.xml
[junit4] 2> 2008865 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-003/.
[junit4] 2> 2008872 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.c.CoreContainer New CoreContainer 1384503610
[junit4] 2> 2008872 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-003]
[junit4] 2> 2008873 WARN (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-003/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-003/lib
[junit4] 2> 2008873 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 2008874 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 2008874 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2008874 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2008875 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 2008875 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 2008875 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-003/.
[junit4] 2> 2008876 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, loadOnStartup=true, schema=schema.xml, configSetProperties=configsetprops.json, transient=false, dataDir=data/}
[junit4] 2> 2008876 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-003/./collection1
[junit4] 2> 2008876 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
[junit4] 2> 2008877 INFO (coreLoadExecutor-4494-thread-1) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-003/collection1'
[junit4] 2> 2008877 INFO (coreLoadExecutor-4494-thread-1) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2008877 INFO (coreLoadExecutor-4494-thread-1) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 2008894 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2
[junit4] 2> 2008894 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 2008899 INFO (coreLoadExecutor-4494-thread-1) [ ] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 2008920 INFO (coreLoadExecutor-4494-thread-1) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 2008986 INFO (coreLoadExecutor-4494-thread-1) [ ] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2008988 INFO (coreLoadExecutor-4494-thread-1) [ ] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 2008990 INFO (coreLoadExecutor-4494-thread-1) [ ] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 2008992 INFO (coreLoadExecutor-4494-thread-1) [ ] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-003/collection1'
[junit4] 2> 2008993 INFO (coreLoadExecutor-4494-thread-1) [ ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-003/./collection1
[junit4] 2> 2008993 INFO (coreLoadExecutor-4494-thread-1) [ x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 2008993 INFO (coreLoadExecutor-4494-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-003/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-003/./collection1/data/]
[junit4] 2> 2008993 INFO (coreLoadExecutor-4494-thread-1) [ x:collection1] o.a.s.c.SolrCore JMX monitoring not detected for core: collection1
[junit4] 2> 2008993 INFO (coreLoadExecutor-4494-thread-1) [ x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-003/./collection1/data
[junit4] 2> 2008993 INFO (coreLoadExecutor-4494-thread-1) [ x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-003/./collection1/data/index/
[junit4] 2> 2008994 WARN (coreLoadExecutor-4494-thread-1) [ x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-003/./collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 2008994 INFO (coreLoadExecutor-4494-thread-1) [ x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-003/./collection1/data/index
[junit4] 2> 2008994 INFO (coreLoadExecutor-4494-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=50, maxMergeAtOnceExplicit=15, maxMergedSegmentMB=67.7880859375, floorSegmentMB=2.0234375, forceMergeDeletesPctAllowed=14.357579647500632, segmentsPerTier=16.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 2008995 INFO (coreLoadExecutor-4494-thread-1) [ x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@366fe354 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1a6f5f4d),segFN=segments_1,generation=1}
[junit4] 2> 2008995 INFO (coreLoadExecutor-4494-thread-1) [ x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 2008997 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [ x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-003/./collection1/data/
[junit4] 2> 2009001 INFO (coreLoadExecutor-4494-thread-1) [ x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 2009004 INFO (coreLoadExecutor-4494-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 2009006 INFO (coreLoadExecutor-4494-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 2009012 INFO (coreLoadExecutor-4494-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 2009013 INFO (coreLoadExecutor-4494-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 2009014 INFO (coreLoadExecutor-4494-thread-1) [ x:collection1] o.a.s.c.PluginBag requestHandler : 'lazy' created with startup=lazy
[junit4] 2> 2009015 INFO (coreLoadExecutor-4494-thread-1) [ x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,lazy,/update/json/docs,/admin/luke,/export,/get,/admin/properties,/update/json,/admin/threads,/update/csv,/sql,/admin/segments,/admin/system,/replication,defaults,/config,/stream,/schema,/admin/plugins,/admin/logging,/admin/ping,/update,/admin/file
[junit4] 2> 2009015 INFO (coreLoadExecutor-4494-thread-1) [ x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 2009015 INFO (coreLoadExecutor-4494-thread-1) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2009015 INFO (coreLoadExecutor-4494-thread-1) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2009015 INFO (coreLoadExecutor-4494-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=24, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 2009016 INFO (coreLoadExecutor-4494-thread-1) [ x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@366fe354 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1a6f5f4d),segFN=segments_1,generation=1}
[junit4] 2> 2009016 INFO (coreLoadExecutor-4494-thread-1) [ x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 2009016 INFO (coreLoadExecutor-4494-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@20a9c8ea[collection1] main
[junit4] 2> 2009016 INFO (coreLoadExecutor-4494-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-003/collection1/conf
[junit4] 2> 2009016 INFO (coreLoadExecutor-4494-thread-1) [ x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {storageDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-003/collection1/conf}
[junit4] 2> 2009016 INFO (coreLoadExecutor-4494-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using file:dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-003/collection1/conf
[junit4] 2> 2009017 INFO (coreLoadExecutor-4494-thread-1) [ x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 2009017 WARN (coreLoadExecutor-4494-thread-1) [ x:collection1] o.a.s.h.IndexFetcher 'masterUrl' must be specified without the /replication suffix
[junit4] 2> 2009017 INFO (coreLoadExecutor-4494-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler No value set for 'pollInterval'. Timer Task not started.
[junit4] 2> 2009017 INFO (coreLoadExecutor-4494-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Replication enabled for following config files: schema.xml
[junit4] 2> 2009017 INFO (coreLoadExecutor-4494-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 2009018 INFO (coreLoadExecutor-4494-thread-1) [ x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 2009018 INFO (searcherExecutor-4495-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@20a9c8ea[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2009396 INFO (qtp1585287444-19219) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[0]} 0 0
[junit4] 2> 2009398 INFO (qtp1585287444-19219) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[1]} 0 0
[junit4] 2> 2009450 INFO (qtp1585287444-19219) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[2]} 0 0
[junit4] 2> 2009452 INFO (qtp1585287444-19219) [ x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 2009467 INFO (qtp1585287444-19219) [ x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=2
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@468381ef lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@51cae963),segFN=segments_1,generation=1}
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@468381ef lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@51cae963),segFN=segments_2,generation=2}
[junit4] 2> 2009467 INFO (qtp1585287444-19219) [ x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 2
[junit4] 2> 2009474 INFO (qtp1585287444-19219) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@65ef7944[collection1] main
[junit4] 2> 2009475 INFO (qtp1585287444-19219) [ x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 2009475 INFO (searcherExecutor-4464-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@65ef7944[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.0.0):C3)))}
[junit4] 2> 2009475 INFO (qtp1585287444-19219) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 23
[junit4] 2> 2009481 WARN (explicit-fetchindex-cmd) [ x:collection1] o.a.s.h.IndexFetcher 'masterUrl' must be specified without the /replication suffix
[junit4] 2> 2009483 INFO (qtp1585287444-19221) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
[junit4] 2> 2009489 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.h.IndexFetcher Master's generation: 2
[junit4] 2> 2009489 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.h.IndexFetcher Slave's generation: 1
[junit4] 2> 2009489 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.h.IndexFetcher Starting replication process
[junit4] 2> 2009494 INFO (qtp1585287444-19221) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={generation=2&qt=/replication&wt=javabin&version=2&command=filelist} status=0 QTime=2
[junit4] 2> 2009495 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.h.IndexFetcher Number of files in latest index in master: 8
[junit4] 2> 2009545 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-003/./collection1/data/index.20151219170755848
[junit4] 2> 2009545 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.u.DefaultSolrCoreState Rollback old IndexWriter... core=collection1
[junit4] 2> 2009545 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=24, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.18216295338052213]
[junit4] 2> 2009546 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@366fe354 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1a6f5f4d),segFN=segments_1,generation=1}
[junit4] 2> 2009546 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 2009546 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
[junit4] 2> 2009546 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@366fe354 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1a6f5f4d),segFN=segments_1,generation=1}
[junit4] 2> 2009546 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 2009546 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.u.DefaultSolrCoreState Rollback old IndexWriter... core=collection1
[junit4] 2> 2009546 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.h.IndexFetcher Starting download (fullCopy=false) to MockDirectoryWrapper(RAMDirectory@6352ef44 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@64f2ef7e)
[junit4] 2> 2009548 INFO (qtp1585287444-19225) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.si&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2009562 INFO (qtp1585287444-19225) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.nvd&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2009565 INFO (qtp1585287444-19219) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.fdx&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2009568 INFO (qtp1585287444-19223) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0_Memory_0.ram&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2009572 INFO (qtp1585287444-19224) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.fdt&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2009576 INFO (qtp1585287444-19221) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.fnm&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2009578 INFO (qtp1585287444-19218) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.nvm&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2009581 INFO (qtp1585287444-19225) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=segments_2&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2009582 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.h.IndexFetcher Total time taken for download (fullCopy=false,bytesDownloaded=1351) : 0 secs (null bytes/sec) to MockDirectoryWrapper(RAMDirectory@6352ef44 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@64f2ef7e)
[junit4] 2> 2009589 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@26095e9a
[junit4] 2> 2009592 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=2
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@366fe354 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1a6f5f4d),segFN=segments_1,generation=1}
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@366fe354 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1a6f5f4d),segFN=segments_2,generation=2}
[junit4] 2> 2009592 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 2
[junit4] 2> 2009592 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
[junit4] 2> 2009594 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@3d3067ea[collection1] main
[junit4] 2> 2009594 INFO (searcherExecutor-4495-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@3d3067ea[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.0.0):C3)))}
[junit4] 2> 2009594 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-003/./collection1/data/index.20151219170755848 [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-003/./collection1/data/index.20151219170755848;done=true>>]
[junit4] 2> 2009595 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-003/./collection1/data/index.20151219170755848
[junit4] 2> 2009595 INFO (qtp1697943481-19277) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={wait=true&masterUrl=http://127.0.0.1:35050/solr/collection1/replication&command=fetchindex} status=0 QTime=115
[junit4] 2> 2009600 INFO (qtp1697943481-19276) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/select params={q=*:*&sort=id+desc&wt=javabin&version=2} hits=3 status=0 QTime=0
[junit4] 2> 2009603 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[503A246F46768822]) [ ] o.a.s.h.TestReplicationHandler Waited for 0ms and found 3 docs
[junit4] 2> 2009611 WARN (explicit-fetchindex-cmd) [ x:collection1] o.a.s.h.IndexFetcher 'masterUrl' must be specified without the /replication suffix
[junit4] 2> 2009614 INFO (qtp1697943481-19276) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
[junit4] 2> 2009614 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.h.IndexFetcher Master's generation: 2
[junit4] 2> 2009614 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.h.IndexFetcher Slave's generation: 1
[junit4] 2> 2009614 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.h.IndexFetcher Starting replication process
[junit4] 2> 2009635 INFO (qtp1697943481-19276) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={generation=2&qt=/replication&wt=javabin&version=2&command=filelist} status=0 QTime=19
[junit4] 2> 2009665 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.h.IndexFetcher Number of files in latest index in master: 8
[junit4] 2> 2009671 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_503A246F46768822-001/solr-instance-002/./collection1/data/index.20151219170756018
[junit4] 2> 2009679 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.u.DefaultSolrCoreState Rollback old IndexWriter... core=collection1
[junit4] 2> 2009679 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=24, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.18216295338052213]
[junit4] 2> 2009680 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@433
[...truncated too long message...]
estIndex(IndexFetcher.java:386)
[junit4] 2> at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:270)
[junit4] 2> at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:387)
[junit4] 2> at org.apache.solr.handler.ReplicationHandler$1.run(ReplicationHandler.java:275)
[junit4] 2>
[junit4] 2> org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException
[junit4] 2> at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:43)
[junit4] 2> at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:352)
[junit4] 2> at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:386)
[junit4] 2> at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:270)
[junit4] 2> at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:387)
[junit4] 2> at org.apache.solr.handler.ReplicationHandler$1.run(ReplicationHandler.java:275)
[junit4] 2>
[junit4] 2> org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException
[junit4] 2> at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:43)
[junit4] 2> at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:352)
[junit4] 2> at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:386)
[junit4] 2> at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:270)
[junit4] 2> at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:387)
[junit4] 2> at org.apache.solr.handler.ReplicationHandler$1.run(ReplicationHandler.java:275)
[junit4] 2>
[junit4] 2> org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException
[junit4] 2> at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:43)
[junit4] 2> at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:352)
[junit4] 2> at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:386)
[junit4] 2> at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:270)
[junit4] 2> at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:387)
[junit4] 2> at org.apache.solr.handler.ReplicationHandler$1.run(ReplicationHandler.java:275)
[junit4] 2>
[junit4] 2> org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException
[junit4] 2> at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:43)
[junit4] 2> at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:352)
[junit4] 2> at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:386)
[junit4] 2> at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:270)
[junit4] 2> at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:387)
[junit4] 2> at org.apache.solr.handler.ReplicationHandler$1.run(ReplicationHandler.java:275)
[junit4] 2>
[junit4] 2> org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException
[junit4] 2> at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:43)
[junit4] 2> at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:352)
[junit4] 2> at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:386)
[junit4] 2> at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:270)
[junit4] 2> at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:387)
[junit4] 2> at org.apache.solr.handler.ReplicationHandler$1.run(ReplicationHandler.java:275)
[junit4] 2>
[junit4] 2> org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException
[junit4] 2> at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:43)
[junit4] 2> at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:352)
[junit4] 2> at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:386)
[junit4] 2> at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:270)
[junit4] 2> at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:387)
[junit4] 2> at org.apache.solr.handler.ReplicationHandler$1.run(ReplicationHandler.java:275)
[junit4] 2>
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene60): {name=PostingsFormat(name=Memory doPackFST= true), id=PostingsFormat(name=Memory doPackFST= true), newname=PostingsFormat(name=Memory doPackFST= true)}, docValues:{}, sim=ClassicSimilarity, locale=es_ES, timezone=Asia/Oral
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_66 (64-bit)/cpus=4,threads=1,free=265383704,total=525336576
[junit4] 2> NOTE: All tests run in this JVM: [DistributedFacetPivotSmallAdvancedTest, TestBulkSchemaAPI, TestNamedUpdateProcessors, HdfsChaosMonkeyNothingIsSafeTest, PluginInfoTest, SimpleFacetsTest, XmlUpdateRequestHandlerTest, ScriptEngineTest, SuggesterTest, TestStressReorder, CollectionTooManyReplicasTest, TestCSVResponseWriter, ForceLeaderTest, DebugComponentTest, LukeRequestHandlerTest, TestNonDefinedSimilarityFactory, TestSimpleQParserPlugin, BadComponentTest, DocValuesMultiTest, BinaryUpdateRequestHandlerTest, TestSolrDynamicMBean, TestSolrConfigHandlerCloud, HighlighterMaxOffsetTest, TestDefaultSearchFieldResource, DeleteShardTest, TestSort, SolrCloudExampleTest, TestCharFilters, TestCollationField, BasicAuthIntegrationTest, CloudExitableDirectoryReaderTest, TestBlendedInfixSuggestions, TestConfigOverlay, TestSchemaManager, AtomicUpdatesTest, TestRecoveryHdfs, TestFieldCollectionResource, HdfsNNFailoverTest, DataDrivenBlockJoinTest, SharedFSAutoReplicaFailoverTest, BigEndianAscendingWordDeserializerTest, TestJsonFacets, ConfigSetsAPITest, TestSolrJ, TestPostingsSolrHighlighter, DirectSolrConnectionTest, TestGroupingSearch, TestManagedSchemaFieldTypeResource, DateMathParserTest, StatsComponentTest, TestWriterPerf, TestRandomCollapseQParserPlugin, TestClusterStateMutator, ShowFileRequestHandlerTest, TestStressRecovery, TestRecovery, TestElisionMultitermQuery, TestUtils, TestPHPSerializedResponseWriter, SolrCoreCheckLockOnStartupTest, TermVectorComponentDistributedTest, SuggesterTSTTest, TestTolerantSearch, HdfsRestartWhileUpdatingTest, TestIndexingPerformance, DirectUpdateHandlerOptimizeTest, HdfsUnloadDistributedZkTest, RegexBoostProcessorTest, TestConfigSetsAPI, TestUniqueKeyFieldResource, FieldAnalysisRequestHandlerTest, HighlighterConfigTest, BadCopyFieldTest, TestSchemaResource, TestConfigSets, TestMiniSolrCloudClusterSSL, TestInitQParser, StatelessScriptUpdateProcessorFactoryTest, TestRandomMergePolicy, LeaderElectionTest, ClusterStateTest, DistributedQueryComponentCustomSortTest, SmileWriterTest, ReplicationFactorTest, UnloadDistributedZkTest, AutoCommitTest, TestPKIAuthenticationPlugin, OverseerTaskQueueTest, TestObjectReleaseTracker, TestCloudSchemaless, FullSolrCloudDistribCmdsTest, TestExactSharedStatsCache, BasicDistributedZk2Test, SyncSliceTest, OverseerTest, BasicZkTest, RecoveryZkTest, TestReplicationHandler]
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestReplicationHandler -Dtests.seed=503A246F46768822 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=es_ES -Dtests.timezone=Asia/Oral -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] ERROR 0.00s J2 | TestReplicationHandler (suite) <<<
[junit4] > Throwable #1: java.lang.AssertionError: ObjectTracker found 9 object(s) that were not released!!! [NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory]
[junit4] > at __randomizedtesting.SeedInfo.seed([503A246F46768822]:0)
[junit4] > at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:229)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] Completed [304/568 (1!)] on J2 in 718.78s, 13 tests, 1 failure <<< FAILURES!
[...truncated 834 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:791: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:728: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1436: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:991: There were test failures: 568 suites (8 ignored), 2263 tests, 1 suite-level error, 33 ignored (18 assumptions) [seed: 503A246F46768822]
Total time: 208 minutes 58 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 885 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/885/
1 tests failed.
FAILED: org.apache.lucene.search.suggest.document.TestSuggestField.testSuggestOnMostlyDeletedDocuments
Error Message:
MockDirectoryWrapper: cannot close: there are still open files: {_y_completion_0.pay=1, _y_completion_0.tim=1, _y.dim=1, _y.fdt=1, _y_completion_0.pos=1, _y.nvd=1, _y_completion_0.doc=1, _y_completion_0.lkp=1}
Stack Trace:
java.lang.RuntimeException: MockDirectoryWrapper: cannot close: there are still open files: {_y_completion_0.pay=1, _y_completion_0.tim=1, _y.dim=1, _y.fdt=1, _y_completion_0.pos=1, _y.nvd=1, _y_completion_0.doc=1, _y_completion_0.lkp=1}
at org.apache.lucene.store.MockDirectoryWrapper.close(MockDirectoryWrapper.java:771)
at org.apache.lucene.search.suggest.document.TestSuggestField.after(TestSuggestField.java:79)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:929)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: unclosed IndexInput: _y_completion_0.pos
at org.apache.lucene.store.MockDirectoryWrapper.addFileHandle(MockDirectoryWrapper.java:659)
at org.apache.lucene.store.MockDirectoryWrapper.openInput(MockDirectoryWrapper.java:703)
at org.apache.lucene.codecs.lucene50.Lucene50PostingsReader.<init>(Lucene50PostingsReader.java:88)
at org.apache.lucene.codecs.lucene50.Lucene50PostingsFormat.fieldsProducer(Lucene50PostingsFormat.java:443)
at org.apache.lucene.search.suggest.document.CompletionFieldsProducer.<init>(CompletionFieldsProducer.java:92)
at org.apache.lucene.search.suggest.document.CompletionPostingsFormat.fieldsProducer(CompletionPostingsFormat.java:124)
at org.apache.lucene.codecs.perfield.PerFieldPostingsFormat$FieldsReader.<init>(PerFieldPostingsFormat.java:261)
at org.apache.lucene.codecs.perfield.PerFieldPostingsFormat.fieldsProducer(PerFieldPostingsFormat.java:341)
at org.apache.lucene.index.SegmentCoreReaders.<init>(SegmentCoreReaders.java:106)
at org.apache.lucene.index.SegmentReader.<init>(SegmentReader.java:66)
at org.apache.lucene.index.ReadersAndUpdates.getReader(ReadersAndUpdates.java:145)
at org.apache.lucene.index.BufferedUpdatesStream$SegmentState.<init>(BufferedUpdatesStream.java:379)
at org.apache.lucene.index.BufferedUpdatesStream.openSegmentStates(BufferedUpdatesStream.java:411)
at org.apache.lucene.index.BufferedUpdatesStream.applyDeletesAndUpdates(BufferedUpdatesStream.java:256)
at org.apache.lucene.index.IndexWriter.applyAllDeletesAndUpdates(IndexWriter.java:3148)
at org.apache.lucene.index.IndexWriter.maybeApplyDeletes(IndexWriter.java:3134)
at org.apache.lucene.index.IndexWriter.getReader(IndexWriter.java:433)
at org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:86)
at org.apache.lucene.search.suggest.document.TestSuggestField.testSuggestOnMostlyDeletedDocuments(TestSuggestField.java:319)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
... 28 more
Build Log:
[...truncated 8822 lines...]
[junit4] Suite: org.apache.lucene.search.suggest.document.TestSuggestField
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestSuggestField -Dtests.method=testSuggestOnMostlyDeletedDocuments -Dtests.seed=2B1CF7F0749F22B2 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=ar_YE -Dtests.timezone=Asia/Tel_Aviv -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] ERROR 1.18s J2 | TestSuggestField.testSuggestOnMostlyDeletedDocuments <<<
[junit4] > Throwable #1: java.lang.AssertionError: Expected: key:abc_1 score:1.0 context:null Actual: key:abc_36 score:36.0 context:null
[junit4] > Expected: "abc_1"
[junit4] > got: "abc_36"
[junit4] > at org.apache.lucene.search.suggest.document.TestSuggestField.assertSuggestions(TestSuggestField.java:641)
[junit4] > at org.apache.lucene.search.suggest.document.TestSuggestField.testSuggestOnMostlyDeletedDocuments(TestSuggestField.java:323)
[junit4] > at java.lang.Thread.run(Thread.java:745)Throwable #2: java.lang.RuntimeException: MockDirectoryWrapper: cannot close: there are still open files: {_y_completion_0.pay=1, _y_completion_0.tim=1, _y.dim=1, _y.fdt=1, _y_completion_0.pos=1, _y.nvd=1, _y_completion_0.doc=1, _y_completion_0.lkp=1}
[junit4] > at org.apache.lucene.store.MockDirectoryWrapper.close(MockDirectoryWrapper.java:771)
[junit4] > at org.apache.lucene.search.suggest.document.TestSuggestField.after(TestSuggestField.java:79)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > Caused by: java.lang.RuntimeException: unclosed IndexInput: _y_completion_0.pos
[junit4] > at org.apache.lucene.store.MockDirectoryWrapper.addFileHandle(MockDirectoryWrapper.java:659)
[junit4] > at org.apache.lucene.store.MockDirectoryWrapper.openInput(MockDirectoryWrapper.java:703)
[junit4] > at org.apache.lucene.codecs.lucene50.Lucene50PostingsReader.<init>(Lucene50PostingsReader.java:88)
[junit4] > at org.apache.lucene.codecs.lucene50.Lucene50PostingsFormat.fieldsProducer(Lucene50PostingsFormat.java:443)
[junit4] > at org.apache.lucene.search.suggest.document.CompletionFieldsProducer.<init>(CompletionFieldsProducer.java:92)
[junit4] > at org.apache.lucene.search.suggest.document.CompletionPostingsFormat.fieldsProducer(CompletionPostingsFormat.java:124)
[junit4] > at org.apache.lucene.codecs.perfield.PerFieldPostingsFormat$FieldsReader.<init>(PerFieldPostingsFormat.java:261)
[junit4] > at org.apache.lucene.codecs.perfield.PerFieldPostingsFormat.fieldsProducer(PerFieldPostingsFormat.java:341)
[junit4] > at org.apache.lucene.index.SegmentCoreReaders.<init>(SegmentCoreReaders.java:106)
[junit4] > at org.apache.lucene.index.SegmentReader.<init>(SegmentReader.java:66)
[junit4] > at org.apache.lucene.index.ReadersAndUpdates.getReader(ReadersAndUpdates.java:145)
[junit4] > at org.apache.lucene.index.BufferedUpdatesStream$SegmentState.<init>(BufferedUpdatesStream.java:379)
[junit4] > at org.apache.lucene.index.BufferedUpdatesStream.openSegmentStates(BufferedUpdatesStream.java:411)
[junit4] > at org.apache.lucene.index.BufferedUpdatesStream.applyDeletesAndUpdates(BufferedUpdatesStream.java:256)
[junit4] > at org.apache.lucene.index.IndexWriter.applyAllDeletesAndUpdates(IndexWriter.java:3148)
[junit4] > at org.apache.lucene.index.IndexWriter.maybeApplyDeletes(IndexWriter.java:3134)
[junit4] > at org.apache.lucene.index.IndexWriter.getReader(IndexWriter.java:433)
[junit4] > at org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:86)
[junit4] > at org.apache.lucene.search.suggest.document.TestSuggestField.testSuggestOnMostlyDeletedDocuments(TestSuggestField.java:319)
[junit4] > ... 28 more
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/suggest/test/J2/temp/lucene.search.suggest.document.TestSuggestField_2B1CF7F0749F22B2-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene60): {}, docValues:{}, sim=ClassicSimilarity, locale=ar_YE, timezone=Asia/Tel_Aviv
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_66 (64-bit)/cpus=4,threads=1,free=169810336,total=225968128
[junit4] 2> NOTE: All tests run in this JVM: [TestContextSuggestField, TestSuggestStopFilterFactory, BlendedInfixSuggesterTest, WFSTCompletionTest, TestRegexCompletionQuery, TestSpellChecker, AnalyzingSuggesterTest, FSTCompletionTest, TestWordBreakSpellChecker, TestLuceneDictionary, TestPlainTextDictionary, PersistenceTest, TestLevenshteinDistance, BytesRefSortersTest, TestHighFrequencyDictionary, FileDictionaryTest, TestSuggestField]
[junit4] Completed [30/32 (1!)] on J2 in 49.26s, 17 tests, 1 error <<< FAILURES!
[...truncated 17 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:791: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:728: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build.xml:472: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:2166: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/module-build.xml:58: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1436: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:991: There were test failures: 32 suites (1 ignored), 204 tests, 1 error, 1 ignored [seed: 2B1CF7F0749F22B2]
Total time: 132 minutes 40 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 884 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/884/
3 tests failed.
FAILED: org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.test
Error Message:
Captured an uncaught exception in thread: Thread[id=68621, name=Thread-61214, state=RUNNABLE, group=TGRP-FullSolrCloudDistribCmdsTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=68621, name=Thread-61214, state=RUNNABLE, group=TGRP-FullSolrCloudDistribCmdsTest]
Caused by: java.lang.RuntimeException: org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:51558/collection1
at __randomizedtesting.SeedInfo.seed([D7FEB351BC788D6B]:0)
at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest$1IndexThread.run(FullSolrCloudDistribCmdsTest.java:645)
Caused by: org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:51558/collection1
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:587)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:150)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:167)
at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest$1IndexThread.run(FullSolrCloudDistribCmdsTest.java:643)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:170)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:480)
... 5 more
FAILED: org.apache.solr.cloud.RollingRestartTest.test
Error Message:
Unable to restart (#4): CloudJettyRunner [url=https://127.0.0.1:45463/collection1]
Stack Trace:
java.lang.AssertionError: Unable to restart (#4): CloudJettyRunner [url=https://127.0.0.1:45463/collection1]
at __randomizedtesting.SeedInfo.seed([D7FEB351BC788D6B:5FAA8C8B1284E093]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.cloud.RollingRestartTest.restartWithRolesTest(RollingRestartTest.java:104)
at org.apache.solr.cloud.RollingRestartTest.test(RollingRestartTest.java:53)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:965)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:940)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test
Error Message:
Captured an uncaught exception in thread: Thread[id=2218, name=collection5, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=2218, name=collection5, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:53457/_c/gk: collection already exists: awholynewstresscollection_collection5_1
at __randomizedtesting.SeedInfo.seed([D7FEB351BC788D6B]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:871)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:807)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1574)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1595)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:881)
Build Log:
[...truncated 10010 lines...]
[junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D7FEB351BC788D6B-001/init-core-data-001
[junit4] 2> 222198 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[D7FEB351BC788D6B]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
[junit4] 2> 222198 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[D7FEB351BC788D6B]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /_c/gk
[junit4] 2> 222200 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 222200 INFO (Thread-940) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 222200 INFO (Thread-940) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 222300 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.ZkTestServer start zk server on port:36990
[junit4] 2> 222300 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 222301 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 222304 INFO (zkCallback-156-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@318aefdc name:ZooKeeperConnection Watcher:127.0.0.1:36990 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 222304 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 222304 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 222304 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 222307 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 222307 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 222308 INFO (zkCallback-157-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@76054e2d name:ZooKeeperConnection Watcher:127.0.0.1:36990/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 222308 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 222308 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 222308 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
[junit4] 2> 222310 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
[junit4] 2> 222311 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
[junit4] 2> 222312 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
[junit4] 2> 222314 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 222314 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 222316 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 222317 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
[junit4] 2> 222318 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 222318 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 222320 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 222320 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
[junit4] 2> 222321 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 222322 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
[junit4] 2> 222323 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 222323 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
[junit4] 2> 222324 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 222325 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 222326 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 222326 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 222327 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 222327 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 222329 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 222329 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 222330 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 222330 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
[junit4] 2> 222639 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D7FEB351BC788D6B-001/control-001/cores/collection1
[junit4] 2> 222641 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.e.j.s.Server jetty-9.3.6.v20151106
[junit4] 2> 222642 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@64e85b64{/_c/gk,null,AVAILABLE}
[junit4] 2> 222648 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.e.j.s.ServerConnector Started ServerConnector@380a8af4{HTTP/1.1,[http/1.1]}{127.0.0.1:60906}
[junit4] 2> 222648 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.e.j.s.Server Started @225769ms
[junit4] 2> 222648 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D7FEB351BC788D6B-001/tempDir-001/control/data, hostContext=/_c/gk, hostPort=60906, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D7FEB351BC788D6B-001/control-001/cores}
[junit4] 2> 222654 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 222654 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D7FEB351BC788D6B-001/control-001'
[junit4] 2> 222656 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 222656 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 222656 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 222657 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 222658 INFO (zkCallback-158-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@74f9e1b3 name:ZooKeeperConnection Watcher:127.0.0.1:36990/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 222658 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 222658 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 222665 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 222665 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D7FEB351BC788D6B-001/control-001/solr.xml
[junit4] 2> 222670 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D7FEB351BC788D6B-001/control-001/cores
[junit4] 2> 222670 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.CoreContainer New CoreContainer 593647298
[junit4] 2> 222670 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D7FEB351BC788D6B-001/control-001]
[junit4] 2> 222670 WARN (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D7FEB351BC788D6B-001/control-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D7FEB351BC788D6B-001/control-001/lib
[junit4] 2> 222671 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 222672 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 222672 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 222673 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 222673 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36990/solr
[junit4] 2> 222673 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 222673 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 222673 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 222675 INFO (zkCallback-160-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4aa984d1 name:ZooKeeperConnection Watcher:127.0.0.1:36990 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 222675 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 222676 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 222680 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [n:127.0.0.1:60906__c%2Fgk ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 222681 INFO (zkCallback-161-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@45b304da name:ZooKeeperConnection Watcher:127.0.0.1:36990/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 222681 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [n:127.0.0.1:60906__c%2Fgk ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 222682 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [n:127.0.0.1:60906__c%2Fgk ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
[junit4] 2> 222684 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [n:127.0.0.1:60906__c%2Fgk ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 222687 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [n:127.0.0.1:60906__c%2Fgk ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 222688 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [n:127.0.0.1:60906__c%2Fgk ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 222690 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [n:127.0.0.1:60906__c%2Fgk ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 222692 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [n:127.0.0.1:60906__c%2Fgk ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 222693 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [n:127.0.0.1:60906__c%2Fgk ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 222694 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [n:127.0.0.1:60906__c%2Fgk ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 222695 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [n:127.0.0.1:60906__c%2Fgk ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 222696 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [n:127.0.0.1:60906__c%2Fgk ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60906__c%2Fgk
[junit4] 2> 222697 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [n:127.0.0.1:60906__c%2Fgk ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:60906__c%2Fgk
[junit4] 2> 222698 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [n:127.0.0.1:60906__c%2Fgk ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 222699 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [n:127.0.0.1:60906__c%2Fgk ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 222700 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [n:127.0.0.1:60906__c%2Fgk ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 222701 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [n:127.0.0.1:60906__c%2Fgk ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95050921183674372-127.0.0.1:60906__c%2Fgk-n_0000000000
[junit4] 2> 222701 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [n:127.0.0.1:60906__c%2Fgk ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:60906__c%2Fgk
[junit4] 2> 222701 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [n:127.0.0.1:60906__c%2Fgk ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
[junit4] 2> 222702 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [n:127.0.0.1:60906__c%2Fgk ] o.a.s.c.Overseer Overseer (id=95050921183674372-127.0.0.1:60906__c%2Fgk-n_0000000000) starting
[junit4] 2> 222704 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [n:127.0.0.1:60906__c%2Fgk ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
[junit4] 2> 222709 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [n:127.0.0.1:60906__c%2Fgk ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 222709 INFO (OverseerCollectionConfigSetProcessor-95050921183674372-127.0.0.1:60906__c%2Fgk-n_0000000000) [n:127.0.0.1:60906__c%2Fgk ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
[junit4] 2> 222709 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [n:127.0.0.1:60906__c%2Fgk ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 222709 INFO (OverseerStateUpdate-95050921183674372-127.0.0.1:60906__c%2Fgk-n_0000000000) [n:127.0.0.1:60906__c%2Fgk ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 222735 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [n:127.0.0.1:60906__c%2Fgk ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 222735 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [n:127.0.0.1:60906__c%2Fgk ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 222736 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [n:127.0.0.1:60906__c%2Fgk ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D7FEB351BC788D6B-001/control-001/cores
[junit4] 2> 222737 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [n:127.0.0.1:60906__c%2Fgk ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=control_collection, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 222737 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [n:127.0.0.1:60906__c%2Fgk ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D7FEB351BC788D6B-001/control-001/cores/collection1
[junit4] 2> 222737 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [n:127.0.0.1:60906__c%2Fgk ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
[junit4] 2> 222738 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [n:127.0.0.1:60906__c%2Fgk ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4] 2> 222738 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [n:127.0.0.1:60906__c%2Fgk ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 222738 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 222738 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 222740 INFO (OverseerStateUpdate-95050921183674372-127.0.0.1:60906__c%2Fgk-n_0000000000) [n:127.0.0.1:60906__c%2Fgk ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:60906/_c/gk",
[junit4] 2> "node_name":"127.0.0.1:60906__c%2Fgk",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 222740 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 222740 INFO (OverseerStateUpdate-95050921183674372-127.0.0.1:60906__c%2Fgk-n_0000000000) [n:127.0.0.1:60906__c%2Fgk ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:60906/_c/gk",
[junit4] 2> "node_name":"127.0.0.1:60906__c%2Fgk",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 222740 INFO (OverseerStateUpdate-95050921183674372-127.0.0.1:60906__c%2Fgk-n_0000000000) [n:127.0.0.1:60906__c%2Fgk ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
[junit4] 2> 222741 INFO (OverseerStateUpdate-95050921183674372-127.0.0.1:60906__c%2Fgk-n_0000000000) [n:127.0.0.1:60906__c%2Fgk ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 222742 INFO (zkCallback-161-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 223740 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 223740 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
[junit4] 2> 223741 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 223741 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 223742 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 223742 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D7FEB351BC788D6B-001/control-001/cores/collection1'
[junit4] 2> 223742 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 223742 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 223743 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 223749 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 223753 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 223771 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection x:collection1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
[junit4] 2> 223780 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 223862 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 223868 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 223869 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 223876 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 223878 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 223881 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 223881 WARN (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 223881 WARN (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 223882 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 223882 WARN (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 223882 WARN (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 223884 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4] 2> 223884 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 223884 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 223884 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D7FEB351BC788D6B-001/control-001/cores/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D7FEB351BC788D6B-001/control-001/cores/collection1/data/]
[junit4] 2> 223884 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@c79b42d
[junit4] 2> 223885 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D7FEB351BC788D6B-001/control-001/cores/collection1/data
[junit4] 2> 223885 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D7FEB351BC788D6B-001/control-001/cores/collection1/data/index/
[junit4] 2> 223885 WARN (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D7FEB351BC788D6B-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 223885 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D7FEB351BC788D6B-001/control-001/cores/collection1/data/index
[junit4] 2> 223885 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=21, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.19726855193967063]
[junit4] 2> 223886 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(NRTCachingDirectory(RAMDirectory@536381fb lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5d1da6f2; maxCacheMB=0.2314453125 maxMergeSizeMB=0.7421875)),segFN=segments_1,generation=1}
[junit4] 2> 223886 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 223886 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D7FEB351BC788D6B-001/control-001/cores/collection1/data/
[junit4] 2> 223886 WARN (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D7FEB351BC788D6B-001/control-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
[junit4] 2> 223890 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 223890 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
[junit4] 2> 223890 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 223890 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 223890 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 223890 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 223890 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 223890 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 223891 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 223891 WARN (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,args = {defaults={a=A,b=B}}}
[junit4] 2> 223892 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 223893 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 223894 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 223895 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 223898 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/dump,/update/csv,/sql,/update/json/docs,/admin/luke,/export,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/stream,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 223899 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 223899 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 223899 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 223900 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 223900 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 223900 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=8, maxMergeAtOnceExplicit=3, maxMergedSegmentMB=78.412109375, floorSegmentMB=0.728515625, forceMergeDeletesPctAllowed=20.491227892643263, segmentsPerTier=8.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6637509871190225
[junit4] 2> 223901 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(NRTCachingDirectory(RAMDirectory@536381fb lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5d1da6f2; maxCacheMB=0.2314453125 maxMergeSizeMB=0.7421875)),segFN=segments_1,generation=1}
[junit4] 2> 223901 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 223901 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@1c9251d8[collection1] main
[junit4] 2> 223901 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 223902 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 223902 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 223902 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 223902 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
[junit4] 2> 223902 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 223903 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 223903 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 223903 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 223903 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 223903 INFO (searcherExecutor-680-thread-1-processing-n:127.0.0.1:60906__c%2Fgk x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@1c9251d8[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 223903 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
[junit4] 2> 223903 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
[junit4] 2> 223903 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
[junit4] 2> 223903 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1520814740722417664
[junit4] 2> 223906 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 2.0ms to seed version buckets with highest version 1520814740722417664
[junit4] 2> 223906 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
[junit4] 2> 223906 INFO (coreLoadExecutor-679-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 223906 INFO (coreZkRegister-673-thread-1-processing-n:127.0.0.1:60906__c%2Fgk x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:60906/_c/gk collection:control_collection shard:shard1
[junit4] 2> 223907 INFO (coreZkRegister-673-thread-1-processing-n:127.0.0.1:60906__c%2Fgk x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 223910 INFO (coreZkRegister-673-thread-1-processing-n:127.0.0.1:60906__c%2Fgk x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/95050921183674372-core_node1-n_0000000000
[junit4] 2> 223910 INFO (coreZkRegister-673-thread-1-processing-n:127.0.0.1:60906__c%2Fgk x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard=shard1 and weAreReplacement=false and leaderVoteWait=180000
[junit4] 2> 223912 INFO (coreZkRegister-673-thread-1-processing-n:127.0.0.1:60906__c%2Fgk x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 223912 INFO (coreZkRegister-673-thread-1-processing-n:127.0.0.1:60906__c%2Fgk x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 223912 INFO (coreZkRegister-673-thread-1-processing-n:127.0.0.1:60906__c%2Fgk x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:60906/_c/gk/collection1/
[junit4] 2> 223912 INFO (coreZkRegister-673-thread-1-processing-n:127.0.0.1:60906__c%2Fgk x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 223912 INFO (OverseerStateUpdate-95050921183674372-127.0.0.1:60906__c%2Fgk-n_0000000000) [n:127.0.0.1:60906__c%2Fgk ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection"} current state version: 1
[junit4] 2> 223913 INFO (coreZkRegister-673-thread-1-processing-n:127.0.0.1:60906__c%2Fgk x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:60906/_c/gk/collection1/ has no replicas
[junit4] 2> 223913 INFO (coreZkRegister-673-thread-1-processing-n:127.0.0.1:60906__c%2Fgk x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 223920 INFO (coreZkRegister-673-thread-1-processing-n:127.0.0.1:60906__c%2Fgk x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
[junit4] 2> 223921 INFO (coreZkRegister-673-thread-1-processing-n:127.0.0.1:60906__c%2Fgk x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:60906/_c/gk/collection1/ shard1
[junit4] 2> 223922 INFO (OverseerStateUpdate-95050921183674372-127.0.0.1:60906__c%2Fgk-n_0000000000) [n:127.0.0.1:60906__c%2Fgk ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:60906/_c/gk",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 1
[junit4] 2> 224024 INFO (zkCallback-161-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 224073 INFO (coreZkRegister-673-thread-1-processing-n:127.0.0.1:60906__c%2Fgk x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:60906/_c/gk/collection1/ and leader is http://127.0.0.1:60906/_c/gk/collection1/
[junit4] 2> 224073 INFO (coreZkRegister-673-thread-1-processing-n:127.0.0.1:60906__c%2Fgk x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:60906/_c/gk
[junit4] 2> 224073 INFO (coreZkRegister-673-thread-1-processing-n:127.0.0.1:60906__c%2Fgk x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 224073 INFO (coreZkRegister-673-thread-1-processing-n:127.0.0.1:60906__c%2Fgk x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
[junit4] 2> 224073 INFO (coreZkRegister-673-thread-1-processing-n:127.0.0.1:60906__c%2Fgk x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:60906__c%2Fgk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 224075 INFO (OverseerStateUpdate-95050921183674372-127.0.0.1:60906__c%2Fgk-n_0000000000) [n:127.0.0.1:60906__c%2Fgk ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:60906/_c/gk",
[junit4] 2> "node_name":"127.0.0.1:60906__c%2Fgk",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 2
[junit4] 2> 224075 INFO (OverseerStateUpdate-95050921183674372-127.0.0.1:60906__c%2Fgk-n_0000000000) [n:127.0.0.1:60906__c%2Fgk ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:60906/_c/gk",
[junit4] 2> "node_name":"127.0.0.1:60906__c%2Fgk",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 224177 INFO (zkCallback-161-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 224240 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 224240 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 224241 INFO (zkCallback-163-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4568b656 name:ZooKeeperConnection Watcher:127.0.0.1:36990/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 224242 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 224242 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 224242 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 224244 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 224244 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with stateFormat=2
[junit4] 2> 224244 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 224244 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 224245 INFO (zkCallback-164-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3f9861f name:ZooKeeperConnection Watcher:127.0.0.1:36990/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 224245 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 224245 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 224247 INFO (OverseerStateUpdate-95050921183674372-127.0.0.1:60906__c%2Fgk-n_0000000000) [n:127.0.0.1:60906__c%2Fgk ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"create",
[junit4] 2> "name":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "stateFormat":"2"} current state version: 3
[junit4] 2> 224247 INFO (OverseerStateUpdate-95050921183674372-127.0.0.1:60906__c%2Fgk-n_0000000000) [n:127.0.0.1:60906__c%2Fgk ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
[junit4] 2> 224248 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x151b04f28ba0006, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 224356 INFO (OverseerStateUpdate-95050921183674372-127.0.0.1:60906__c%2Fgk-n_0000000000) [n:127.0.0.1:60906__c%2Fgk ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/collection1/state.json
[junit4] 2> 224554 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D7FEB351BC788D6B-001/shard-1-001/cores/collection1
[junit4] 2> 224555 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D7FEB351BC788D6B-001/shard-1-001
[junit4] 2> 224556 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.e.j.s.Server jetty-9.3.6.v20151106
[junit4] 2> 224557 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@13096eef{/_c/gk,null,AVAILABLE}
[junit4] 2> 224558 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.e.j.s.ServerConnector Started ServerConnector@a70722d{HTTP/1.1,[http/1.1]}{127.0.0.1:40296}
[junit4] 2> 224558 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.e.j.s.Server Started @227679ms
[junit4] 2> 224558 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D7FEB351BC788D6B-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/_c/gk, hostPort=40296, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D7FEB351BC788D6B-001/shard-1-001/cores}
[junit4] 2> 224558 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 224558 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D7FEB351BC788D6B-001/shard-1-001'
[junit4] 2> 224558 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 224558 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 224558 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 224559 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 224561 INFO (zkCallback-165-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2f71e0f2 name:ZooKeeperConnection Watcher:127.0.0.1:36990/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 224561 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 224561 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 224562 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 224562 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D7FEB351BC788D6B-001/shard-1-001/solr.xml
[junit4] 2> 224567 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D7FEB351BC788D6B-001/shard-1-001/cores
[junit4] 2> 224568 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.CoreContainer New CoreContainer 1292260639
[junit4] 2> 224568 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D7FEB351BC788D6B-001/shard-1-001]
[junit4] 2> 224568 WARN (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D7FEB351BC788D6B-001/shard-1-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D7FEB351BC788D6B-001/shard-1-001/lib
[junit4] 2> 224568 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 224569 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 224570 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 224570 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 224570 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36990/solr
[junit4] 2> 224570 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 224570 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 224571 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 224572 INFO (zkCallback-167-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2fe13557 name:ZooKeeperConnection Watcher:127.0.0.1:36990 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 224572 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 224572 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 224574 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [n:127.0.0.1:40296__c%2Fgk ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 224575 INFO (zkCallback-168-thread-1-processing-n:127.0.0.1:40296__c%2Fgk) [n:127.0.0.1:40296__c%2Fgk ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@360ebdc1 name:ZooKeeperConnection Watcher:127.0.0.1:36990/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 224575 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [n:127.0.0.1:40296__c%2Fgk ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 224580 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [n:127.0.0.1:40296__c%2Fgk ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 225585 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [n:127.0.0.1:40296__c%2Fgk ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40296__c%2Fgk
[junit4] 2> 225586 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [n:127.0.0.1:40296__c%2Fgk ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:40296__c%2Fgk
[junit4] 2> 225587 INFO (zkCallback-163-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 225587 INFO (zkCallback-161-thread-1-processing-n:127.0.0.1:60906__c%2Fgk) [n:127.0.0.1:60906__c%2Fgk ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 225587 INFO (zkCallback-168-thread-1-processing-n:127.0.0.1:40296__c%2Fgk) [n:127.0.0.1:40296__c%2Fgk ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 225588 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [n:127.0.0.1:40296__c%2Fgk ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 225589 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [n:127.0.0.1:40296__c%2Fgk ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95050921183674377-127.0.0.1:40296__c%2Fgk-n_0000000001
[junit4] 2> 225590 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [n:127.0.0.1:40296__c%2Fgk ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/95050921183674372-127.0.0.1:60906__c%2Fgk-n_0000000000 to know if I could be the leader
[junit4] 2> 225601 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [n:127.0.0.1:40296__c%2Fgk ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 225601 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [n:127.0.0.1:40296__c%2Fgk ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 225601 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [n:127.0.0.1:40296__c%2Fgk ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D7FEB351BC788D6B-001/shard-1-001/cores
[junit4] 2> 225602 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [n:127.0.0.1:40296__c%2Fgk ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=collection1, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 225602 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [n:127.0.0.1:40296__c%2Fgk ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D7FEB351BC788D6B-001/shard-1-001/cores/collection1
[junit4] 2> 225602 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [n:127.0.0.1:40296__c%2Fgk ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
[junit4] 2> 225603 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [n:127.0.0.1:40296__c%2Fgk ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4] 2> 225604 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D7FEB351BC788D6B]) [n:127.0.0.1:40296__c%2Fgk ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 225604 INFO (coreLoadExecutor-690-thread-1-processing-n:127.0.0.1:40296__c%2Fgk) [n:127.0.0.1:40296__c%2Fgk c:collection1 x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 225604 INFO (coreLoadExecutor-690-thread-1-processing-n:127.0.0.1:40296__c%2Fgk) [n:127.0.0.1:40296__c%2Fgk c:collection1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 225605 INFO (coreLoadExecutor-690-thread-1-processing-n:127.0.0.1:40296__c%2Fgk) [n:127.0.0.1:40296__c%2Fgk c:collection1 x:collection1] o.a.s.c.ZkController Registering watch for collection collection1
[junit4] 2> 225605 INFO (coreLoadExecutor-690-thread-1-processing-n:127.0.0.1:40296__c%2Fgk) [n:127.0.0.1:40296__c%2Fgk c:collection1 x:collection1] o.a.s.c.c.ZkStateReader addZkWatch collection1
[junit4] 2> 225605 INFO (OverseerStateUpdate-95050921183674372-127.0.0.1:60906__c%2Fgk-n_0000000000) [n:127.0.0.1:60906__c%2Fgk ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:40296/_c/gk",
[junit4] 2> "node_name":"127.0.0.1:40296__c%2Fgk",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"} current state version: 3
[junit4] 2> 225606 INFO (coreLoadExecutor-690-thread-1-processing-n:127.0.0.1:40296__c%2Fgk) [n:127.0.0.1:40296__c%2Fgk c:collection1 x:collection1] o.a.s.c.c.ZkStateReader Add data for collection1 ver 0
[junit4] 2> 225606 INFO (coreLoadExecutor-690-thread-1-processing-n:127.0.0.1:40296__c%2Fgk) [n:127.0.0.1:40296__c%2Fgk c:collection1 x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 225606 INFO (OverseerStateUpdate-95050921183674372-127.0.0.1:60906__c%2Fgk-n_0000000000) [n:127.0.0.1:60906__c%2Fgk ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:40296/_c/gk",
[junit4] 2> "node_name":"127.0.0.1:40296__c%2Fgk",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"}
[junit4] 2> 225606 INFO (OverseerStateUpdate-95050921183674372-127.0.0.1:60906__c%2Fgk-n_0000000000) [n:127.0.0.1:60906__c%2Fgk ] o.a.s.c.o.ReplicaMutator Collection already exists with numShards=2
[junit4] 2> 225606 INFO (OverseerStateUpdate-95050921183674372-127.0.0.1:60906__c%2Fgk-n_0000000000) [n:127.0.0.1:60906__c%2Fgk ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2
[junit4] 2> 225708 INFO (OverseerStateUpdate-95050921183674372-127.0.0.1:60906__c%2Fgk-n_0000000000) [n:127.0.0.1:60906__c%2Fgk ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/collection1/state.json version: 0
[junit4] 2> 225709 INFO (zkCallback-168-thread-1-processing-n:127.0.0.1:40296__c%2Fgk) [n:127.0.0.1:40296__c%2Fgk ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json
[...truncated too long message...]
00000009
[junit4] 2> 2 /solr/overseer_elect/election/95051116825935966-127.0.0.1:34015_-n_0000000042
[junit4] 2> 2 /solr/overseer_elect/election/95051116825936044-127.0.0.1:51542_-n_0000000090
[junit4] 2> 2 /solr/overseer_elect/election/95051116825936068-127.0.0.1:57785_-n_0000000101
[junit4] 2> 2 /solr/overseer_elect/election/95051116825935891-127.0.0.1:59298_-n_0000000021
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard2/election/95051116825935888-core_node3-n_0000000001
[junit4] 2> 2 /solr/overseer_elect/election/95051116825936140-127.0.0.1:51542_-n_0000000143
[junit4] 2> 2 /solr/overseer_elect/election/95051116825936020-127.0.0.1:57785_-n_0000000073
[junit4] 2> 2 /solr/overseer_elect/election/95051116825935927-127.0.0.1:51138_-n_0000000145
[junit4] 2> 2 /solr/overseer_elect/election/95051116825936116-127.0.0.1:57785_-n_0000000128
[junit4] 2> 2 /solr/overseer_elect/election/95051116825935918-127.0.0.1:55456_-n_0000000140
[junit4] 2> 2 /solr/overseer_elect/election/95051116825936110-127.0.0.1:34015_-n_0000000124
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard2/election/95051116825936140-core_node15-n_0000000045
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard2/election/95051116825936044-core_node15-n_0000000027
[junit4] 2> 2 /solr/overseer_elect/election/95051116825935972-127.0.0.1:57785_-n_0000000048
[junit4] 2> 2 /solr/overseer_elect/election/95051116825936062-127.0.0.1:34015_-n_0000000096
[junit4] 2> 2 /solr/overseer_elect/election/95051116825936092-127.0.0.1:51542_-n_0000000115
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard2/election/95051116825935975-core_node5-n_0000000016
[junit4] 2> 2 /solr/overseer_elect/election/95051116825935996-127.0.0.1:51542_-n_0000000061
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard1/election/95051116825936050-core_node14-n_0000000027
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard2/election/95051116825936023-core_node5-n_0000000025
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard1/election/95051116825936098-core_node14-n_0000000034
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard2/election/95051116825936071-core_node5-n_0000000034
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard2/election/95051116825935996-core_node15-n_0000000018
[junit4] 2> 2 /solr/overseer_elect/election/95051116825935948-127.0.0.1:51542_-n_0000000034
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard1/election/95051116825935954-core_node14-n_0000000013
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard1/election/95051116825936002-core_node14-n_0000000020
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard2/election/95051116825935948-core_node15-n_0000000009
[junit4] 2> 2 /solr/overseer_elect/election/95051116825936014-127.0.0.1:34015_-n_0000000071
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 95 /solr/collections
[junit4] 2> 31 /solr/overseer/collection-queue-work
[junit4] 2> 28 /solr/overseer/queue
[junit4] 2> 18 /solr/live_nodes
[junit4] 2> 9 /solr/overseer/queue-work
[junit4] 2>
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=RollingRestartTest -Dtests.method=test -Dtests.seed=D7FEB351BC788D6B -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=es_PY -Dtests.timezone=Asia/Yerevan -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[junit4] FAILURE 664s J2 | RollingRestartTest.test <<<
[junit4] > Throwable #1: java.lang.AssertionError: Unable to restart (#4): CloudJettyRunner [url=https://127.0.0.1:45463/collection1]
[junit4] > at __randomizedtesting.SeedInfo.seed([D7FEB351BC788D6B:5FAA8C8B1284E093]:0)
[junit4] > at org.apache.solr.cloud.RollingRestartTest.restartWithRolesTest(RollingRestartTest.java:104)
[junit4] > at org.apache.solr.cloud.RollingRestartTest.test(RollingRestartTest.java:53)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:965)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:940)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 3871884 INFO (SUITE-RollingRestartTest-seed#[D7FEB351BC788D6B]-worker) [n:127.0.0.1:51138_ c:collection1 s:shard1 r:core_node16 x:collection1] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.RollingRestartTest_D7FEB351BC788D6B-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene60), sim=RandomSimilarityProvider(queryNorm=true,coord=yes): {}, locale=es_PY, timezone=Asia/Yerevan
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_66 (64-bit)/cpus=4,threads=1,free=57849608,total=529006592
[junit4] 2> NOTE: All tests run in this JVM: [CdcrVersionReplicationTest, TestMiniSolrCloudCluster, TestMaxScoreQueryParser, DateMathParserTest, TestCharFilters, TestSolrJ, VersionInfoTest, TestReplicaProperties, CollectionTooManyReplicasTest, SuggesterTSTTest, BadComponentTest, MultiThreadedOCPTest, HdfsSyncSliceTest, BasicDistributedZk2Test, TestShortCircuitedRequests, SuggesterWFSTTest, RegexBoostProcessorTest, XmlUpdateRequestHandlerTest, TestClassNameShortening, CurrencyFieldXmlFileTest, TestSchemaSimilarityResource, SolrCloudExampleTest, ZkStateReaderTest, NoCacheHeaderTest, SharedFSAutoReplicaFailoverTest, HardAutoCommitTest, FieldAnalysisRequestHandlerTest, AutoCommitTest, TestUtils, TestSweetSpotSimilarityFactory, TestWriterPerf, TestExclusionRuleCollectionAccess, TestManagedSchemaDynamicFieldResource, CheckHdfsIndexTest, QueryParsingTest, StatelessScriptUpdateProcessorFactoryTest, TestTolerantSearch, DistributedQueryComponentOptimizationTest, TermVectorComponentDistributedTest, TestReversedWildcardFilterFactory, SpatialHeatmapFacetsTest, LeaderElectionTest, TestCoreDiscovery, ConfigSetsAPITest, TestReload, EnumFieldTest, TestRuleBasedAuthorizationPlugin, TestMinMaxOnMultiValuedField, TestTrackingShardHandlerFactory, TestSolrIndexConfig, ParsingFieldUpdateProcessorsTest, TestPerFieldSimilarityClassic, TestMiniSolrCloudClusterSSL, TestDynamicFieldCollectionResource, DeleteInactiveReplicaTest, TestStressRecovery, TestInitParams, TestRecovery, RecoveryZkTest, CoreMergeIndexesAdminHandlerTest, TestDefaultStatsCache, BitVectorTest, VMParamsZkACLAndCredentialsProvidersTest, UnloadDistributedZkTest, HdfsWriteToMultipleCollectionsTest, HdfsDirectoryFactoryTest, DebugComponentTest, ClusterStateTest, BlockCacheTest, PrimitiveFieldTypeTest, MergeStrategyTest, DeleteShardTest, TestIndexingPerformance, CloudExitableDirectoryReaderTest, SimpleMLTQParserTest, SimpleFacetsTest, TestCustomDocTransformer, HighlighterConfigTest, SSLMigrationTest, RequestHandlersTest, AnalyticsMergeStrategyTest, TestOverriddenPrefixQueryForCustomFieldType, OverseerTest, DistribJoinFromCollectionTest, PKIAuthenticationIntegrationTest, SliceStateTest, TestSearchPerf, ActionThrottleTest, DistributedFacetPivotLargeTest, FieldMutatingUpdateProcessorTest, SegmentsInfoRequestHandlerTest, BadIndexSchemaTest, ForceLeaderTest, ChaosMonkeySafeLeaderTest, LeaderElectionIntegrationTest, ShardRoutingTest, TestReplicationHandler, SolrCmdDistributorTest, TestBadConfig, DistributedQueryElevationComponentTest, TestTrie, TestPseudoReturnFields, QueryEqualityTest, DocValuesMultiTest, LukeRequestHandlerTest, RequiredFieldsTest, IndexSchemaRuntimeFieldTest, TestJmxIntegration, TestAnalyzedSuggestions, SearchHandlerTest, TestLFUCache, AsyncMigrateRouteKeyTest, ConcurrentDeleteAndCreateCollectionTest, ConnectionManagerTest, DeleteReplicaTest, DistribDocExpirationUpdateProcessorTest, LeaderInitiatedRecoveryOnCommitTest, OutOfBoxZkACLAndCredentialsProvidersTest, OverriddenZkACLAndCredentialsProvidersTest, OverseerRolesTest, RollingRestartTest]
[junit4] Completed [453/566 (3!)] on J2 in 664.37s, 1 test, 1 failure <<< FAILURES!
[...truncated 361 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:791: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:728: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1436: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:991: There were test failures: 566 suites (8 ignored), 2254 tests, 2 errors, 1 failure, 33 ignored (18 assumptions) [seed: D7FEB351BC788D6B]
Total time: 204 minutes 34 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 883 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/883/
1 tests failed.
FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test
Error Message:
Captured an uncaught exception in thread: Thread[id=35685, name=collection2, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=35685, name=collection2, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:41821: Could not find collection : awholynewstresscollection_collection2_3
at __randomizedtesting.SeedInfo.seed([DA02B3D0A26311E2]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:871)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:807)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:888)
Build Log:
[...truncated 11300 lines...]
[junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DA02B3D0A26311E2-001/init-core-data-001
[junit4] 2> 3677256 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[DA02B3D0A26311E2]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
[junit4] 2> 3677256 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[DA02B3D0A26311E2]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
[junit4] 2> 3677260 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 3677260 INFO (Thread-22250) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 3677260 INFO (Thread-22250) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 3677360 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.ZkTestServer start zk server on port:39993
[junit4] 2> 3677360 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 3677361 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 3677365 INFO (zkCallback-2856-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5fecb3a0 name:ZooKeeperConnection Watcher:127.0.0.1:39993 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 3677365 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 3677365 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 3677365 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 3677370 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 3677371 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 3677372 INFO (zkCallback-2857-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@23aade2b name:ZooKeeperConnection Watcher:127.0.0.1:39993/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 3677372 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 3677373 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 3677373 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
[junit4] 2> 3677374 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
[junit4] 2> 3677376 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
[junit4] 2> 3677377 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
[junit4] 2> 3677379 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 3677380 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 3677382 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 3677382 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
[junit4] 2> 3677384 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 3677385 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 3677387 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 3677387 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
[junit4] 2> 3677389 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 3677389 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
[junit4] 2> 3677391 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 3677391 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
[junit4] 2> 3677392 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 3677393 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 3677394 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 3677394 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 3677396 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 3677396 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 3677397 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 3677398 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 3677399 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 3677399 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
[junit4] 2> 3677715 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DA02B3D0A26311E2-001/control-001/cores/collection1
[junit4] 2> 3677717 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.e.j.s.Server jetty-9.3.6.v20151106
[junit4] 2> 3677718 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5252adc{/,null,AVAILABLE}
[junit4] 2> 3677719 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.e.j.s.ServerConnector Started ServerConnector@7d4d580c{HTTP/1.1,[http/1.1]}{127.0.0.1:41821}
[junit4] 2> 3677720 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.e.j.s.Server Started @3681184ms
[junit4] 2> 3677720 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DA02B3D0A26311E2-001/tempDir-001/control/data, hostContext=/, hostPort=41821, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DA02B3D0A26311E2-001/control-001/cores}
[junit4] 2> 3677720 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 3677721 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DA02B3D0A26311E2-001/control-001'
[junit4] 2> 3677721 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 3677721 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 3677721 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 3677722 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 3677722 INFO (zkCallback-2858-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7a09cc4f name:ZooKeeperConnection Watcher:127.0.0.1:39993/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 3677722 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 3677723 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 3677724 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 3677724 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DA02B3D0A26311E2-001/control-001/solr.xml
[junit4] 2> 3677728 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DA02B3D0A26311E2-001/control-001/cores
[junit4] 2> 3677728 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.CoreContainer New CoreContainer 2014431182
[junit4] 2> 3677728 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DA02B3D0A26311E2-001/control-001]
[junit4] 2> 3677729 WARN (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DA02B3D0A26311E2-001/control-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DA02B3D0A26311E2-001/control-001/lib
[junit4] 2> 3677729 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 3677730 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 3677730 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 3677730 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 3677731 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39993/solr
[junit4] 2> 3677731 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 3677731 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 3677731 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 3677732 INFO (zkCallback-2860-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1a1d95e3 name:ZooKeeperConnection Watcher:127.0.0.1:39993 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 3677734 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 3677734 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 3677735 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [n:127.0.0.1:41821_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 3677736 INFO (zkCallback-2861-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1f6bda8d name:ZooKeeperConnection Watcher:127.0.0.1:39993/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 3677736 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [n:127.0.0.1:41821_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 3677737 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [n:127.0.0.1:41821_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
[junit4] 2> 3677739 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [n:127.0.0.1:41821_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 3677741 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [n:127.0.0.1:41821_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 3677743 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [n:127.0.0.1:41821_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 3677745 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [n:127.0.0.1:41821_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 3677747 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [n:127.0.0.1:41821_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 3677748 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [n:127.0.0.1:41821_ ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 3677749 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [n:127.0.0.1:41821_ ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 3677750 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [n:127.0.0.1:41821_ ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 3677751 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [n:127.0.0.1:41821_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41821_
[junit4] 2> 3677751 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [n:127.0.0.1:41821_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:41821_
[junit4] 2> 3677752 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [n:127.0.0.1:41821_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 3677754 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [n:127.0.0.1:41821_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 3677755 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [n:127.0.0.1:41821_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 3677755 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [n:127.0.0.1:41821_ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95044976504340484-127.0.0.1:41821_-n_0000000000
[junit4] 2> 3677755 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [n:127.0.0.1:41821_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:41821_
[junit4] 2> 3677755 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [n:127.0.0.1:41821_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
[junit4] 2> 3677756 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [n:127.0.0.1:41821_ ] o.a.s.c.Overseer Overseer (id=95044976504340484-127.0.0.1:41821_-n_0000000000) starting
[junit4] 2> 3677758 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [n:127.0.0.1:41821_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
[junit4] 2> 3677763 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [n:127.0.0.1:41821_ ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 3677763 INFO (OverseerCollectionConfigSetProcessor-95044976504340484-127.0.0.1:41821_-n_0000000000) [n:127.0.0.1:41821_ ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
[junit4] 2> 3677763 INFO (OverseerStateUpdate-95044976504340484-127.0.0.1:41821_-n_0000000000) [n:127.0.0.1:41821_ ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 3677764 INFO (OverseerStateUpdate-95044976504340484-127.0.0.1:41821_-n_0000000000) [n:127.0.0.1:41821_ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 3677773 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [n:127.0.0.1:41821_ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 3677785 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [n:127.0.0.1:41821_ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 3677785 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [n:127.0.0.1:41821_ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 3677786 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [n:127.0.0.1:41821_ ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DA02B3D0A26311E2-001/control-001/cores
[junit4] 2> 3677786 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [n:127.0.0.1:41821_ ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=control_collection, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 3677787 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [n:127.0.0.1:41821_ ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DA02B3D0A26311E2-001/control-001/cores/collection1
[junit4] 2> 3677787 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [n:127.0.0.1:41821_ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
[junit4] 2> 3677788 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [n:127.0.0.1:41821_ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4] 2> 3677788 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [n:127.0.0.1:41821_ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 3677788 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 3677788 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 3677789 INFO (OverseerStateUpdate-95044976504340484-127.0.0.1:41821_-n_0000000000) [n:127.0.0.1:41821_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:41821",
[junit4] 2> "node_name":"127.0.0.1:41821_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 3677790 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 3677790 INFO (OverseerStateUpdate-95044976504340484-127.0.0.1:41821_-n_0000000000) [n:127.0.0.1:41821_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:41821",
[junit4] 2> "node_name":"127.0.0.1:41821_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 3677790 INFO (OverseerStateUpdate-95044976504340484-127.0.0.1:41821_-n_0000000000) [n:127.0.0.1:41821_ ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
[junit4] 2> 3677791 INFO (OverseerStateUpdate-95044976504340484-127.0.0.1:41821_-n_0000000000) [n:127.0.0.1:41821_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 3677792 INFO (zkCallback-2861-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 3677792 INFO (zkCallback-2861-thread-2-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 3678790 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 3678790 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
[junit4] 2> 3678791 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 3678791 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 3678791 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 3678791 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DA02B3D0A26311E2-001/control-001/cores/collection1'
[junit4] 2> 3678792 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 3678792 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 3678793 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 3678798 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 3678802 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 3678809 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection x:collection1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
[junit4] 2> 3678814 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 3678907 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 3678912 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 3678913 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 3678920 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 3678922 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 3678924 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 3678924 WARN (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 3678924 WARN (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 3678924 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 3678925 WARN (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 3678925 WARN (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 3678926 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4] 2> 3678926 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 3678926 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 3678927 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DA02B3D0A26311E2-001/control-001/cores/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DA02B3D0A26311E2-001/control-001/cores/collection1/data/]
[junit4] 2> 3678927 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3931edfc
[junit4] 2> 3678927 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DA02B3D0A26311E2-001/control-001/cores/collection1/data
[junit4] 2> 3678928 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DA02B3D0A26311E2-001/control-001/cores/collection1/data/index/
[junit4] 2> 3678928 WARN (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DA02B3D0A26311E2-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 3678928 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DA02B3D0A26311E2-001/control-001/cores/collection1/data/index
[junit4] 2> 3678928 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=3, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 3678929 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@57c4afaf lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@209ec51),segFN=segments_1,generation=1}
[junit4] 2> 3678929 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 3678929 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DA02B3D0A26311E2-001/control-001/cores/collection1/data/
[junit4] 2> 3678930 WARN (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DA02B3D0A26311E2-001/control-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
[junit4] 2> 3678934 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 3678934 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
[junit4] 2> 3678934 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 3678934 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 3678934 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 3678934 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 3678934 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 3678935 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 3678935 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 3678935 WARN (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,args = {defaults={a=A,b=B}}}
[junit4] 2> 3678936 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 3678937 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 3678938 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 3678939 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 3678942 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/dump,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 3678942 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 3678943 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 3678943 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 3678944 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 3678944 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 3678945 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=27, maxMergeAtOnceExplicit=27, maxMergedSegmentMB=27.5712890625, floorSegmentMB=2.0234375, forceMergeDeletesPctAllowed=2.9088675241833393, segmentsPerTier=17.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.78207185484954
[junit4] 2> 3678945 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@57c4afaf lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@209ec51),segFN=segments_1,generation=1}
[junit4] 2> 3678945 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 3678945 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@1c696d61[collection1] main
[junit4] 2> 3678945 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 3678946 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 3678946 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 3678946 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 3678946 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
[junit4] 2> 3678947 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 3678947 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 3678947 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 3678947 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 3678947 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 3678948 INFO (searcherExecutor-11783-thread-1-processing-n:127.0.0.1:41821_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@1c696d61[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 3678948 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
[junit4] 2> 3678948 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
[junit4] 2> 3678948 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
[junit4] 2> 3678948 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1520719625838395392
[junit4] 2> 3678950 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 2.0ms to seed version buckets with highest version 1520719625838395392
[junit4] 2> 3678950 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
[junit4] 2> 3678951 INFO (coreLoadExecutor-11782-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 3678951 INFO (coreZkRegister-11776-thread-1-processing-n:127.0.0.1:41821_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:41821 collection:control_collection shard:shard1
[junit4] 2> 3678952 INFO (coreZkRegister-11776-thread-1-processing-n:127.0.0.1:41821_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 3678955 INFO (coreZkRegister-11776-thread-1-processing-n:127.0.0.1:41821_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/95044976504340484-core_node1-n_0000000000
[junit4] 2> 3678955 INFO (coreZkRegister-11776-thread-1-processing-n:127.0.0.1:41821_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard=shard1 and weAreReplacement=false and leaderVoteWait=180000
[junit4] 2> 3678957 INFO (coreZkRegister-11776-thread-1-processing-n:127.0.0.1:41821_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 3678957 INFO (coreZkRegister-11776-thread-1-processing-n:127.0.0.1:41821_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 3678957 INFO (coreZkRegister-11776-thread-1-processing-n:127.0.0.1:41821_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:41821/collection1/
[junit4] 2> 3678957 INFO (OverseerStateUpdate-95044976504340484-127.0.0.1:41821_-n_0000000000) [n:127.0.0.1:41821_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection"} current state version: 1
[junit4] 2> 3678957 INFO (coreZkRegister-11776-thread-1-processing-n:127.0.0.1:41821_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 3678957 INFO (coreZkRegister-11776-thread-1-processing-n:127.0.0.1:41821_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:41821/collection1/ has no replicas
[junit4] 2> 3678958 INFO (coreZkRegister-11776-thread-1-processing-n:127.0.0.1:41821_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 3678960 INFO (coreZkRegister-11776-thread-1-processing-n:127.0.0.1:41821_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
[junit4] 2> 3678961 INFO (coreZkRegister-11776-thread-1-processing-n:127.0.0.1:41821_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:41821/collection1/ shard1
[junit4] 2> 3678962 INFO (OverseerStateUpdate-95044976504340484-127.0.0.1:41821_-n_0000000000) [n:127.0.0.1:41821_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:41821",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 1
[junit4] 2> 3679064 INFO (zkCallback-2861-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 3679065 INFO (zkCallback-2861-thread-2-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 3679112 INFO (coreZkRegister-11776-thread-1-processing-n:127.0.0.1:41821_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:41821/collection1/ and leader is http://127.0.0.1:41821/collection1/
[junit4] 2> 3679113 INFO (coreZkRegister-11776-thread-1-processing-n:127.0.0.1:41821_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:41821
[junit4] 2> 3679113 INFO (coreZkRegister-11776-thread-1-processing-n:127.0.0.1:41821_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 3679113 INFO (coreZkRegister-11776-thread-1-processing-n:127.0.0.1:41821_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
[junit4] 2> 3679113 INFO (coreZkRegister-11776-thread-1-processing-n:127.0.0.1:41821_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41821_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 3679115 INFO (OverseerStateUpdate-95044976504340484-127.0.0.1:41821_-n_0000000000) [n:127.0.0.1:41821_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:41821",
[junit4] 2> "node_name":"127.0.0.1:41821_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 2
[junit4] 2> 3679115 INFO (OverseerStateUpdate-95044976504340484-127.0.0.1:41821_-n_0000000000) [n:127.0.0.1:41821_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:41821",
[junit4] 2> "node_name":"127.0.0.1:41821_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 3679217 INFO (zkCallback-2861-thread-2-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 3679217 INFO (zkCallback-2861-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 3679289 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 3679290 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 3679291 INFO (zkCallback-2863-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2615a77d name:ZooKeeperConnection Watcher:127.0.0.1:39993/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 3679292 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 3679292 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 3679292 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 3679294 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 3679604 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DA02B3D0A26311E2-001/shard-1-001/cores/collection1
[junit4] 2> 3679604 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DA02B3D0A26311E2-001/shard-1-001
[junit4] 2> 3679605 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.e.j.s.Server jetty-9.3.6.v20151106
[junit4] 2> 3679607 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@36a7d747{/,null,AVAILABLE}
[junit4] 2> 3679607 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.e.j.s.ServerConnector Started ServerConnector@61ad1847{HTTP/1.1,[http/1.1]}{127.0.0.1:41440}
[junit4] 2> 3679608 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.e.j.s.Server Started @3683072ms
[junit4] 2> 3679609 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DA02B3D0A26311E2-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/, hostPort=41440, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DA02B3D0A26311E2-001/shard-1-001/cores}
[junit4] 2> 3679609 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 3679609 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DA02B3D0A26311E2-001/shard-1-001'
[junit4] 2> 3679609 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 3679609 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 3679609 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 3679610 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 3679611 INFO (zkCallback-2864-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5936b735 name:ZooKeeperConnection Watcher:127.0.0.1:39993/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 3679611 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 3679611 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 3679612 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 3679612 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DA02B3D0A26311E2-001/shard-1-001/solr.xml
[junit4] 2> 3679617 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DA02B3D0A26311E2-001/shard-1-001/cores
[junit4] 2> 3679617 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.CoreContainer New CoreContainer 1714305772
[junit4] 2> 3679617 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DA02B3D0A26311E2-001/shard-1-001]
[junit4] 2> 3679617 WARN (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DA02B3D0A26311E2-001/shard-1-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DA02B3D0A26311E2-001/shard-1-001/lib
[junit4] 2> 3679618 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 3679619 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 3679619 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 3679619 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 3679619 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39993/solr
[junit4] 2> 3679620 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 3679620 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 3679620 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 3679621 INFO (zkCallback-2866-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@a7f8aaf name:ZooKeeperConnection Watcher:127.0.0.1:39993 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 3679623 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 3679623 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 3679624 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [n:127.0.0.1:41440_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 3679625 INFO (zkCallback-2867-thread-1-processing-n:127.0.0.1:41440_) [n:127.0.0.1:41440_ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@69fa34a7 name:ZooKeeperConnection Watcher:127.0.0.1:39993/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 3679625 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [n:127.0.0.1:41440_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 3679629 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [n:127.0.0.1:41440_ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 3680634 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [n:127.0.0.1:41440_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41440_
[junit4] 2> 3680635 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [n:127.0.0.1:41440_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:41440_
[junit4] 2> 3680637 INFO (zkCallback-2863-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 3680637 INFO (zkCallback-2861-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 3680637 INFO (zkCallback-2867-thread-1-processing-n:127.0.0.1:41440_) [n:127.0.0.1:41440_ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 3680637 INFO (zkCallback-2861-thread-2-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 3680641 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [n:127.0.0.1:41440_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 3680641 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [n:127.0.0.1:41440_ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95044976504340488-127.0.0.1:41440_-n_0000000001
[junit4] 2> 3680642 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [n:127.0.0.1:41440_ ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/95044976504340484-127.0.0.1:41821_-n_0000000000 to know if I could be the leader
[junit4] 2> 3680652 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [n:127.0.0.1:41440_ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 3680652 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [n:127.0.0.1:41440_ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 3680653 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [n:127.0.0.1:41440_ ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DA02B3D0A26311E2-001/shard-1-001/cores
[junit4] 2> 3680653 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [n:127.0.0.1:41440_ ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=collection1, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 3680653 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [n:127.0.0.1:41440_ ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DA02B3D0A26311E2-001/shard-1-001/cores/collection1
[junit4] 2> 3680653 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [n:127.0.0.1:41440_ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
[junit4] 2> 3680654 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [n:127.0.0.1:41440_ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4] 2> 3680655 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DA02B3D0A26311E2]) [n:127.0.0.1:41440_ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 3680655 INFO (coreLoadExecutor-11793-thread-1-processing-n:127.0.0.1:41440_) [n:127.0.0.1:41440_ c:collection1 x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 3680655 INFO (coreLoadExecutor-11793-thread-1-processing-n:127.0.0.1:41440_) [n:127.0.0.1:41440_ c:collection1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 3680656 INFO (coreLoadExecutor-11793-thread-1-processing-n:127.0.0.1:41440_) [n:127.0.0.1:41440_ c:collection1 x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 3680656 INFO (OverseerStateUpdate-95044976504340484-127.0.0.1:41821_-n_0000000000) [n:127.0.0.1:41821_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:41440",
[junit4] 2> "node_name":"127.0.0.1:41440_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"} current state version: 3
[junit4] 2> 3680657 INFO (OverseerStateUpdate-95044976504340484-127.0.0.1:41821_-n_0000000000) [n:127.0.0.1:41821_ ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:41440",
[junit4] 2> "node_name":"127.0.0.1:41440_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"}
[junit4] 2> 3680657 INFO (OverseerStateUpdate-95044976504340484-127.0.0.1:41821_-n_0000000000) [n:127.0.0.1:41821_ ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
[junit4] 2> 3680657 INFO (OverseerStateUpdate-95044976504340484-127.0.0.1:41821_-n_0000000000) [n:127.0.0.1:41821_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2
[junit4] 2> 3680759 INFO (zkCallback-2863-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 3680759 INFO (zkCallback-2861-thread-1-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 3680759 INFO (zkCallback-2867-thread-1-processing-n:127.0.0.1:41440_) [n:127.0.0.1:41440_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 3680759 INFO (zkCallback-2861-thread-2-processing-n:127.0.0.1:41821_) [n:127.0.0.1:41821_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 3681657 INFO (coreLoadExecutor-11793-thread-1-processing-n:127.0.0.1:41440_) [n:127.0.0.1:41440_ c:collection1 x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 3681657 INFO (coreLoadExecutor-11793-thread-1-processing-n:127.0.0.1:41440_) [n:127.0.0.1:41440_ c:collection1 x:collection1] o.a.s.c.ZkController Check for collection zkNode:collection1
[junit4] 2> 3681657 INFO (coreLoadExecutor-11793-thread-1-processing-n:127.0.0.1:41440_) [n:127.0.0.1:41440_ c:collection1 x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 3681657 INFO (coreLoadExecutor-11793-thread-1-processing-n:127.0.0.1:41440_) [n:127.0.0.1:41440_ c:collection1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/collection1
[junit4] 2> 3681658 INFO (coreLoadExecutor-11793-thread-1-processing-n:127.0.0.1:41440_) [n:127.0.0.1:41440_ c:collection1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 3681658 INFO (coreLoadExecutor-11793-thread-1-processing-n:127.0.0.1:41440_) [n:127.0.0.1:41440_ c:collection1 x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DA02B3D0A26311E2-001/shard-1-001/cores/collection1'
[junit4] 2> 3681658 INFO (coreLoadExecutor-11793-thread-1-processing-n:127.0.0.1:41440_) [n:127.0.0.1:41440_ c:collection1 x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 3681658 INFO (coreLoadExecutor-11793-thread-1-processing-n:127.0.0.1:41440_) [n:127.0.0.1:41440_ c:collection1 x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 3681659 INFO (coreLoadExecutor-11793-thread-1-processing-n:127.0.0.1:41440_) [n:127.0.0.1:41440_ c:collection1 x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 3681665 INFO (coreLoadExecutor-11793-thread-1-processing-n:127.0.0.1:41440_) [n:127.0.0.1:41440_ c:collection1 x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 3681668 INFO (coreLoadExecutor-11793-thread-1-processing-n:127.0.0.1:41440_) [n:127.0.0.1:41440_ c:collection1 x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 3681676 INFO (coreLoadExecutor-11793-thread-1-processing-n:127.0.0.1:41440_) [n:127.0.0.1:41440_ c:collection1 x:collection1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
[junit4] 2> 3681681 INFO (coreLoadExecutor-11793-thread-1-processing-n:127.0.0.1:41440_) [n:127.0.0.1:41440_ c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 3681778 INFO (coreLoadExecutor-11793-thread-1-processing-n:127.0.0.1:41440_) [n:127.0.0.1:41440_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 3681783 INFO (coreLoadExecutor-11793-thread-1-processing-n:127.0.0.1:41440_) [n:127.0.0.1:41440_ c:collection1 x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 3681784 INFO (coreLoadExecutor-11793-thread-1-processing-n:127.0.0.1:41440_) [n:127.0.0.1:41440_ c:collection1 x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 3681792 INFO (coreLoadExecutor-11793-thread-1-processing-n:127.0.0.1:41440_) [n:127.0.0.1:41440_ c:collection1 x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 3681794 INFO (coreLoadExecutor-11793-thread-1-processing-n:127.0.0.1:41440_) [n:127.0.0.1:41440_ c:collection1 x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 3681795 INFO (coreLoadExecutor-11793-thread-1-processing-n:127.0.0.1:41440_) [n:127.0.0.1:41440_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 3681796 WARN (coreLoadExecutor-11793-thread-1-processing-n:127.0.0.1:41440_) [n:127.0.0.1:41440_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 3681796 WARN (coreLoadExecutor-11793-thread-1-processing-n:127.0.0.1:41440_) [n:127.0.0.1:41440_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 3681796 INFO (coreLoadExecutor-11793-thread-1-processing-n:127.0.0.1:41440_) [n:127.0.0.1:41440_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 3681797 WARN (coreLoadExecutor-11793-thread-1-processing-n:127.0.0.1:41440_) [n:127.0.0.1:41440_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 3681797 WARN (coreLoadExecutor-11793-thread-1-processing-n:127.0.0.1:41440_) [n:127.0.0.1:41440_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 3681798 INFO (coreLoadExecutor-11793-thread-1-processing-n:127.0.0.1:41440_) [n:127.0.0.1:41440_ c:collection1 x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4] 2> 3681798 INFO (coreLoadExecutor-11793-thread-1-processing-n:127.0.0.1:41440_) [n:127.0.0.1:41440_ c:collection1 x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 3681798 INFO (coreLoadExecutor-11793-thread-1-processing-n:127.0.0.1:41440_) [n:127.0.0.1:41440_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 3681798 INFO (coreLoadExecutor-11793-thread-1-processing-n:127.0.0.1:41440_) [n:127.0.0.1:41440_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DA02B3D0A26311E2-001/shard-1-001/cores/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DA02B3D0A26311E2-001/shard-1-001/cores/collection1/data/]
[junit4] 2> 3681798 INFO (coreLoadExecutor-11793-thread-1-processing-n:127.0.0.1:41440_) [n:127.0.0.1:41440_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3931edfc
[junit4] 2> 3681799 INFO (coreLoadExecutor-11793-thread-1-processing-n:127.0.0.1:41440_) [n:127.0.0.1:41440_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DA02B3D0A26311E2-001/shard-1-001/cores/collection1/data
[junit4] 2> 3681800 INFO (coreLoadExecutor-11793-thread-1-processing-n:127.0.0.1:41440_) [n:127.0.0.1:41440_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DA02B3D0A26311E2-001/shard-1-001/cores/collection1/data/index/
[junit4] 2> 3681800 WARN (coreLoadExecutor-11793-thread-1-processing-n:127.0.0.1:41440_) [n:127.0.0.1:41440_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DA02B3D0A26311E2-001/shard-1-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 3681800 INFO (coreLoadExecutor-11793-thread-1-processing-n:127.0.0.1:41440_) [n:127.0.0.1:41440_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DA02B3D0A26311E2-001/shard-1-001/cores/collection1/data/index
[junit4] 2> 3681800 INFO (coreLoadExecutor-11793-thread-1-processing-n:127.0.0.1:41440_) [n:127.0.0.1:41440_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=3, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 3681800 INFO (coreLoadExecutor-11793-thread-1-processing-n:127.0.0.1:41440_) [n:127.0.0.1:41440_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@79ae77d4 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@53b240d5),segFN=segments_1,generation=1}
[junit4] 2> 3681801 INFO (coreLoadExecutor-11793-thread-1-processing-n:127.0.0.1:41440_) [n:127.0.0.1:41440_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 3681801 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:41440_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DA02B3D0A26311E2-001/shard-1-001/cores/collection1/data/
[junit4] 2> 3681801 WARN (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:41440_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DA02B3D0A26311E2-001/shard-1-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
[junit4] 2> 3681806 INFO (coreLoadExecutor-11793-thread-1-processing-n:127.0.0.1:41440_) [n:127.0.0.1:41440_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 3681806 INFO (coreLoadExecutor-11793-thread-1-processing-n:127.0.0.1:41440_) [n:127.0.0.1:41440_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
[junit4]
[...truncated too long message...]
est(CloudSolrClient.java:807)
[junit4] > at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1574)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1595)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:881)Throwable #4: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=35683, name=collection0, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:41821: Could not find collection : awholynewstresscollection_collection0_3
[junit4] > at __randomizedtesting.SeedInfo.seed([DA02B3D0A26311E2]:0)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:871)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:807)
[junit4] > at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:888)Throwable #5: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=35688, name=collection5, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:41821: collection already exists: awholynewstresscollection_collection5_4
[junit4] > at __randomizedtesting.SeedInfo.seed([DA02B3D0A26311E2]:0)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:871)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:807)
[junit4] > at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1574)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1595)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:881)Throwable #6: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=35684, name=collection1, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:41821: Could not find collection : awholynewstresscollection_collection1_4
[junit4] > at __randomizedtesting.SeedInfo.seed([DA02B3D0A26311E2]:0)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:871)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:807)
[junit4] > at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:888)
[junit4] 2> 3968648 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[DA02B3D0A26311E2]-worker) [n:127.0.0.1:35904_ c:addReplicaColl s:shard2 r:core_node6 x:addReplicaColl_shard2_replica3] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene60): {other_tl1=PostingsFormat(name=Asserting), range_facet_l_dv=PostingsFormat(name=LuceneFixedGap), _version_=PostingsFormat(name=Asserting), multiDefault=PostingsFormat(name=MockRandom), a_t=PostingsFormat(name=Asserting), intDefault=PostingsFormat(name=Asserting), a_i1=PostingsFormat(name=Asserting), id=PostingsFormat(name=LuceneFixedGap), range_facet_i_dv=PostingsFormat(name=Asserting), text=FSTOrd50, range_facet_l=PostingsFormat(name=Asserting), timestamp=PostingsFormat(name=Asserting)}, docValues:{range_facet_l_dv=DocValuesFormat(name=Memory), range_facet_i_dv=DocValuesFormat(name=Direct), timestamp=DocValuesFormat(name=Direct)}, sim=ClassicSimilarity, locale=en, timezone=Pacific/Chatham
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_66 (64-bit)/cpus=4,threads=1,free=87788936,total=498597888
[junit4] 2> NOTE: All tests run in this JVM: [FullHLLTest, TestHighFrequencyDictionaryFactory, MBeansHandlerTest, TestClusterStateMutator, RollingRestartTest, SecurityConfHandlerTest, IgnoreCommitOptimizeUpdateProcessorFactoryTest, TestBlendedInfixSuggestions, TestObjectReleaseTracker, SimpleCollectionCreateDeleteTest, BasicFunctionalityTest, TestWordDelimiterFilterFactory, TestRecoveryHdfs, TestSchemaResource, TestConfigSetsAPIZkFailure, CdcrRequestHandlerTest, TestUniqueKeyFieldResource, TestInfoStreamLogging, TestSolrDynamicMBean, TestFastLRUCache, TestPartialUpdateDeduplication, TestDFRSimilarityFactory, ConvertedLegacyTest, TestCoreContainer, TestLeaderInitiatedRecoveryThread, TriLevelCompositeIdRoutingTest, AddBlockUpdateTest, OpenCloseCoreStressTest, TestCursorMarkWithoutUniqueKey, NotRequiredUniqueKeyTest, TestJettySolrRunner, ChaosMonkeySafeLeaderTest, OpenExchangeRatesOrgProviderTest, IndexBasedSpellCheckerTest, BigEndianAscendingWordSerializerTest, TestDistributedGrouping, DistributedVersionInfoTest, TestAuthenticationFramework, MigrateRouteKeyTest, ShardSplitTest, TimeZoneUtilsTest, TestSimpleQParserPlugin, TestExactSharedStatsCache, TestPivotHelperCode, CollectionStateFormat2Test, HighlighterTest, SoftAutoCommitTest, RemoteQueryErrorTest, HdfsCollectionsAPIDistributedZkTest, FastVectorHighlighterTest, CloudMLTQParserTest, DistributedTermsComponentTest, FileUtilsTest, TestLFUCache, DistributedFacetPivotSmallAdvancedTest, TestBulkSchemaConcurrent, TestScoreJoinQPNoScore, TestRandomCollapseQParserPlugin, MinimalSchemaTest, TestSolrDeletionPolicy2, SolrIndexSplitterTest, DirectSolrSpellCheckerTest, SolrInfoMBeanTest, CleanupOldIndexTest, TestStressVersions, TermsComponentTest, ZkControllerTest, CoreAdminRequestStatusTest, CollectionsAPIDistributedZkTest]
[junit4] Completed [448/566 (1!)] on J1 in 292.31s, 1 test, 1 error <<< FAILURES!
[...truncated 374 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:791: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:728: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1436: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:991: There were test failures: 566 suites (8 ignored), 2254 tests, 1 error, 33 ignored (18 assumptions) [seed: DA02B3D0A26311E2]
Total time: 267 minutes 7 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 882 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/882/
10 tests failed.
FAILED: org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.test
Error Message:
Test abandoned because suite timeout was reached.
Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
at __randomizedtesting.SeedInfo.seed([712A9BC123B2B08E]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.FullSolrCloudDistribCmdsTest
Error Message:
Suite timeout exceeded (>= 7200000 msec).
Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
at __randomizedtesting.SeedInfo.seed([712A9BC123B2B08E]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.FullSolrCloudDistribCmdsTest
Error Message:
Captured an uncaught exception in thread: Thread[id=4193, name=zkCallback-541-thread-4, state=RUNNABLE, group=TGRP-FullSolrCloudDistribCmdsTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=4193, name=zkCallback-541-thread-4, state=RUNNABLE, group=TGRP-FullSolrCloudDistribCmdsTest]
Caused by: java.lang.OutOfMemoryError: GC overhead limit exceeded
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.FullSolrCloudDistribCmdsTest
Error Message:
Captured an uncaught exception in thread: Thread[id=3385, name=OverseerHdfsCoreFailoverThread-95038595507486724-127.0.0.1:44248_-n_0000000000, state=RUNNABLE, group=Overseer Hdfs SolrCore Failover Thread.]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=3385, name=OverseerHdfsCoreFailoverThread-95038595507486724-127.0.0.1:44248_-n_0000000000, state=RUNNABLE, group=Overseer Hdfs SolrCore Failover Thread.]
Caused by: java.lang.OutOfMemoryError: GC overhead limit exceeded
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.FullSolrCloudDistribCmdsTest
Error Message:
Captured an uncaught exception in thread: Thread[id=3383, name=OverseerStateUpdate-95038595507486724-127.0.0.1:44248_-n_0000000000, state=RUNNABLE, group=Overseer state updater.]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=3383, name=OverseerStateUpdate-95038595507486724-127.0.0.1:44248_-n_0000000000, state=RUNNABLE, group=Overseer state updater.]
Caused by: java.lang.OutOfMemoryError: GC overhead limit exceeded
FAILED: org.apache.solr.cloud.HttpPartitionTest.test
Error Message:
Test abandoned because suite timeout was reached.
Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
at __randomizedtesting.SeedInfo.seed([712A9BC123B2B08E]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.HttpPartitionTest
Error Message:
Suite timeout exceeded (>= 7200000 msec).
Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
at __randomizedtesting.SeedInfo.seed([712A9BC123B2B08E]:0)
FAILED: org.apache.solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest.test
Error Message:
document count mismatch. control=5468 sum(shards)=5467 cloudClient=5467
Stack Trace:
java.lang.AssertionError: document count mismatch. control=5468 sum(shards)=5467 cloudClient=5467
at __randomizedtesting.SeedInfo.seed([712A9BC123B2B08E:F97EA41B8D4EDD76]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1298)
at org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest.test(ChaosMonkeyNothingIsSafeTest.java:234)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:965)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:940)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.handler.TestReplicationHandler.doTestReplicateAfterCoreReload
Error Message:
Test abandoned because suite timeout was reached.
Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
at __randomizedtesting.SeedInfo.seed([712A9BC123B2B08E]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.handler.TestReplicationHandler
Error Message:
Suite timeout exceeded (>= 7200000 msec).
Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
at __randomizedtesting.SeedInfo.seed([712A9BC123B2B08E]:0)
Build Log:
[...truncated 10396 lines...]
[junit4] JVM J1: stdout was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/temp/junit4-J1-20151215_095831_840.sysout
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] java.lang.OutOfMemoryError: GC overhead limit exceeded
[junit4] Dumping heap to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/heapdumps/java_pid6940.hprof ...
[junit4] Heap dump file created [606766085 bytes in 3.907 secs]
[junit4] <<< JVM J1: EOF ----
[junit4] JVM J1: stderr was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/temp/junit4-J1-20151215_095831_840.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] WARN: Unhandled exception in event serialization. -> java.lang.OutOfMemoryError: GC overhead limit exceeded
[junit4] at java.nio.CharBuffer.wrap(CharBuffer.java:373)
[junit4] at sun.nio.cs.StreamEncoder.implWrite(StreamEncoder.java:265)
[junit4] at sun.nio.cs.StreamEncoder.write(StreamEncoder.java:125)
[junit4] at sun.nio.cs.StreamEncoder.write(StreamEncoder.java:135)
[junit4] at java.io.OutputStreamWriter.write(OutputStreamWriter.java:220)
[junit4] at java.io.Writer.write(Writer.java:157)
[junit4] at com.carrotsearch.ant.tasks.junit4.gson.stream.JsonWriter.string(JsonWriter.java:573)
[junit4] at com.carrotsearch.ant.tasks.junit4.gson.stream.JsonWriter.value(JsonWriter.java:414)
[junit4] at com.carrotsearch.ant.tasks.junit4.events.Serializer$2.run(Serializer.java:100)
[junit4] at com.carrotsearch.ant.tasks.junit4.events.Serializer$2.run(Serializer.java:96)
[junit4] at java.security.AccessController.doPrivileged(Native Method)
[junit4] at com.carrotsearch.ant.tasks.junit4.events.Serializer.flushQueue(Serializer.java:96)
[junit4] at com.carrotsearch.ant.tasks.junit4.events.Serializer.serialize(Serializer.java:81)
[junit4] at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain$3$2.write(SlaveMain.java:456)
[junit4] at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
[junit4] at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140)
[junit4] at java.io.PrintStream.flush(PrintStream.java:338)
[junit4] at java.io.FilterOutputStream.flush(FilterOutputStream.java:140)
[junit4] at java.io.PrintStream.write(PrintStream.java:482)
[junit4] at sun.nio.cs.StreamEncoder.writeBytes(StreamEncoder.java:221)
[junit4] at sun.nio.cs.StreamEncoder.implFlushBuffer(StreamEncoder.java:291)
[junit4] at sun.nio.cs.StreamEncoder.implFlush(StreamEncoder.java:295)
[junit4] at sun.nio.cs.StreamEncoder.flush(StreamEncoder.java:141)
[junit4] at java.io.OutputStreamWriter.flush(OutputStreamWriter.java:229)
[junit4] at org.apache.log4j.helpers.QuietWriter.flush(QuietWriter.java:59)
[junit4] at org.apache.log4j.WriterAppender.subAppend(WriterAppender.java:324)
[junit4] at org.apache.log4j.WriterAppender.append(WriterAppender.java:162)
[junit4] at org.apache.log4j.AppenderSkeleton.doAppend(AppenderSkeleton.java:251)
[junit4] at org.apache.log4j.h
[junit4] elpers.AppenderAttachableImpl.appendLoopOnAppenders(AppenderAttachableImpl.java:66)
[junit4] at org.apache.log4j.Category.callAppenders(Category.java:206)
[junit4] at org.apache.log4j.Category.forcedLog(Category.java:391)
[junit4] at org.apache.log4j.Category.log(Category.java:856)
[junit4] <<< JVM J1: EOF ----
[...truncated 217 lines...]
[junit4] Suite: org.apache.solr.cloud.FullSolrCloudDistribCmdsTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_712A9BC123B2B08E-001/init-core-data-001
[junit4] 2> 366336 INFO (SUITE-FullSolrCloudDistribCmdsTest-seed#[712A9BC123B2B08E]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
[junit4] 2> 366340 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 366340 INFO (Thread-1202) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 366340 INFO (Thread-1202) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 366440 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.ZkTestServer start zk server on port:58829
[junit4] 2> 366440 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 366441 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 366443 INFO (zkCallback-536-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@40f13dba name:ZooKeeperConnection Watcher:127.0.0.1:58829 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 366444 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 366444 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 366444 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 366446 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 366447 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 366448 INFO (zkCallback-537-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@77abed32 name:ZooKeeperConnection Watcher:127.0.0.1:58829/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 366448 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 366448 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 366448 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
[junit4] 2> 366449 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
[junit4] 2> 366451 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
[junit4] 2> 366452 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
[junit4] 2> 366455 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 366455 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 366459 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 366459 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
[junit4] 2> 366460 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 366461 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 366463 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 366463 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
[junit4] 2> 366464 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 366464 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
[junit4] 2> 366472 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 366472 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
[junit4] 2> 366474 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 366474 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 366475 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 366475 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 366477 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 366477 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 366478 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 366479 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 366481 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 366481 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
[junit4] 2> 366849 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_712A9BC123B2B08E-001/control-001/cores/collection1
[junit4] 2> 366851 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.e.j.s.Server jetty-9.3.6.v20151106
[junit4] 2> 366853 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3e991353{/,null,AVAILABLE}
[junit4] 2> 366863 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.e.j.s.ServerConnector Started ServerConnector@7dd2af1c{HTTP/1.1,[http/1.1]}{127.0.0.1:44248}
[junit4] 2> 366863 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.e.j.s.Server Started @370267ms
[junit4] 2> 366863 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_712A9BC123B2B08E-001/tempDir-001/control/data, hostContext=/, hostPort=44248, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_712A9BC123B2B08E-001/control-001/cores}
[junit4] 2> 366864 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 366864 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_712A9BC123B2B08E-001/control-001'
[junit4] 2> 366864 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 366864 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 366864 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 366873 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 366873 INFO (zkCallback-538-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@16a4169f name:ZooKeeperConnection Watcher:127.0.0.1:58829/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 366873 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 366874 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 366875 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 366875 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_712A9BC123B2B08E-001/control-001/solr.xml
[junit4] 2> 366879 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_712A9BC123B2B08E-001/control-001/cores
[junit4] 2> 366880 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.CoreContainer New CoreContainer 77849489
[junit4] 2> 366880 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_712A9BC123B2B08E-001/control-001]
[junit4] 2> 366880 WARN (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_712A9BC123B2B08E-001/control-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_712A9BC123B2B08E-001/control-001/lib
[junit4] 2> 366880 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 366882 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 366882 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 366882 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 366882 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:58829/solr
[junit4] 2> 366882 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 366882 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 366883 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 366885 INFO (zkCallback-540-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@358af1d0 name:ZooKeeperConnection Watcher:127.0.0.1:58829 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 366885 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 366886 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 366891 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [n:127.0.0.1:44248_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 366892 INFO (zkCallback-541-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@67d38ea5 name:ZooKeeperConnection Watcher:127.0.0.1:58829/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 366892 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [n:127.0.0.1:44248_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 366894 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [n:127.0.0.1:44248_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
[junit4] 2> 366900 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [n:127.0.0.1:44248_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 366904 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [n:127.0.0.1:44248_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 366905 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [n:127.0.0.1:44248_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 366906 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [n:127.0.0.1:44248_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 366908 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [n:127.0.0.1:44248_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 366909 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [n:127.0.0.1:44248_ ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 366911 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [n:127.0.0.1:44248_ ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 366912 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [n:127.0.0.1:44248_ ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 366913 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [n:127.0.0.1:44248_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44248_
[junit4] 2> 366913 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [n:127.0.0.1:44248_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:44248_
[junit4] 2> 366915 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [n:127.0.0.1:44248_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 366917 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [n:127.0.0.1:44248_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 366918 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [n:127.0.0.1:44248_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 366918 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [n:127.0.0.1:44248_ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95038595507486724-127.0.0.1:44248_-n_0000000000
[junit4] 2> 366918 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [n:127.0.0.1:44248_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:44248_
[junit4] 2> 366918 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [n:127.0.0.1:44248_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
[junit4] 2> 366919 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [n:127.0.0.1:44248_ ] o.a.s.c.Overseer Overseer (id=95038595507486724-127.0.0.1:44248_-n_0000000000) starting
[junit4] 2> 366921 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [n:127.0.0.1:44248_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
[junit4] 2> 366928 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [n:127.0.0.1:44248_ ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 366929 INFO (OverseerStateUpdate-95038595507486724-127.0.0.1:44248_-n_0000000000) [n:127.0.0.1:44248_ ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 366930 INFO (OverseerStateUpdate-95038595507486724-127.0.0.1:44248_-n_0000000000) [n:127.0.0.1:44248_ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 366935 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [n:127.0.0.1:44248_ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 366935 INFO (OverseerCollectionConfigSetProcessor-95038595507486724-127.0.0.1:44248_-n_0000000000) [n:127.0.0.1:44248_ ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
[junit4] 2> 366981 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [n:127.0.0.1:44248_ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 366981 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [n:127.0.0.1:44248_ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 366982 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [n:127.0.0.1:44248_ ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_712A9BC123B2B08E-001/control-001/cores
[junit4] 2> 366983 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [n:127.0.0.1:44248_ ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=control_collection, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 366983 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [n:127.0.0.1:44248_ ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_712A9BC123B2B08E-001/control-001/cores/collection1
[junit4] 2> 366983 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [n:127.0.0.1:44248_ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
[junit4] 2> 366984 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [n:127.0.0.1:44248_ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2
[junit4] 2> 366985 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 366985 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [n:127.0.0.1:44248_ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 366985 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 366986 INFO (OverseerStateUpdate-95038595507486724-127.0.0.1:44248_-n_0000000000) [n:127.0.0.1:44248_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:44248",
[junit4] 2> "node_name":"127.0.0.1:44248_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 366987 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 366987 INFO (OverseerStateUpdate-95038595507486724-127.0.0.1:44248_-n_0000000000) [n:127.0.0.1:44248_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:44248",
[junit4] 2> "node_name":"127.0.0.1:44248_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 366988 INFO (OverseerStateUpdate-95038595507486724-127.0.0.1:44248_-n_0000000000) [n:127.0.0.1:44248_ ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
[junit4] 2> 366988 INFO (OverseerStateUpdate-95038595507486724-127.0.0.1:44248_-n_0000000000) [n:127.0.0.1:44248_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 366990 INFO (zkCallback-541-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 366991 INFO (zkCallback-541-thread-2-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 367987 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 367987 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
[junit4] 2> 367988 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 367988 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 367988 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 367988 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_712A9BC123B2B08E-001/control-001/cores/collection1'
[junit4] 2> 367989 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 367989 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 367990 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 367995 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 367999 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 368006 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection x:collection1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
[junit4] 2> 368013 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 368098 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 368099 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 368100 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 368104 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 368124 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2
[junit4] 2> 368124 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 368125 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 368125 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_712A9BC123B2B08E-001/control-001/cores/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_712A9BC123B2B08E-001/control-001/cores/collection1/data/]
[junit4] 2> 368125 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@d28ee65
[junit4] 2> 368126 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_712A9BC123B2B08E-001/control-001/cores/collection1/data
[junit4] 2> 368126 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_712A9BC123B2B08E-001/control-001/cores/collection1/data/index/
[junit4] 2> 368126 WARN (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_712A9BC123B2B08E-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 368126 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_712A9BC123B2B08E-001/control-001/cores/collection1/data/index
[junit4] 2> 368127 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=11, maxMergeAtOnceExplicit=22, maxMergedSegmentMB=19.935546875, floorSegmentMB=0.791015625, forceMergeDeletesPctAllowed=22.539443265727368, segmentsPerTier=21.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.3764691806371193
[junit4] 2> 368127 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@51d62c4d lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4800abe1),segFN=segments_1,generation=1}
[junit4] 2> 368128 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 368134 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_712A9BC123B2B08E-001/control-001/cores/collection1/data/
[junit4] 2> 368134 WARN (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_712A9BC123B2B08E-001/control-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
[junit4] 2> 368137 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 368138 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
[junit4] 2> 368138 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 368138 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 368138 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 368138 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 368138 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 368138 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 368138 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 368138 WARN (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,args = {defaults={a=A,b=B}}}
[junit4] 2> 368140 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 368141 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 368142 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 368143 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 368146 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/dump,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 368146 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 368147 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 368147 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 368148 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 368148 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 368149 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=3, maxMergeAtOnceExplicit=4, maxMergedSegmentMB=17.46875, floorSegmentMB=0.4609375, forceMergeDeletesPctAllowed=25.01121132785535, segmentsPerTier=32.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 368149 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@51d62c4d lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4800abe1),segFN=segments_1,generation=1}
[junit4] 2> 368149 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 368149 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@27f3b2cd[collection1] main
[junit4] 2> 368149 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 368150 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 368150 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 368150 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 368151 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
[junit4] 2> 368151 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 368151 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 368151 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 368151 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 368151 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 368152 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
[junit4] 2> 368152 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
[junit4] 2> 368152 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
[junit4] 2> 368152 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1520617530018758656
[junit4] 2> 368154 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 1.0ms to seed version buckets with highest version 1520617530018758656
[junit4] 2> 368154 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
[junit4] 2> 368154 INFO (coreLoadExecutor-1147-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 368154 INFO (searcherExecutor-1148-thread-1-processing-n:127.0.0.1:44248_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@27f3b2cd[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 368155 INFO (coreZkRegister-1141-thread-1-processing-n:127.0.0.1:44248_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:44248 collection:control_collection shard:shard1
[junit4] 2> 368156 INFO (coreZkRegister-1141-thread-1-processing-n:127.0.0.1:44248_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 368159 INFO (coreZkRegister-1141-thread-1-processing-n:127.0.0.1:44248_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/95038595507486724-core_node1-n_0000000000
[junit4] 2> 368159 INFO (coreZkRegister-1141-thread-1-processing-n:127.0.0.1:44248_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard=shard1 and weAreReplacement=false and leaderVoteWait=10000
[junit4] 2> 368161 INFO (coreZkRegister-1141-thread-1-processing-n:127.0.0.1:44248_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 368161 INFO (coreZkRegister-1141-thread-1-processing-n:127.0.0.1:44248_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 368161 INFO (OverseerStateUpdate-95038595507486724-127.0.0.1:44248_-n_0000000000) [n:127.0.0.1:44248_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection"} current state version: 1
[junit4] 2> 368161 INFO (coreZkRegister-1141-thread-1-processing-n:127.0.0.1:44248_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:44248/collection1/
[junit4] 2> 368161 INFO (coreZkRegister-1141-thread-1-processing-n:127.0.0.1:44248_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 368161 INFO (coreZkRegister-1141-thread-1-processing-n:127.0.0.1:44248_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:44248/collection1/ has no replicas
[junit4] 2> 368162 INFO (coreZkRegister-1141-thread-1-processing-n:127.0.0.1:44248_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 368164 INFO (coreZkRegister-1141-thread-1-processing-n:127.0.0.1:44248_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
[junit4] 2> 368166 INFO (coreZkRegister-1141-thread-1-processing-n:127.0.0.1:44248_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:44248/collection1/ shard1
[junit4] 2> 368167 INFO (OverseerStateUpdate-95038595507486724-127.0.0.1:44248_-n_0000000000) [n:127.0.0.1:44248_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:44248",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 1
[junit4] 2> 368269 INFO (zkCallback-541-thread-2-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 368269 INFO (zkCallback-541-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 368317 INFO (coreZkRegister-1141-thread-1-processing-n:127.0.0.1:44248_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:44248/collection1/ and leader is http://127.0.0.1:44248/collection1/
[junit4] 2> 368317 INFO (coreZkRegister-1141-thread-1-processing-n:127.0.0.1:44248_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:44248
[junit4] 2> 368317 INFO (coreZkRegister-1141-thread-1-processing-n:127.0.0.1:44248_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 368317 INFO (coreZkRegister-1141-thread-1-processing-n:127.0.0.1:44248_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
[junit4] 2> 368317 INFO (coreZkRegister-1141-thread-1-processing-n:127.0.0.1:44248_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:44248_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 368319 INFO (OverseerStateUpdate-95038595507486724-127.0.0.1:44248_-n_0000000000) [n:127.0.0.1:44248_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:44248",
[junit4] 2> "node_name":"127.0.0.1:44248_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 2
[junit4] 2> 368319 INFO (OverseerStateUpdate-95038595507486724-127.0.0.1:44248_-n_0000000000) [n:127.0.0.1:44248_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:44248",
[junit4] 2> "node_name":"127.0.0.1:44248_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 368425 INFO (zkCallback-541-thread-2-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 368425 INFO (zkCallback-541-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 368486 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 368487 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 368488 INFO (zkCallback-543-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4c80c0b4 name:ZooKeeperConnection Watcher:127.0.0.1:58829/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 368488 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 368488 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 368488 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 368490 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 368885 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_712A9BC123B2B08E-001/shard-1-001/cores/collection1
[junit4] 2> 368886 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_712A9BC123B2B08E-001/shard-1-001
[junit4] 2> 368887 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.e.j.s.Server jetty-9.3.6.v20151106
[junit4] 2> 368888 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4d0df294{/,null,AVAILABLE}
[junit4] 2> 368889 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.e.j.s.ServerConnector Started ServerConnector@23d0f763{HTTP/1.1,[http/1.1]}{127.0.0.1:33870}
[junit4] 2> 368889 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.e.j.s.Server Started @372293ms
[junit4] 2> 368889 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_712A9BC123B2B08E-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/, hostPort=33870, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_712A9BC123B2B08E-001/shard-1-001/cores}
[junit4] 2> 368890 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 368890 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_712A9BC123B2B08E-001/shard-1-001'
[junit4] 2> 368890 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 368890 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 368890 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 368891 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 368895 INFO (zkCallback-544-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1957a545 name:ZooKeeperConnection Watcher:127.0.0.1:58829/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 368895 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 368896 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 368897 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 368897 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_712A9BC123B2B08E-001/shard-1-001/solr.xml
[junit4] 2> 368902 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_712A9BC123B2B08E-001/shard-1-001/cores
[junit4] 2> 368902 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.CoreContainer New CoreContainer 637120388
[junit4] 2> 368902 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_712A9BC123B2B08E-001/shard-1-001]
[junit4] 2> 368902 WARN (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_712A9BC123B2B08E-001/shard-1-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_712A9BC123B2B08E-001/shard-1-001/lib
[junit4] 2> 368902 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 368903 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 368904 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 368904 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 368904 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:58829/solr
[junit4] 2> 368904 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 368904 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 368905 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 368906 INFO (zkCallback-546-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6ae98d2b name:ZooKeeperConnection Watcher:127.0.0.1:58829 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 368907 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 368907 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 368908 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [n:127.0.0.1:33870_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 368909 INFO (zkCallback-547-thread-1-processing-n:127.0.0.1:33870_) [n:127.0.0.1:33870_ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3943d618 name:ZooKeeperConnection Watcher:127.0.0.1:58829/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 368909 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [n:127.0.0.1:33870_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 368914 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [n:127.0.0.1:33870_ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 369919 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [n:127.0.0.1:33870_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33870_
[junit4] 2> 369921 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [n:127.0.0.1:33870_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:33870_
[junit4] 2> 369922 INFO (zkCallback-541-thread-2-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 369922 INFO (zkCallback-543-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 369922 INFO (zkCallback-541-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 369922 INFO (zkCallback-547-thread-1-processing-n:127.0.0.1:33870_) [n:127.0.0.1:33870_ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 369923 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [n:127.0.0.1:33870_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 369924 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [n:127.0.0.1:33870_ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95038595507486728-127.0.0.1:33870_-n_0000000001
[junit4] 2> 369928 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [n:127.0.0.1:33870_ ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/95038595507486724-127.0.0.1:44248_-n_0000000000 to know if I could be the leader
[junit4] 2> 369944 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [n:127.0.0.1:33870_ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 369944 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [n:127.0.0.1:33870_ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 369945 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [n:127.0.0.1:33870_ ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_712A9BC123B2B08E-001/shard-1-001/cores
[junit4] 2> 369946 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [n:127.0.0.1:33870_ ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=collection1, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 369946 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [n:127.0.0.1:33870_ ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_712A9BC123B2B08E-001/shard-1-001/cores/collection1
[junit4] 2> 369946 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [n:127.0.0.1:33870_ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
[junit4] 2> 369947 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [n:127.0.0.1:33870_ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2
[junit4] 2> 369947 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[712A9BC123B2B08E]) [n:127.0.0.1:33870_ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 369947 INFO (coreLoadExecutor-1158-thread-1-processing-n:127.0.0.1:33870_) [n:127.0.0.1:33870_ c:collection1 x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 369947 INFO (coreLoadExecutor-1158-thread-1-processing-n:127.0.0.1:33870_) [n:127.0.0.1:33870_ c:collection1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 369949 INFO (coreLoadExecutor-1158-thread-1-processing-n:127.0.0.1:33870_) [n:127.0.0.1:33870_ c:collection1 x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 369949 INFO (OverseerStateUpdate-95038595507486724-127.0.0.1:44248_-n_0000000000) [n:127.0.0.1:44248_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:33870",
[junit4] 2> "node_name":"127.0.0.1:33870_",
[junit4] 2> "numShards":"3",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"} current state version: 3
[junit4] 2> 369949 INFO (OverseerStateUpdate-95038595507486724-127.0.0.1:44248_-n_0000000000) [n:127.0.0.1:44248_ ] o.a.s.c.o.ReplicaMutator Update state numShards=3 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:33870",
[junit4] 2> "node_name":"127.0.0.1:33870_",
[junit4] 2> "numShards":"3",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"}
[junit4] 2> 369949 INFO (OverseerStateUpdate-95038595507486724-127.0.0.1:44248_-n_0000000000) [n:127.0.0.1:44248_ ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
[junit4] 2> 369949 INFO (OverseerStateUpdate-95038595507486724-127.0.0.1:44248_-n_0000000000) [n:127.0.0.1:44248_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2
[junit4] 2> 369950 INFO (zkCallback-543-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 369950 INFO (zkCallback-541-thread-2-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 369950 INFO (zkCallback-547-thread-1-processing-n:127.0.0.1:33870_) [n:127.0.0.1:33870_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 369951 INFO (zkCallback-541-thread-1-processing-n:127.0.0.1:44248_) [n:127.0.0.1:44248_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 370949 INFO (coreLoadExecutor-1158-thread-1-processing-n:127.0.0.1:33870_) [n:127.0.0.1:33870_ c:collection1 x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 370949 INFO (coreLoadExecutor-1158-thread-1-processing-n:127.0.0.1:33870_) [n:127.0.0.1:33870_ c:collection1 x:collection1] o.a.s.c.ZkController Check for collection zkNode:collection1
[junit4] 2> 370950 INFO (coreLoadExecutor-1158-thread-1-processing-n:127.0.0.1:33870_) [n:127.0.0.1:33870_ c:collection1 x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 370950 INFO (coreLoadExecutor-1158-thread-1-processing-n:127.0.0.1:33870_) [n:127.0.0.1:33870_ c:collection1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/collection1
[junit4] 2> 370950 INFO (coreLoadExecutor-1158-thread-1-processing-n:127.0.0.1:33870_) [n:127.0.0.1:33870_ c:collection1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 370950 INFO (coreLoadExecutor-1158-thread-1-processing-n:127.0.0.1:33870_) [n:127.0.0.1:33870_ c:collection1 x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_712A9BC123B2B08E-001/shard-1-001/cores/collection1'
[junit4] 2> 370950 INFO (coreLoadExecutor-1158-thread-1-processing-n:127.0.0.1:33870_) [n:127.0.0.1:33870_ c:collection1 x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 370951 INFO (coreLoadExecutor-1158-thread-1-processing-n:127.0.0.1:33870_) [n:127.0.0.1:33870_ c:collection1 x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 370952 INFO (coreLoadExecutor-1158-thread-1-processing-n:127.0.0.1:33870_) [n:127.0.0.1:33870_ c:collection1 x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 370957 INFO (coreLoadExecutor-1158-thread-1-processing-n:127.0.0.1:33870_) [n:127.0.0.1:33870_ c:collection1 x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 370960 INFO (coreLoadExecutor-1158-thread-1-processing-n:127.0.0.1:33870_) [n:127.0.0.1:33870_ c:collection1 x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 370968 INFO (coreLoadExecutor-1158-thread-1-processing-n:127.0.0.1:33870_) [n:127.0.0.1:33870_ c:collection1 x:collection1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
[junit4] 2> 370973 INFO (coreLoadExecutor-1158-thread-1-processing-n:127.0.0.1:33870_) [n
[...truncated too long message...]
kins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-changelog-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-collective-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-event-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-exception-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-journal-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-normalization-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-operational-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-referral-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-schema-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-subtree-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-trigger-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-jdbm-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-jdbm1-2.0.0-M2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-kerberos-codec-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-ldif-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-mavibot-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-protocol-kerberos-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-protocol-ldap-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-protocol-shared-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-xdbm-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/api-all-1.0.0-M20.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/bcprov-jdk15-1.45.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/cglib-nodep-2.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/commons-collections-3.2.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/commons-math3-3.4.1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/easymock-3.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/ehcache-core-2.4.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/hadoop-common-2.6.0-tests.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/hadoop-hdfs-2.6.0-tests.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/hadoop-minikdc-2.6.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/jackson-annotations-2.5.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/jackson-databind-2.5.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/jersey-core-1.9.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/jersey-server-1.9.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/jetty-6.1.26.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/jetty-util-6.1.26.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/mina-core-2.0.0-M5.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/objenesis-1.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/presto-parser-0.122.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/slice-0.10.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/analysis/icu/lucene-analyzers-icu-6.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-analysis-extras/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/contrib/analysis-extras/lib/icu4j-54.1.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-launcher.jar:/x1/jenkins/.ant/lib/ivy-2.3.0.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-antlr.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-regexp.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-resolver.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-commons-net.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jmf.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-oro.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-xalan2.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-commons-logging.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jsch.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-junit4.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-javamail.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jai.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jdepend.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-junit.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-bsf.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-swing.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-netrexx.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-bcel.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-testutil.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-log4j.jar:/x1/jenkins/jenkins-slave/tools/hudson.model.JDK/latest1.8/lib/tools.jar:/x1/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.3.2.jar com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe -eventsfile /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/temp/junit4-J1-20151215_095831_840.events @/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/temp/junit4-J1-20151215_095831_840.suites -stdin
[junit4] ERROR: JVM J1 ended with an exception: Quit event not received from the forked process? This may indicate JVM crash or runner bugs.
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4.executeSlave(JUnit4.java:1501)
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4.access$000(JUnit4.java:121)
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:955)
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:952)
[junit4] at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] at java.lang.Thread.run(Thread.java:745)
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:791: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:728: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1436: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:991: At least one slave process threw an exception, first: Quit event not received from the forked process? This may indicate JVM crash or runner bugs.
Total time: 419 minutes 33 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 881 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/881/
2 tests failed.
FAILED: org.apache.solr.cloud.TestAuthenticationFramework.testStopAllStartAll
Error Message:
Address already in use
Stack Trace:
java.net.BindException: Address already in use
at __randomizedtesting.SeedInfo.seed([5B47E26B2883A50F:2D79FD1869B40820]:0)
at sun.nio.ch.Net.bind0(Native Method)
at sun.nio.ch.Net.bind(Net.java:433)
at sun.nio.ch.Net.bind(Net.java:425)
at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)
at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
at org.eclipse.jetty.server.ServerConnector.open(ServerConnector.java:326)
at org.eclipse.jetty.server.AbstractNetworkConnector.doStart(AbstractNetworkConnector.java:80)
at org.eclipse.jetty.server.ServerConnector.doStart(ServerConnector.java:244)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
at org.eclipse.jetty.server.Server.doStart(Server.java:384)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:409)
at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:357)
at org.apache.solr.cloud.TestMiniSolrCloudCluster.testStopAllStartAll(TestMiniSolrCloudCluster.java:421)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test
Error Message:
Captured an uncaught exception in thread: Thread[id=14641, name=collection3, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=14641, name=collection3, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:52008: Could not find collection : awholynewstresscollection_collection3_7
at __randomizedtesting.SeedInfo.seed([5B47E26B2883A50F]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:871)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:807)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:888)
Build Log:
[...truncated 10305 lines...]
[junit4] Suite: org.apache.solr.cloud.TestAuthenticationFramework
[junit4] 2> 928930 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 928931 INFO (Thread-3084) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 928931 INFO (Thread-3084) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 929031 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.ZkTestServer start zk server on port:42106
[junit4] 2> 929031 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 929032 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 929038 INFO (zkCallback-733-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4a6ce808 name:ZooKeeperConnection Watcher:127.0.0.1:42106 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 929038 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 929039 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 929039 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr/solr.xml
[junit4] 2> 929114 INFO (jetty-launcher-732-thread-2) [ ] o.e.j.s.Server jetty-9.3.6.v20151106
[junit4] 2> 929136 INFO (jetty-launcher-732-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@66840f92{/solr,null,AVAILABLE}
[junit4] 2> 929148 INFO (jetty-launcher-732-thread-2) [ ] o.e.j.s.ServerConnector Started ServerConnector@1b105b28{HTTP/1.1,[http/1.1]}{127.0.0.1:42477}
[junit4] 2> 929148 INFO (jetty-launcher-732-thread-2) [ ] o.e.j.s.Server Started @932262ms
[junit4] 2> 929148 INFO (jetty-launcher-732-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=42477}
[junit4] 2> 929148 INFO (jetty-launcher-732-thread-2) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 929148 INFO (jetty-launcher-732-thread-2) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.TestAuthenticationFramework_5B47E26B2883A50F-001/tempDir-001/node4'
[junit4] 2> 929149 INFO (jetty-launcher-732-thread-2) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 929149 INFO (jetty-launcher-732-thread-2) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 929149 INFO (jetty-launcher-732-thread-2) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 929155 INFO (jetty-launcher-732-thread-4) [ ] o.e.j.s.Server jetty-9.3.6.v20151106
[junit4] 2> 929167 INFO (jetty-launcher-732-thread-4) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@46289fb9{/solr,null,AVAILABLE}
[junit4] 2> 929167 INFO (jetty-launcher-732-thread-4) [ ] o.e.j.s.ServerConnector Started ServerConnector@55628fda{HTTP/1.1,[http/1.1]}{127.0.0.1:50143}
[junit4] 2> 929167 INFO (jetty-launcher-732-thread-4) [ ] o.e.j.s.Server Started @932281ms
[junit4] 2> 929167 INFO (jetty-launcher-732-thread-4) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=50143}
[junit4] 2> 929167 INFO (jetty-launcher-732-thread-4) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 929167 INFO (jetty-launcher-732-thread-4) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.TestAuthenticationFramework_5B47E26B2883A50F-001/tempDir-001/node3'
[junit4] 2> 929168 INFO (jetty-launcher-732-thread-4) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 929168 INFO (jetty-launcher-732-thread-4) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 929168 INFO (jetty-launcher-732-thread-4) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 929170 INFO (jetty-launcher-732-thread-4) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 929171 INFO (jetty-launcher-732-thread-2) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 929171 INFO (jetty-launcher-732-thread-5) [ ] o.e.j.s.Server jetty-9.3.6.v20151106
[junit4] 2> 929244 INFO (zkCallback-735-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@12a41cfb name:ZooKeeperConnection Watcher:127.0.0.1:42106/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 929244 INFO (jetty-launcher-732-thread-4) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 929244 INFO (jetty-launcher-732-thread-4) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 929245 INFO (jetty-launcher-732-thread-4) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 929246 INFO (jetty-launcher-732-thread-1) [ ] o.e.j.s.Server jetty-9.3.6.v20151106
[junit4] 2> 929259 INFO (jetty-launcher-732-thread-3) [ ] o.e.j.s.Server jetty-9.3.6.v20151106
[junit4] 2> 929271 INFO (jetty-launcher-732-thread-3) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5b28f437{/solr,null,AVAILABLE}
[junit4] 2> 929272 INFO (jetty-launcher-732-thread-3) [ ] o.e.j.s.ServerConnector Started ServerConnector@41bc7346{HTTP/1.1,[http/1.1]}{127.0.0.1:40446}
[junit4] 2> 929272 INFO (jetty-launcher-732-thread-3) [ ] o.e.j.s.Server Started @932385ms
[junit4] 2> 929272 INFO (jetty-launcher-732-thread-3) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=40446}
[junit4] 2> 929272 INFO (jetty-launcher-732-thread-3) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 929272 INFO (jetty-launcher-732-thread-3) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.TestAuthenticationFramework_5B47E26B2883A50F-001/tempDir-001/node2'
[junit4] 2> 929272 INFO (jetty-launcher-732-thread-3) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 929272 INFO (jetty-launcher-732-thread-3) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 929273 INFO (jetty-launcher-732-thread-3) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 929274 INFO (jetty-launcher-732-thread-3) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 929281 INFO (jetty-launcher-732-thread-4) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.TestAuthenticationFramework_5B47E26B2883A50F-001/tempDir-001/node3/.
[junit4] 2> 929281 INFO (zkCallback-736-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@68c3317d name:ZooKeeperConnection Watcher:127.0.0.1:42106/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 929282 INFO (jetty-launcher-732-thread-3) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 929282 INFO (jetty-launcher-732-thread-3) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 929281 INFO (jetty-launcher-732-thread-4) [ ] o.a.s.c.CoreContainer New CoreContainer 2046369490
[junit4] 2> 929283 INFO (jetty-launcher-732-thread-4) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.TestAuthenticationFramework_5B47E26B2883A50F-001/tempDir-001/node3]
[junit4] 2> 929283 WARN (jetty-launcher-732-thread-4) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.TestAuthenticationFramework_5B47E26B2883A50F-001/tempDir-001/node3/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.TestAuthenticationFramework_5B47E26B2883A50F-001/tempDir-001/node3/lib
[junit4] 2> 929288 INFO (jetty-launcher-732-thread-5) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4799620{/solr,null,AVAILABLE}
[junit4] 2> 929296 INFO (jetty-launcher-732-thread-4) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 929296 INFO (jetty-launcher-732-thread-5) [ ] o.e.j.s.ServerConnector Started ServerConnector@708fdfc1{HTTP/1.1,[http/1.1]}{127.0.0.1:46567}
[junit4] 2> 929296 INFO (jetty-launcher-732-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@78e9b534{/solr,null,AVAILABLE}
[junit4] 2> 929296 INFO (jetty-launcher-732-thread-5) [ ] o.e.j.s.Server Started @932410ms
[junit4] 2> 929296 INFO (jetty-launcher-732-thread-5) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=46567}
[junit4] 2> 929296 INFO (jetty-launcher-732-thread-1) [ ] o.e.j.s.ServerConnector Started ServerConnector@4d8c3de9{HTTP/1.1,[http/1.1]}{127.0.0.1:49414}
[junit4] 2> 929296 INFO (jetty-launcher-732-thread-5) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 929297 INFO (jetty-launcher-732-thread-1) [ ] o.e.j.s.Server Started @932410ms
[junit4] 2> 929297 INFO (jetty-launcher-732-thread-5) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.TestAuthenticationFramework_5B47E26B2883A50F-001/tempDir-001/node5'
[junit4] 2> 929297 INFO (jetty-launcher-732-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=49414}
[junit4] 2> 929284 INFO (zkCallback-734-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7edfc26 name:ZooKeeperConnection Watcher:127.0.0.1:42106/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 929297 INFO (jetty-launcher-732-thread-5) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 929297 INFO (jetty-launcher-732-thread-1) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 929297 INFO (jetty-launcher-732-thread-5) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 929297 INFO (jetty-launcher-732-thread-1) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.TestAuthenticationFramework_5B47E26B2883A50F-001/tempDir-001/node1'
[junit4] 2> 929297 INFO (jetty-launcher-732-thread-1) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 929297 INFO (jetty-launcher-732-thread-1) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 929297 INFO (jetty-launcher-732-thread-5) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 929297 INFO (jetty-launcher-732-thread-1) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 929298 INFO (jetty-launcher-732-thread-2) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 929298 INFO (jetty-launcher-732-thread-2) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 929283 INFO (jetty-launcher-732-thread-3) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 929305 INFO (jetty-launcher-732-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 929315 INFO (jetty-launcher-732-thread-4) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 929316 INFO (jetty-launcher-732-thread-4) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 929316 INFO (jetty-launcher-732-thread-4) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 929316 INFO (jetty-launcher-732-thread-4) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42106/solr
[junit4] 2> 929316 INFO (jetty-launcher-732-thread-4) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 929316 INFO (jetty-launcher-732-thread-4) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 929317 INFO (jetty-launcher-732-thread-5) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 929335 INFO (jetty-launcher-732-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 929336 INFO (jetty-launcher-732-thread-4) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 929336 INFO (jetty-launcher-732-thread-2) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.TestAuthenticationFramework_5B47E26B2883A50F-001/tempDir-001/node4/.
[junit4] 2> 929336 INFO (jetty-launcher-732-thread-2) [ ] o.a.s.c.CoreContainer New CoreContainer 1265713474
[junit4] 2> 929336 INFO (jetty-launcher-732-thread-2) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.TestAuthenticationFramework_5B47E26B2883A50F-001/tempDir-001/node4]
[junit4] 2> 929337 WARN (jetty-launcher-732-thread-2) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.TestAuthenticationFramework_5B47E26B2883A50F-001/tempDir-001/node4/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.TestAuthenticationFramework_5B47E26B2883A50F-001/tempDir-001/node4/lib
[junit4] 2> 929337 INFO (jetty-launcher-732-thread-2) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 929338 INFO (jetty-launcher-732-thread-3) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.TestAuthenticationFramework_5B47E26B2883A50F-001/tempDir-001/node2/.
[junit4] 2> 929338 INFO (jetty-launcher-732-thread-3) [ ] o.a.s.c.CoreContainer New CoreContainer 2049237379
[junit4] 2> 929338 INFO (jetty-launcher-732-thread-3) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.TestAuthenticationFramework_5B47E26B2883A50F-001/tempDir-001/node2]
[junit4] 2> 929338 WARN (jetty-launcher-732-thread-3) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.TestAuthenticationFramework_5B47E26B2883A50F-001/tempDir-001/node2/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.TestAuthenticationFramework_5B47E26B2883A50F-001/tempDir-001/node2/lib
[junit4] 2> 929341 INFO (jetty-launcher-732-thread-3) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 929342 INFO (jetty-launcher-732-thread-3) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 929342 INFO (jetty-launcher-732-thread-3) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 929342 INFO (jetty-launcher-732-thread-3) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 929342 INFO (jetty-launcher-732-thread-3) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42106/solr
[junit4] 2> 929342 INFO (jetty-launcher-732-thread-3) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 929342 INFO (jetty-launcher-732-thread-3) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 929343 INFO (jetty-launcher-732-thread-3) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 929360 INFO (jetty-launcher-732-thread-2) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 929376 INFO (zkCallback-737-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@16539eb3 name:ZooKeeperConnection Watcher:127.0.0.1:42106/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 929376 INFO (jetty-launcher-732-thread-2) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 929376 INFO (jetty-launcher-732-thread-2) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 929377 INFO (jetty-launcher-732-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42106/solr
[junit4] 2> 929377 INFO (jetty-launcher-732-thread-2) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 929377 INFO (jetty-launcher-732-thread-2) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 929377 INFO (jetty-launcher-732-thread-5) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 929378 INFO (jetty-launcher-732-thread-5) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 929377 INFO (jetty-launcher-732-thread-2) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 929368 INFO (zkCallback-738-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@47ccf470 name:ZooKeeperConnection Watcher:127.0.0.1:42106/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 929379 INFO (jetty-launcher-732-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 929379 INFO (jetty-launcher-732-thread-1) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 929380 INFO (jetty-launcher-732-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 929380 INFO (jetty-launcher-732-thread-5) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 929380 INFO (zkCallback-742-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@529f4cee name:ZooKeeperConnection Watcher:127.0.0.1:42106 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 929380 INFO (jetty-launcher-732-thread-3) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 929367 INFO (zkCallback-740-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@45f0bbef name:ZooKeeperConnection Watcher:127.0.0.1:42106 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 929380 INFO (jetty-launcher-732-thread-4) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 929380 INFO (jetty-launcher-732-thread-3) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 929380 INFO (jetty-launcher-732-thread-4) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 929390 INFO (jetty-launcher-732-thread-5) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.TestAuthenticationFramework_5B47E26B2883A50F-001/tempDir-001/node5/.
[junit4] 2> 929390 INFO (jetty-launcher-732-thread-5) [ ] o.a.s.c.CoreContainer New CoreContainer 1656758157
[junit4] 2> 929390 INFO (jetty-launcher-732-thread-5) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.TestAuthenticationFramework_5B47E26B2883A50F-001/tempDir-001/node5]
[junit4] 2> 929390 WARN (jetty-launcher-732-thread-5) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.TestAuthenticationFramework_5B47E26B2883A50F-001/tempDir-001/node5/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.TestAuthenticationFramework_5B47E26B2883A50F-001/tempDir-001/node5/lib
[junit4] 2> 929390 INFO (jetty-launcher-732-thread-5) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 929391 INFO (zkCallback-744-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@54e7f548 name:ZooKeeperConnection Watcher:127.0.0.1:42106 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 929391 INFO (jetty-launcher-732-thread-2) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 929392 INFO (jetty-launcher-732-thread-2) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 929392 INFO (jetty-launcher-732-thread-5) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 929393 INFO (jetty-launcher-732-thread-5) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 929393 INFO (jetty-launcher-732-thread-5) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 929393 INFO (jetty-launcher-732-thread-5) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42106/solr
[junit4] 2> 929393 INFO (jetty-launcher-732-thread-5) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 929393 INFO (jetty-launcher-732-thread-5) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 929395 INFO (jetty-launcher-732-thread-1) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.TestAuthenticationFramework_5B47E26B2883A50F-001/tempDir-001/node1/.
[junit4] 2> 929395 INFO (jetty-launcher-732-thread-3) [n:127.0.0.1:40446_solr ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 929417 INFO (jetty-launcher-732-thread-4) [n:127.0.0.1:50143_solr ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 929420 INFO (jetty-launcher-732-thread-1) [ ] o.a.s.c.CoreContainer New CoreContainer 956607161
[junit4] 2> 929420 INFO (jetty-launcher-732-thread-1) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.TestAuthenticationFramework_5B47E26B2883A50F-001/tempDir-001/node1]
[junit4] 2> 929420 WARN (jetty-launcher-732-thread-1) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.TestAuthenticationFramework_5B47E26B2883A50F-001/tempDir-001/node1/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.TestAuthenticationFramework_5B47E26B2883A50F-001/tempDir-001/node1/lib
[junit4] 2> 929422 INFO (jetty-launcher-732-thread-1) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 929423 INFO (zkCallback-745-thread-1-processing-n:127.0.0.1:40446_solr) [n:127.0.0.1:40446_solr ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6927f784 name:ZooKeeperConnection Watcher:127.0.0.1:42106/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 929423 INFO (jetty-launcher-732-thread-3) [n:127.0.0.1:40446_solr ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 929424 INFO (jetty-launcher-732-thread-5) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 929425 INFO (jetty-launcher-732-thread-1) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 929426 INFO (jetty-launcher-732-thread-1) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 929426 INFO (jetty-launcher-732-thread-1) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 929426 INFO (jetty-launcher-732-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42106/solr
[junit4] 2> 929426 INFO (jetty-launcher-732-thread-1) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 929426 INFO (jetty-launcher-732-thread-1) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 929428 INFO (jetty-launcher-732-thread-3) [n:127.0.0.1:40446_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
[junit4] 2> 929441 INFO (jetty-launcher-732-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 929432 INFO (jetty-launcher-732-thread-2) [n:127.0.0.1:42477_solr ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 929443 INFO (zkCallback-748-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1b029a1a name:ZooKeeperConnection Watcher:127.0.0.1:42106 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 929443 INFO (jetty-launcher-732-thread-5) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 929444 INFO (jetty-launcher-732-thread-5) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 929446 INFO (zkCallback-746-thread-1-processing-n:127.0.0.1:50143_solr) [n:127.0.0.1:50143_solr ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@42cff451 name:ZooKeeperConnection Watcher:127.0.0.1:42106/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 929446 INFO (zkCallback-749-thread-1-processing-n:127.0.0.1:42477_solr) [n:127.0.0.1:42477_solr ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3267ed9e name:ZooKeeperConnection Watcher:127.0.0.1:42106/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 929446 INFO (jetty-launcher-732-thread-4) [n:127.0.0.1:50143_solr ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 929447 INFO (jetty-launcher-732-thread-2) [n:127.0.0.1:42477_solr ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 929447 INFO (jetty-launcher-732-thread-3) [n:127.0.0.1:40446_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 929456 INFO (jetty-launcher-732-thread-2) [n:127.0.0.1:42477_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 929456 INFO (jetty-launcher-732-thread-3) [n:127.0.0.1:40446_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 929456 INFO (jetty-launcher-732-thread-4) [n:127.0.0.1:50143_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 929462 INFO (zkCallback-751-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@70883e4 name:ZooKeeperConnection Watcher:127.0.0.1:42106 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 929462 INFO (jetty-launcher-732-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 929462 INFO (jetty-launcher-732-thread-1) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 929462 INFO (jetty-launcher-732-thread-2) [n:127.0.0.1:42477_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 929464 INFO (jetty-launcher-732-thread-5) [n:127.0.0.1:46567_solr ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 929466 INFO (jetty-launcher-732-thread-3) [n:127.0.0.1:40446_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 929531 INFO (zkCallback-752-thread-1-processing-n:127.0.0.1:46567_solr) [n:127.0.0.1:46567_solr ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@e19310d name:ZooKeeperConnection Watcher:127.0.0.1:42106/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 929531 INFO (jetty-launcher-732-thread-5) [n:127.0.0.1:46567_solr ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 929537 INFO (jetty-launcher-732-thread-4) [n:127.0.0.1:50143_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 929538 INFO (jetty-launcher-732-thread-1) [n:127.0.0.1:49414_solr ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 929539 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x1519c287ff2000d, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 929548 INFO (jetty-launcher-732-thread-3) [n:127.0.0.1:40446_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 929548 INFO (zkCallback-753-thread-1-processing-n:127.0.0.1:49414_solr) [n:127.0.0.1:49414_solr ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2e97234d name:ZooKeeperConnection Watcher:127.0.0.1:42106/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 929550 INFO (jetty-launcher-732-thread-2) [n:127.0.0.1:42477_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 929550 INFO (jetty-launcher-732-thread-1) [n:127.0.0.1:49414_solr ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 929553 INFO (jetty-launcher-732-thread-4) [n:127.0.0.1:50143_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 929557 INFO (jetty-launcher-732-thread-3) [n:127.0.0.1:40446_solr ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 929561 INFO (jetty-launcher-732-thread-3) [n:127.0.0.1:40446_solr ] o.a.s.c.c.SolrZkClient makePath: /collections
[junit4] 2> 929561 INFO (jetty-launcher-732-thread-2) [n:127.0.0.1:42477_solr ] o.a.s.c.c.SolrZkClient makePath: /collections
[junit4] 2> 929562 INFO (jetty-launcher-732-thread-4) [n:127.0.0.1:50143_solr ] o.a.s.c.c.SolrZkClient makePath: /collections
[junit4] 2> 929566 INFO (jetty-launcher-732-thread-3) [n:127.0.0.1:40446_solr ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 929566 INFO (jetty-launcher-732-thread-4) [n:127.0.0.1:50143_solr ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 929567 INFO (jetty-launcher-732-thread-2) [n:127.0.0.1:42477_solr ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 929567 INFO (jetty-launcher-732-thread-5) [n:127.0.0.1:46567_solr ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 929575 INFO (jetty-launcher-732-thread-3) [n:127.0.0.1:40446_solr ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 929577 INFO (jetty-launcher-732-thread-4) [n:127.0.0.1:50143_solr ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 929583 INFO (jetty-launcher-732-thread-3) [n:127.0.0.1:40446_solr ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 929583 INFO (jetty-launcher-732-thread-2) [n:127.0.0.1:42477_solr ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 929584 INFO (jetty-launcher-732-thread-4) [n:127.0.0.1:50143_solr ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 929590 INFO (jetty-launcher-732-thread-5) [n:127.0.0.1:46567_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46567_solr
[junit4] 2> 929590 INFO (jetty-launcher-732-thread-3) [n:127.0.0.1:40446_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40446_solr
[junit4] 2> 929590 INFO (jetty-launcher-732-thread-2) [n:127.0.0.1:42477_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42477_solr
[junit4] 2> 929591 INFO (jetty-launcher-732-thread-5) [n:127.0.0.1:46567_solr ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:46567_solr
[junit4] 2> 929592 INFO (jetty-launcher-732-thread-2) [n:127.0.0.1:42477_solr ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:42477_solr
[junit4] 2> 929592 INFO (jetty-launcher-732-thread-3) [n:127.0.0.1:40446_solr ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:40446_solr
[junit4] 2> 929593 INFO (jetty-launcher-732-thread-4) [n:127.0.0.1:50143_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50143_solr
[junit4] 2> 929596 INFO (jetty-launcher-732-thread-4) [n:127.0.0.1:50143_solr ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:50143_solr
[junit4] 2> 929598 INFO (jetty-launcher-732-thread-1) [n:127.0.0.1:49414_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49414_solr
[junit4] 2> 929601 INFO (jetty-launcher-732-thread-1) [n:127.0.0.1:49414_solr ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:49414_solr
[junit4] 2> 929603 INFO (jetty-launcher-732-thread-5) [n:127.0.0.1:46567_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 929604 INFO (jetty-launcher-732-thread-3) [n:127.0.0.1:40446_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 929606 INFO (jetty-launcher-732-thread-2) [n:127.0.0.1:42477_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 929615 INFO (jetty-launcher-732-thread-3) [n:127.0.0.1:40446_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 929619 INFO (jetty-launcher-732-thread-5) [n:127.0.0.1:46567_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 929619 INFO (jetty-launcher-732-thread-2) [n:127.0.0.1:42477_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 929620 INFO (jetty-launcher-732-thread-4) [n:127.0.0.1:50143_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 929620 INFO (jetty-launcher-732-thread-1) [n:127.0.0.1:49414_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 929621 INFO (jetty-launcher-732-thread-5) [n:127.0.0.1:46567_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 929622 INFO (jetty-launcher-732-thread-3) [n:127.0.0.1:40446_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 929623 INFO (jetty-launcher-732-thread-5) [n:127.0.0.1:46567_solr ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95028764910682126-127.0.0.1:46567_solr-n_0000000000
[junit4] 2> 929626 INFO (jetty-launcher-732-thread-3) [n:127.0.0.1:40446_solr ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95028764910682121-127.0.0.1:40446_solr-n_0000000001
[junit4] 2> 929627 INFO (jetty-launcher-732-thread-2) [n:127.0.0.1:42477_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 929628 INFO (jetty-launcher-732-thread-5) [n:127.0.0.1:46567_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:46567_solr
[junit4] 2> 929628 INFO (jetty-launcher-732-thread-5) [n:127.0.0.1:46567_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
[junit4] 2> 929628 INFO (jetty-launcher-732-thread-1) [n:127.0.0.1:49414_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 929629 INFO (jetty-launcher-732-thread-4) [n:127.0.0.1:50143_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 929629 INFO (jetty-launcher-732-thread-3) [n:127.0.0.1:40446_solr ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/95028764910682126-127.0.0.1:46567_solr-n_0000000000 to know if I could be the leader
[junit4] 2> 929629 INFO (jetty-launcher-732-thread-3) [n:127.0.0.1:40446_solr ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 929634 INFO (jetty-launcher-732-thread-1) [n:127.0.0.1:49414_solr ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95028764910682127-127.0.0.1:49414_solr-n_0000000002
[junit4] 2> 929634 INFO (jetty-launcher-732-thread-2) [n:127.0.0.1:42477_solr ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95028764910682124-127.0.0.1:42477_solr-n_0000000003
[junit4] 2> 929639 INFO (jetty-launcher-732-thread-4) [n:127.0.0.1:50143_solr ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95028764910682122-127.0.0.1:50143_solr-n_0000000004
[junit4] 2> 929644 INFO (jetty-launcher-732-thread-1) [n:127.0.0.1:49414_solr ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/95028764910682121-127.0.0.1:40446_solr-n_0000000001 to know if I could be the leader
[junit4] 2> 929644 INFO (jetty-launcher-732-thread-2) [n:127.0.0.1:42477_solr ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/95028764910682127-127.0.0.1:49414_solr-n_0000000002 to know if I could be the leader
[junit4] 2> 929644 INFO (jetty-launcher-732-thread-1) [n:127.0.0.1:49414_solr ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 929644 INFO (jetty-launcher-732-thread-2) [n:127.0.0.1:42477_solr ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 929644 INFO (jetty-launcher-732-thread-5) [n:127.0.0.1:46567_solr ] o.a.s.c.Overseer Overseer (id=95028764910682126-127.0.0.1:46567_solr-n_0000000000) starting
[junit4] 2> 929646 INFO (jetty-launcher-732-thread-4) [n:127.0.0.1:50143_solr ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/95028764910682124-127.0.0.1:42477_solr-n_0000000003 to know if I could be the leader
[junit4] 2> 929646 INFO (jetty-launcher-732-thread-4) [n:127.0.0.1:50143_solr ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 929653 INFO (jetty-launcher-732-thread-5) [n:127.0.0.1:46567_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
[junit4] 2> 929692 INFO (jetty-launcher-732-thread-5) [n:127.0.0.1:46567_solr ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 929694 INFO (OverseerCollectionConfigSetProcessor-95028764910682126-127.0.0.1:46567_solr-n_0000000000) [n:127.0.0.1:46567_solr ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
[junit4] 2> 929694 INFO (jetty-launcher-732-thread-5) [n:127.0.0.1:46567_solr ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 929694 INFO (OverseerStateUpdate-95028764910682126-127.0.0.1:46567_solr-n_0000000000) [n:127.0.0.1:46567_solr ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 929704 INFO (jetty-launcher-732-thread-4) [n:127.0.0.1:50143_solr ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 929704 INFO (jetty-launcher-732-thread-4) [n:127.0.0.1:50143_solr ] o.a.s.c.CoreContainer Authentication plugin class obtained from system property 'authenticationPlugin': org.apache.solr.cloud.TestAuthenticationFramework$MockAuthenticationPlugin
[junit4] 2> 929706 INFO (jetty-launcher-732-thread-4) [n:127.0.0.1:50143_solr ] o.a.s.c.CoreContainer Reconfiguring the shard handler factory and update shard handler.
[junit4] 2> 929706 INFO (jetty-launcher-732-thread-4) [n:127.0.0.1:50143_solr ] o.a.s.h.c.HttpShardHandlerFactory Reconfiguring the default client with: org.apache.solr.cloud.TestAuthenticationFramework$MockAuthenticationPlugin$MockClientConfigurer@2de9fbbc
[junit4] 2> 929707 INFO (jetty-launcher-732-thread-4) [n:127.0.0.1:50143_solr ] o.a.s.u.UpdateShardHandler Reconfiguring the default client with: org.apache.solr.cloud.TestAuthenticationFramework$MockAuthenticationPlugin$MockClientConfigurer@2de9fbbc
[junit4] 2> 929710 INFO (jetty-launcher-732-thread-4) [n:127.0.0.1:50143_solr ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.TestAuthenticationFramework_5B47E26B2883A50F-001/tempDir-001/node3/.
[junit4] 2> 929710 INFO (jetty-launcher-732-thread-4) [n:127.0.0.1:50143_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions
[junit4] 2> 929712 INFO (jetty-launcher-732-thread-4) [n:127.0.0.1:50143_solr ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4] 2> 929712 INFO (jetty-launcher-732-thread-4) [n:127.0.0.1:50143_solr ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 929721 INFO (jetty-launcher-732-thread-2) [n:127.0.0.1:42477_solr ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 929721 INFO (jetty-launcher-732-thread-2) [n:127.0.0.1:42477_solr ] o.a.s.c.CoreContainer Authentication plugin class obtained from system property 'authenticationPlugin': org.apache.solr.cloud.TestAuthenticationFramework$MockAuthenticationPlugin
[junit4] 2> 929722 INFO (jetty-launcher-732-thread-1) [n:127.0.0.1:49414_solr ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 929722 INFO (jetty-launcher-732-thread-1) [n:127.0.0.1:49414_solr ] o.a.s.c.CoreContainer Authentication plugin class obtained from system property 'authenticationPlugin': org.apache.solr.cloud.TestAuthenticationFramework$MockAuthenticationPlugin
[junit4] 2> 929722 INFO (jetty-launcher-732-thread-1) [n:127.0.0.1:49414_solr ] o.a.s.c.CoreContainer Reconfiguring the shard handler factory and update shard handler.
[junit4] 2> 929722 INFO (jetty-launcher-732-thread-1) [n:127.0.0.1:49414_solr ] o.a.s.h.c.HttpShardHandlerFactory Reconfiguring the default client with: org.apache.solr.cloud.TestAuthenticationFramework$MockAuthenticationPlugin$MockClientConfigurer@3a676550
[junit4] 2> 929722 INFO (jetty-launcher-732-thread-1) [n:127.0.0.1:49414_solr ] o.a.s.u.UpdateShardHandler Reconfiguring the default client with: org.apache.solr.cloud.TestAuthenticationFramework$MockAuthenticationPlugin$MockClientConfigurer@3a676550
[junit4] 2> 929723 INFO (jetty-launcher-732-thread-1) [n:127.0.0.1:49414_solr ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.TestAuthenticationFramework_5B47E26B2883A50F-001/tempDir-001/node1/.
[junit4] 2> 929723 INFO (jetty-launcher-732-thread-1) [n:127.0.0.1:49414_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions
[junit4] 2> 929723 INFO (jetty-launcher-732-thread-2) [n:127.0.0.1:42477_solr ] o.a.s.c.CoreContainer Reconfiguring the shard handler factory and update shard handler.
[junit4] 2> 929723 INFO (jetty-launcher-732-thread-2) [n:127.0.0.1:42477_solr ] o.a.s.h.c.HttpShardHandlerFactory Reconfiguring the default client with: org.apache.solr.cloud.TestAuthenticationFramework$MockAuthenticationPlugin$MockClientConfigurer@17d50208
[junit4] 2> 929723 INFO (jetty-launcher-732-thread-2) [n:127.0.0.1:42477_solr ] o.a.s.u.UpdateShardHandler Reconfiguring the default client with: org.apache.solr.cloud.TestAuthenticationFramework$MockAuthenticationPlugin$MockClientConfigurer@17d50208
[junit4] 2> 929724 INFO (jetty-launcher-732-thread-2) [n:127.0.0.1:42477_solr ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.TestAuthenticationFramework_5B47E26B2883A50F-001/tempDir-001/node4/.
[junit4] 2> 929724 INFO (jetty-launcher-732-thread-2) [n:127.0.0.1:42477_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions
[junit4] 2> 929725 INFO (jetty-launcher-732-thread-1) [n:127.0.0.1:49414_solr ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4] 2> 929725 INFO (jetty-launcher-732-thread-1) [n:127.0.0.1:49414_solr ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 929728 INFO (jetty-launcher-732-thread-3) [n:127.0.0.1:40446_solr ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 929728 INFO (jetty-launcher-732-thread-3) [n:127.0.0.1:40446_solr ] o.a.s.c.CoreContainer Authentication plugin class obtained from system property 'authenticationPlugin': org.apache.solr.cloud.TestAuthenticationFramework$MockAuthenticationPlugin
[junit4] 2> 929728 INFO (jetty-launcher-732-thread-3) [n:127.0.0.1:40446_solr ] o.a.s.c.CoreContainer Reconfiguring the shard handler factory and update shard handler.
[junit4] 2> 929728 INFO (jetty-launcher-732-thread-3) [n:127.0.0.1:40446_solr ] o.a.s.h.c.HttpShardHandlerFactory Reconfiguring the default client with: org.apache.solr.cloud.TestAuthenticationFramework$MockAuthenticationPlugin$MockClientConfigurer@4b8859bb
[junit4] 2> 929728 INFO (jetty-launcher-732-thread-3) [n:127.0.0.1:40446_solr ] o.a.s.u.UpdateShardHandler Reconfiguring the default client with: org.apache.solr.cloud.TestAuthenticationFramework$MockAuthenticationPlugin$MockClientConfigurer@4b8859bb
[junit4] 2> 929729 INFO (jetty-launcher-732-thread-3) [n:127.0.0.1:40446_solr ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.TestAuthenticationFramework_5B47E26B2883A50F-001/tempDir-001/node2/.
[junit4] 2> 929729 INFO (jetty-launcher-732-thread-3) [n:127.0.0.1:40446_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions
[junit4] 2> 929730 INFO (jetty-launcher-732-thread-2) [n:127.0.0.1:42477_solr ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4] 2> 929730 INFO (jetty-launcher-732-thread-2) [n:127.0.0.1:42477_solr ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 929737 INFO (jetty-launcher-732-thread-3) [n:127.0.0.1:40446_solr ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4] 2> 929737 INFO (jetty-launcher-732-thread-3) [n:127.0.0.1:40446_solr ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 929761 INFO (jetty-launcher-732-thread-5) [n:127.0.0.1:46567_solr ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 929761 INFO (jetty-launcher-732-thread-5) [n:127.0.0.1:46567_solr ] o.a.s.c.CoreContainer Authentication plugin class obtained from system property 'authenticationPlugin': org.apache.solr.cloud.TestAuthenticationFramework$MockAuthenticationPlugin
[junit4] 2> 929762 INFO (jetty-launcher-732-thread-5) [n:127.0.0.1:46567_solr ] o.a.s.c.CoreContainer Reconfiguring the shard handler factory and update shard handler.
[junit4] 2> 929762 INFO (jetty-launcher-732-thread-5) [n:127.0.0.1:46567_solr ] o.a.s.h.c.HttpShardHandlerFactory Reconfiguring the default client with: org.apache.solr.cloud.TestAuthenticationFramework$MockAuthenticationPlugin$MockClientConfigurer@46a7cc41
[junit4] 2> 929762 INFO (jetty-launcher-732-thread-5) [n:127.0.0.1:46567_solr ] o.a.s.u.UpdateShardHandler Reconfiguring the default client with: org.apache.solr.cloud.TestAuthenticationFramework$MockAuthenticationPlugin$MockClientConfigurer@46a7cc41
[junit4] 2> 929762 INFO (jetty-launcher-732-thread-5) [n:127.0.0.1:46567_solr ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.TestAuthenticationFramework_5B47E26B2883A50F-001/tempDir-001/node5/.
[junit4] 2> 929763 INFO (jetty-launcher-732-thread-5) [n:127.0.0.1:46567_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions
[junit4] 2> 929773 INFO (jetty-launcher-732-thread-5) [n:127.0.0.1:46567_solr ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4] 2> 929773 INFO (jetty-launcher-732-thread-5) [n:127.0.0.1:46567_solr ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 929773 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 929779 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 929779 INFO (zkCallback-754-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@49f6052f name:ZooKeeperConnection Watcher:127.0.0.1:42106 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 929779 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 929780 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 929787 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.TestMiniSolrCloudCluster #### Stopping a server
[junit4] 2> 929790 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.e.j.s.ServerConnector Stopped ServerConnector@55628fda{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 929791 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=2046369490
[junit4] 2> 929795 INFO (zkCallback-746-thread-1-processing-n:127.0.0.1:50143_solr) [n:127.0.0.1:50143_solr ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4] 2> 929795 INFO (zkCallback-752-thread-1-processing-n:127.0.0.1:46567_solr) [n:127.0.0.1:46567_solr ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4] 2> 929795 WARN (zkCallback-746-thread-1-processing-n:127.0.0.1:50143_solr) [n:127.0.0.1:50143_solr ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 929796 INFO (zkCallback-753-thread-1-processing-n:127.0.0.1:49414_solr) [n:127.0.0.1:49414_solr ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4] 2> 929796 INFO (zkCallback-745-thread-1-processing-n:127.0.0.1:40446_solr) [n:127.0.0.1:40446_solr ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4] 2> 929796 INFO (zkCallback-749-thread-1-processing-n:127.0.0.1:42477_solr) [n:127.0.0.1:42477_solr ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4] 2> 929797 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@46289fb9{/solr,null,UNAVAILABLE}
[junit4] 2> 929814 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.TestMiniSolrCloudCluster #### Starting a server
[junit4] 2> 929818 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.e.j.s.Server jetty-9.3.6.v20151106
[junit4] 2> 929881 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6ddc20d3{/solr,null,AVAILABLE}
[junit4] 2> 929881 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.e.j.s.ServerConnector Started ServerConnector@32cc2648{HTTP/1.1,[http/1.1]}{127.0.0.1:47612}
[junit4] 2> 929883 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.e.j.s.Server Started @932995ms
[junit4] 2> 929884 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=47612}
[junit4] 2> 929884 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 929884 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.TestAuthenticationFramework_5B47E26B2883A50F-001/tempDir-001/node6'
[junit4] 2> 929884 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 929884 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 929884 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 929893 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 929908 INFO (zkCallback-756-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@70a38286 name:ZooKeeperConnection Watcher:127.0.0.1:42106/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 929908 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 929909 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 929911 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 929922 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.TestAuthenticationFramework_5B47E26B2883A50F-001/tempDir-001/node6/.
[junit4] 2> 929922 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.CoreContainer New CoreContainer 1094583412
[junit4] 2> 929922 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.TestAuthenticationFramework_5B47E26B2883A50F-001/tempDir-001/node6]
[junit4] 2> 929922 WARN (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.TestAuthenticationFramework_5B47E26B2883A50F-001/tempDir-001/node6/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.TestAuthenticationFramework_5B47E26B2883A50F-001/tempDir-001/node6/lib
[junit4] 2> 929922 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 929923 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 929924 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 929924 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 929924 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42106/solr
[junit4] 2> 929924 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 929924 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 929950 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 929960 INFO (zkCallback-758-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@14a8b8dc name:ZooKeeperConnection Watcher:127.0.0.1:42106 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 929962 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 929962 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 930027 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [n:127.0.0.1:47612_solr ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 930038 INFO (zkCallback-759-thread-1-processing-n:127.0.0.1:47612_solr) [n:127.0.0.1:47612_solr ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@550e00b0 name:ZooKeeperConnection Watcher:127.0.0.1:42106/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 930038 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [n:127.0.0.1:47612_solr ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 930055 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [n:127.0.0.1:47612_solr ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 931060 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [n:127.0.0.1:47612_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47612_solr
[junit4] 2> 931064 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [n:127.0.0.1:47612_solr ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:47612_solr
[junit4] 2> 931067 INFO (zkCallback-753-thread-1-processing-n:127.0.0.1:49414_solr) [n:127.0.0.1:49414_solr ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4] 2> 931067 INFO (zkCallback-759-thread-1-processing-n:127.0.0.1:47612_solr) [n:127.0.0.1:47612_solr ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4] 2> 931068 INFO (zkCallback-745-thread-1-processing-n:127.0.0.1:40446_solr) [n:127.0.0.1:40446_solr ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4] 2> 931068 INFO (zkCallback-749-thread-1-processing-n:127.0.0.1:42477_solr) [n:127.0.0.1:42477_solr ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4] 2> 931068 INFO (zkCallback-752-thread-1-processing-n:127.0.0.1:46567_solr) [n:127.0.0.1:46567_solr ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4] 2> 931070 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [n:127.0.0.1:47612_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 931074 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [n:127.0.0.1:47612_solr ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95028764910682131-127.0.0.1:47612_solr-n_0000000005
[junit4] 2> 931075 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [n:127.0.0.1:47612_solr ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/95028764910682124-127.0.0.1:42477_solr-n_0000000003 to know if I could be the leader
[junit4] 2> 931086 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [n:127.0.0.1:47612_solr ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 931086 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [n:127.0.0.1:47612_solr ] o.a.s.c.CoreContainer Authentication plugin class obtained from system property 'authenticationPlugin': org.apache.solr.cloud.TestAuthenticationFramework$MockAuthenticationPlugin
[junit4] 2> 931086 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [n:127.0.0.1:47612_solr ] o.a.s.c.CoreContainer Reconfiguring the shard handler factory and update shard handler.
[junit4] 2> 931086 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [n:127.0.0.1:47612_solr ] o.a.s.h.c.HttpShardHandlerFactory Reconfiguring the default client with: org.apache.solr.cloud.TestAuthenticationFramework$MockAuthenticationPlugin$MockClientConfigurer@8076e72
[junit4] 2> 931086 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [n:127.0.0.1:47612_solr ] o.a.s.u.UpdateShardHandler Reconfiguring the default client with: org.apache.solr.cloud.TestAuthenticationFramework$MockAuthenticationPlugin$MockClientConfigurer@8076e72
[junit4] 2> 931087 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [n:127.0.0.1:47612_solr ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.TestAuthenticationFramework_5B47E26B2883A50F-001/tempDir-001/node6/.
[junit4] 2> 931089 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [n:127.0.0.1:47612_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions
[junit4] 2> 931097 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [n:127.0.0.1:47612_solr ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4] 2> 931097 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [n:127.0.0.1:47612_solr ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 931097 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.TestMiniSolrCloudCluster #### Creating a collection
[junit4] 2> 931098 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 931106 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 931112 INFO (zkCallback-760-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7ec2d79e name:ZooKeeperConnection Watcher:127.0.0.1:42106/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 931112 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 931112 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 931113 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/solrconfig-spellcheckcomponent.xml
[junit4] 2> 931125 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/schema-null-charfilters-analyzer.xml
[junit4] 2> 931127 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/regex-boost-processor-test.txt
[junit4] 2> 931131 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/solrconfig-spellchecker.xml
[junit4] 2> 931142 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-schema-multiple-asterisk-copyfield-dest-should-fail-test.xml
[junit4] 2> 931144 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/schema-docValuesFaceting.xml
[junit4] 2> 931159 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/solrconfig-tlog-with-delayingcomponent.xml
[junit4] 2> 931178 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-schema-currency-ft-bogus-default-code.xml
[junit4] 2> 931183 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/schema-numeric.xml
[junit4] 2> 931199 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/solrconfig_codec.xml
[junit4] 2> 931215 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-schema-multiple-asterisk-copyfield-source-should-fail-test.xml
[junit4] 2> 931220 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/schema_latest.xml
[junit4] 2> 931240 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/schema-sorts.xml
[junit4] 2> 931254 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/solrconfig-headers.xml
[junit4] 2> 931267 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/solrconfig-implicitproperties.xml
[junit4] 2> 931273 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-solrconfig-bogus-scriptengine-name.xml
[junit4] 2> 931295 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/schema-snippet-types.incl
[junit4] 2> 931303 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/solrconfig-parsing-update-processor-chains.xml
[junit4] 2> 931320 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/schema-docValuesMissing.xml
[junit4] 2> 931338 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/solrconfig-noopregen.xml
[junit4] 2> 931352 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/schema-one-field-no-dynamic-field-unique-key.xml
[junit4] 2> 931363 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/solrconfig-script-updateprocessor.xml
[junit4] 2> 931383 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-error-solrconfig.xml
[junit4] 2> 931392 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/solrconfig-suggestercomponent.xml
[junit4] 2> 931412 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-currency.xml
[junit4] 2> 931415 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/solrconfig-query-parser-init.xml
[junit4] 2> 931434 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/solrconfig-caching.xml
[junit4] 2> 931442 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/conditional.updateprocessor.js
[junit4] 2> 931445 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/compoundDictionary.txt
[junit4] 2> 931448 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/phrasesuggest.txt
[junit4] 2> 931463 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/solrconfig-transformers.xml
[junit4] 2> 931466 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-schema-not-indexed-but-norms.xml
[junit4] 2> 931478 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/blendedInfixSuggest.txt
[junit4] 2> 931481 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/schema-phrasesuggest.xml
[junit4] 2> 931485 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/hunspell-test.dic
[junit4] 2> 931486 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/schema-HighlighterMaxOffsetTest.xml
[junit4] 2> 931491 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/schema-rest-lucene-match-version.xml
[junit4] 2> 931493 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/solrconfig-functionquery.xml
[junit4] 2> 931496 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/solrconfig-externalversionconstraint.xml
[junit4] 2> 931507 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-schema-codec-global-vs-ft-mismatch.xml
[junit4] 2> 931510 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/schema-sim.xml
[junit4] 2> 931513 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/schema-docValuesMulti.xml
[junit4] 2> 931516 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/solrconfig-collapseqparser.xml
[junit4] 2> 931521 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/solrconfig-analytics-query.xml
[junit4] 2> 931525 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/schema-sweetspot.xml
[junit4] 2> 931528 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/solrconfig-searcher-listeners1.xml
[junit4] 2> 931535 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/schema-id-and-version-fields-only.xml
[junit4] 2> 931540 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-solrconfig-schema-mutable-but-not-managed.xml
[junit4] 2> 931544 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/hunspell-test.aff
[junit4] 2> 931547 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/solrconfig-response-log-component.xml
[junit4] 2> 931550 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-schema-sim-default-does-not-exist.xml
[junit4] 2> 931552 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-schema-dynamicfield-required.xml
[junit4] 2> 931556 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-schema-not-indexed-but-pos.xml
[junit4] 2> 931558 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/solrconfig-hash.xml
[junit4] 2> 931563 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/solrconfig-components-name.xml
[junit4] 2> 931565 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-mp-solrconfig.xml
[junit4] 2> 931570 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883A50F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 931571 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[5B47E26B2883
[...truncated too long message...]
equestWithRetryOnStaleState(CloudSolrClient.java:871)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:807)
[junit4] > at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:888)Throwable #2: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=14638, name=collection0, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:52008: Could not find collection : awholynewstresscollection_collection0_9
[junit4] > at __randomizedtesting.SeedInfo.seed([5B47E26B2883A50F]:0)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:871)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:807)
[junit4] > at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:888)Throwable #3: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=14642, name=collection4, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:52008: collection already exists: awholynewstresscollection_collection4_9
[junit4] > at __randomizedtesting.SeedInfo.seed([5B47E26B2883A50F]:0)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:871)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:807)
[junit4] > at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1574)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1595)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:881)Throwable #4: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=14640, name=collection2, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:52008: Could not find collection : awholynewstresscollection_collection2_7
[junit4] > at __randomizedtesting.SeedInfo.seed([5B47E26B2883A50F]:0)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:871)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:807)
[junit4] > at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:888)
[junit4] 2> 2015394 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[5B47E26B2883A50F]-worker) [n:127.0.0.1:57298_ c:addReplicaColl s:shard2 r:core_node3 x:addReplicaColl_shard2_replica2] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: test params are: codec=DummyCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=DUMMY, chunkSize=4898, maxDocsPerChunk=5, blockSize=35), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=DUMMY, chunkSize=4898, blockSize=35)), sim=ClassicSimilarity, locale=ar_SD, timezone=America/Indiana/Tell_City
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_66 (64-bit)/cpus=4,threads=1,free=89038896,total=489684992
[junit4] 2> NOTE: All tests run in this JVM: [CursorMarkTest, MoreLikeThisHandlerTest, CollectionStateFormat2Test, UpdateRequestProcessorFactoryTest, ChaosMonkeySafeLeaderTest, TestConfigSetsAPIZkFailure, TestCodecSupport, TestJsonFacets, TestRandomCollapseQParserPlugin, SpatialFilterTest, TestInitQParser, TestCollectionAPI, TestQuerySenderListener, TestHashPartitioner, TestSerializedLuceneMatchVersion, TestRawTransformer, DocValuesTest, SecurityConfHandlerTest, DocumentBuilderTest, FullHLLTest, TestJettySolrRunner, DistributedQueryComponentCustomSortTest, ZkSolrClientTest, HighlighterMaxOffsetTest, MigrateRouteKeyTest, ChaosMonkeyNothingIsSafeTest, ZkCLITest, FileUtilsTest, TestStressVersions, CdcrRequestHandlerTest, MinimalSchemaTest, SolrPluginUtilsTest, TestCoreContainer, FastVectorHighlighterTest, MBeansHandlerTest, TestDistributedGrouping, TestFieldCollectionResource, HdfsRecoveryZkTest, TestUniqueKeyFieldResource, TestSortByMinMaxFunction, TestHighFrequencyDictionaryFactory, TestQueryUtils, ClusterStateUpdateTest, ShardRoutingTest, UniqFieldsUpdateProcessorFactoryTest, TestManagedResource, DistributedMLTComponentTest, IndexBasedSpellCheckerTest, SpellCheckCollatorTest, SimpleCollectionCreateDeleteTest, HighlighterTest, DirectSolrSpellCheckerTest, TestAuthenticationFramework, OpenExchangeRatesOrgProviderTest, TestSolrCoreProperties, TestDownShardTolerantSearch, TestInfoStreamLogging, TestSimpleTrackingShardHandler, TimeZoneUtilsTest, TermVectorComponentTest, DistributedExpandComponentTest, CleanupOldIndexTest, TestCursorMarkWithoutUniqueKey, TestManagedSchemaFieldTypeResource, TestRecoveryHdfs, TestCloudSchemaless, TestBinaryResponseWriter, TestPKIAuthenticationPlugin, TestPivotHelperCode, SoftAutoCommitTest, SuggesterFSTTest, TestSolrDynamicMBean, BasicAuthIntegrationTest, TestBM25SimilarityFactory, TriLevelCompositeIdRoutingTest, SolrIndexConfigTest, SchemaVersionSpecificBehaviorTest, ResponseHeaderTest, SimplePostToolTest, TestRandomMergePolicy, SpellCheckComponentTest, TestChildDocTransformer, TestLMJelinekMercerSimilarityFactory, DistributedTermsComponentTest, CustomCollectionTest, DOMUtilTest, ShardRoutingCustomTest, NumericFieldsTest, SuggestComponentTest, ExitableDirectoryReaderTest, TestReloadAndDeleteDocs, BasicDistributedZk2Test, CollectionsAPIDistributedZkTest]
[junit4] Completed [280/566 (2!)] on J1 in 520.21s, 1 test, 1 error <<< FAILURES!
[...truncated 918 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:791: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:728: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1436: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:991: There were test failures: 566 suites (8 ignored), 2245 tests, 2 errors, 33 ignored (18 assumptions) [seed: 5B47E26B2883A50F]
Total time: 197 minutes 22 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 880 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/880/
1 tests failed.
FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test
Error Message:
Captured an uncaught exception in thread: Thread[id=61974, name=collection4, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=61974, name=collection4, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: java.lang.RuntimeException: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:44219, http://127.0.0.1:41121, http://127.0.0.1:60207, http://127.0.0.1:46906, http://127.0.0.1:41625]
at __randomizedtesting.SeedInfo.seed([1EF0D91F3A098E50]:0)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:891)
Caused by: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:44219, http://127.0.0.1:41121, http://127.0.0.1:60207, http://127.0.0.1:46906, http://127.0.0.1:41625]
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:352)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:871)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:807)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1574)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1595)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:881)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:46906: KeeperErrorCode = Session expired for /overseer/collection-queue-work/qnr-
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
... 7 more
Build Log:
[...truncated 10836 lines...]
[junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_1EF0D91F3A098E50-001/init-core-data-001
[junit4] 2> 2149123 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[1EF0D91F3A098E50]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
[junit4] 2> 2149123 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[1EF0D91F3A098E50]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
[junit4] 2> 2149133 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 2149138 INFO (Thread-54047) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 2149138 INFO (Thread-54047) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 2149235 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.ZkTestServer start zk server on port:60158
[junit4] 2> 2149235 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 2149241 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2149259 INFO (zkCallback-2280-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@28f8bb35 name:ZooKeeperConnection Watcher:127.0.0.1:60158 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2149259 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2149260 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 2149260 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 2149265 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 2149280 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2149281 INFO (zkCallback-2281-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@605986dc name:ZooKeeperConnection Watcher:127.0.0.1:60158/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2149281 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2149281 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 2149281 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
[junit4] 2> 2149282 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
[junit4] 2> 2149283 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
[junit4] 2> 2149284 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
[junit4] 2> 2149285 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 2149285 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 2149287 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 2149287 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
[junit4] 2> 2149288 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 2149288 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 2149289 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 2149290 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
[junit4] 2> 2149291 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 2149291 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
[junit4] 2> 2149292 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 2149292 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
[junit4] 2> 2149293 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 2149293 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 2149294 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 2149294 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 2149295 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 2149295 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 2149296 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 2149297 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 2149298 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 2149298 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
[junit4] 2> 2149697 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_1EF0D91F3A098E50-001/control-001/cores/collection1
[junit4] 2> 2149699 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.e.j.s.Server jetty-9.3.6.v20151106
[junit4] 2> 2149702 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6c16f3c8{/,null,AVAILABLE}
[junit4] 2> 2149707 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.e.j.s.ServerConnector Started ServerConnector@34d7bf0b{HTTP/1.1,[http/1.1]}{127.0.0.1:41625}
[junit4] 2> 2149707 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.e.j.s.Server Started @2152924ms
[junit4] 2> 2149707 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_1EF0D91F3A098E50-001/tempDir-001/control/data, hostContext=/, hostPort=41625, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_1EF0D91F3A098E50-001/control-001/cores}
[junit4] 2> 2149707 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 2149707 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_1EF0D91F3A098E50-001/control-001'
[junit4] 2> 2149708 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2149708 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 2149708 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 2149710 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2149710 INFO (zkCallback-2282-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@369cb474 name:ZooKeeperConnection Watcher:127.0.0.1:60158/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2149710 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2149711 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 2149713 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 2149713 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_1EF0D91F3A098E50-001/control-001/solr.xml
[junit4] 2> 2149718 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_1EF0D91F3A098E50-001/control-001/cores
[junit4] 2> 2149718 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.CoreContainer New CoreContainer 1348979021
[junit4] 2> 2149718 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_1EF0D91F3A098E50-001/control-001]
[junit4] 2> 2149719 WARN (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_1EF0D91F3A098E50-001/control-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_1EF0D91F3A098E50-001/control-001/lib
[junit4] 2> 2149719 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 2149721 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 2149722 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2149723 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2149723 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:60158/solr
[junit4] 2> 2149723 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 2149723 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 2149727 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2149742 INFO (zkCallback-2284-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1cd994de name:ZooKeeperConnection Watcher:127.0.0.1:60158 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2149743 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2149743 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 2149749 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [n:127.0.0.1:41625_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2149757 INFO (zkCallback-2285-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6195ab67 name:ZooKeeperConnection Watcher:127.0.0.1:60158/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2149757 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [n:127.0.0.1:41625_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2149758 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [n:127.0.0.1:41625_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
[junit4] 2> 2149760 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [n:127.0.0.1:41625_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 2149762 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [n:127.0.0.1:41625_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 2149763 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [n:127.0.0.1:41625_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 2149765 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [n:127.0.0.1:41625_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 2149767 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [n:127.0.0.1:41625_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 2149773 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [n:127.0.0.1:41625_ ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 2149774 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [n:127.0.0.1:41625_ ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 2149775 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [n:127.0.0.1:41625_ ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 2149777 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [n:127.0.0.1:41625_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41625_
[junit4] 2> 2149777 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [n:127.0.0.1:41625_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:41625_
[junit4] 2> 2149781 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [n:127.0.0.1:41625_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 2149783 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [n:127.0.0.1:41625_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 2149787 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [n:127.0.0.1:41625_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2149788 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [n:127.0.0.1:41625_ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95022641820073988-127.0.0.1:41625_-n_0000000000
[junit4] 2> 2149789 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [n:127.0.0.1:41625_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:41625_
[junit4] 2> 2149789 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [n:127.0.0.1:41625_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
[junit4] 2> 2149799 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [n:127.0.0.1:41625_ ] o.a.s.c.Overseer Overseer (id=95022641820073988-127.0.0.1:41625_-n_0000000000) starting
[junit4] 2> 2149800 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [n:127.0.0.1:41625_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
[junit4] 2> 2149830 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [n:127.0.0.1:41625_ ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 2149837 INFO (OverseerCollectionConfigSetProcessor-95022641820073988-127.0.0.1:41625_-n_0000000000) [n:127.0.0.1:41625_ ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
[junit4] 2> 2149841 INFO (OverseerStateUpdate-95022641820073988-127.0.0.1:41625_-n_0000000000) [n:127.0.0.1:41625_ ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 2149841 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [n:127.0.0.1:41625_ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 2149869 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [n:127.0.0.1:41625_ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 2149870 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [n:127.0.0.1:41625_ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 2149870 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [n:127.0.0.1:41625_ ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_1EF0D91F3A098E50-001/control-001/cores
[junit4] 2> 2149872 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [n:127.0.0.1:41625_ ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=control_collection, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 2149872 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [n:127.0.0.1:41625_ ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_1EF0D91F3A098E50-001/control-001/cores/collection1
[junit4] 2> 2149872 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [n:127.0.0.1:41625_ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
[junit4] 2> 2149878 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [n:127.0.0.1:41625_ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4] 2> 2149878 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [n:127.0.0.1:41625_ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 2149878 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 2149878 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 2149880 INFO (OverseerStateUpdate-95022641820073988-127.0.0.1:41625_-n_0000000000) [n:127.0.0.1:41625_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:41625",
[junit4] 2> "node_name":"127.0.0.1:41625_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 2149880 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 2149880 INFO (OverseerStateUpdate-95022641820073988-127.0.0.1:41625_-n_0000000000) [n:127.0.0.1:41625_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:41625",
[junit4] 2> "node_name":"127.0.0.1:41625_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 2149881 INFO (OverseerStateUpdate-95022641820073988-127.0.0.1:41625_-n_0000000000) [n:127.0.0.1:41625_ ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
[junit4] 2> 2149881 INFO (OverseerStateUpdate-95022641820073988-127.0.0.1:41625_-n_0000000000) [n:127.0.0.1:41625_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 2149882 INFO (zkCallback-2285-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2150881 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 2150881 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
[junit4] 2> 2150881 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 2150881 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 2150882 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2150882 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_1EF0D91F3A098E50-001/control-001/cores/collection1'
[junit4] 2> 2150882 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2150882 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 2150883 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 2150888 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 2150892 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 2150925 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection x:collection1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2150938 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 2151043 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 2151068 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 2151075 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 2151127 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 2151130 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 2151134 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2151139 WARN (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 2151139 WARN (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 2151139 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2151143 WARN (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 2151144 WARN (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 2151159 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4] 2> 2151159 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 2151159 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 2151161 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_1EF0D91F3A098E50-001/control-001/cores/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_1EF0D91F3A098E50-001/control-001/cores/collection1/data/]
[junit4] 2> 2151161 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@14da7975
[junit4] 2> 2151161 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_1EF0D91F3A098E50-001/control-001/cores/collection1/data
[junit4] 2> 2151161 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_1EF0D91F3A098E50-001/control-001/cores/collection1/data/index/
[junit4] 2> 2151162 WARN (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_1EF0D91F3A098E50-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 2151162 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_1EF0D91F3A098E50-001/control-001/cores/collection1/data/index
[junit4] 2> 2151162 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@7696055f
[junit4] 2> 2151162 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=RawDirectoryWrapper(RAMDirectory@4b09acec lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2047bd39),segFN=segments_1,generation=1}
[junit4] 2> 2151163 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 2151176 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 2151176 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
[junit4] 2> 2151176 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2151176 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 2151176 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2151176 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 2151176 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2151177 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2151177 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 2151177 WARN (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,args = {defaults={a=A,b=B}}}
[junit4] 2> 2151178 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 2151179 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 2151180 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 2151181 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 2151181 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_1EF0D91F3A098E50-001/control-001/cores/collection1/data/
[junit4] 2> 2151187 WARN (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_1EF0D91F3A098E50-001/control-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
[junit4] 2> 2151188 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/dump,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 2151192 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 2151197 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 2151197 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 2151198 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2151198 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2151198 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=48, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=1.22265625, noCFSRatio=0.0]
[junit4] 2> 2151198 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=RawDirectoryWrapper(RAMDirectory@4b09acec lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2047bd39),segFN=segments_1,generation=1}
[junit4] 2> 2151198 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 2151198 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@760a8b4a[collection1] main
[junit4] 2> 2151199 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 2151199 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2151199 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 2151200 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 2151200 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
[junit4] 2> 2151200 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2151202 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 2151202 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2151202 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 2151202 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 2151202 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
[junit4] 2> 2151202 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
[junit4] 2> 2151203 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
[junit4] 2> 2151203 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1520362271280201728
[junit4] 2> 2151204 INFO (searcherExecutor-3678-thread-1-processing-n:127.0.0.1:41625_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@760a8b4a[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2151205 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 2.0ms to seed version buckets with highest version 1520362271280201728
[junit4] 2> 2151205 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
[junit4] 2> 2151205 INFO (coreLoadExecutor-3677-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 2151206 INFO (coreZkRegister-3671-thread-1-processing-n:127.0.0.1:41625_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:41625 collection:control_collection shard:shard1
[junit4] 2> 2151206 INFO (coreZkRegister-3671-thread-1-processing-n:127.0.0.1:41625_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 2151209 INFO (coreZkRegister-3671-thread-1-processing-n:127.0.0.1:41625_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/95022641820073988-core_node1-n_0000000000
[junit4] 2> 2151209 INFO (coreZkRegister-3671-thread-1-processing-n:127.0.0.1:41625_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard=shard1 and weAreReplacement=false and leaderVoteWait=180000
[junit4] 2> 2151211 INFO (OverseerStateUpdate-95022641820073988-127.0.0.1:41625_-n_0000000000) [n:127.0.0.1:41625_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection"} current state version: 1
[junit4] 2> 2151211 INFO (coreZkRegister-3671-thread-1-processing-n:127.0.0.1:41625_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 2151212 INFO (coreZkRegister-3671-thread-1-processing-n:127.0.0.1:41625_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 2151212 INFO (coreZkRegister-3671-thread-1-processing-n:127.0.0.1:41625_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:41625/collection1/
[junit4] 2> 2151212 INFO (coreZkRegister-3671-thread-1-processing-n:127.0.0.1:41625_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 2151212 INFO (coreZkRegister-3671-thread-1-processing-n:127.0.0.1:41625_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:41625/collection1/ has no replicas
[junit4] 2> 2151213 INFO (coreZkRegister-3671-thread-1-processing-n:127.0.0.1:41625_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 2151215 INFO (coreZkRegister-3671-thread-1-processing-n:127.0.0.1:41625_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
[junit4] 2> 2151220 INFO (OverseerStateUpdate-95022641820073988-127.0.0.1:41625_-n_0000000000) [n:127.0.0.1:41625_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:41625",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 1
[junit4] 2> 2151220 INFO (coreZkRegister-3671-thread-1-processing-n:127.0.0.1:41625_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:41625/collection1/ shard1
[junit4] 2> 2151323 INFO (zkCallback-2285-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2151373 INFO (coreZkRegister-3671-thread-1-processing-n:127.0.0.1:41625_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:41625/collection1/ and leader is http://127.0.0.1:41625/collection1/
[junit4] 2> 2151373 INFO (coreZkRegister-3671-thread-1-processing-n:127.0.0.1:41625_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:41625
[junit4] 2> 2151373 INFO (coreZkRegister-3671-thread-1-processing-n:127.0.0.1:41625_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 2151373 INFO (coreZkRegister-3671-thread-1-processing-n:127.0.0.1:41625_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
[junit4] 2> 2151373 INFO (coreZkRegister-3671-thread-1-processing-n:127.0.0.1:41625_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 2151375 INFO (OverseerStateUpdate-95022641820073988-127.0.0.1:41625_-n_0000000000) [n:127.0.0.1:41625_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:41625",
[junit4] 2> "node_name":"127.0.0.1:41625_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 2
[junit4] 2> 2151376 INFO (OverseerStateUpdate-95022641820073988-127.0.0.1:41625_-n_0000000000) [n:127.0.0.1:41625_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:41625",
[junit4] 2> "node_name":"127.0.0.1:41625_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 2151380 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 2151388 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2151404 INFO (zkCallback-2287-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2bcb525a name:ZooKeeperConnection Watcher:127.0.0.1:60158/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2151404 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2151405 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 2151405 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 2151407 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 2151480 INFO (zkCallback-2287-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2151480 INFO (zkCallback-2285-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2151865 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_1EF0D91F3A098E50-001/shard-1-001/cores/collection1
[junit4] 2> 2151866 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_1EF0D91F3A098E50-001/shard-1-001
[junit4] 2> 2151866 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.e.j.s.Server jetty-9.3.6.v20151106
[junit4] 2> 2151868 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@36457fda{/,null,AVAILABLE}
[junit4] 2> 2151868 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.e.j.s.ServerConnector Started ServerConnector@495375e{HTTP/1.1,[http/1.1]}{127.0.0.1:60207}
[junit4] 2> 2151868 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.e.j.s.Server Started @2155085ms
[junit4] 2> 2151868 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_1EF0D91F3A098E50-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/, hostPort=60207, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_1EF0D91F3A098E50-001/shard-1-001/cores}
[junit4] 2> 2151869 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 2151869 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_1EF0D91F3A098E50-001/shard-1-001'
[junit4] 2> 2151869 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2151869 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 2151869 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 2151872 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2151879 INFO (zkCallback-2288-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@51f5a404 name:ZooKeeperConnection Watcher:127.0.0.1:60158/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2151879 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2151879 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 2151894 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 2151894 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_1EF0D91F3A098E50-001/shard-1-001/solr.xml
[junit4] 2> 2151899 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_1EF0D91F3A098E50-001/shard-1-001/cores
[junit4] 2> 2151899 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.CoreContainer New CoreContainer 1802466715
[junit4] 2> 2151899 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_1EF0D91F3A098E50-001/shard-1-001]
[junit4] 2> 2151899 WARN (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_1EF0D91F3A098E50-001/shard-1-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_1EF0D91F3A098E50-001/shard-1-001/lib
[junit4] 2> 2151899 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 2151900 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 2151901 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2151901 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2151901 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:60158/solr
[junit4] 2> 2151901 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 2151901 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 2151906 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2151907 INFO (zkCallback-2290-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1a864a81 name:ZooKeeperConnection Watcher:127.0.0.1:60158 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2151907 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2151907 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 2151915 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [n:127.0.0.1:60207_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2151923 INFO (zkCallback-2291-thread-1-processing-n:127.0.0.1:60207_) [n:127.0.0.1:60207_ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3953e852 name:ZooKeeperConnection Watcher:127.0.0.1:60158/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2151923 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [n:127.0.0.1:60207_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2151928 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [n:127.0.0.1:60207_ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 2152932 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [n:127.0.0.1:60207_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60207_
[junit4] 2> 2152933 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [n:127.0.0.1:60207_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:60207_
[junit4] 2> 2152934 INFO (zkCallback-2287-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2152934 INFO (zkCallback-2291-thread-1-processing-n:127.0.0.1:60207_) [n:127.0.0.1:60207_ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2152934 INFO (zkCallback-2285-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2152935 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [n:127.0.0.1:60207_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2152936 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [n:127.0.0.1:60207_ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95022641820073992-127.0.0.1:60207_-n_0000000001
[junit4] 2> 2152937 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [n:127.0.0.1:60207_ ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/95022641820073988-127.0.0.1:41625_-n_0000000000 to know if I could be the leader
[junit4] 2> 2152947 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [n:127.0.0.1:60207_ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 2152947 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [n:127.0.0.1:60207_ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 2152948 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [n:127.0.0.1:60207_ ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_1EF0D91F3A098E50-001/shard-1-001/cores
[junit4] 2> 2152949 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [n:127.0.0.1:60207_ ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=collection1, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 2152949 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [n:127.0.0.1:60207_ ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_1EF0D91F3A098E50-001/shard-1-001/cores/collection1
[junit4] 2> 2152949 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [n:127.0.0.1:60207_ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
[junit4] 2> 2152953 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [n:127.0.0.1:60207_ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4] 2> 2152953 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1EF0D91F3A098E50]) [n:127.0.0.1:60207_ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 2152953 INFO (coreLoadExecutor-3688-thread-1-processing-n:127.0.0.1:60207_) [n:127.0.0.1:60207_ c:collection1 x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 2152953 INFO (coreLoadExecutor-3688-thread-1-processing-n:127.0.0.1:60207_) [n:127.0.0.1:60207_ c:collection1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 2152955 INFO (coreLoadExecutor-3688-thread-1-processing-n:127.0.0.1:60207_) [n:127.0.0.1:60207_ c:collection1 x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 2152956 INFO (OverseerStateUpdate-95022641820073988-127.0.0.1:41625_-n_0000000000) [n:127.0.0.1:41625_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:60207",
[junit4] 2> "node_name":"127.0.0.1:60207_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"} current state version: 3
[junit4] 2> 2152956 INFO (OverseerStateUpdate-95022641820073988-127.0.0.1:41625_-n_0000000000) [n:127.0.0.1:41625_ ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:60207",
[junit4] 2> "node_name":"127.0.0.1:60207_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"}
[junit4] 2> 2152956 INFO (OverseerStateUpdate-95022641820073988-127.0.0.1:41625_-n_0000000000) [n:127.0.0.1:41625_ ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
[junit4] 2> 2152956 INFO (OverseerStateUpdate-95022641820073988-127.0.0.1:41625_-n_0000000000) [n:127.0.0.1:41625_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2
[junit4] 2> 2153058 INFO (zkCallback-2291-thread-1-processing-n:127.0.0.1:60207_) [n:127.0.0.1:60207_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2153058 INFO (zkCallback-2287-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2153059 INFO (zkCallback-2285-thread-1-processing-n:127.0.0.1:41625_) [n:127.0.0.1:41625_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2153955 INFO (coreLoadExecutor-3688-thread-1-processing-n:127.0.0.1:60207_) [n:127.0.0.1:60207_ c:collection1 x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 2153955 INFO (coreLoadExecutor-3688-thread-1-processing-n:127.0.0.1:60207_) [n:127.0.0.1:60207_ c:collection1 x:collection1] o.a.s.c.ZkController Check for collection zkNode:collection1
[junit4] 2> 2153956 INFO (coreLoadExecutor-3688-thread-1-processing-n:127.0.0.1:60207_) [n:127.0.0.1:60207_ c:collection1 x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 2153956 INFO (coreLoadExecutor-3688-thread-1-processing-n:127.0.0.1:60207_) [n:127.0.0.1:60207_ c:collection1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/collection1
[junit4] 2> 2153956 INFO (coreLoadExecutor-3688-thread-1-processing-n:127.0.0.1:60207_) [n:127.0.0.1:60207_ c:collection1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2153957 INFO (coreLoadExecutor-3688-thread-1-processing-n:127.0.0.1:60207_) [n:127.0.0.1:60207_ c:collection1 x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_1EF0D91F3A098E50-001/shard-1-001/cores/collection1'
[junit4] 2> 2153957 INFO (coreLoadExecutor-3688-thread-1-processing-n:127.0.0.1:60207_) [n:127.0.0.1:60207_ c:collection1 x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2153957 INFO (coreLoadExecutor-3688-thread-1-processing-n:127.0.0.1:60207_) [n:127.0.0.1:60207_ c:collection1 x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 2153958 INFO (coreLoadExecutor-3688-thread-1-processing-n:127.0.0.1:60207_) [n:127.0.0.1:60207_ c:collection1 x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 2153962 INFO (coreLoadExecutor-3688-thread-1-processing-n:127.0.0.1:60207_) [n:127.0.0.1:60207_ c:collection1 x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 2153966 INFO (coreLoadExecutor-3688-thread-1-processing-n:127.0.0.1:60207_) [n:127.0.0.1:60207_ c:collection1 x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 2153973 INFO (coreLoadExecutor-3688-thread-1-processing-n:127.0.0.1:60207_) [n:127.0.0.1:60207_ c:collection1 x:collection1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2153979 INFO (coreLoadExecutor-3688-thread-1-processing-n:127.0.0.1:60207_) [n:127.0.0.1:60207_ c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 2154092 INFO (coreLoadExecutor-3688-thread-1-processing-n:127.0.0.1:60207_) [n:127.0.0.1:60207_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 2154098 INFO (coreLoadExecutor-3688-thread-1-processing-n:127.0.0.1:60207_) [n:127.0.0.1:60207_ c:collection1 x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 2154099 INFO (coreLoadExecutor-3688-thread-1-processing-n:127.0.0.1:60207_) [n:127.0.0.1:60207_ c:collection1 x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 2154107 INFO (coreLoadExecutor-3688-thread-1-processing-n:127.0.0.1:60207_) [n:127.0.0.1:60207_ c:collection1 x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 2154111 INFO (coreLoadExecutor-3688-thread-1-processing-n:127.0.0.1:60207_) [n:127.0.0.1:60207_ c:collection1 x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 2154115 INFO (coreLoadExecutor-3688-thread-1-processing-n:127.0.0.1:60207_) [n:127.0.0.1:60207_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2154115 WARN (coreLoadExecutor-3688-thread-1-processing-n:127.0.0.1:60207_) [n:127.0.0.1:60207_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 2154116 WARN (coreLoadExecutor-3688-thread-1-processing-n:127.0.0.1:60207_) [n:127.0.0.1:60207_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 2154116 INFO (coreLoadExecutor-3688-thread-1-processing-n:127.0.0.1:60207_) [n:127.0.0.1:60207_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2154117 WARN (coreLoadExecutor-3688-thread-1-processing-n:127.0.0.1:60207_) [n:127.0.0.1:60207_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 2154117 WARN (coreLoadExecutor-3688-thread-1-processing-n:127.0.0.1:60207_) [n:127.0.0.1:60207_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 2154118 INFO (coreLoadExecutor-3688-thread-1-processing-n:127.0.0.1:60207_) [n:127.0.0.1:60207_ c:collection1 x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4] 2> 2154118 INFO (coreLoadExecutor-3688-thread-1-processing-n:127.0.0.1:60207_) [n:127.0.0.1:60207_ c:collection1 x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 2154120 INFO (coreLoadExecutor-3688-thread-1-processing-n:127.0.0.1:60207_) [n:127.0.0.1:60207_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 2154120 INFO (coreLoadExecutor-3688-thread-1-processing-n:127.0.0.1:60207_) [n:127.0.0.1:60207_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_1EF0D91F3A098E50-001/shard-1-001/cores/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_1EF0D91F3A098E50-001/shard-1-001/cores/collection1/data/]
[junit4] 2> 2154120 INFO (coreLoadExecutor-3688-thread-1-processing-n:127.0.0.1:60207_) [n:127.0.0.1:60207_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@14da7975
[junit4] 2> 2154122 INFO (coreLoadExecutor-3688-thread-1-processing-n:127.0.0.1:60207_) [n:127.0.0.1:60207_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_1EF0D91F3A098E50-001/shard-1-001/cores/collection1/data
[junit4] 2> 2154122 INFO (coreLoadExecutor-3688-thread-1-processing-n:127.0.0.1:60207_) [n:127.0.0.1:60207_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_1EF0D91F3A098E50-001/shard-1-001/cores/collection1/data/index/
[junit4] 2> 2154122 WARN (coreLoadExecutor-3688-thread-1-processing-n:127.0.0.1:60207_) [n:127.0.0.1:60207_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_1EF0D91F3A098E50-001/shard-1-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 2154122 INFO (coreLoadExecutor-3688-thread-1-processing-n:127.0.0.1:60207_) [n:127.0.0.1:60207_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_1EF0D91F3A098E50-001/shard-1-001/cores/collection1/data/index
[junit4] 2> 2154124 INFO (coreLoadExecutor-3688-thread-1-processing-n:127.0.0.1:60207_) [n:127.0.0.1:60207_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@6dbef9ac
[junit4] 2> 2154126 INFO (coreLoadExecutor-3688-thread-1-processing-n:127.0.0.1:60207_) [n:127.0.0.1:60207_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=RawDirectoryWrapper(RAMDirectory@5e1a0ac5 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@6ab5d64a),segFN=segments_1,generation=1}
[junit4] 2> 2154126 INFO (coreLoadExecutor-3688-thread-1-processing-n:127.0.0.1:60207_) [n:127.0.0.1:60207_ c:collect
[...truncated too long message...]
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:881)Throwable #4: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=61973, name=collection3, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:46906: collection already exists: awholynewstresscollection_collection3_1
[junit4] > at __randomizedtesting.SeedInfo.seed([1EF0D91F3A098E50]:0)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:871)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:807)
[junit4] > at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1574)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1595)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:881)Throwable #5: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=61972, name=collection2, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:46906: collection already exists: awholynewstresscollection_collection2_1
[junit4] > at __randomizedtesting.SeedInfo.seed([1EF0D91F3A098E50]:0)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:871)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:807)
[junit4] > at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1574)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1595)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:881)Throwable #6: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=61971, name=collection1, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:46906: Could not find collection : awholynewstresscollection_collection1_1
[junit4] > at __randomizedtesting.SeedInfo.seed([1EF0D91F3A098E50]:0)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:871)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:807)
[junit4] > at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:888)
[junit4] 2> 2483231 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[1EF0D91F3A098E50]-worker) [n:127.0.0.1:41121_ c:addReplicaColl s:shard2 r:core_node6 x:addReplicaColl_shard2_replica3] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: test params are: codec=FastCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST, chunkSize=4, maxDocsPerChunk=10, blockSize=975), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST, chunkSize=4, blockSize=975)), sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=ko_KR, timezone=Europe/Nicosia
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_66 (64-bit)/cpus=4,threads=1,free=129888400,total=487587840
[junit4] 2> NOTE: All tests run in this JVM: [TestCSVLoader, AnalyticsQueryTest, TestCopyFieldCollectionResource, SolrCoreTest, TestManagedSchema, TestPerFieldSimilarityWithDefaultOverride, AlternateDirectoryTest, RankQueryTest, TestFreeTextSuggestions, TestConfigSetsAPIExclusivity, BasicDistributedZkTest, BasicZkTest, DateRangeFieldTest, TestJsonRequest, PeerSyncTest, TestCloudPivotFacet, TestSha256AuthenticationProvider, TestCloudManagedSchemaConcurrent, TestDistributedSearch, HdfsLockFactoryTest, TestSolr4Spatial2, HttpPartitionTest, LeaderElectionIntegrationTest, DefaultValueUpdateProcessorTest, TestDocSet, TestMiniSolrCloudClusterBase, TestDistribDocBasedVersion, ExternalFileFieldSortTest, CdcrReplicationHandlerTest, ReturnFieldsTest, URLClassifyProcessorTest, TestOmitPositions, TestLMDirichletSimilarityFactory, ResourceLoaderTest, TestSolr4Spatial, BigEndianAscendingWordDeserializerTest, TestStressLucene, SuggestComponentContextFilterQueryTest, SystemInfoHandlerTest, TestSchemaVersionResource, CacheHeaderTest, OverseerRolesTest, TestRandomFaceting, PingRequestHandlerTest, TestRandomDVFaceting, HdfsThreadLeakTest, CursorPagingTest, AliasIntegrationTest, TestManagedSchemaFieldResource, CoreAdminCreateDiscoverTest, TestExpandComponent, TestFaceting, CachingDirectoryFactoryTest, TestAtomicUpdateErrorCases, SaslZkACLProviderTest, TestHighlightDedupGrouping, ZkStateWriterTest, OutOfBoxZkACLAndCredentialsProvidersTest, StandardRequestHandlerTest, TestSolrCloudWithKerberosAlt, TestSolrQueryParserResource, TestOrdValues, TestSearcherReuse, TestExceedMaxTermLength, TestRangeQuery, TestTrieFacet, DeleteLastCustomShardedReplicaTest, TestComponentsName, TestRawResponseWriter, DistributedFacetPivotLongTailTest, SynonymTokenizerTest, DistribCursorPagingTest, JsonLoaderTest, TestLuceneMatchVersion, XsltUpdateRequestHandlerTest, ResponseLogComponentTest, TestManagedSynonymFilterFactory, UUIDFieldTest, HdfsBasicDistributedZk2Test, SOLR749Test, DistributedFacetPivotWhiteBoxTest, OutputWriterTest, TestConfig, TestMacros, EchoParamsTest, SolrRequestParserTest, QueryEqualityTest, TestMissingGroups, InfoHandlerTest, CdcrUpdateLogTest, TestDistribIDF, TestCrossCoreJoin, TestRandomRequestDistribution, BasicDistributedZk2Test, UnloadDistributedZkTest, CollectionsAPIDistributedZkTest]
[junit4] Completed [285/566 (1!)] on J0 in 334.85s, 1 test, 1 error <<< FAILURES!
[...truncated 919 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:791: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:728: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1436: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:991: There were test failures: 566 suites (8 ignored), 2245 tests, 1 error, 33 ignored (18 assumptions) [seed: 1EF0D91F3A098E50]
Total time: 200 minutes 23 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 879 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/879/
3 tests failed.
FAILED: org.apache.solr.TestDistributedSearch.test
Error Message:
Captured an uncaught exception in thread: Thread[id=41366, name=Thread-34986, state=RUNNABLE, group=TGRP-TestDistributedSearch]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=41366, name=Thread-34986, state=RUNNABLE, group=TGRP-TestDistributedSearch]
at __randomizedtesting.SeedInfo.seed([5782BE7325D8DB38:DFD681A98B24B6C0]:0)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:57114/ai/collection1: java.lang.NullPointerException
at org.apache.solr.search.grouping.distributed.responseprocessor.TopGroupsShardResponseProcessor.process(TopGroupsShardResponseProcessor.java:105)
at org.apache.solr.handler.component.QueryComponent.handleGroupedResponses(QueryComponent.java:746)
at org.apache.solr.handler.component.QueryComponent.handleResponses(QueryComponent.java:729)
at org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:406)
at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:156)
at org.apache.solr.core.SolrCore.execute(SolrCore.java:2070)
at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:658)
at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:457)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:222)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:181)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1668)
at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:111)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1668)
at org.eclipse.jetty.servlets.GzipFilter.doFilter(GzipFilter.java:45)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1668)
at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:581)
at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1158)
at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:511)
at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1090)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:437)
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:119)
at org.eclipse.jetty.server.Server.handle(Server.java:517)
at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:308)
at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:242)
at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:261)
at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)
at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:75)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceAndRun(ExecuteProduceConsume.java:213)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:147)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:654)
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572)
at java.lang.Thread.run(Thread.java:745)
at __randomizedtesting.SeedInfo.seed([5782BE7325D8DB38]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:150)
at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:943)
at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:958)
at org.apache.solr.TestDistributedSearch$1.run(TestDistributedSearch.java:1115)
FAILED: org.apache.solr.cloud.TestRequestForwarding.testMultiCollectionQuery
Error Message:
Could not create collection. Response{responseHeader={status=0,QTime=90258},success={null={responseHeader={status=0,QTime=1610},core=collection1_shard1_replica1}},failure={null=org.apache.solr.client.solrj.SolrServerException:Timeout occured while waiting response from server at: http://127.0.0.1:48786/solr}}
Stack Trace:
java.lang.AssertionError: Could not create collection. Response{responseHeader={status=0,QTime=90258},success={null={responseHeader={status=0,QTime=1610},core=collection1_shard1_replica1}},failure={null=org.apache.solr.client.solrj.SolrServerException:Timeout occured while waiting response from server at: http://127.0.0.1:48786/solr}}
at __randomizedtesting.SeedInfo.seed([5782BE7325D8DB38:46F17942F9AEDE44]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.TestRequestForwarding.createCollection(TestRequestForwarding.java:87)
at org.apache.solr.cloud.TestRequestForwarding.testMultiCollectionQuery(TestRequestForwarding.java:57)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest.test
Error Message:
shard3 is not consistent. Got 522 from https://127.0.0.1:55468/collection1 (previous client) and got 184 from https://127.0.0.1:47547/collection1
Stack Trace:
java.lang.AssertionError: shard3 is not consistent. Got 522 from https://127.0.0.1:55468/collection1 (previous client) and got 184 from https://127.0.0.1:47547/collection1
at __randomizedtesting.SeedInfo.seed([5782BE7325D8DB38:DFD681A98B24B6C0]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1246)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1225)
at org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.test(ChaosMonkeySafeLeaderTest.java:172)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:965)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:940)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 10337 lines...]
[junit4] Suite: org.apache.solr.cloud.TestRequestForwarding
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.TestRequestForwarding_5782BE7325D8DB38-001/init-core-data-001
[junit4] 2> 963881 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testMultiCollectionQuery
[junit4] 2> 963882 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 963882 INFO (Thread-1602) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 963882 INFO (Thread-1602) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 963982 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.ZkTestServer start zk server on port:37485
[junit4] 2> 963983 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 964015 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 964025 INFO (zkCallback-1119-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@40e0c451 name:ZooKeeperConnection Watcher:127.0.0.1:37485 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 964025 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 964025 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 964025 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr/solr.xml
[junit4] 2> 964035 INFO (jetty-launcher-1118-thread-1) [ ] o.e.j.s.Server jetty-9.3.6.v20151106
[junit4] 2> 964039 INFO (jetty-launcher-1118-thread-2) [ ] o.e.j.s.Server jetty-9.3.6.v20151106
[junit4] 2> 964042 INFO (jetty-launcher-1118-thread-3) [ ] o.e.j.s.Server jetty-9.3.6.v20151106
[junit4] 2> 964051 INFO (jetty-launcher-1118-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2610fd17{/solr,null,AVAILABLE}
[junit4] 2> 964052 INFO (jetty-launcher-1118-thread-2) [ ] o.e.j.s.ServerConnector Started ServerConnector@5dc6e856{HTTP/1.1,[http/1.1]}{127.0.0.1:40978}
[junit4] 2> 964052 INFO (jetty-launcher-1118-thread-2) [ ] o.e.j.s.Server Started @967389ms
[junit4] 2> 964053 INFO (jetty-launcher-1118-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=40978}
[junit4] 2> 964053 INFO (jetty-launcher-1118-thread-2) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 964053 INFO (jetty-launcher-1118-thread-2) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.TestRequestForwarding_5782BE7325D8DB38-001/tempDir-001/node1'
[junit4] 2> 964053 INFO (jetty-launcher-1118-thread-2) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 964053 INFO (jetty-launcher-1118-thread-2) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 964053 INFO (jetty-launcher-1118-thread-2) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 964054 INFO (jetty-launcher-1118-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@42c543e1{/solr,null,AVAILABLE}
[junit4] 2> 964056 INFO (jetty-launcher-1118-thread-3) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@613aa27f{/solr,null,AVAILABLE}
[junit4] 2> 964056 INFO (jetty-launcher-1118-thread-3) [ ] o.e.j.s.ServerConnector Started ServerConnector@a09bcc{HTTP/1.1,[http/1.1]}{127.0.0.1:48786}
[junit4] 2> 964056 INFO (jetty-launcher-1118-thread-3) [ ] o.e.j.s.Server Started @967393ms
[junit4] 2> 964056 INFO (jetty-launcher-1118-thread-3) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=48786}
[junit4] 2> 964056 INFO (jetty-launcher-1118-thread-3) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 964056 INFO (jetty-launcher-1118-thread-3) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.TestRequestForwarding_5782BE7325D8DB38-001/tempDir-001/node3'
[junit4] 2> 964056 INFO (jetty-launcher-1118-thread-3) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 964056 INFO (jetty-launcher-1118-thread-3) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 964057 INFO (jetty-launcher-1118-thread-3) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 964057 INFO (jetty-launcher-1118-thread-3) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 964062 INFO (jetty-launcher-1118-thread-2) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 964067 INFO (jetty-launcher-1118-thread-1) [ ] o.e.j.s.ServerConnector Started ServerConnector@2f3faa8c{HTTP/1.1,[http/1.1]}{127.0.0.1:43269}
[junit4] 2> 964067 INFO (jetty-launcher-1118-thread-1) [ ] o.e.j.s.Server Started @967403ms
[junit4] 2> 964067 INFO (jetty-launcher-1118-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=43269}
[junit4] 2> 964067 INFO (jetty-launcher-1118-thread-1) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 964067 INFO (jetty-launcher-1118-thread-1) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.TestRequestForwarding_5782BE7325D8DB38-001/tempDir-001/node2'
[junit4] 2> 964067 INFO (jetty-launcher-1118-thread-1) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 964067 INFO (jetty-launcher-1118-thread-1) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 964068 INFO (jetty-launcher-1118-thread-1) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 964068 INFO (jetty-launcher-1118-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 964071 INFO (zkCallback-1120-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@252baa1f name:ZooKeeperConnection Watcher:127.0.0.1:37485/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 964072 INFO (jetty-launcher-1118-thread-2) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 964072 INFO (zkCallback-1121-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@43cac844 name:ZooKeeperConnection Watcher:127.0.0.1:37485/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 964072 INFO (jetty-launcher-1118-thread-2) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 964072 INFO (jetty-launcher-1118-thread-3) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 964072 INFO (jetty-launcher-1118-thread-3) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 964074 INFO (zkCallback-1122-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@533e8a37 name:ZooKeeperConnection Watcher:127.0.0.1:37485/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 964075 INFO (jetty-launcher-1118-thread-3) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 964075 INFO (jetty-launcher-1118-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 964075 INFO (jetty-launcher-1118-thread-1) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 964075 INFO (jetty-launcher-1118-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 964078 INFO (jetty-launcher-1118-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 964083 INFO (jetty-launcher-1118-thread-1) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.TestRequestForwarding_5782BE7325D8DB38-001/tempDir-001/node2/.
[junit4] 2> 964084 INFO (jetty-launcher-1118-thread-1) [ ] o.a.s.c.CoreContainer New CoreContainer 730031114
[junit4] 2> 964084 INFO (jetty-launcher-1118-thread-1) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.TestRequestForwarding_5782BE7325D8DB38-001/tempDir-001/node2]
[junit4] 2> 964084 WARN (jetty-launcher-1118-thread-1) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.TestRequestForwarding_5782BE7325D8DB38-001/tempDir-001/node2/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.TestRequestForwarding_5782BE7325D8DB38-001/tempDir-001/node2/lib
[junit4] 2> 964088 INFO (jetty-launcher-1118-thread-3) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.TestRequestForwarding_5782BE7325D8DB38-001/tempDir-001/node3/.
[junit4] 2> 964089 INFO (jetty-launcher-1118-thread-1) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 964089 INFO (jetty-launcher-1118-thread-3) [ ] o.a.s.c.CoreContainer New CoreContainer 325915103
[junit4] 2> 964089 INFO (jetty-launcher-1118-thread-3) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.TestRequestForwarding_5782BE7325D8DB38-001/tempDir-001/node3]
[junit4] 2> 964089 WARN (jetty-launcher-1118-thread-3) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.TestRequestForwarding_5782BE7325D8DB38-001/tempDir-001/node3/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.TestRequestForwarding_5782BE7325D8DB38-001/tempDir-001/node3/lib
[junit4] 2> 964089 INFO (jetty-launcher-1118-thread-3) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 964088 INFO (jetty-launcher-1118-thread-2) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.TestRequestForwarding_5782BE7325D8DB38-001/tempDir-001/node1/.
[junit4] 2> 964090 INFO (jetty-launcher-1118-thread-2) [ ] o.a.s.c.CoreContainer New CoreContainer 101235799
[junit4] 2> 964090 INFO (jetty-launcher-1118-thread-2) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.TestRequestForwarding_5782BE7325D8DB38-001/tempDir-001/node1]
[junit4] 2> 964090 INFO (jetty-launcher-1118-thread-3) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 964090 WARN (jetty-launcher-1118-thread-2) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.TestRequestForwarding_5782BE7325D8DB38-001/tempDir-001/node1/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.TestRequestForwarding_5782BE7325D8DB38-001/tempDir-001/node1/lib
[junit4] 2> 964090 INFO (jetty-launcher-1118-thread-2) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 964090 INFO (jetty-launcher-1118-thread-3) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 964090 INFO (jetty-launcher-1118-thread-3) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 964090 INFO (jetty-launcher-1118-thread-3) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:37485/solr
[junit4] 2> 964091 INFO (jetty-launcher-1118-thread-3) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 964091 INFO (jetty-launcher-1118-thread-3) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 964091 INFO (jetty-launcher-1118-thread-2) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 964092 INFO (jetty-launcher-1118-thread-2) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 964092 INFO (jetty-launcher-1118-thread-2) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 964092 INFO (jetty-launcher-1118-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:37485/solr
[junit4] 2> 964092 INFO (jetty-launcher-1118-thread-2) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 964092 INFO (jetty-launcher-1118-thread-2) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 964092 INFO (jetty-launcher-1118-thread-1) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 964093 INFO (jetty-launcher-1118-thread-1) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 964093 INFO (jetty-launcher-1118-thread-1) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 964093 INFO (jetty-launcher-1118-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:37485/solr
[junit4] 2> 964093 INFO (jetty-launcher-1118-thread-1) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 964093 INFO (jetty-launcher-1118-thread-1) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 964094 INFO (jetty-launcher-1118-thread-2) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 964092 INFO (jetty-launcher-1118-thread-3) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 964095 INFO (jetty-launcher-1118-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 964150 INFO (zkCallback-1126-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6c85fba6 name:ZooKeeperConnection Watcher:127.0.0.1:37485 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 964150 INFO (jetty-launcher-1118-thread-2) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 964151 INFO (jetty-launcher-1118-thread-2) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 964175 INFO (zkCallback-1128-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@db2b31b name:ZooKeeperConnection Watcher:127.0.0.1:37485 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 964175 INFO (jetty-launcher-1118-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 964176 INFO (jetty-launcher-1118-thread-1) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 964194 INFO (jetty-launcher-1118-thread-2) [n:127.0.0.1:40978_solr ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 964194 INFO (zkCallback-1124-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@373a8f03 name:ZooKeeperConnection Watcher:127.0.0.1:37485 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 964205 INFO (jetty-launcher-1118-thread-3) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 964205 INFO (jetty-launcher-1118-thread-3) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 964227 INFO (zkCallback-1129-thread-1-processing-n:127.0.0.1:40978_solr) [n:127.0.0.1:40978_solr ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@285588a8 name:ZooKeeperConnection Watcher:127.0.0.1:37485/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 964227 INFO (jetty-launcher-1118-thread-2) [n:127.0.0.1:40978_solr ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 964253 INFO (jetty-launcher-1118-thread-1) [n:127.0.0.1:43269_solr ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 964261 INFO (jetty-launcher-1118-thread-2) [n:127.0.0.1:40978_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
[junit4] 2> 964262 INFO (jetty-launcher-1118-thread-2) [n:127.0.0.1:40978_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 964264 INFO (jetty-launcher-1118-thread-2) [n:127.0.0.1:40978_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 964266 INFO (jetty-launcher-1118-thread-2) [n:127.0.0.1:40978_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 964267 INFO (jetty-launcher-1118-thread-2) [n:127.0.0.1:40978_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 964268 INFO (jetty-launcher-1118-thread-2) [n:127.0.0.1:40978_solr ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 964269 INFO (jetty-launcher-1118-thread-2) [n:127.0.0.1:40978_solr ] o.a.s.c.c.SolrZkClient makePath: /collections
[junit4] 2> 964272 INFO (jetty-launcher-1118-thread-2) [n:127.0.0.1:40978_solr ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 964272 INFO (jetty-launcher-1118-thread-2) [n:127.0.0.1:40978_solr ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 964273 INFO (jetty-launcher-1118-thread-2) [n:127.0.0.1:40978_solr ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 964274 INFO (jetty-launcher-1118-thread-2) [n:127.0.0.1:40978_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40978_solr
[junit4] 2> 964274 INFO (jetty-launcher-1118-thread-2) [n:127.0.0.1:40978_solr ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:40978_solr
[junit4] 2> 964275 INFO (jetty-launcher-1118-thread-2) [n:127.0.0.1:40978_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 964276 INFO (jetty-launcher-1118-thread-2) [n:127.0.0.1:40978_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 964277 INFO (jetty-launcher-1118-thread-2) [n:127.0.0.1:40978_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 964277 INFO (jetty-launcher-1118-thread-2) [n:127.0.0.1:40978_solr ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95018149253480455-127.0.0.1:40978_solr-n_0000000000
[junit4] 2> 964278 INFO (jetty-launcher-1118-thread-2) [n:127.0.0.1:40978_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:40978_solr
[junit4] 2> 964278 INFO (jetty-launcher-1118-thread-2) [n:127.0.0.1:40978_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
[junit4] 2> 964279 INFO (jetty-launcher-1118-thread-2) [n:127.0.0.1:40978_solr ] o.a.s.c.Overseer Overseer (id=95018149253480455-127.0.0.1:40978_solr-n_0000000000) starting
[junit4] 2> 964280 INFO (jetty-launcher-1118-thread-2) [n:127.0.0.1:40978_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
[junit4] 2> 964282 INFO (jetty-launcher-1118-thread-3) [n:127.0.0.1:48786_solr ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 964294 INFO (jetty-launcher-1118-thread-2) [n:127.0.0.1:40978_solr ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 964294 INFO (zkCallback-1130-thread-1-processing-n:127.0.0.1:43269_solr) [n:127.0.0.1:43269_solr ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7953df19 name:ZooKeeperConnection Watcher:127.0.0.1:37485/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 964294 INFO (jetty-launcher-1118-thread-1) [n:127.0.0.1:43269_solr ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 964310 INFO (jetty-launcher-1118-thread-1) [n:127.0.0.1:43269_solr ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 964327 INFO (OverseerStateUpdate-95018149253480455-127.0.0.1:40978_solr-n_0000000000) [n:127.0.0.1:40978_solr ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 964327 INFO (OverseerStateUpdate-95018149253480455-127.0.0.1:40978_solr-n_0000000000) [n:127.0.0.1:40978_solr ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 964330 INFO (OverseerCollectionConfigSetProcessor-95018149253480455-127.0.0.1:40978_solr-n_0000000000) [n:127.0.0.1:40978_solr ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
[junit4] 2> 964342 INFO (jetty-launcher-1118-thread-2) [n:127.0.0.1:40978_solr ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 964346 INFO (zkCallback-1131-thread-1-processing-n:127.0.0.1:48786_solr) [n:127.0.0.1:48786_solr ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@23ea7fc9 name:ZooKeeperConnection Watcher:127.0.0.1:37485/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 964346 INFO (jetty-launcher-1118-thread-3) [n:127.0.0.1:48786_solr ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 964362 INFO (jetty-launcher-1118-thread-3) [n:127.0.0.1:48786_solr ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 964365 INFO (jetty-launcher-1118-thread-2) [n:127.0.0.1:40978_solr ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 964365 INFO (jetty-launcher-1118-thread-2) [n:127.0.0.1:40978_solr ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 964365 INFO (jetty-launcher-1118-thread-2) [n:127.0.0.1:40978_solr ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.TestRequestForwarding_5782BE7325D8DB38-001/tempDir-001/node1/.
[junit4] 2> 964366 INFO (jetty-launcher-1118-thread-2) [n:127.0.0.1:40978_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions
[junit4] 2> 964390 INFO (jetty-launcher-1118-thread-2) [n:127.0.0.1:40978_solr ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4] 2> 964390 INFO (jetty-launcher-1118-thread-2) [n:127.0.0.1:40978_solr ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 965361 INFO (jetty-launcher-1118-thread-1) [n:127.0.0.1:43269_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43269_solr
[junit4] 2> 965362 INFO (jetty-launcher-1118-thread-1) [n:127.0.0.1:43269_solr ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:43269_solr
[junit4] 2> 965363 INFO (zkCallback-1131-thread-1-processing-n:127.0.0.1:48786_solr) [n:127.0.0.1:48786_solr ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 965363 INFO (zkCallback-1129-thread-1-processing-n:127.0.0.1:40978_solr) [n:127.0.0.1:40978_solr ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 965364 INFO (jetty-launcher-1118-thread-1) [n:127.0.0.1:43269_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 965364 INFO (jetty-launcher-1118-thread-1) [n:127.0.0.1:43269_solr ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95018149253480456-127.0.0.1:43269_solr-n_0000000001
[junit4] 2> 965365 INFO (jetty-launcher-1118-thread-1) [n:127.0.0.1:43269_solr ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/95018149253480455-127.0.0.1:40978_solr-n_0000000000 to know if I could be the leader
[junit4] 2> 965365 INFO (jetty-launcher-1118-thread-3) [n:127.0.0.1:48786_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48786_solr
[junit4] 2> 965365 INFO (jetty-launcher-1118-thread-3) [n:127.0.0.1:48786_solr ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:48786_solr
[junit4] 2> 965367 INFO (jetty-launcher-1118-thread-3) [n:127.0.0.1:48786_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 965367 INFO (jetty-launcher-1118-thread-3) [n:127.0.0.1:48786_solr ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95018149253480457-127.0.0.1:48786_solr-n_0000000002
[junit4] 2> 965368 INFO (zkCallback-1129-thread-1-processing-n:127.0.0.1:40978_solr) [n:127.0.0.1:40978_solr ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4] 2> 965368 INFO (jetty-launcher-1118-thread-3) [n:127.0.0.1:48786_solr ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/95018149253480456-127.0.0.1:43269_solr-n_0000000001 to know if I could be the leader
[junit4] 2> 965368 INFO (zkCallback-1129-thread-2-processing-n:127.0.0.1:40978_solr) [n:127.0.0.1:40978_solr ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4] 2> 965377 INFO (jetty-launcher-1118-thread-1) [n:127.0.0.1:43269_solr ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 965377 INFO (jetty-launcher-1118-thread-1) [n:127.0.0.1:43269_solr ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 965385 INFO (zkCallback-1130-thread-1-processing-n:127.0.0.1:43269_solr) [n:127.0.0.1:43269_solr ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 965385 INFO (zkCallback-1131-thread-2-processing-n:127.0.0.1:48786_solr) [n:127.0.0.1:48786_solr ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 965386 INFO (jetty-launcher-1118-thread-1) [n:127.0.0.1:43269_solr ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.TestRequestForwarding_5782BE7325D8DB38-001/tempDir-001/node2/.
[junit4] 2> 965386 INFO (jetty-launcher-1118-thread-1) [n:127.0.0.1:43269_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions
[junit4] 2> 965394 INFO (jetty-launcher-1118-thread-1) [n:127.0.0.1:43269_solr ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4] 2> 965394 INFO (jetty-launcher-1118-thread-1) [n:127.0.0.1:43269_solr ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 965403 INFO (jetty-launcher-1118-thread-3) [n:127.0.0.1:48786_solr ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 965403 INFO (jetty-launcher-1118-thread-3) [n:127.0.0.1:48786_solr ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 965404 INFO (jetty-launcher-1118-thread-3) [n:127.0.0.1:48786_solr ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.TestRequestForwarding_5782BE7325D8DB38-001/tempDir-001/node3/.
[junit4] 2> 965404 INFO (jetty-launcher-1118-thread-3) [n:127.0.0.1:48786_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions
[junit4] 2> 965405 INFO (jetty-launcher-1118-thread-3) [n:127.0.0.1:48786_solr ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4] 2> 965405 INFO (jetty-launcher-1118-thread-3) [n:127.0.0.1:48786_solr ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 965405 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 965406 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 965411 INFO (zkCallback-1132-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@69ad1bec name:ZooKeeperConnection Watcher:127.0.0.1:37485 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 965411 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 965411 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 965414 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 965422 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 965424 INFO (zkCallback-1134-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@58d3a9c0 name:ZooKeeperConnection Watcher:127.0.0.1:37485/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 965424 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 965424 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 965425 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-spellcheckcomponent.xml
[junit4] 2> 965427 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-null-charfilters-analyzer.xml
[junit4] 2> 965429 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/regex-boost-processor-test.txt
[junit4] 2> 965430 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-spellchecker.xml
[junit4] 2> 965432 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-multiple-asterisk-copyfield-dest-should-fail-test.xml
[junit4] 2> 965433 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-docValuesFaceting.xml
[junit4] 2> 965435 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-tlog-with-delayingcomponent.xml
[junit4] 2> 965436 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-currency-ft-bogus-default-code.xml
[junit4] 2> 965438 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-numeric.xml
[junit4] 2> 965439 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig_codec.xml
[junit4] 2> 965441 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-multiple-asterisk-copyfield-source-should-fail-test.xml
[junit4] 2> 965443 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema_latest.xml
[junit4] 2> 965444 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-sorts.xml
[junit4] 2> 965446 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-headers.xml
[junit4] 2> 965447 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-implicitproperties.xml
[junit4] 2> 965449 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-solrconfig-bogus-scriptengine-name.xml
[junit4] 2> 965450 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-snippet-types.incl
[junit4] 2> 965452 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-parsing-update-processor-chains.xml
[junit4] 2> 965453 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-docValuesMissing.xml
[junit4] 2> 965455 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-noopregen.xml
[junit4] 2> 965456 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-one-field-no-dynamic-field-unique-key.xml
[junit4] 2> 965457 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-script-updateprocessor.xml
[junit4] 2> 965459 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-error-solrconfig.xml
[junit4] 2> 965460 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-suggestercomponent.xml
[junit4] 2> 965462 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-currency.xml
[junit4] 2> 965464 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-query-parser-init.xml
[junit4] 2> 965465 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-caching.xml
[junit4] 2> 965467 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/conditional.updateprocessor.js
[junit4] 2> 965468 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/compoundDictionary.txt
[junit4] 2> 965471 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/phrasesuggest.txt
[junit4] 2> 965472 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-transformers.xml
[junit4] 2> 965474 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-not-indexed-but-norms.xml
[junit4] 2> 965475 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/blendedInfixSuggest.txt
[junit4] 2> 965476 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-phrasesuggest.xml
[junit4] 2> 965478 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/hunspell-test.dic
[junit4] 2> 965479 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-HighlighterMaxOffsetTest.xml
[junit4] 2> 965481 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-rest-lucene-match-version.xml
[junit4] 2> 965482 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-functionquery.xml
[junit4] 2> 965484 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-externalversionconstraint.xml
[junit4] 2> 965485 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-codec-global-vs-ft-mismatch.xml
[junit4] 2> 965490 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-sim.xml
[junit4] 2> 965492 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-docValuesMulti.xml
[junit4] 2> 965494 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-collapseqparser.xml
[junit4] 2> 965496 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-analytics-query.xml
[junit4] 2> 965498 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-sweetspot.xml
[junit4] 2> 965500 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-searcher-listeners1.xml
[junit4] 2> 965502 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-id-and-version-fields-only.xml
[junit4] 2> 965504 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-solrconfig-schema-mutable-but-not-managed.xml
[junit4] 2> 965505 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/hunspell-test.aff
[junit4] 2> 965507 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-response-log-component.xml
[junit4] 2> 965508 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-sim-default-does-not-exist.xml
[junit4] 2> 965510 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-dynamicfield-required.xml
[junit4] 2> 965523 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-not-indexed-but-pos.xml
[junit4] 2> 965525 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-hash.xml
[junit4] 2> 965526 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-components-name.xml
[junit4] 2> 965527 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-mp-solrconfig.xml
[junit4] 2> 965528 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 965530 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-xinclude.xml
[junit4] 2> 965531 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/cross-compatible.js
[junit4] 2> 965532 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig_perf.xml
[junit4] 2> 965533 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-solrconfig-invalid-scriptfile.xml
[junit4] 2> 965535 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-basic.xml
[junit4] 2> 965536 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-sql.xml
[junit4] 2> 965537 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-replication1.xml
[junit4] 2> 965543 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-solrconfig-missing-scriptfile.xml
[junit4] 2> 965544 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-altdirectory.xml
[junit4] 2> 965545 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-distributed-missing-sort.xml
[junit4] 2> 965547 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 965548 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-tfidf.xml
[junit4] 2> 965549 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/jasuggest.txt
[junit4] 2> 965551 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-dup-field.xml
[junit4] 2> 965552 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-cdcrupdatelog.xml
[junit4] 2> 965553 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/fuzzysuggest.txt
[junit4] 2> 965554 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-minimal.xml
[junit4] 2> 965556 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-highlight.xml
[junit4] 2> 965557 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-tieredmergepolicy.xml
[junit4] 2> 965559 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-version-indexed.xml
[junit4] 2> 965560 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-unsupported-docValues.xml
[junit4] 2> 965561 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 965563 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-lmdirichlet.xml
[junit4] 2> 965564 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-synonym-tokenizer.xml
[junit4] 2> 965565 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stop-2.txt
[junit4] 2> 965571 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-sim-default-override.xml
[junit4] 2> 965572 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-plugcollector.xml
[junit4] 2> 965574 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-managed-schema-test.xml
[junit4] 2> 965575 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-uniquekey-uses-default.xml
[junit4] 2> 965576 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-sim-global-vs-ft-mismatch.xml
[junit4] 2> 965578 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-warmer.xml
[junit4] 2> 965579 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema11.xml
[junit4] 2> 965581 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-tlog.xml
[junit4] 2> 965582 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-withgethandler.xml
[junit4] 2> 965583 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-lmjelinekmercer.xml
[junit4] 2> 965585 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema12.xml
[junit4] 2> 965586 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-SOLR-749.xml
[junit4] 2> 965588 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-sweetspot-partial-hyperbolic.xml
[junit4] 2> 965591 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-master2.xml
[junit4] 2> 965592 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-bm25.xml
[junit4] 2> 965593 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 965595 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-preanalyzed.xml
[junit4] 2> 965596 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-snippet-type.xml
[junit4] 2> 965606 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-suggestercomponent-context-filter-query.xml
[junit4] 2> 965611 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-distrib-interval-faceting.xml
[junit4] 2> 965612 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-master1.xml
[junit4] 2> 965614 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-currency-ft-oer-norates.xml
[junit4] 2> 965615 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-schemaless.xml
[junit4] 2> 965616 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-dynamicfield-default-val.xml
[junit4] 2> 965618 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-sweetspot-partial-norms.xml
[junit4] 2> 965622 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/elevate.xml
[junit4] 2> 965639 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-required-fields.xml
[junit4] 2> 965640 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-doc-expire-update-processor.xml
[junit4] 2> 965642 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-charfilters.xml
[junit4] 2> 965643 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-querysender.xml
[junit4] 2> 965644 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-nontext-analyzer.xml
[junit4] 2> 965645 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/frenchArticles.txt
[junit4] 2> 965646 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-tolerant-search.xml
[junit4] 2> 965648 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-sim-default-has-no-explicit-sim.xml
[junit4] 2> 965649 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
[junit4] 2> 965650 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-update-processor-chains.xml
[junit4] 2> 965651 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-rest.xml
[junit4] 2> 965653 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/trivial.updateprocessor0.js
[junit4] 2> 965654 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-mergepolicy-nocfs.xml
[junit4] 2> 965656 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-reqHandler.incl
[junit4] 2> 965657 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
[junit4] 2> 965658 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-spellchecker.xml
[junit4] 2> 965659 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-doctransformers.xml
[junit4] 2> 965661 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-reversed.xml
[junit4] 2> 965662 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-managed-schema.xml
[junit4] 2> 965663 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-omit-tf-but-not-pos.xml
[junit4] 2> 965664 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-solcoreproperties.xml
[junit4] 2> 965665 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
[junit4] 2> 965667 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/keep-1.txt
[junit4] 2> 965668 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/throw.error.on.add.updateprocessor.js
[junit4] 2> 965669 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-master-throttled.xml
[junit4] 2> 965671 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-single-dynamic-copy-field.xml
[junit4] 2> 965672 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-xinclude.xml
[junit4] 2> 965673 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-elevate.xml
[junit4] 2> 965675 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stoptypes-2.txt
[junit4] 2> 965676 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-complex-phrase.xml
[junit4] 2> 965677 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-master1-keepOneBackup.xml
[junit4] 2> 965678 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-bogus-analysis-parameters.xml
[junit4] 2> 965680 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stemdict.txt
[junit4] 2> 965681 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-trie.xml
[junit4] 2> 965682 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/wdftypes.txt
[junit4] 2> 965683 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-slave1.xml
[junit4] 2> 965699 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-defaults.xml
[junit4] 2> 965700 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-graph.xml
[junit4] 2> 965702 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-external-filefield.xml
[junit4] 2> 965703 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-docValues.xml
[junit4] 2> 965704 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-delpolicy2.xml
[junit4] 2> 965705 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schemasurround.xml
[junit4] 2> 965707 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-test-misc.xml
[junit4] 2> 965708 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema15.xml
[junit4] 2> 965709 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-class-name-shortening-on-serialization.xml
[junit4] 2> 965711 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-add-schema-fields-update-processor.xml
[junit4] 2> 965712 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-collate.xml
[junit4] 2> 965713 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 965715 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-snippet-field.xml
[junit4] 2> 965716 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-indexconfig.xml
[junit4] 2> 965717 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad_solrconfig.xml
[junit4] 2> 965718 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-eff.xml
[junit4] 2> 965720 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-uniquekey-multivalued.xml
[junit4] 2> 965721 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-solrconfig-nrtmode.xml
[junit4] 2> 965723 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/analyzingInfixSuggest.txt
[junit4] 2> 965724 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-repeater.xml
[junit4] 2> 965725 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-spatial.xml
[junit4] 2> 965726 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-hash.xml
[junit4] 2> 965728 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-spatial.xml
[junit4] 2> 965729 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-field-sort-values.xml
[junit4] 2> 965730 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stoptypes-1.txt
[junit4] 2> 965731 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-init-error.xml
[junit4] 2> 965733 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-customfield.xml
[junit4] 2> 965734 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-solrconfig-managed-schema-named-schema.xml.xml
[junit4] 2> 965735 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-paramset.xml
[junit4] 2> 965736 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-dup-dynamicField.xml
[junit4] 2> 965737 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
[junit4] 2> 965739 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-folding.xml
[junit4] 2> 965740 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwithbom.txt
[junit4] 2> 965741 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/missleading.extension.updateprocessor.js.txt
[junit4] 2> 965742 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-currency-dynamic-multivalued.xml
[junit4] 2> 965744 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-binaryfield.xml
[junit4] 2> 965745 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-slave.xml
[junit4] 2> 965746 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-luceneMatchVersion.xml
[junit4] 2> 965747 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-cdcr.xml
[junit4] 2> 965748 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-sortingresponse.xml
[junit4] 2> 965750 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-sweetspot-partial-baseline.xml
[junit4] 2> 965751 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-stop-keep.xml
[junit4] 2> 965752 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-infostream-logging.xml
[junit4] 2> 965753 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-uniquekey-is-copyfield-dest.xml
[junit4] 2> 965761 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-master.xml
[junit4] 2> 965762 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-replication2.xml
[junit4] 2> 965763 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-currency-ft-bogus-code-in-xml.xml
[junit4] 2> 965765 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/addfields.updateprocessor.js
[junit4] 2> 965766 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-dfr.xml
[junit4] 2> 965767 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-enums.xml
[junit4] 2> 965768 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-delpolicy1.xml
[junit4] 2> 965769 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-minimal.xml
[junit4] 2> 965770 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-solrconfig-multiple-cfs.xml
[junit4] 2> 965772 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/trivial.updateprocessor1.js
[junit4] 2> 965773 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/missing.functions.updateprocessor.js
[junit4] 2> 965774 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-solrconfig-multiple-dirfactory.xml
[junit4] 2> 965775 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 965776 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-misplaced-asterisk-copyfield-source-should-fail-test.xml
[junit4] 2> 965778 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-add-schema-fields-update-processor-chains.xml
[junit4] 2> 965779 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-version-dv.xml
[junit4] 2> 965780 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-delaying-component.xml
[junit4] 2> 965781 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-custom-field.xml
[junit4] 2> 965783 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-ib.xml
[junit4] 2> 965784 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/keep-2.txt
[junit4] 2> 965785 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-one-field-no-dynamic-field.xml
[junit4] 2> 965786 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-not-required-unique-key.xml
[junit4] 2> 965788 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/hyphenation.dtd
[junit4] 2> 965789 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-sql.xml
[junit4] 2> 965790 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-copyfield-test.xml
[junit4] 2> 965791 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-analyzer-class-and-nested.xml
[junit4] 2> 965792 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-currency-ft-multivalued.xml
[junit4] 2> 965794 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-querysender-noquery.xml
[junit4] 2> 965795 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-phrasesuggest.xml
[junit4] 2> 965796 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[5782BE7325D8DB38]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf
[...truncated too long message...]
kins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-changelog-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-collective-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-event-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-exception-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-journal-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-normalization-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-operational-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-referral-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-schema-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-subtree-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-trigger-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-jdbm-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-jdbm1-2.0.0-M2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-kerberos-codec-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-ldif-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-mavibot-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-protocol-kerberos-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-protocol-ldap-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-protocol-shared-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-xdbm-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/api-all-1.0.0-M20.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/bcprov-jdk15-1.45.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/cglib-nodep-2.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/commons-collections-3.2.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/commons-math3-3.4.1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/easymock-3.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/ehcache-core-2.4.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/hadoop-common-2.6.0-tests.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/hadoop-hdfs-2.6.0-tests.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/hadoop-minikdc-2.6.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/jackson-annotations-2.5.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/jackson-databind-2.5.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/jersey-core-1.9.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/jersey-server-1.9.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/jetty-6.1.26.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/jetty-util-6.1.26.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/mina-core-2.0.0-M5.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/objenesis-1.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/presto-parser-0.122.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/slice-0.10.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/analysis/icu/lucene-analyzers-icu-6.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-analysis-extras/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/contrib/analysis-extras/lib/icu4j-54.1.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-launcher.jar:/x1/jenkins/.ant/lib/ivy-2.3.0.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-antlr.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-regexp.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-resolver.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-commons-net.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jmf.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-oro.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-xalan2.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-commons-logging.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jsch.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-junit4.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-javamail.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jai.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jdepend.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-junit.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-bsf.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-swing.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-netrexx.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-bcel.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-testutil.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-log4j.jar:/x1/jenkins/jenkins-slave/tools/hudson.model.JDK/latest1.8/lib/tools.jar:/x1/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.3.2.jar com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe -eventsfile /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/temp/junit4-J1-20151211_190849_122.events @/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/temp/junit4-J1-20151211_190849_122.suites -stdin
[junit4] ERROR: JVM J1 ended with an exception: Quit event not received from the forked process? This may indicate JVM crash or runner bugs.
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4.executeSlave(JUnit4.java:1501)
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4.access$000(JUnit4.java:121)
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:955)
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:952)
[junit4] at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] at java.lang.Thread.run(Thread.java:745)
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:791: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:728: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1436: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:991: At least one slave process threw an exception, first: Quit event not received from the forked process? This may indicate JVM crash or runner bugs.
Total time: 278 minutes 46 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 878 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/878/
2 tests failed.
FAILED: org.apache.solr.hadoop.MorphlineBasicMiniMRTest.mrRun
Error Message:
Failed on local exception: java.io.IOException: Broken pipe; Host Details : local host is: "lucene1-us-west/10.41.0.5"; destination host is: "lucene1-us-west.apache.org":34973;
Stack Trace:
java.io.IOException: Failed on local exception: java.io.IOException: Broken pipe; Host Details : local host is: "lucene1-us-west/10.41.0.5"; destination host is: "lucene1-us-west.apache.org":34973;
at __randomizedtesting.SeedInfo.seed([DB854BE53D4F9D71:D5D7FFEB3CD9AF7E]:0)
at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:772)
at org.apache.hadoop.ipc.Client.call(Client.java:1472)
at org.apache.hadoop.ipc.Client.call(Client.java:1399)
at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232)
at com.sun.proxy.$Proxy110.getClusterMetrics(Unknown Source)
at org.apache.hadoop.yarn.api.impl.pb.client.ApplicationClientProtocolPBClientImpl.getClusterMetrics(ApplicationClientProtocolPBClientImpl.java:202)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
at com.sun.proxy.$Proxy111.getClusterMetrics(Unknown Source)
at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.getYarnClusterMetrics(YarnClientImpl.java:461)
at org.apache.hadoop.mapred.ResourceMgrDelegate.getClusterMetrics(ResourceMgrDelegate.java:151)
at org.apache.hadoop.mapred.YARNRunner.getClusterMetrics(YARNRunner.java:179)
at org.apache.hadoop.mapreduce.Cluster.getClusterStatus(Cluster.java:246)
at org.apache.hadoop.mapred.JobClient$3.run(JobClient.java:719)
at org.apache.hadoop.mapred.JobClient$3.run(JobClient.java:717)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.hadoop.mapred.JobClient.getClusterStatus(JobClient.java:717)
at org.apache.solr.hadoop.MapReduceIndexerTool.run(MapReduceIndexerTool.java:645)
at org.apache.solr.hadoop.MapReduceIndexerTool.run(MapReduceIndexerTool.java:608)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.solr.hadoop.MorphlineBasicMiniMRTest.mrRun(MorphlineBasicMiniMRTest.java:363)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: Broken pipe
at sun.nio.ch.FileDispatcherImpl.write0(Native Method)
at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47)
at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)
at sun.nio.ch.IOUtil.write(IOUtil.java:65)
at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:471)
at org.apache.hadoop.net.SocketOutputStream$Writer.performIO(SocketOutputStream.java:63)
at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:142)
at org.apache.hadoop.net.SocketOutputStream.write(SocketOutputStream.java:159)
at org.apache.hadoop.net.SocketOutputStream.write(SocketOutputStream.java:117)
at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140)
at java.io.DataOutputStream.flush(DataOutputStream.java:123)
at org.apache.hadoop.ipc.Client$Connection$3.run(Client.java:1030)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
... 1 more
FAILED: org.apache.solr.hadoop.MorphlineGoLiveMiniMRTest.test
Error Message:
Failed on local exception: java.io.IOException: Connection reset by peer; Host Details : local host is: "lucene1-us-west/10.41.0.5"; destination host is: "lucene1-us-west.apache.org":54461;
Stack Trace:
java.io.IOException: Failed on local exception: java.io.IOException: Connection reset by peer; Host Details : local host is: "lucene1-us-west/10.41.0.5"; destination host is: "lucene1-us-west.apache.org":54461;
at __randomizedtesting.SeedInfo.seed([DB854BE53D4F9D71:53D1743F93B3F089]:0)
at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:772)
at org.apache.hadoop.ipc.Client.call(Client.java:1472)
at org.apache.hadoop.ipc.Client.call(Client.java:1399)
at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232)
at com.sun.proxy.$Proxy111.getClusterMetrics(Unknown Source)
at org.apache.hadoop.yarn.api.impl.pb.client.ApplicationClientProtocolPBClientImpl.getClusterMetrics(ApplicationClientProtocolPBClientImpl.java:202)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
at com.sun.proxy.$Proxy112.getClusterMetrics(Unknown Source)
at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.getYarnClusterMetrics(YarnClientImpl.java:461)
at org.apache.hadoop.mapred.ResourceMgrDelegate.getClusterMetrics(ResourceMgrDelegate.java:151)
at org.apache.hadoop.mapred.YARNRunner.getClusterMetrics(YARNRunner.java:179)
at org.apache.hadoop.mapreduce.Cluster.getClusterStatus(Cluster.java:246)
at org.apache.hadoop.mapred.JobClient$3.run(JobClient.java:719)
at org.apache.hadoop.mapred.JobClient$3.run(JobClient.java:717)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.hadoop.mapred.JobClient.getClusterStatus(JobClient.java:717)
at org.apache.solr.hadoop.MapReduceIndexerTool.run(MapReduceIndexerTool.java:645)
at org.apache.solr.hadoop.MapReduceIndexerTool.run(MapReduceIndexerTool.java:608)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.solr.hadoop.MorphlineGoLiveMiniMRTest.test(MorphlineGoLiveMiniMRTest.java:402)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:965)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:940)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: Connection reset by peer
at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
at sun.nio.ch.IOUtil.read(IOUtil.java:197)
at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380)
at org.apache.hadoop.net.SocketInputStream$Reader.performIO(SocketInputStream.java:57)
at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:142)
at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161)
at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131)
at java.io.FilterInputStream.read(FilterInputStream.java:133)
at java.io.FilterInputStream.read(FilterInputStream.java:133)
at org.apache.hadoop.ipc.Client$Connection$PingInputStream.read(Client.java:513)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read(BufferedInputStream.java:265)
at java.io.DataInputStream.readInt(DataInputStream.java:387)
at org.apache.hadoop.ipc.Client$Connection.receiveRpcResponse(Client.java:1071)
at org.apache.hadoop.ipc.Client$Connection.run(Client.java:966)
Build Log:
[...truncated 17969 lines...]
[junit4] Suite: org.apache.solr.hadoop.MorphlineBasicMiniMRTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/init-core-data-001
[junit4] 2> 0 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
[junit4] 2> 2418 WARN (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.u.NativeCodeLoader Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
[junit4] 1> Formatting using clusterid: testClusterID
[junit4] 2> 2512 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.n.FSNamesystem No KeyProvider found.
[junit4] 2> 2553 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.n.FSNamesystem fsLock is fair:true
[junit4] 2> 2636 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.c.C.deprecation hadoop.configured.node.mapping is deprecated. Instead, use net.topology.configured.node.mapping
[junit4] 2> 2636 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.b.DatanodeManager dfs.block.invalidate.limit=1000
[junit4] 2> 2636 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.b.DatanodeManager dfs.namenode.datanode.registration.ip-hostname-check=true
[junit4] 2> 2648 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.b.BlockManager dfs.namenode.startup.delay.block.deletion.sec is set to 000:00:00:00.000
[junit4] 2> 2654 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.b.BlockManager The block deletion will start around 2015 gru 11 07:26:29
[junit4] 2> 2658 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.u.GSet Computing capacity for map BlocksMap
[junit4] 2> 2659 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.u.GSet VM type = 64-bit
[junit4] 2> 2661 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.u.GSet 2.0% max memory 455.5 MB = 9.1 MB
[junit4] 2> 2661 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.u.GSet capacity = 2^20 = 1048576 entries
[junit4] 2> 2690 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.b.BlockManager dfs.block.access.token.enable=false
[junit4] 2> 2690 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.b.BlockManager defaultReplication = 2
[junit4] 2> 2690 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.b.BlockManager maxReplication = 512
[junit4] 2> 2690 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.b.BlockManager minReplication = 1
[junit4] 2> 2691 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.b.BlockManager maxReplicationStreams = 2
[junit4] 2> 2691 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.b.BlockManager shouldCheckForEnoughRacks = false
[junit4] 2> 2691 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.b.BlockManager replicationRecheckInterval = 3000
[junit4] 2> 2691 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.b.BlockManager encryptDataTransfer = false
[junit4] 2> 2691 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.b.BlockManager maxNumBlocksToLog = 1000
[junit4] 2> 2700 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.n.FSNamesystem fsOwner = jenkins (auth:SIMPLE)
[junit4] 2> 2700 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.n.FSNamesystem supergroup = supergroup
[junit4] 2> 2700 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.n.FSNamesystem isPermissionEnabled = true
[junit4] 2> 2702 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.n.FSNamesystem HA Enabled: false
[junit4] 2> 2707 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.n.FSNamesystem Append Enabled: true
[junit4] 2> 3239 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.u.GSet Computing capacity for map INodeMap
[junit4] 2> 3239 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.u.GSet VM type = 64-bit
[junit4] 2> 3239 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.u.GSet 1.0% max memory 455.5 MB = 4.6 MB
[junit4] 2> 3240 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.u.GSet capacity = 2^19 = 524288 entries
[junit4] 2> 3240 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.n.NameNode Caching file names occuring more than 10 times
[junit4] 2> 3255 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.u.GSet Computing capacity for map cachedBlocks
[junit4] 2> 3256 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.u.GSet VM type = 64-bit
[junit4] 2> 3256 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.u.GSet 0.25% max memory 455.5 MB = 1.1 MB
[junit4] 2> 3256 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.u.GSet capacity = 2^17 = 131072 entries
[junit4] 2> 3258 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.n.FSNamesystem dfs.namenode.safemode.threshold-pct = 0.9990000128746033
[junit4] 2> 3258 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.n.FSNamesystem dfs.namenode.safemode.min.datanodes = 0
[junit4] 2> 3259 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.n.FSNamesystem dfs.namenode.safemode.extension = 0
[junit4] 2> 3261 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.n.FSNamesystem Retry cache on namenode is enabled
[junit4] 2> 3262 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.n.FSNamesystem Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000 millis
[junit4] 2> 3267 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.u.GSet Computing capacity for map NameNodeRetryCache
[junit4] 2> 3267 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.u.GSet VM type = 64-bit
[junit4] 2> 3268 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.u.GSet 0.029999999329447746% max memory 455.5 MB = 139.9 KB
[junit4] 2> 3268 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.u.GSet capacity = 2^14 = 16384 entries
[junit4] 2> 3277 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.n.NNConf ACLs enabled? false
[junit4] 2> 3278 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.n.NNConf XAttrs enabled? true
[junit4] 2> 3278 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.n.NNConf Maximum size of an xattr: 16384
[junit4] 2> 3463 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.n.FSImage Allocated new BlockPoolId: BP-1779961120-10.41.0.5-1449807990008
[junit4] 2> 3518 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/name1 has been successfully formatted.
[junit4] 2> 3524 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/name2 has been successfully formatted.
[junit4] 2> 3896 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.n.NNStorageRetentionManager Going to retain 1 images with txid >= 0
[junit4] 2> 3906 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.n.NameNode createNameNode []
[junit4] 2> 3983 WARN (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
[junit4] 2> 4185 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.m.i.MetricsSystemImpl Scheduled snapshot period at 10 second(s).
[junit4] 2> 4185 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.m.i.MetricsSystemImpl NameNode metrics system started
[junit4] 2> 4188 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.n.NameNode fs.defaultFS is hdfs://127.0.0.1:0
[junit4] 2> 4368 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.DFSUtil Starting Web-server for hdfs at: http://localhost:0
[junit4] 2> 4500 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.m.log Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
[junit4] 2> 4513 WARN (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 4553 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.HttpServer2 Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
[junit4] 2> 4556 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.HttpServer2 Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context hdfs
[junit4] 2> 4557 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.HttpServer2 Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
[junit4] 2> 4557 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.HttpServer2 Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
[junit4] 2> 4609 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.HttpServer2 Added filter 'org.apache.hadoop.hdfs.web.AuthFilter' (class=org.apache.hadoop.hdfs.web.AuthFilter)
[junit4] 2> 4612 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.HttpServer2 addJerseyResourcePackage: packageName=org.apache.hadoop.hdfs.server.namenode.web.resources;org.apache.hadoop.hdfs.web.resources, pathSpec=/webhdfs/v1/*
[junit4] 2> 4665 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.HttpServer2 Jetty bound to port 33669
[junit4] 2> 4665 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 4806 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_33669_hdfs____f5q2f7/webapp
[junit4] 2> 5153 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
[junit4] 2> 6529 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33669
[junit4] 2> 6548 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.n.FSNamesystem No KeyProvider found.
[junit4] 2> 6549 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.n.FSNamesystem fsLock is fair:true
[junit4] 2> 6549 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.b.DatanodeManager dfs.block.invalidate.limit=1000
[junit4] 2> 6550 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.b.DatanodeManager dfs.namenode.datanode.registration.ip-hostname-check=true
[junit4] 2> 6550 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.b.BlockManager dfs.namenode.startup.delay.block.deletion.sec is set to 000:00:00:00.000
[junit4] 2> 6550 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.b.BlockManager The block deletion will start around 2015 gru 11 07:26:33
[junit4] 2> 6550 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.u.GSet Computing capacity for map BlocksMap
[junit4] 2> 6551 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.u.GSet VM type = 64-bit
[junit4] 2> 6551 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.u.GSet 2.0% max memory 455.5 MB = 9.1 MB
[junit4] 2> 6551 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.u.GSet capacity = 2^20 = 1048576 entries
[junit4] 2> 6552 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.b.BlockManager dfs.block.access.token.enable=false
[junit4] 2> 6552 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.b.BlockManager defaultReplication = 2
[junit4] 2> 6552 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.b.BlockManager maxReplication = 512
[junit4] 2> 6552 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.b.BlockManager minReplication = 1
[junit4] 2> 6552 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.b.BlockManager maxReplicationStreams = 2
[junit4] 2> 6553 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.b.BlockManager shouldCheckForEnoughRacks = false
[junit4] 2> 6553 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.b.BlockManager replicationRecheckInterval = 3000
[junit4] 2> 6553 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.b.BlockManager encryptDataTransfer = false
[junit4] 2> 6553 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.b.BlockManager maxNumBlocksToLog = 1000
[junit4] 2> 6553 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.n.FSNamesystem fsOwner = jenkins (auth:SIMPLE)
[junit4] 2> 6553 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.n.FSNamesystem supergroup = supergroup
[junit4] 2> 6553 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.n.FSNamesystem isPermissionEnabled = true
[junit4] 2> 6554 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.n.FSNamesystem HA Enabled: false
[junit4] 2> 6554 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.n.FSNamesystem Append Enabled: true
[junit4] 2> 6554 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.u.GSet Computing capacity for map INodeMap
[junit4] 2> 6554 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.u.GSet VM type = 64-bit
[junit4] 2> 6555 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.u.GSet 1.0% max memory 455.5 MB = 4.6 MB
[junit4] 2> 6555 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.u.GSet capacity = 2^19 = 524288 entries
[junit4] 2> 6555 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.n.NameNode Caching file names occuring more than 10 times
[junit4] 2> 6555 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.u.GSet Computing capacity for map cachedBlocks
[junit4] 2> 6555 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.u.GSet VM type = 64-bit
[junit4] 2> 6556 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.u.GSet 0.25% max memory 455.5 MB = 1.1 MB
[junit4] 2> 6556 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.u.GSet capacity = 2^17 = 131072 entries
[junit4] 2> 6556 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.n.FSNamesystem dfs.namenode.safemode.threshold-pct = 0.9990000128746033
[junit4] 2> 6556 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.n.FSNamesystem dfs.namenode.safemode.min.datanodes = 0
[junit4] 2> 6556 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.n.FSNamesystem dfs.namenode.safemode.extension = 0
[junit4] 2> 6556 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.n.FSNamesystem Retry cache on namenode is enabled
[junit4] 2> 6556 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.n.FSNamesystem Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000 millis
[junit4] 2> 6557 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.u.GSet Computing capacity for map NameNodeRetryCache
[junit4] 2> 6557 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.u.GSet VM type = 64-bit
[junit4] 2> 6557 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.u.GSet 0.029999999329447746% max memory 455.5 MB = 139.9 KB
[junit4] 2> 6557 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.u.GSet capacity = 2^14 = 16384 entries
[junit4] 2> 6560 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.n.NNConf ACLs enabled? false
[junit4] 2> 6560 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.n.NNConf XAttrs enabled? true
[junit4] 2> 6560 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.n.NNConf Maximum size of an xattr: 16384
[junit4] 2> 6566 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.c.Storage Lock on /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/name1/in_use.lock acquired by nodename 482@lucene1-us-west
[junit4] 2> 6572 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.c.Storage Lock on /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/name2/in_use.lock acquired by nodename 482@lucene1-us-west
[junit4] 2> 6583 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.n.FileJournalManager Recovering unfinalized segments in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/name1/current
[junit4] 2> 6584 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.n.FileJournalManager Recovering unfinalized segments in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/name2/current
[junit4] 2> 6584 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.n.FSImage No edit log streams selected.
[junit4] 2> 6613 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.n.FSImageFormatPBINode Loading 1 INodes.
[junit4] 2> 6632 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.n.FSImageFormatProtobuf Loaded FSImage in 0 seconds.
[junit4] 2> 6632 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.n.FSImage Loaded image for txid 0 from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/name1/current/fsimage_0000000000000000000
[junit4] 2> 6642 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.n.FSNamesystem Need to save fs image? false (staleImage=false, haEnabled=false, isRollingUpgrade=false)
[junit4] 2> 6644 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.n.FSEditLog Starting log segment at 1
[junit4] 2> 6763 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.n.NameCache initialized with 0 entries 0 lookups
[junit4] 2> 6766 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.n.FSNamesystem Finished loading FSImage in 206 msecs
[junit4] 2> 7356 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.n.NameNode RPC server is binding to localhost:0
[junit4] 2> 7397 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.i.CallQueueManager Using callQueue class java.util.concurrent.LinkedBlockingQueue
[junit4] 2> 7441 INFO (Socket Reader #1 for port 37077) [ ] o.a.h.i.Server Starting Socket Reader #1 for port 37077
[junit4] 2> 7533 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.n.NameNode Clients are to use localhost:37077 to access this namenode/service.
[junit4] 2> 7548 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.n.FSNamesystem Registered FSNamesystemState MBean
[junit4] 2> 7627 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.n.FSNamesystem Number of blocks under construction: 0
[junit4] 2> 7628 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.n.FSNamesystem Number of blocks under construction: 0
[junit4] 2> 7628 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.n.FSNamesystem initializing replication queues
[junit4] 2> 7630 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.StateChange STATE* Leaving safe mode after 1 secs
[junit4] 2> 7630 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.StateChange STATE* Network topology has 0 racks and 0 datanodes
[junit4] 2> 7630 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.StateChange STATE* UnderReplicatedBlocks has 0 blocks
[junit4] 2> 7678 INFO (Replication Queue Initializer) [ ] o.a.h.h.s.b.BlockManager Total number of blocks = 0
[junit4] 2> 7694 INFO (Replication Queue Initializer) [ ] o.a.h.h.s.b.BlockManager Number of invalid blocks = 0
[junit4] 2> 7694 INFO (Replication Queue Initializer) [ ] o.a.h.h.s.b.BlockManager Number of under-replicated blocks = 0
[junit4] 2> 7694 INFO (Replication Queue Initializer) [ ] o.a.h.h.s.b.BlockManager Number of over-replicated blocks = 0
[junit4] 2> 7695 INFO (Replication Queue Initializer) [ ] o.a.h.h.s.b.BlockManager Number of blocks being written = 0
[junit4] 2> 7695 INFO (Replication Queue Initializer) [ ] o.a.h.h.StateChange STATE* Replication Queue initialization scan for invalid, over- and under-replicated blocks completed in 63 msec
[junit4] 2> 7834 INFO (IPC Server Responder) [ ] o.a.h.i.Server IPC Server Responder: starting
[junit4] 2> 7846 INFO (IPC Server listener on 37077) [ ] o.a.h.i.Server IPC Server listener on 37077: starting
[junit4] 2> 7963 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.n.NameNode NameNode RPC up at: localhost/127.0.0.1:37077
[junit4] 2> 7963 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.n.FSNamesystem Starting services required for active state
[junit4] 2> 8053 INFO (CacheReplicationMonitor(1074923987)) [ ] o.a.h.h.s.b.CacheReplicationMonitor Starting CacheReplicationMonitor with interval 30000 milliseconds
[junit4] 2> 8053 INFO (CacheReplicationMonitor(1074923987)) [ ] o.a.h.h.s.b.CacheReplicationMonitor Rescanning after 18268291010 milliseconds
[junit4] 2> 8062 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.MiniDFSCluster Starting DataNode 0 with dfs.datanode.data.dir: [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data1,[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data2
[junit4] 2> 8062 INFO (CacheReplicationMonitor(1074923987)) [ ] o.a.h.h.s.b.CacheReplicationMonitor Scanned 0 directive(s) and 0 block(s) in 10 millisecond(s).
[junit4] 2> 8401 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.m.i.MetricsSystemImpl DataNode metrics system started (again)
[junit4] 2> 8403 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.d.DataNode Configured hostname is 127.0.0.1
[junit4] 2> 8413 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.d.DataNode Starting DataNode with maxLockedMemory = 0
[junit4] 2> 8435 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.d.DataNode Opened streaming server at /127.0.0.1:45656
[junit4] 2> 8440 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.d.DataNode Balancing bandwith is 1048576 bytes/s
[junit4] 2> 8440 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.d.DataNode Number threads for balancing is 5
[junit4] 2> 8457 WARN (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 8461 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.HttpServer2 Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
[junit4] 2> 8462 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.HttpServer2 Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context datanode
[junit4] 2> 8465 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.HttpServer2 Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
[junit4] 2> 8466 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.HttpServer2 Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
[junit4] 2> 8477 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.HttpServer2 addJerseyResourcePackage: packageName=org.apache.hadoop.hdfs.server.datanode.web.resources;org.apache.hadoop.hdfs.web.resources, pathSpec=/webhdfs/v1/*
[junit4] 2> 8478 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.HttpServer2 Jetty bound to port 59015
[junit4] 2> 8478 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 8517 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_59015_datanode____.226mzt/webapp
[junit4] 2> 8793 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
[junit4] 2> 9407 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:59015
[junit4] 2> 9428 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.d.DataNode dnUserName = jenkins
[junit4] 2> 9429 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.d.DataNode supergroup = supergroup
[junit4] 2> 9503 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.i.CallQueueManager Using callQueue class java.util.concurrent.LinkedBlockingQueue
[junit4] 2> 9537 INFO (Socket Reader #1 for port 57863) [ ] o.a.h.i.Server Starting Socket Reader #1 for port 57863
[junit4] 2> 9547 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.d.DataNode Opened IPC server at /127.0.0.1:57863
[junit4] 2> 9576 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.d.DataNode Refresh request received for nameservices: null
[junit4] 2> 9581 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.d.DataNode Starting BPOfferServices for nameservices: <default>
[junit4] 2> 9630 INFO (IPC Server Responder) [ ] o.a.h.i.Server IPC Server Responder: starting
[junit4] 2> 9645 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.MiniDFSCluster Starting DataNode 1 with dfs.datanode.data.dir: [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data3,[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data4
[junit4] 2> 9640 INFO (IPC Server listener on 57863) [ ] o.a.h.i.Server IPC Server listener on 57863: starting
[junit4] 2> 9615 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:37077) [ ] o.a.h.h.s.d.DataNode Block pool <registering> (Datanode Uuid unassigned) service to localhost/127.0.0.1:37077 starting to offer service
[junit4] 2> 9743 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.m.i.MetricsSystemImpl DataNode metrics system started (again)
[junit4] 2> 9743 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.d.DataNode Configured hostname is 127.0.0.1
[junit4] 2> 9743 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.d.DataNode Starting DataNode with maxLockedMemory = 0
[junit4] 2> 9744 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.d.DataNode Opened streaming server at /127.0.0.1:49137
[junit4] 2> 9744 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.d.DataNode Balancing bandwith is 1048576 bytes/s
[junit4] 2> 9744 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.d.DataNode Number threads for balancing is 5
[junit4] 2> 9746 WARN (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 9747 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.HttpServer2 Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
[junit4] 2> 9747 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.HttpServer2 Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context datanode
[junit4] 2> 9747 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.HttpServer2 Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
[junit4] 2> 9748 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.HttpServer2 Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
[junit4] 2> 9766 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.HttpServer2 addJerseyResourcePackage: packageName=org.apache.hadoop.hdfs.server.datanode.web.resources;org.apache.hadoop.hdfs.web.resources, pathSpec=/webhdfs/v1/*
[junit4] 2> 9766 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.HttpServer2 Jetty bound to port 45817
[junit4] 2> 9766 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 9788 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_45817_datanode____.e0blng/webapp
[junit4] 2> 9991 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
[junit4] 2> 10432 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:37077) [ ] o.a.h.h.s.c.Storage DataNode version: -56 and NameNode layout version: -60
[junit4] 2> 10444 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:37077) [ ] o.a.h.h.s.c.Storage Lock on /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data1/in_use.lock acquired by nodename 482@lucene1-us-west
[junit4] 2> 10447 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:37077) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data1 is not formatted for BP-1779961120-10.41.0.5-1449807990008
[junit4] 2> 10447 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:37077) [ ] o.a.h.h.s.c.Storage Formatting ...
[junit4] 2> 10453 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:37077) [ ] o.a.h.h.s.c.Storage Lock on /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data2/in_use.lock acquired by nodename 482@lucene1-us-west
[junit4] 2> 10455 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:37077) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data2 is not formatted for BP-1779961120-10.41.0.5-1449807990008
[junit4] 2> 10455 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:37077) [ ] o.a.h.h.s.c.Storage Formatting ...
[junit4] 2> 10587 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45817
[junit4] 2> 10606 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.d.DataNode dnUserName = jenkins
[junit4] 2> 10606 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.d.DataNode supergroup = supergroup
[junit4] 2> 10607 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.i.CallQueueManager Using callQueue class java.util.concurrent.LinkedBlockingQueue
[junit4] 2> 10622 INFO (Socket Reader #1 for port 60607) [ ] o.a.h.i.Server Starting Socket Reader #1 for port 60607
[junit4] 2> 10630 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.d.DataNode Opened IPC server at /127.0.0.1:60607
[junit4] 2> 10641 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.d.DataNode Refresh request received for nameservices: null
[junit4] 2> 10642 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [ ] o.a.h.h.s.d.DataNode Starting BPOfferServices for nameservices: <default>
[junit4] 2> 10663 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:37077) [ ] o.a.h.h.s.d.DataNode Block pool <registering> (Datanode Uuid unassigned) service to localhost/127.0.0.1:37077 starting to offer service
[junit4] 2> 10689 INFO (IPC Server Responder) [ ] o.a.h.i.Server IPC Server Responder: starting
[junit4] 2> 10694 INFO (IPC Server listener on 60607) [ ] o.a.h.i.Server IPC Server listener on 60607: starting
[junit4] 2> 10822 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:37077) [ ] o.a.h.h.s.c.Storage DataNode version: -56 and NameNode layout version: -60
[junit4] 2> 10841 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:37077) [ ] o.a.h.h.s.c.Storage Lock on /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data3/in_use.lock acquired by nodename 482@lucene1-us-west
[junit4] 2> 10842 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:37077) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data3 is not formatted for BP-1779961120-10.41.0.5-1449807990008
[junit4] 2> 10842 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:37077) [ ] o.a.h.h.s.c.Storage Formatting ...
[junit4] 2> 10847 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:37077) [ ] o.a.h.h.s.c.Storage Lock on /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data4/in_use.lock acquired by nodename 482@lucene1-us-west
[junit4] 2> 10848 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:37077) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data4 is not formatted for BP-1779961120-10.41.0.5-1449807990008
[junit4] 2> 10848 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:37077) [ ] o.a.h.h.s.c.Storage Formatting ...
[junit4] 2> 10865 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:37077) [ ] o.a.h.h.s.c.Storage Analyzing storage directories for bpid BP-1779961120-10.41.0.5-1449807990008
[junit4] 2> 10865 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:37077) [ ] o.a.h.h.s.c.Storage Locking is disabled
[junit4] 2> 10868 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:37077) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data1/current/BP-1779961120-10.41.0.5-1449807990008 is not formatted.
[junit4] 2> 10868 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:37077) [ ] o.a.h.h.s.c.Storage Formatting ...
[junit4] 2> 10868 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:37077) [ ] o.a.h.h.s.c.Storage Formatting block pool BP-1779961120-10.41.0.5-1449807990008 directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data1/current/BP-1779961120-10.41.0.5-1449807990008/current
[junit4] 2> 10872 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:37077) [ ] o.a.h.h.s.c.Storage Locking is disabled
[junit4] 2> 10873 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:37077) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data2/current/BP-1779961120-10.41.0.5-1449807990008 is not formatted.
[junit4] 2> 10873 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:37077) [ ] o.a.h.h.s.c.Storage Formatting ...
[junit4] 2> 10873 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:37077) [ ] o.a.h.h.s.c.Storage Formatting block pool BP-1779961120-10.41.0.5-1449807990008 directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data2/current/BP-1779961120-10.41.0.5-1449807990008/current
[junit4] 2> 10878 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:37077) [ ] o.a.h.h.s.c.Storage Restored 0 block files from trash.
[junit4] 2> 10879 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:37077) [ ] o.a.h.h.s.c.Storage Restored 0 block files from trash.
[junit4] 2> 10890 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:37077) [ ] o.a.h.h.s.d.DataNode Setting up storage: nsid=881586584;bpid=BP-1779961120-10.41.0.5-1449807990008;lv=-56;nsInfo=lv=-60;cid=testClusterID;nsid=881586584;c=0;bpid=BP-1779961120-10.41.0.5-1449807990008;dnuuid=null
[junit4] 2> 10897 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:37077) [ ] o.a.h.h.s.d.DataNode Generated and persisted new Datanode UUID b44f9dbc-1c85-40a3-be6d-47cd0b3dd202
[junit4] 2> 11034 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:37077) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Added new volume: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data1/current
[junit4] 2> 11037 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:37077) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Added volume - /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data1/current, StorageType: DISK
[junit4] 2> 11037 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:37077) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Added new volume: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data2/current
[junit4] 2> 11037 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:37077) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Added volume - /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data2/current, StorageType: DISK
[junit4] 2> 11072 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:37077) [ ] o.a.h.h.s.c.Storage Analyzing storage directories for bpid BP-1779961120-10.41.0.5-1449807990008
[junit4] 2> 11072 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:37077) [ ] o.a.h.h.s.c.Storage Locking is disabled
[junit4] 2> 11073 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:37077) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data3/current/BP-1779961120-10.41.0.5-1449807990008 is not formatted.
[junit4] 2> 11073 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:37077) [ ] o.a.h.h.s.c.Storage Formatting ...
[junit4] 2> 11073 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:37077) [ ] o.a.h.h.s.c.Storage Formatting block pool BP-1779961120-10.41.0.5-1449807990008 directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data3/current/BP-1779961120-10.41.0.5-1449807990008/current
[junit4] 2> 11109 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:37077) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Registered FSDatasetState MBean
[junit4] 2> 11110 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:37077) [ ] o.a.h.h.s.c.Storage Locking is disabled
[junit4] 2> 11111 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:37077) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data4/current/BP-1779961120-10.41.0.5-1449807990008 is not formatted.
[junit4] 2> 11111 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:37077) [ ] o.a.h.h.s.c.Storage Formatting ...
[junit4] 2> 11111 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:37077) [ ] o.a.h.h.s.c.Storage Formatting block pool BP-1779961120-10.41.0.5-1449807990008 directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data4/current/BP-1779961120-10.41.0.5-1449807990008/current
[junit4] 2> 11114 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:37077) [ ] o.a.h.h.s.c.Storage Restored 0 block files from trash.
[junit4] 2> 11115 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:37077) [ ] o.a.h.h.s.c.Storage Restored 0 block files from trash.
[junit4] 2> 11116 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:37077) [ ] o.a.h.h.s.d.DataNode Setting up storage: nsid=881586584;bpid=BP-1779961120-10.41.0.5-1449807990008;lv=-56;nsInfo=lv=-60;cid=testClusterID;nsid=881586584;c=0;bpid=BP-1779961120-10.41.0.5-1449807990008;dnuuid=null
[junit4] 2> 11120 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:37077) [ ] o.a.h.h.s.d.DataNode Generated and persisted new Datanode UUID 0a09f239-cdcb-42f1-b99f-ae47f3fffbf3
[junit4] 2> 11120 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:37077) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Added new volume: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data3/current
[junit4] 2> 11125 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:37077) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Added volume - /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data3/current, StorageType: DISK
[junit4] 2> 11126 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:37077) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Added new volume: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data4/current
[junit4] 2> 11126 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:37077) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Added volume - /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data4/current, StorageType: DISK
[junit4] 2> 11143 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_DB854BE53D4F9D71-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.Morphlin
[...truncated too long message...]
tion1] o.a.h.h.s.n.FSNamesystem Stopping services started for standby state
[junit4] 2> 78798 INFO (SUITE-MorphlineGoLiveMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [n:127.0.0.1:52676_ c:collection1 s:shard1 r:core_node5 x:collection1] o.m.log Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0
[junit4] 2> 78899 INFO (SUITE-MorphlineGoLiveMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [n:127.0.0.1:52676_ c:collection1 s:shard1 r:core_node5 x:collection1] o.a.h.m.i.MetricsSystemImpl Stopping JobHistoryServer metrics system...
[junit4] 2> 78902 ERROR (SUITE-MorphlineGoLiveMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [n:127.0.0.1:52676_ c:collection1 s:shard1 r:core_node5 x:collection1] o.a.h.m.l.MethodMetric Error invoking method getBlocksTotal
[junit4] 2> java.lang.reflect.InvocationTargetException
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:497)
[junit4] 2> at org.apache.hadoop.metrics2.lib.MethodMetric$2.snapshot(MethodMetric.java:111)
[junit4] 2> at org.apache.hadoop.metrics2.lib.MethodMetric.snapshot(MethodMetric.java:144)
[junit4] 2> at org.apache.hadoop.metrics2.lib.MetricsRegistry.snapshot(MetricsRegistry.java:387)
[junit4] 2> at org.apache.hadoop.metrics2.lib.MetricsSourceBuilder$1.getMetrics(MetricsSourceBuilder.java:79)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.getMetrics(MetricsSourceAdapter.java:195)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.updateJmxCache(MetricsSourceAdapter.java:172)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.getMBeanInfo(MetricsSourceAdapter.java:151)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getClassName(DefaultMBeanServerInterceptor.java:1804)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.safeGetClassName(DefaultMBeanServerInterceptor.java:1595)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.checkMBeanPermission(DefaultMBeanServerInterceptor.java:1813)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.exclusiveUnregisterMBean(DefaultMBeanServerInterceptor.java:430)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.unregisterMBean(DefaultMBeanServerInterceptor.java:415)
[junit4] 2> at com.sun.jmx.mbeanserver.JmxMBeanServer.unregisterMBean(JmxMBeanServer.java:546)
[junit4] 2> at org.apache.hadoop.metrics2.util.MBeans.unregister(MBeans.java:81)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stopMBeans(MetricsSourceAdapter.java:227)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stop(MetricsSourceAdapter.java:212)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stopSources(MetricsSystemImpl.java:461)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stop(MetricsSystemImpl.java:212)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.shutdown(MetricsSystemImpl.java:592)
[junit4] 2> at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdownInstance(DefaultMetricsSystem.java:72)
[junit4] 2> at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdown(DefaultMetricsSystem.java:68)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.metrics.NameNodeMetrics.shutdown(NameNodeMetrics.java:145)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.NameNode.stop(NameNode.java:822)
[junit4] 2> at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1720)
[junit4] 2> at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1699)
[junit4] 2> at org.apache.solr.hadoop.MorphlineGoLiveMiniMRTest.teardownClass(MorphlineGoLiveMiniMRTest.java:236)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:497)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:834)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> Caused by: java.lang.NullPointerException
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlocksMap.size(BlocksMap.java:198)
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.getTotalBlocks(BlockManager.java:3291)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlocksTotal(FSNamesystem.java:6223)
[junit4] 2> ... 53 more
[junit4] 2> 78918 INFO (SUITE-MorphlineGoLiveMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [n:127.0.0.1:52676_ c:collection1 s:shard1 r:core_node5 x:collection1] o.a.h.m.i.MetricsSystemImpl JobHistoryServer metrics system stopped.
[junit4] 2> 78919 INFO (SUITE-MorphlineGoLiveMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [n:127.0.0.1:52676_ c:collection1 s:shard1 r:core_node5 x:collection1] o.a.h.m.i.MetricsSystemImpl JobHistoryServer metrics system shutdown complete.
[junit4] 2> 78924 INFO (SUITE-MorphlineGoLiveMiniMRTest-seed#[DB854BE53D4F9D71]-worker) [n:127.0.0.1:52676_ c:collection1 s:shard1 r:core_node5 x:collection1] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J1/temp/solr.hadoop.MorphlineGoLiveMiniMRTest_DB854BE53D4F9D71-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene60): {}, docValues:{}, sim=ClassicSimilarity, locale=nl_BE, timezone=America/Dawson_Creek
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_66 (64-bit)/cpus=4,threads=8,free=283947968,total=375390208
[junit4] 2> NOTE: All tests run in this JVM: [MorphlineGoLiveMiniMRTest]
[junit4] Completed [7/7 (2!)] on J1 in 81.06s, 2 tests, 1 error <<< FAILURES!
[...truncated 12 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:791: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:728: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:253: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:457: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1436: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:991: There were test failures: 7 suites, 35 tests, 2 errors, 1 ignored [seed: DB854BE53D4F9D71]
Total time: 223 minutes 35 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 877 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/877/
1 tests failed.
FAILED: org.apache.solr.core.HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig
Error Message:
The max direct memory is likely too low. Either increase it (by adding -XX:MaxDirectMemorySize=<size>g -XX:+UseLargePages to your containers startup args) or disable direct allocation using solr.hdfs.blockcache.direct.memory.allocation=false in solrconfig.xml. If you are putting the block cache on the heap, your java heap size might not be large enough. Failed allocating ~134.217728 MB.
Stack Trace:
java.lang.RuntimeException: The max direct memory is likely too low. Either increase it (by adding -XX:MaxDirectMemorySize=<size>g -XX:+UseLargePages to your containers startup args) or disable direct allocation using solr.hdfs.blockcache.direct.memory.allocation=false in solrconfig.xml. If you are putting the block cache on the heap, your java heap size might not be large enough. Failed allocating ~134.217728 MB.
at __randomizedtesting.SeedInfo.seed([BDA7739CFE7D7C0A:4A08BAB703F49621]:0)
at org.apache.solr.core.HdfsDirectoryFactory.createBlockCache(HdfsDirectoryFactory.java:295)
at org.apache.solr.core.HdfsDirectoryFactory.getBlockDirectoryCache(HdfsDirectoryFactory.java:277)
at org.apache.solr.core.HdfsDirectoryFactory.create(HdfsDirectoryFactory.java:212)
at org.apache.solr.core.HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig(HdfsDirectoryFactoryTest.java:114)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.OutOfMemoryError: Direct buffer memory
at java.nio.Bits.reserveMemory(Bits.java:658)
at java.nio.DirectByteBuffer.<init>(DirectByteBuffer.java:123)
at java.nio.ByteBuffer.allocateDirect(ByteBuffer.java:311)
at org.apache.solr.store.blockcache.BlockCache.<init>(BlockCache.java:65)
at org.apache.solr.core.HdfsDirectoryFactory.createBlockCache(HdfsDirectoryFactory.java:293)
... 42 more
Build Log:
[...truncated 10383 lines...]
[junit4] Suite: org.apache.solr.core.HdfsDirectoryFactoryTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.HdfsDirectoryFactoryTest_BDA7739CFE7D7C0A-001/init-core-data-001
[junit4] 2> 902558 INFO (SUITE-HdfsDirectoryFactoryTest-seed#[BDA7739CFE7D7C0A]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false)
[junit4] 1> Formatting using clusterid: testClusterID
[junit4] 2> 902595 WARN (SUITE-HdfsDirectoryFactoryTest-seed#[BDA7739CFE7D7C0A]-worker) [ ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
[junit4] 2> 902606 WARN (SUITE-HdfsDirectoryFactoryTest-seed#[BDA7739CFE7D7C0A]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 902609 INFO (SUITE-HdfsDirectoryFactoryTest-seed#[BDA7739CFE7D7C0A]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 902633 INFO (SUITE-HdfsDirectoryFactoryTest-seed#[BDA7739CFE7D7C0A]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_51811_hdfs____.fyikgq/webapp
[junit4] 2> 902746 INFO (SUITE-HdfsDirectoryFactoryTest-seed#[BDA7739CFE7D7C0A]-worker) [ ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
[junit4] 2> 902985 INFO (SUITE-HdfsDirectoryFactoryTest-seed#[BDA7739CFE7D7C0A]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:51811
[junit4] 2> 903097 WARN (SUITE-HdfsDirectoryFactoryTest-seed#[BDA7739CFE7D7C0A]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 903098 INFO (SUITE-HdfsDirectoryFactoryTest-seed#[BDA7739CFE7D7C0A]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 903117 INFO (SUITE-HdfsDirectoryFactoryTest-seed#[BDA7739CFE7D7C0A]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_55705_datanode____1i7mbn/webapp
[junit4] 2> 903218 INFO (SUITE-HdfsDirectoryFactoryTest-seed#[BDA7739CFE7D7C0A]-worker) [ ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
[junit4] 2> 903385 INFO (SUITE-HdfsDirectoryFactoryTest-seed#[BDA7739CFE7D7C0A]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:55705
[junit4] 2> 903465 WARN (SUITE-HdfsDirectoryFactoryTest-seed#[BDA7739CFE7D7C0A]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 903466 INFO (SUITE-HdfsDirectoryFactoryTest-seed#[BDA7739CFE7D7C0A]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 903495 INFO (SUITE-HdfsDirectoryFactoryTest-seed#[BDA7739CFE7D7C0A]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_40935_datanode____.owpge2/webapp
[junit4] 2> 903638 INFO (IPC Server handler 3 on 39180) [ ] BlockStateChange BLOCK* processReport: from storage DS-7233180d-6451-4fe8-996c-b1838895e7bc node DatanodeRegistration(127.0.0.1, datanodeUuid=2ea0c89b-ba17-43e1-873b-49d45721ab6b, infoPort=55705, ipcPort=52294, storageInfo=lv=-56;cid=testClusterID;nsid=1752831667;c=0), blocks: 0, hasStaleStorages: true, processing time: 1 msecs
[junit4] 2> 903638 INFO (IPC Server handler 3 on 39180) [ ] BlockStateChange BLOCK* processReport: from storage DS-075bb421-a66a-449c-9af1-e91db2dea815 node DatanodeRegistration(127.0.0.1, datanodeUuid=2ea0c89b-ba17-43e1-873b-49d45721ab6b, infoPort=55705, ipcPort=52294, storageInfo=lv=-56;cid=testClusterID;nsid=1752831667;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
[junit4] 2> 903716 INFO (SUITE-HdfsDirectoryFactoryTest-seed#[BDA7739CFE7D7C0A]-worker) [ ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
[junit4] 2> 904018 INFO (SUITE-HdfsDirectoryFactoryTest-seed#[BDA7739CFE7D7C0A]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40935
[junit4] 2> 904118 INFO (IPC Server handler 1 on 39180) [ ] BlockStateChange BLOCK* processReport: from storage DS-d5e34a01-4c73-4095-98a8-14acc0e6553a node DatanodeRegistration(127.0.0.1, datanodeUuid=e8b88ba3-2d56-4c74-91f9-e13d3d6dd063, infoPort=40935, ipcPort=48899, storageInfo=lv=-56;cid=testClusterID;nsid=1752831667;c=0), blocks: 0, hasStaleStorages: true, processing time: 0 msecs
[junit4] 2> 904118 INFO (IPC Server handler 1 on 39180) [ ] BlockStateChange BLOCK* processReport: from storage DS-9cbdaf43-62f4-47ec-9bd8-e5a1e0718a55 node DatanodeRegistration(127.0.0.1, datanodeUuid=e8b88ba3-2d56-4c74-91f9-e13d3d6dd063, infoPort=40935, ipcPort=48899, storageInfo=lv=-56;cid=testClusterID;nsid=1752831667;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
[junit4] 2> 904204 INFO (TEST-HdfsDirectoryFactoryTest.testCleanupOldIndexDirectories-seed#[BDA7739CFE7D7C0A]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testCleanupOldIndexDirectories
[junit4] 2> 904204 INFO (TEST-HdfsDirectoryFactoryTest.testCleanupOldIndexDirectories-seed#[BDA7739CFE7D7C0A]) [ ] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:39180/solr1
[junit4] 2> 904204 INFO (TEST-HdfsDirectoryFactoryTest.testCleanupOldIndexDirectories-seed#[BDA7739CFE7D7C0A]) [ ] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 904208 INFO (TEST-HdfsDirectoryFactoryTest.testCleanupOldIndexDirectories-seed#[BDA7739CFE7D7C0A]) [ ] o.a.s.c.CoreContainer New CoreContainer 928651843
[junit4] 2> 904209 INFO (TEST-HdfsDirectoryFactoryTest.testCleanupOldIndexDirectories-seed#[BDA7739CFE7D7C0A]) [ ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=mock, config=solrconfig.xml, loadOnStartup=true, schema=schema.xml, configSetProperties=configsetprops.json, transient=false, dataDir=data/}
[junit4] 2> 904235 INFO (TEST-HdfsDirectoryFactoryTest.testCleanupOldIndexDirectories-seed#[BDA7739CFE7D7C0A]) [ ] o.a.s.c.HdfsDirectoryFactory Deleted old index directory hdfs://localhost:39180/solr1/mock/data/index.20151209200439858
[junit4] 2> 904236 INFO (TEST-HdfsDirectoryFactoryTest.testCleanupOldIndexDirectories-seed#[BDA7739CFE7D7C0A]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testCleanupOldIndexDirectories
[junit4] 2> 904261 INFO (TEST-HdfsDirectoryFactoryTest.testLocalityReporter-seed#[BDA7739CFE7D7C0A]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testLocalityReporter
[junit4] 2> 904268 INFO (TEST-HdfsDirectoryFactoryTest.testLocalityReporter-seed#[BDA7739CFE7D7C0A]) [ ] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:39180/solr
[junit4] 2> 904268 INFO (TEST-HdfsDirectoryFactoryTest.testLocalityReporter-seed#[BDA7739CFE7D7C0A]) [ ] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 904269 INFO (TEST-HdfsDirectoryFactoryTest.testLocalityReporter-seed#[BDA7739CFE7D7C0A]) [ ] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:39180/solr3/
[junit4] 2> 904279 INFO (TEST-HdfsDirectoryFactoryTest.testLocalityReporter-seed#[BDA7739CFE7D7C0A]) [ ] o.a.s.s.h.HdfsLocalityReporter Registering direcotry hdfs://localhost:39180/solr3 for locality metrics.
[junit4] 2> 904311 INFO (IPC Server handler 4 on 39180) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:43051 is added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-7233180d-6451-4fe8-996c-b1838895e7bc:NORMAL:127.0.0.1:44462|RBW], ReplicaUnderConstruction[[DISK]DS-d5e34a01-4c73-4095-98a8-14acc0e6553a:NORMAL:127.0.0.1:43051|FINALIZED]]} size 0
[junit4] 2> 904311 INFO (IPC Server handler 4 on 39180) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:44462 is added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-d5e34a01-4c73-4095-98a8-14acc0e6553a:NORMAL:127.0.0.1:43051|FINALIZED], ReplicaUnderConstruction[[DISK]DS-075bb421-a66a-449c-9af1-e91db2dea815:NORMAL:127.0.0.1:44462|FINALIZED]]} size 0
[junit4] 2> 904317 INFO (TEST-HdfsDirectoryFactoryTest.testLocalityReporter-seed#[BDA7739CFE7D7C0A]) [ ] o.a.s.c.CachingDirectoryFactory Closing HdfsDirectoryFactory - 0 directories currently being tracked
[junit4] 2> 904317 INFO (TEST-HdfsDirectoryFactoryTest.testLocalityReporter-seed#[BDA7739CFE7D7C0A]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testLocalityReporter
[junit4] 2> 904348 INFO (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[BDA7739CFE7D7C0A]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testInitArgsOrSysPropConfig
[junit4] 2> 904348 INFO (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[BDA7739CFE7D7C0A]) [ ] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:39180/solr1
[junit4] 2> 904348 INFO (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[BDA7739CFE7D7C0A]) [ ] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 904348 INFO (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[BDA7739CFE7D7C0A]) [ ] o.a.s.c.CoreContainer New CoreContainer 1942537750
[junit4] 2> 904349 INFO (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[BDA7739CFE7D7C0A]) [ ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=mock, config=solrconfig.xml, loadOnStartup=true, schema=schema.xml, configSetProperties=configsetprops.json, transient=false, dataDir=data/}
[junit4] 2> 904349 INFO (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[BDA7739CFE7D7C0A]) [ ] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:39180/solr2
[junit4] 2> 904349 INFO (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[BDA7739CFE7D7C0A]) [ ] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 904349 INFO (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[BDA7739CFE7D7C0A]) [ ] o.a.s.c.CoreContainer New CoreContainer 981907340
[junit4] 2> 904349 INFO (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[BDA7739CFE7D7C0A]) [ ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=mock, config=solrconfig.xml, loadOnStartup=true, schema=schema.xml, configSetProperties=configsetprops.json, transient=false, dataDir=data/}
[junit4] 2> 904349 INFO (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[BDA7739CFE7D7C0A]) [ ] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:39180/solr2
[junit4] 2> 904349 INFO (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[BDA7739CFE7D7C0A]) [ ] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 904349 INFO (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[BDA7739CFE7D7C0A]) [ ] o.a.s.c.CoreContainer New CoreContainer 245639510
[junit4] 2> 904349 INFO (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[BDA7739CFE7D7C0A]) [ ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=mock, config=solrconfig.xml, loadOnStartup=true, schema=schema.xml, configSetProperties=configsetprops.json, transient=false, dataDir=data/}
[junit4] 2> 904350 INFO (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[BDA7739CFE7D7C0A]) [ ] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:39180/solr
[junit4] 2> 904359 INFO (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[BDA7739CFE7D7C0A]) [ ] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 904359 INFO (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[BDA7739CFE7D7C0A]) [ ] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [134217728] will allocate [1] slabs and use ~[134217728] bytes
[junit4] 2> 904359 INFO (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[BDA7739CFE7D7C0A]) [ ] o.a.s.c.HdfsDirectoryFactory Creating new global HDFS BlockCache
[junit4] 2> 904983 ERROR (Finalizer) [ ] o.a.s.c.CoreContainer CoreContainer was not close prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!! instance=928651843
[junit4] 2> 904984 ERROR (Finalizer) [ ] o.a.s.c.CoreContainer CoreContainer was not close prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!! instance=245639510
[junit4] 2> 904984 ERROR (Finalizer) [ ] o.a.s.c.CoreContainer CoreContainer was not close prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!! instance=981907340
[junit4] 2> 904984 ERROR (Finalizer) [ ] o.a.s.c.CoreContainer CoreContainer was not close prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!! instance=1942537750
[junit4] 2> 905082 INFO (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[BDA7739CFE7D7C0A]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testInitArgsOrSysPropConfig
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=HdfsDirectoryFactoryTest -Dtests.method=testInitArgsOrSysPropConfig -Dtests.seed=BDA7739CFE7D7C0A -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=ar_LB -Dtests.timezone=America/Asuncion -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] ERROR 0.77s J2 | HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig <<<
[junit4] > Throwable #1: java.lang.RuntimeException: The max direct memory is likely too low. Either increase it (by adding -XX:MaxDirectMemorySize=<size>g -XX:+UseLargePages to your containers startup args) or disable direct allocation using solr.hdfs.blockcache.direct.memory.allocation=false in solrconfig.xml. If you are putting the block cache on the heap, your java heap size might not be large enough. Failed allocating ~134.217728 MB.
[junit4] > at __randomizedtesting.SeedInfo.seed([BDA7739CFE7D7C0A:4A08BAB703F49621]:0)
[junit4] > at org.apache.solr.core.HdfsDirectoryFactory.createBlockCache(HdfsDirectoryFactory.java:295)
[junit4] > at org.apache.solr.core.HdfsDirectoryFactory.getBlockDirectoryCache(HdfsDirectoryFactory.java:277)
[junit4] > at org.apache.solr.core.HdfsDirectoryFactory.create(HdfsDirectoryFactory.java:212)
[junit4] > at org.apache.solr.core.HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig(HdfsDirectoryFactoryTest.java:114)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > Caused by: java.lang.OutOfMemoryError: Direct buffer memory
[junit4] > at java.nio.Bits.reserveMemory(Bits.java:658)
[junit4] > at java.nio.DirectByteBuffer.<init>(DirectByteBuffer.java:123)
[junit4] > at java.nio.ByteBuffer.allocateDirect(ByteBuffer.java:311)
[junit4] > at org.apache.solr.store.blockcache.BlockCache.<init>(BlockCache.java:65)
[junit4] > at org.apache.solr.core.HdfsDirectoryFactory.createBlockCache(HdfsDirectoryFactory.java:293)
[junit4] > ... 42 more
[junit4] 2> 905089 WARN (SUITE-HdfsDirectoryFactoryTest-seed#[BDA7739CFE7D7C0A]-worker) [ ] o.a.h.h.s.d.DirectoryScanner DirectoryScanner: shutdown has been called
[junit4] 2> 905102 INFO (SUITE-HdfsDirectoryFactoryTest-seed#[BDA7739CFE7D7C0A]-worker) [ ] o.m.log Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0
[junit4] 2> 905204 WARN (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.HdfsDirectoryFactoryTest_BDA7739CFE7D7C0A-001/tempDir-001/hdfsBaseDir/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.HdfsDirectoryFactoryTest_BDA7739CFE7D7C0A-001/tempDir-001/hdfsBaseDir/data/data4/]] heartbeating to localhost/127.0.0.1:39180) [ ] o.a.h.h.s.d.DataNode BPOfferService for Block pool BP-817240175-10.41.0.5-1449702278213 (Datanode Uuid e8b88ba3-2d56-4c74-91f9-e13d3d6dd063) service to localhost/127.0.0.1:39180 interrupted
[junit4] 2> 905204 WARN (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.HdfsDirectoryFactoryTest_BDA7739CFE7D7C0A-001/tempDir-001/hdfsBaseDir/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.HdfsDirectoryFactoryTest_BDA7739CFE7D7C0A-001/tempDir-001/hdfsBaseDir/data/data4/]] heartbeating to localhost/127.0.0.1:39180) [ ] o.a.h.h.s.d.DataNode Ending block pool service for: Block pool BP-817240175-10.41.0.5-1449702278213 (Datanode Uuid e8b88ba3-2d56-4c74-91f9-e13d3d6dd063) service to localhost/127.0.0.1:39180
[junit4] 2> 905207 WARN (SUITE-HdfsDirectoryFactoryTest-seed#[BDA7739CFE7D7C0A]-worker) [ ] o.a.h.h.s.d.DirectoryScanner DirectoryScanner: shutdown has been called
[junit4] 2> 905211 INFO (SUITE-HdfsDirectoryFactoryTest-seed#[BDA7739CFE7D7C0A]-worker) [ ] o.m.log Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0
[junit4] 2> 905215 WARN (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.HdfsDirectoryFactoryTest_BDA7739CFE7D7C0A-001/tempDir-001/hdfsBaseDir/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.HdfsDirectoryFactoryTest_BDA7739CFE7D7C0A-001/tempDir-001/hdfsBaseDir/data/data2/]] heartbeating to localhost/127.0.0.1:39180) [ ] o.a.h.h.s.d.DataNode BPOfferService for Block pool BP-817240175-10.41.0.5-1449702278213 (Datanode Uuid 2ea0c89b-ba17-43e1-873b-49d45721ab6b) service to localhost/127.0.0.1:39180 interrupted
[junit4] 2> 905215 WARN (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.HdfsDirectoryFactoryTest_BDA7739CFE7D7C0A-001/tempDir-001/hdfsBaseDir/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.HdfsDirectoryFactoryTest_BDA7739CFE7D7C0A-001/tempDir-001/hdfsBaseDir/data/data2/]] heartbeating to localhost/127.0.0.1:39180) [ ] o.a.h.h.s.d.DataNode Ending block pool service for: Block pool BP-817240175-10.41.0.5-1449702278213 (Datanode Uuid 2ea0c89b-ba17-43e1-873b-49d45721ab6b) service to localhost/127.0.0.1:39180
[junit4] 2> 905223 WARN (org.apache.hadoop.hdfs.server.blockmanagement.DecommissionManager$Monitor@6e7235bd) [ ] o.a.h.h.s.b.DecommissionManager Monitor interrupted: java.lang.InterruptedException: sleep interrupted
[junit4] 2> 905232 INFO (SUITE-HdfsDirectoryFactoryTest-seed#[BDA7739CFE7D7C0A]-worker) [ ] o.m.log Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0
[junit4] 2> 905338 ERROR (SUITE-HdfsDirectoryFactoryTest-seed#[BDA7739CFE7D7C0A]-worker) [ ] o.a.h.m.l.MethodMetric Error invoking method getBlocksTotal
[junit4] 2> java.lang.reflect.InvocationTargetException
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:497)
[junit4] 2> at org.apache.hadoop.metrics2.lib.MethodMetric$2.snapshot(MethodMetric.java:111)
[junit4] 2> at org.apache.hadoop.metrics2.lib.MethodMetric.snapshot(MethodMetric.java:144)
[junit4] 2> at org.apache.hadoop.metrics2.lib.MetricsRegistry.snapshot(MetricsRegistry.java:387)
[junit4] 2> at org.apache.hadoop.metrics2.lib.MetricsSourceBuilder$1.getMetrics(MetricsSourceBuilder.java:79)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.getMetrics(MetricsSourceAdapter.java:195)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.updateJmxCache(MetricsSourceAdapter.java:172)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.getMBeanInfo(MetricsSourceAdapter.java:151)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getClassName(DefaultMBeanServerInterceptor.java:1804)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.safeGetClassName(DefaultMBeanServerInterceptor.java:1595)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.checkMBeanPermission(DefaultMBeanServerInterceptor.java:1813)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.exclusiveUnregisterMBean(DefaultMBeanServerInterceptor.java:430)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.unregisterMBean(DefaultMBeanServerInterceptor.java:415)
[junit4] 2> at com.sun.jmx.mbeanserver.JmxMBeanServer.unregisterMBean(JmxMBeanServer.java:546)
[junit4] 2> at org.apache.hadoop.metrics2.util.MBeans.unregister(MBeans.java:81)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stopMBeans(MetricsSourceAdapter.java:227)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stop(MetricsSourceAdapter.java:212)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stopSources(MetricsSystemImpl.java:461)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stop(MetricsSystemImpl.java:212)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.shutdown(MetricsSystemImpl.java:592)
[junit4] 2> at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdownInstance(DefaultMetricsSystem.java:72)
[junit4] 2> at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdown(DefaultMetricsSystem.java:68)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.metrics.NameNodeMetrics.shutdown(NameNodeMetrics.java:145)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.NameNode.stop(NameNode.java:822)
[junit4] 2> at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1720)
[junit4] 2> at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1699)
[junit4] 2> at org.apache.solr.cloud.hdfs.HdfsTestUtil.teardownClass(HdfsTestUtil.java:198)
[junit4] 2> at org.apache.solr.core.HdfsDirectoryFactoryTest.teardownClass(HdfsDirectoryFactoryTest.java:67)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:497)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:834)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> Caused by: java.lang.NullPointerException
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlocksMap.size(BlocksMap.java:198)
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.getTotalBlocks(BlockManager.java:3291)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlocksTotal(FSNamesystem.java:6223)
[junit4] 2> ... 54 more
[junit4] 2> 905342 INFO (SUITE-HdfsDirectoryFactoryTest-seed#[BDA7739CFE7D7C0A]-worker) [ ] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.HdfsDirectoryFactoryTest_BDA7739CFE7D7C0A-001
[junit4] 2> Dec 09, 2015 11:04:40 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 2 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene60): {}, docValues:{}, sim=ClassicSimilarity, locale=ar_LB, timezone=America/Asuncion
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_66 (64-bit)/cpus=4,threads=2,free=378082208,total=502792192
[junit4] 2> NOTE: All tests run in this JVM: [DirectUpdateHandlerOptimizeTest, TestQueryWrapperFilter, TestFastWriter, StatsComponentTest, AddSchemaFieldsUpdateProcessorFactoryTest, DateRangeFieldTest, TestMissingGroups, ZkStateReaderTest, SegmentsInfoRequestHandlerTest, FieldMutatingUpdateProcessorTest, TestRestManager, TestJmxIntegration, StatelessScriptUpdateProcessorFactoryTest, TestCollationField, VMParamsZkACLAndCredentialsProvidersTest, TestExceedMaxTermLength, TestIndexingPerformance, TestFreeTextSuggestions, SolrTestCaseJ4Test, TestPostingsSolrHighlighter, CurrencyFieldXmlFileTest, QueryParsingTest, SuggesterTSTTest, TestLRUStatsCache, TestWriterPerf, UnloadDistributedZkTest, TestCustomSort, TestConfigReload, ForceLeaderTest, TestFuzzyAnalyzedSuggestions, TermVectorComponentDistributedTest, BlockDirectoryTest, TestSchemaVersionResource, TestCharFilters, SSLMigrationTest, RequestHandlersTest, FullHLLTest, OverseerTaskQueueTest, OverseerCollectionConfigSetProcessorTest, TestReversedWildcardFilterFactory, TestSha256AuthenticationProvider, TestDynamicLoading, PrimitiveFieldTypeTest, TestSearchPerf, CloudExitableDirectoryReaderTest, BadIndexSchemaTest, TestCustomDocTransformer, TestElisionMultitermQuery, TestCryptoKeys, TestShortCircuitedRequests, DistributedQueryComponentOptimizationTest, XmlUpdateRequestHandlerTest, SliceStateTest, RegexBoostProcessorTest, TestSolrXml, LukeRequestHandlerTest, TestZkChroot, TestRandomMergePolicy, AutoCommitTest, HdfsSyncSliceTest, AsyncCallRequestStatusResponseTest, SharedFSAutoReplicaFailoverTest, TestTrieFacet, TestJsonRequest, TestSortingResponseWriter, HdfsDirectoryFactoryTest]
[junit4] Completed [167/564 (1!)] on J2 in 12.62s, 3 tests, 1 error <<< FAILURES!
[...truncated 1313 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:791: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:728: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1436: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:991: There were test failures: 564 suites (8 ignored), 2241 tests, 1 error, 33 ignored (18 assumptions) [seed: BDA7739CFE7D7C0A]
Total time: 201 minutes 52 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 876 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/876/
2 tests failed.
FAILED: org.apache.solr.hadoop.MorphlineBasicMiniMRTest.mrRun
Error Message:
Failed on local exception: java.io.IOException: Connection reset by peer; Host Details : local host is: "lucene1-us-west/10.41.0.5"; destination host is: "lucene1-us-west.apache.org":60509;
Stack Trace:
java.io.IOException: Failed on local exception: java.io.IOException: Connection reset by peer; Host Details : local host is: "lucene1-us-west/10.41.0.5"; destination host is: "lucene1-us-west.apache.org":60509;
at __randomizedtesting.SeedInfo.seed([D4DF6ED0852803F1:DA8DDADE84BE31FE]:0)
at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:772)
at org.apache.hadoop.ipc.Client.call(Client.java:1472)
at org.apache.hadoop.ipc.Client.call(Client.java:1399)
at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232)
at com.sun.proxy.$Proxy110.getClusterMetrics(Unknown Source)
at org.apache.hadoop.yarn.api.impl.pb.client.ApplicationClientProtocolPBClientImpl.getClusterMetrics(ApplicationClientProtocolPBClientImpl.java:202)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
at com.sun.proxy.$Proxy111.getClusterMetrics(Unknown Source)
at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.getYarnClusterMetrics(YarnClientImpl.java:461)
at org.apache.hadoop.mapred.ResourceMgrDelegate.getClusterMetrics(ResourceMgrDelegate.java:151)
at org.apache.hadoop.mapred.YARNRunner.getClusterMetrics(YARNRunner.java:179)
at org.apache.hadoop.mapreduce.Cluster.getClusterStatus(Cluster.java:246)
at org.apache.hadoop.mapred.JobClient$3.run(JobClient.java:719)
at org.apache.hadoop.mapred.JobClient$3.run(JobClient.java:717)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.hadoop.mapred.JobClient.getClusterStatus(JobClient.java:717)
at org.apache.solr.hadoop.MapReduceIndexerTool.run(MapReduceIndexerTool.java:645)
at org.apache.solr.hadoop.MapReduceIndexerTool.run(MapReduceIndexerTool.java:608)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.solr.hadoop.MorphlineBasicMiniMRTest.mrRun(MorphlineBasicMiniMRTest.java:363)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: Connection reset by peer
at sun.nio.ch.FileDispatcherImpl.write0(Native Method)
at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47)
at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)
at sun.nio.ch.IOUtil.write(IOUtil.java:65)
at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:471)
at org.apache.hadoop.net.SocketOutputStream$Writer.performIO(SocketOutputStream.java:63)
at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:142)
at org.apache.hadoop.net.SocketOutputStream.write(SocketOutputStream.java:159)
at org.apache.hadoop.net.SocketOutputStream.write(SocketOutputStream.java:117)
at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140)
at java.io.DataOutputStream.flush(DataOutputStream.java:123)
at org.apache.hadoop.ipc.Client$Connection$3.run(Client.java:1030)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
... 1 more
FAILED: org.apache.solr.hadoop.MorphlineGoLiveMiniMRTest.test
Error Message:
Failed on local exception: java.io.IOException: Connection reset by peer; Host Details : local host is: "lucene1-us-west/10.41.0.5"; destination host is: "lucene1-us-west.apache.org":39169;
Stack Trace:
java.io.IOException: Failed on local exception: java.io.IOException: Connection reset by peer; Host Details : local host is: "lucene1-us-west/10.41.0.5"; destination host is: "lucene1-us-west.apache.org":39169;
at __randomizedtesting.SeedInfo.seed([D4DF6ED0852803F1:5C8B510A2BD46E09]:0)
at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:772)
at org.apache.hadoop.ipc.Client.call(Client.java:1472)
at org.apache.hadoop.ipc.Client.call(Client.java:1399)
at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232)
at com.sun.proxy.$Proxy111.getClusterMetrics(Unknown Source)
at org.apache.hadoop.yarn.api.impl.pb.client.ApplicationClientProtocolPBClientImpl.getClusterMetrics(ApplicationClientProtocolPBClientImpl.java:202)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
at com.sun.proxy.$Proxy112.getClusterMetrics(Unknown Source)
at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.getYarnClusterMetrics(YarnClientImpl.java:461)
at org.apache.hadoop.mapred.ResourceMgrDelegate.getClusterMetrics(ResourceMgrDelegate.java:151)
at org.apache.hadoop.mapred.YARNRunner.getClusterMetrics(YARNRunner.java:179)
at org.apache.hadoop.mapreduce.Cluster.getClusterStatus(Cluster.java:246)
at org.apache.hadoop.mapred.JobClient$3.run(JobClient.java:719)
at org.apache.hadoop.mapred.JobClient$3.run(JobClient.java:717)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.hadoop.mapred.JobClient.getClusterStatus(JobClient.java:717)
at org.apache.solr.hadoop.MapReduceIndexerTool.run(MapReduceIndexerTool.java:645)
at org.apache.solr.hadoop.MapReduceIndexerTool.run(MapReduceIndexerTool.java:608)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.solr.hadoop.MorphlineGoLiveMiniMRTest.test(MorphlineGoLiveMiniMRTest.java:402)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:965)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:940)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: Connection reset by peer
at sun.nio.ch.FileDispatcherImpl.write0(Native Method)
at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47)
at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)
at sun.nio.ch.IOUtil.write(IOUtil.java:65)
at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:471)
at org.apache.hadoop.net.SocketOutputStream$Writer.performIO(SocketOutputStream.java:63)
at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:142)
at org.apache.hadoop.net.SocketOutputStream.write(SocketOutputStream.java:159)
at org.apache.hadoop.net.SocketOutputStream.write(SocketOutputStream.java:117)
at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140)
at java.io.DataOutputStream.flush(DataOutputStream.java:123)
at org.apache.hadoop.ipc.Client$Connection$3.run(Client.java:1030)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
... 1 more
Build Log:
[...truncated 17860 lines...]
[junit4] Suite: org.apache.solr.hadoop.MorphlineBasicMiniMRTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/init-core-data-001
[junit4] 2> 1 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true)
[junit4] 2> 3140 WARN (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.u.NativeCodeLoader Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
[junit4] 1> Formatting using clusterid: testClusterID
[junit4] 2> 3347 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.n.FSNamesystem No KeyProvider found.
[junit4] 2> 3451 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.n.FSNamesystem fsLock is fair:true
[junit4] 2> 3551 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.c.C.deprecation hadoop.configured.node.mapping is deprecated. Instead, use net.topology.configured.node.mapping
[junit4] 2> 3552 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.b.DatanodeManager dfs.block.invalidate.limit=1000
[junit4] 2> 3552 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.b.DatanodeManager dfs.namenode.datanode.registration.ip-hostname-check=true
[junit4] 2> 3557 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.b.BlockManager dfs.namenode.startup.delay.block.deletion.sec is set to 000:00:00:00.000
[junit4] 2> 3562 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.b.BlockManager The block deletion will start around 2015 Dis 09 00:23:06
[junit4] 2> 3567 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.u.GSet Computing capacity for map BlocksMap
[junit4] 2> 3567 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.u.GSet VM type = 64-bit
[junit4] 2> 3571 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.u.GSet 2.0% max memory 455.5 MB = 9.1 MB
[junit4] 2> 3571 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.u.GSet capacity = 2^20 = 1048576 entries
[junit4] 2> 3641 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.b.BlockManager dfs.block.access.token.enable=false
[junit4] 2> 3642 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.b.BlockManager defaultReplication = 2
[junit4] 2> 3644 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.b.BlockManager maxReplication = 512
[junit4] 2> 3645 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.b.BlockManager minReplication = 1
[junit4] 2> 3645 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.b.BlockManager maxReplicationStreams = 2
[junit4] 2> 3645 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.b.BlockManager shouldCheckForEnoughRacks = false
[junit4] 2> 3645 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.b.BlockManager replicationRecheckInterval = 3000
[junit4] 2> 3645 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.b.BlockManager encryptDataTransfer = false
[junit4] 2> 3646 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.b.BlockManager maxNumBlocksToLog = 1000
[junit4] 2> 3660 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.n.FSNamesystem fsOwner = jenkins (auth:SIMPLE)
[junit4] 2> 3661 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.n.FSNamesystem supergroup = supergroup
[junit4] 2> 3661 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.n.FSNamesystem isPermissionEnabled = true
[junit4] 2> 3662 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.n.FSNamesystem HA Enabled: false
[junit4] 2> 3668 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.n.FSNamesystem Append Enabled: true
[junit4] 2> 4261 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.u.GSet Computing capacity for map INodeMap
[junit4] 2> 4261 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.u.GSet VM type = 64-bit
[junit4] 2> 4262 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.u.GSet 1.0% max memory 455.5 MB = 4.6 MB
[junit4] 2> 4262 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.u.GSet capacity = 2^19 = 524288 entries
[junit4] 2> 4262 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.n.NameNode Caching file names occuring more than 10 times
[junit4] 2> 4297 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.u.GSet Computing capacity for map cachedBlocks
[junit4] 2> 4297 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.u.GSet VM type = 64-bit
[junit4] 2> 4298 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.u.GSet 0.25% max memory 455.5 MB = 1.1 MB
[junit4] 2> 4298 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.u.GSet capacity = 2^17 = 131072 entries
[junit4] 2> 4301 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.n.FSNamesystem dfs.namenode.safemode.threshold-pct = 0.9990000128746033
[junit4] 2> 4313 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.n.FSNamesystem dfs.namenode.safemode.min.datanodes = 0
[junit4] 2> 4314 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.n.FSNamesystem dfs.namenode.safemode.extension = 0
[junit4] 2> 4317 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.n.FSNamesystem Retry cache on namenode is enabled
[junit4] 2> 4317 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.n.FSNamesystem Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000 millis
[junit4] 2> 4331 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.u.GSet Computing capacity for map NameNodeRetryCache
[junit4] 2> 4332 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.u.GSet VM type = 64-bit
[junit4] 2> 4332 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.u.GSet 0.029999999329447746% max memory 455.5 MB = 139.9 KB
[junit4] 2> 4332 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.u.GSet capacity = 2^14 = 16384 entries
[junit4] 2> 4354 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.n.NNConf ACLs enabled? false
[junit4] 2> 4354 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.n.NNConf XAttrs enabled? true
[junit4] 2> 4354 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.n.NNConf Maximum size of an xattr: 16384
[junit4] 2> 4534 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.n.FSImage Allocated new BlockPoolId: BP-2041808141-10.41.0.5-1449609787346
[junit4] 2> 4682 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/name1 has been successfully formatted.
[junit4] 2> 4688 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/name2 has been successfully formatted.
[junit4] 2> 4988 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.n.NNStorageRetentionManager Going to retain 1 images with txid >= 0
[junit4] 2> 4996 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.n.NameNode createNameNode []
[junit4] 2> 5074 WARN (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
[junit4] 2> 5245 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.m.i.MetricsSystemImpl Scheduled snapshot period at 10 second(s).
[junit4] 2> 5246 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.m.i.MetricsSystemImpl NameNode metrics system started
[junit4] 2> 5251 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.n.NameNode fs.defaultFS is hdfs://127.0.0.1:0
[junit4] 2> 5343 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.DFSUtil Starting Web-server for hdfs at: http://localhost:0
[junit4] 2> 5521 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.m.log Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
[junit4] 2> 5551 WARN (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 5623 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.HttpServer2 Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
[junit4] 2> 5640 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.HttpServer2 Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context hdfs
[junit4] 2> 5640 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.HttpServer2 Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
[junit4] 2> 5640 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.HttpServer2 Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
[junit4] 2> 5790 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.HttpServer2 Added filter 'org.apache.hadoop.hdfs.web.AuthFilter' (class=org.apache.hadoop.hdfs.web.AuthFilter)
[junit4] 2> 5798 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.HttpServer2 addJerseyResourcePackage: packageName=org.apache.hadoop.hdfs.server.namenode.web.resources;org.apache.hadoop.hdfs.web.resources, pathSpec=/webhdfs/v1/*
[junit4] 2> 5856 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.HttpServer2 Jetty bound to port 39498
[junit4] 2> 5856 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 5969 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_39498_hdfs____.yijyuh/webapp
[junit4] 2> 6333 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
[junit4] 2> 7519 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39498
[junit4] 2> 7567 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.n.FSNamesystem No KeyProvider found.
[junit4] 2> 7568 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.n.FSNamesystem fsLock is fair:true
[junit4] 2> 7581 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.b.DatanodeManager dfs.block.invalidate.limit=1000
[junit4] 2> 7581 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.b.DatanodeManager dfs.namenode.datanode.registration.ip-hostname-check=true
[junit4] 2> 7581 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.b.BlockManager dfs.namenode.startup.delay.block.deletion.sec is set to 000:00:00:00.000
[junit4] 2> 7582 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.b.BlockManager The block deletion will start around 2015 Dis 09 00:23:10
[junit4] 2> 7582 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.u.GSet Computing capacity for map BlocksMap
[junit4] 2> 7582 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.u.GSet VM type = 64-bit
[junit4] 2> 7582 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.u.GSet 2.0% max memory 455.5 MB = 9.1 MB
[junit4] 2> 7582 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.u.GSet capacity = 2^20 = 1048576 entries
[junit4] 2> 7583 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.b.BlockManager dfs.block.access.token.enable=false
[junit4] 2> 7584 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.b.BlockManager defaultReplication = 2
[junit4] 2> 7584 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.b.BlockManager maxReplication = 512
[junit4] 2> 7584 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.b.BlockManager minReplication = 1
[junit4] 2> 7584 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.b.BlockManager maxReplicationStreams = 2
[junit4] 2> 7584 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.b.BlockManager shouldCheckForEnoughRacks = false
[junit4] 2> 7584 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.b.BlockManager replicationRecheckInterval = 3000
[junit4] 2> 7584 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.b.BlockManager encryptDataTransfer = false
[junit4] 2> 7584 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.b.BlockManager maxNumBlocksToLog = 1000
[junit4] 2> 7585 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.n.FSNamesystem fsOwner = jenkins (auth:SIMPLE)
[junit4] 2> 7585 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.n.FSNamesystem supergroup = supergroup
[junit4] 2> 7585 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.n.FSNamesystem isPermissionEnabled = true
[junit4] 2> 7585 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.n.FSNamesystem HA Enabled: false
[junit4] 2> 7585 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.n.FSNamesystem Append Enabled: true
[junit4] 2> 7586 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.u.GSet Computing capacity for map INodeMap
[junit4] 2> 7586 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.u.GSet VM type = 64-bit
[junit4] 2> 7586 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.u.GSet 1.0% max memory 455.5 MB = 4.6 MB
[junit4] 2> 7586 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.u.GSet capacity = 2^19 = 524288 entries
[junit4] 2> 7587 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.n.NameNode Caching file names occuring more than 10 times
[junit4] 2> 7587 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.u.GSet Computing capacity for map cachedBlocks
[junit4] 2> 7587 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.u.GSet VM type = 64-bit
[junit4] 2> 7587 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.u.GSet 0.25% max memory 455.5 MB = 1.1 MB
[junit4] 2> 7588 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.u.GSet capacity = 2^17 = 131072 entries
[junit4] 2> 7588 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.n.FSNamesystem dfs.namenode.safemode.threshold-pct = 0.9990000128746033
[junit4] 2> 7588 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.n.FSNamesystem dfs.namenode.safemode.min.datanodes = 0
[junit4] 2> 7588 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.n.FSNamesystem dfs.namenode.safemode.extension = 0
[junit4] 2> 7588 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.n.FSNamesystem Retry cache on namenode is enabled
[junit4] 2> 7588 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.n.FSNamesystem Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000 millis
[junit4] 2> 7595 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.u.GSet Computing capacity for map NameNodeRetryCache
[junit4] 2> 7595 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.u.GSet VM type = 64-bit
[junit4] 2> 7596 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.u.GSet 0.029999999329447746% max memory 455.5 MB = 139.9 KB
[junit4] 2> 7596 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.u.GSet capacity = 2^14 = 16384 entries
[junit4] 2> 7598 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.n.NNConf ACLs enabled? false
[junit4] 2> 7599 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.n.NNConf XAttrs enabled? true
[junit4] 2> 7599 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.n.NNConf Maximum size of an xattr: 16384
[junit4] 2> 7612 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.c.Storage Lock on /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/name1/in_use.lock acquired by nodename 8882@lucene1-us-west
[junit4] 2> 7622 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.c.Storage Lock on /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/name2/in_use.lock acquired by nodename 8882@lucene1-us-west
[junit4] 2> 7628 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.n.FileJournalManager Recovering unfinalized segments in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/name1/current
[junit4] 2> 7628 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.n.FileJournalManager Recovering unfinalized segments in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/name2/current
[junit4] 2> 7629 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.n.FSImage No edit log streams selected.
[junit4] 2> 7669 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.n.FSImageFormatPBINode Loading 1 INodes.
[junit4] 2> 7691 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.n.FSImageFormatProtobuf Loaded FSImage in 0 seconds.
[junit4] 2> 7691 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.n.FSImage Loaded image for txid 0 from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/name1/current/fsimage_0000000000000000000
[junit4] 2> 7705 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.n.FSNamesystem Need to save fs image? false (staleImage=false, haEnabled=false, isRollingUpgrade=false)
[junit4] 2> 7706 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.n.FSEditLog Starting log segment at 1
[junit4] 2> 7787 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.n.NameCache initialized with 0 entries 0 lookups
[junit4] 2> 7787 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.n.FSNamesystem Finished loading FSImage in 188 msecs
[junit4] 2> 8425 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.n.NameNode RPC server is binding to localhost:0
[junit4] 2> 8457 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.i.CallQueueManager Using callQueue class java.util.concurrent.LinkedBlockingQueue
[junit4] 2> 8561 INFO (Socket Reader #1 for port 35141) [ ] o.a.h.i.Server Starting Socket Reader #1 for port 35141
[junit4] 2> 8650 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.n.NameNode Clients are to use localhost:35141 to access this namenode/service.
[junit4] 2> 8654 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.n.FSNamesystem Registered FSNamesystemState MBean
[junit4] 2> 8734 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.n.FSNamesystem Number of blocks under construction: 0
[junit4] 2> 8734 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.n.FSNamesystem Number of blocks under construction: 0
[junit4] 2> 8735 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.n.FSNamesystem initializing replication queues
[junit4] 2> 8736 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.StateChange STATE* Leaving safe mode after 1 secs
[junit4] 2> 8737 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.StateChange STATE* Network topology has 0 racks and 0 datanodes
[junit4] 2> 8737 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.StateChange STATE* UnderReplicatedBlocks has 0 blocks
[junit4] 2> 8769 INFO (Replication Queue Initializer) [ ] o.a.h.h.s.b.BlockManager Total number of blocks = 0
[junit4] 2> 8770 INFO (Replication Queue Initializer) [ ] o.a.h.h.s.b.BlockManager Number of invalid blocks = 0
[junit4] 2> 8770 INFO (Replication Queue Initializer) [ ] o.a.h.h.s.b.BlockManager Number of under-replicated blocks = 0
[junit4] 2> 8770 INFO (Replication Queue Initializer) [ ] o.a.h.h.s.b.BlockManager Number of over-replicated blocks = 0
[junit4] 2> 8770 INFO (Replication Queue Initializer) [ ] o.a.h.h.s.b.BlockManager Number of blocks being written = 0
[junit4] 2> 8770 INFO (Replication Queue Initializer) [ ] o.a.h.h.StateChange STATE* Replication Queue initialization scan for invalid, over- and under-replicated blocks completed in 31 msec
[junit4] 2> 8843 INFO (IPC Server Responder) [ ] o.a.h.i.Server IPC Server Responder: starting
[junit4] 2> 8938 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.n.NameNode NameNode RPC up at: localhost/127.0.0.1:35141
[junit4] 2> 8938 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.n.FSNamesystem Starting services required for active state
[junit4] 2> 8941 INFO (IPC Server listener on 35141) [ ] o.a.h.i.Server IPC Server listener on 35141: starting
[junit4] 2> 9025 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.MiniDFSCluster Starting DataNode 0 with dfs.datanode.data.dir: [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data1,[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data2
[junit4] 2> 9045 INFO (CacheReplicationMonitor(522443715)) [ ] o.a.h.h.s.b.CacheReplicationMonitor Starting CacheReplicationMonitor with interval 30000 milliseconds
[junit4] 2> 9046 INFO (CacheReplicationMonitor(522443715)) [ ] o.a.h.h.s.b.CacheReplicationMonitor Rescanning after 18070088745 milliseconds
[junit4] 2> 9046 INFO (CacheReplicationMonitor(522443715)) [ ] o.a.h.h.s.b.CacheReplicationMonitor Scanned 0 directive(s) and 0 block(s) in 0 millisecond(s).
[junit4] 2> 9234 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.m.i.MetricsSystemImpl DataNode metrics system started (again)
[junit4] 2> 9236 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.d.DataNode Configured hostname is 127.0.0.1
[junit4] 2> 9247 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.d.DataNode Starting DataNode with maxLockedMemory = 0
[junit4] 2> 9263 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.d.DataNode Opened streaming server at /127.0.0.1:41723
[junit4] 2> 9268 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.d.DataNode Balancing bandwith is 1048576 bytes/s
[junit4] 2> 9268 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.d.DataNode Number threads for balancing is 5
[junit4] 2> 9278 WARN (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 9280 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.HttpServer2 Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
[junit4] 2> 9281 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.HttpServer2 Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context datanode
[junit4] 2> 9285 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.HttpServer2 Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
[junit4] 2> 9286 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.HttpServer2 Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
[junit4] 2> 9299 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.HttpServer2 addJerseyResourcePackage: packageName=org.apache.hadoop.hdfs.server.datanode.web.resources;org.apache.hadoop.hdfs.web.resources, pathSpec=/webhdfs/v1/*
[junit4] 2> 9300 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.HttpServer2 Jetty bound to port 36350
[junit4] 2> 9300 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 9326 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_36350_datanode____.qwrglq/webapp
[junit4] 2> 9491 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
[junit4] 2> 10003 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36350
[junit4] 2> 10007 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.d.DataNode dnUserName = jenkins
[junit4] 2> 10007 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.d.DataNode supergroup = supergroup
[junit4] 2> 10043 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.i.CallQueueManager Using callQueue class java.util.concurrent.LinkedBlockingQueue
[junit4] 2> 10049 INFO (Socket Reader #1 for port 49243) [ ] o.a.h.i.Server Starting Socket Reader #1 for port 49243
[junit4] 2> 10069 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.d.DataNode Opened IPC server at /127.0.0.1:49243
[junit4] 2> 10106 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.d.DataNode Refresh request received for nameservices: null
[junit4] 2> 10112 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.d.DataNode Starting BPOfferServices for nameservices: <default>
[junit4] 2> 10144 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:35141) [ ] o.a.h.h.s.d.DataNode Block pool <registering> (Datanode Uuid unassigned) service to localhost/127.0.0.1:35141 starting to offer service
[junit4] 2> 10174 INFO (IPC Server Responder) [ ] o.a.h.i.Server IPC Server Responder: starting
[junit4] 2> 10200 INFO (IPC Server listener on 49243) [ ] o.a.h.i.Server IPC Server listener on 49243: starting
[junit4] 2> 10272 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.MiniDFSCluster Starting DataNode 1 with dfs.datanode.data.dir: [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data3,[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data4
[junit4] 2> 10424 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.m.i.MetricsSystemImpl DataNode metrics system started (again)
[junit4] 2> 10424 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.d.DataNode Configured hostname is 127.0.0.1
[junit4] 2> 10425 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.d.DataNode Starting DataNode with maxLockedMemory = 0
[junit4] 2> 10426 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.d.DataNode Opened streaming server at /127.0.0.1:57615
[junit4] 2> 10426 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.d.DataNode Balancing bandwith is 1048576 bytes/s
[junit4] 2> 10426 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.d.DataNode Number threads for balancing is 5
[junit4] 2> 10428 WARN (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 10438 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.HttpServer2 Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
[junit4] 2> 10439 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.HttpServer2 Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context datanode
[junit4] 2> 10439 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.HttpServer2 Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
[junit4] 2> 10441 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.HttpServer2 Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
[junit4] 2> 10455 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.HttpServer2 addJerseyResourcePackage: packageName=org.apache.hadoop.hdfs.server.datanode.web.resources;org.apache.hadoop.hdfs.web.resources, pathSpec=/webhdfs/v1/*
[junit4] 2> 10456 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.HttpServer2 Jetty bound to port 44299
[junit4] 2> 10456 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 10530 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_44299_datanode____.inpm87/webapp
[junit4] 2> 10821 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
[junit4] 2> 11272 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44299
[junit4] 2> 11273 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.d.DataNode dnUserName = jenkins
[junit4] 2> 11273 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.d.DataNode supergroup = supergroup
[junit4] 2> 11273 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.i.CallQueueManager Using callQueue class java.util.concurrent.LinkedBlockingQueue
[junit4] 2> 11285 INFO (Socket Reader #1 for port 34885) [ ] o.a.h.i.Server Starting Socket Reader #1 for port 34885
[junit4] 2> 11288 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.d.DataNode Opened IPC server at /127.0.0.1:34885
[junit4] 2> 11304 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.d.DataNode Refresh request received for nameservices: null
[junit4] 2> 11304 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [ ] o.a.h.h.s.d.DataNode Starting BPOfferServices for nameservices: <default>
[junit4] 2> 11317 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:35141) [ ] o.a.h.h.s.d.DataNode Block pool <registering> (Datanode Uuid unassigned) service to localhost/127.0.0.1:35141 starting to offer service
[junit4] 2> 11319 INFO (IPC Server Responder) [ ] o.a.h.i.Server IPC Server Responder: starting
[junit4] 2> 11321 INFO (IPC Server listener on 34885) [ ] o.a.h.i.Server IPC Server listener on 34885: starting
[junit4] 2> 11423 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:35141) [ ] o.a.h.h.s.c.Storage DataNode version: -56 and NameNode layout version: -60
[junit4] 2> 11427 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:35141) [ ] o.a.h.h.s.c.Storage DataNode version: -56 and NameNode layout version: -60
[junit4] 2> 11430 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:35141) [ ] o.a.h.h.s.c.Storage Lock on /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data3/in_use.lock acquired by nodename 8882@lucene1-us-west
[junit4] 2> 11434 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:35141) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data3 is not formatted for BP-2041808141-10.41.0.5-1449609787346
[junit4] 2> 11434 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:35141) [ ] o.a.h.h.s.c.Storage Formatting ...
[junit4] 2> 11440 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:35141) [ ] o.a.h.h.s.c.Storage Lock on /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data1/in_use.lock acquired by nodename 8882@lucene1-us-west
[junit4] 2> 11444 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:35141) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data1 is not formatted for BP-2041808141-10.41.0.5-1449609787346
[junit4] 2> 11444 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:35141) [ ] o.a.h.h.s.c.Storage Formatting ...
[junit4] 2> 11453 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:35141) [ ] o.a.h.h.s.c.Storage Lock on /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data4/in_use.lock acquired by nodename 8882@lucene1-us-west
[junit4] 2> 11454 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:35141) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data4 is not formatted for BP-2041808141-10.41.0.5-1449609787346
[junit4] 2> 11455 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:35141) [ ] o.a.h.h.s.c.Storage Formatting ...
[junit4] 2> 11471 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:35141) [ ] o.a.h.h.s.c.Storage Lock on /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data2/in_use.lock acquired by nodename 8882@lucene1-us-west
[junit4] 2> 11472 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:35141) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data2 is not formatted for BP-2041808141-10.41.0.5-1449609787346
[junit4] 2> 11473 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:35141) [ ] o.a.h.h.s.c.Storage Formatting ...
[junit4] 2> 11802 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:35141) [ ] o.a.h.h.s.c.Storage Analyzing storage directories for bpid BP-2041808141-10.41.0.5-1449609787346
[junit4] 2> 11802 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:35141) [ ] o.a.h.h.s.c.Storage Locking is disabled
[junit4] 2> 11804 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:35141) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data1/current/BP-2041808141-10.41.0.5-1449609787346 is not formatted.
[junit4] 2> 11805 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:35141) [ ] o.a.h.h.s.c.Storage Formatting ...
[junit4] 2> 11805 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:35141) [ ] o.a.h.h.s.c.Storage Formatting block pool BP-2041808141-10.41.0.5-1449609787346 directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data1/current/BP-2041808141-10.41.0.5-1449609787346/current
[junit4] 2> 11808 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:35141) [ ] o.a.h.h.s.c.Storage Locking is disabled
[junit4] 2> 11809 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:35141) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data2/current/BP-2041808141-10.41.0.5-1449609787346 is not formatted.
[junit4] 2> 11809 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:35141) [ ] o.a.h.h.s.c.Storage Formatting ...
[junit4] 2> 11810 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:35141) [ ] o.a.h.h.s.c.Storage Formatting block pool BP-2041808141-10.41.0.5-1449609787346 directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data2/current/BP-2041808141-10.41.0.5-1449609787346/current
[junit4] 2> 11815 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:35141) [ ] o.a.h.h.s.c.Storage Restored 0 block files from trash.
[junit4] 2> 11815 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:35141) [ ] o.a.h.h.s.c.Storage Restored 0 block files from trash.
[junit4] 2> 11821 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:35141) [ ] o.a.h.h.s.d.DataNode Setting up storage: nsid=546498308;bpid=BP-2041808141-10.41.0.5-1449609787346;lv=-56;nsInfo=lv=-60;cid=testClusterID;nsid=546498308;c=0;bpid=BP-2041808141-10.41.0.5-1449609787346;dnuuid=null
[junit4] 2> 11823 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:35141) [ ] o.a.h.h.s.c.Storage Analyzing storage directories for bpid BP-2041808141-10.41.0.5-1449609787346
[junit4] 2> 11824 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:35141) [ ] o.a.h.h.s.c.Storage Locking is disabled
[junit4] 2> 11825 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:35141) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data3/current/BP-2041808141-10.41.0.5-1449609787346 is not formatted.
[junit4] 2> 11825 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:35141) [ ] o.a.h.h.s.c.Storage Formatting ...
[junit4] 2> 11825 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:35141) [ ] o.a.h.h.s.c.Storage Formatting block pool BP-2041808141-10.41.0.5-1449609787346 directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data3/current/BP-2041808141-10.41.0.5-1449609787346/current
[junit4] 2> 11830 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:35141) [ ] o.a.h.h.s.c.Storage Locking is disabled
[junit4] 2> 11831 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:35141) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data4/current/BP-2041808141-10.41.0.5-1449609787346 is not formatted.
[junit4] 2> 11831 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:35141) [ ] o.a.h.h.s.c.Storage Formatting ...
[junit4] 2> 11831 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:35141) [ ] o.a.h.h.s.c.Storage Formatting block pool BP-2041808141-10.41.0.5-1449609787346 directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data4/current/BP-2041808141-10.41.0.5-1449609787346/current
[junit4] 2> 11841 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:35141) [ ] o.a.h.h.s.d.DataNode Generated and persisted new Datanode UUID 5a2ebc82-56fb-47ce-810d-d56b141b7801
[junit4] 2> 11850 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:35141) [ ] o.a.h.h.s.c.Storage Restored 0 block files from trash.
[junit4] 2> 11851 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:35141) [ ] o.a.h.h.s.c.Storage Restored 0 block files from trash.
[junit4] 2> 11857 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:35141) [ ] o.a.h.h.s.d.DataNode Setting up storage: nsid=546498308;bpid=BP-2041808141-10.41.0.5-1449609787346;lv=-56;nsInfo=lv=-60;cid=testClusterID;nsid=546498308;c=0;bpid=BP-2041808141-10.41.0.5-1449609787346;dnuuid=null
[junit4] 2> 11877 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:35141) [ ] o.a.h.h.s.d.DataNode Generated and persisted new Datanode UUID 6b01b325-5d82-4931-8cc6-49c41e900f08
[junit4] 2> 12029 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:35141) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Added new volume: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data3/current
[junit4] 2> 12032 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:35141) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Added volume - /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data3/current, StorageType: DISK
[junit4] 2> 12033 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:35141) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Added new volume: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data1/current
[junit4] 2> 12044 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:35141) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Added volume - /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data1/current, StorageType: DISK
[junit4] 2> 12044 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:35141) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Added new volume: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data2/current
[junit4] 2> 12044 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:35141) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Added volume - /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data2/current, StorageType: DISK
[junit4] 2> 12057 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:35141) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Added new volume: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data4/current
[junit4] 2> 12057 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:35141) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Added volume - /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data4/current, StorageType: DISK
[junit4] 2> 12104 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:35141) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Registered FSDatasetState MBean
[junit4] 2> 12107 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineBasicMiniMRTest_D4DF6ED0852803F1-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/j
[...truncated too long message...]
opping services started for standby state
[junit4] 2> 177981 INFO (SUITE-MorphlineGoLiveMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [n:127.0.0.1:45764_kpux%2Fdy c:collection1 s:shard1 r:core_node5 x:collection1] o.m.log Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0
[junit4] 2> 178083 INFO (SUITE-MorphlineGoLiveMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [n:127.0.0.1:45764_kpux%2Fdy c:collection1 s:shard1 r:core_node5 x:collection1] o.a.h.m.i.MetricsSystemImpl Stopping JobHistoryServer metrics system...
[junit4] 2> 178086 ERROR (SUITE-MorphlineGoLiveMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [n:127.0.0.1:45764_kpux%2Fdy c:collection1 s:shard1 r:core_node5 x:collection1] o.a.h.m.l.MethodMetric Error invoking method getBlocksTotal
[junit4] 2> java.lang.reflect.InvocationTargetException
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:497)
[junit4] 2> at org.apache.hadoop.metrics2.lib.MethodMetric$2.snapshot(MethodMetric.java:111)
[junit4] 2> at org.apache.hadoop.metrics2.lib.MethodMetric.snapshot(MethodMetric.java:144)
[junit4] 2> at org.apache.hadoop.metrics2.lib.MetricsRegistry.snapshot(MetricsRegistry.java:387)
[junit4] 2> at org.apache.hadoop.metrics2.lib.MetricsSourceBuilder$1.getMetrics(MetricsSourceBuilder.java:79)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.getMetrics(MetricsSourceAdapter.java:195)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.updateJmxCache(MetricsSourceAdapter.java:172)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.getMBeanInfo(MetricsSourceAdapter.java:151)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getClassName(DefaultMBeanServerInterceptor.java:1804)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.safeGetClassName(DefaultMBeanServerInterceptor.java:1595)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.checkMBeanPermission(DefaultMBeanServerInterceptor.java:1813)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.exclusiveUnregisterMBean(DefaultMBeanServerInterceptor.java:430)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.unregisterMBean(DefaultMBeanServerInterceptor.java:415)
[junit4] 2> at com.sun.jmx.mbeanserver.JmxMBeanServer.unregisterMBean(JmxMBeanServer.java:546)
[junit4] 2> at org.apache.hadoop.metrics2.util.MBeans.unregister(MBeans.java:81)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stopMBeans(MetricsSourceAdapter.java:227)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stop(MetricsSourceAdapter.java:212)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stopSources(MetricsSystemImpl.java:461)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stop(MetricsSystemImpl.java:212)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.shutdown(MetricsSystemImpl.java:592)
[junit4] 2> at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdownInstance(DefaultMetricsSystem.java:72)
[junit4] 2> at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdown(DefaultMetricsSystem.java:68)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.metrics.NameNodeMetrics.shutdown(NameNodeMetrics.java:145)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.NameNode.stop(NameNode.java:822)
[junit4] 2> at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1720)
[junit4] 2> at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1699)
[junit4] 2> at org.apache.solr.hadoop.MorphlineGoLiveMiniMRTest.teardownClass(MorphlineGoLiveMiniMRTest.java:236)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:497)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:834)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> Caused by: java.lang.NullPointerException
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlocksMap.size(BlocksMap.java:198)
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.getTotalBlocks(BlockManager.java:3291)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlocksTotal(FSNamesystem.java:6223)
[junit4] 2> ... 53 more
[junit4] 2> 178104 INFO (SUITE-MorphlineGoLiveMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [n:127.0.0.1:45764_kpux%2Fdy c:collection1 s:shard1 r:core_node5 x:collection1] o.a.h.m.i.MetricsSystemImpl JobHistoryServer metrics system stopped.
[junit4] 2> 178105 INFO (SUITE-MorphlineGoLiveMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [n:127.0.0.1:45764_kpux%2Fdy c:collection1 s:shard1 r:core_node5 x:collection1] o.a.h.m.i.MetricsSystemImpl JobHistoryServer metrics system shutdown complete.
[junit4] 2> 178110 INFO (SUITE-MorphlineGoLiveMiniMRTest-seed#[D4DF6ED0852803F1]-worker) [n:127.0.0.1:45764_kpux%2Fdy c:collection1 s:shard1 r:core_node5 x:collection1] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J1/temp/solr.hadoop.MorphlineGoLiveMiniMRTest_D4DF6ED0852803F1-001
[junit4] 2> NOTE: test params are: codec=CheapBastard, sim=ClassicSimilarity, locale=bg_BG, timezone=America/Paramaribo
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_66 (64-bit)/cpus=4,threads=8,free=241227064,total=370671616
[junit4] 2> NOTE: All tests run in this JVM: [MorphlineGoLiveMiniMRTest]
[junit4] Completed [7/7 (2!)] on J1 in 179.24s, 2 tests, 1 error <<< FAILURES!
[...truncated 12 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:791: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:728: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:253: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:457: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1436: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:991: There were test failures: 7 suites, 35 tests, 2 errors, 1 ignored [seed: D4DF6ED0852803F1]
Total time: 218 minutes 49 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 875 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/875/
3 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.core.TestCoreDiscovery
Error Message:
ERROR: SolrIndexSearcher opens=27 closes=26
Stack Trace:
java.lang.AssertionError: ERROR: SolrIndexSearcher opens=27 closes=26
at __randomizedtesting.SeedInfo.seed([F1B0EF4985C4E60C]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:453)
at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:225)
at sun.reflect.GeneratedMethodAccessor45.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:834)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
FAILED: junit.framework.TestSuite.org.apache.solr.core.TestCoreDiscovery
Error Message:
1 thread leaked from SUITE scope at org.apache.solr.core.TestCoreDiscovery: 1) Thread[id=3187, name=searcherExecutor-1461-thread-1, state=WAITING, group=TGRP-TestCoreDiscovery] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.core.TestCoreDiscovery:
1) Thread[id=3187, name=searcherExecutor-1461-thread-1, state=WAITING, group=TGRP-TestCoreDiscovery]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
at __randomizedtesting.SeedInfo.seed([F1B0EF4985C4E60C]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.core.TestCoreDiscovery
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=3187, name=searcherExecutor-1461-thread-1, state=WAITING, group=TGRP-TestCoreDiscovery] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=3187, name=searcherExecutor-1461-thread-1, state=WAITING, group=TGRP-TestCoreDiscovery]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
at __randomizedtesting.SeedInfo.seed([F1B0EF4985C4E60C]:0)
Build Log:
[...truncated 10113 lines...]
[junit4] Suite: org.apache.solr.core.TestCoreDiscovery
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/init-core-data-001
[junit4] 2> 505606 INFO (SUITE-TestCoreDiscovery-seed#[F1B0EF4985C4E60C]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false)
[junit4] 2> 505606 INFO (SUITE-TestCoreDiscovery-seed#[F1B0EF4985C4E60C]-worker) [ ] o.a.s.SolrTestCaseJ4 ####initCore
[junit4] 2> 505606 INFO (SUITE-TestCoreDiscovery-seed#[F1B0EF4985C4E60C]-worker) [ ] o.a.s.SolrTestCaseJ4 ####initCore end
[junit4] 2> 505609 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testDiscovery
[junit4] 2> 505616 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 505616 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ ] o.a.s.c.SolrResourceLoader using system property solr.solr.home: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001
[junit4] 2> 505616 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001'
[junit4] 2> 505616 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 505616 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ ] o.a.s.c.SolrResourceLoader using system property solr.solr.home: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001
[junit4] 2> 505616 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001/solr.xml
[junit4] 2> 505627 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001
[junit4] 2> 505628 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ ] o.a.s.c.CoreContainer New CoreContainer 713243136
[junit4] 2> 505628 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001]
[junit4] 2> 505628 WARN (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001/lib
[junit4] 2> 505628 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 600000,connTimeout : 60000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 505631 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=600000&connTimeout=60000&retry=true
[junit4] 2> 505633 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ ] o.a.s.c.SolrCores Allocating transient cache for 2 transient cores
[junit4] 2> 505635 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 505635 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 505635 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 505635 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 505636 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001
[junit4] 2> 505637 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=lazy1, config=solrconfig-minimal.xml, loadOnStartup=false, schema=schema-tiny.xml, configSetProperties=configsetprops.json, transient=true, dataDir=lazy1}
[junit4] 2> 505637 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ ] o.a.s.c.CorePropertiesLocator Found core lazy1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001/lazy1
[junit4] 2> 505637 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=core1, config=solrconfig-minimal.xml, loadOnStartup=true, schema=schema-tiny.xml, configSetProperties=configsetprops.json, transient=false, dataDir=core1}
[junit4] 2> 505637 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ ] o.a.s.c.CorePropertiesLocator Found core core1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001/core1
[junit4] 2> 505638 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=core2, config=solrconfig-minimal.xml, loadOnStartup=false, schema=schema-tiny.xml, configSetProperties=configsetprops.json, transient=false, dataDir=core2}
[junit4] 2> 505638 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ ] o.a.s.c.CorePropertiesLocator Found core core2 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001/core2
[junit4] 2> 505638 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ ] o.a.s.c.CorePropertiesLocator Found 3 core definitions
[junit4] 2> 505639 INFO (coreLoadExecutor-1328-thread-1) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001/core1'
[junit4] 2> 505639 INFO (coreLoadExecutor-1328-thread-1) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 505639 INFO (coreLoadExecutor-1328-thread-1) [ ] o.a.s.c.SolrResourceLoader using system property solr.solr.home: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001
[junit4] 2> 505648 INFO (coreLoadExecutor-1328-thread-1) [ ] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 505655 INFO (coreLoadExecutor-1328-thread-1) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 505660 INFO (coreLoadExecutor-1328-thread-1) [ ] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig-minimal.xml
[junit4] 2> 505663 INFO (coreLoadExecutor-1328-thread-1) [ ] o.a.s.s.IndexSchema [core1] Schema name=tiny
[junit4] 2> 505666 INFO (coreLoadExecutor-1328-thread-1) [ ] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 505667 INFO (coreLoadExecutor-1328-thread-1) [ ] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001/core1'
[junit4] 2> 505668 INFO (coreLoadExecutor-1328-thread-1) [ ] o.a.s.c.CoreContainer Creating SolrCore 'core1' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001/core1
[junit4] 2> 505668 INFO (coreLoadExecutor-1328-thread-1) [ x:core1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 505668 INFO (coreLoadExecutor-1328-thread-1) [ x:core1] o.a.s.c.SolrCore [[core1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001/core1], dataDir=[null]
[junit4] 2> 505668 INFO (coreLoadExecutor-1328-thread-1) [ x:core1] o.a.s.c.SolrCore JMX monitoring not detected for core: core1
[junit4] 2> 505668 INFO (coreLoadExecutor-1328-thread-1) [ x:core1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001/core1/core1
[junit4] 2> 505668 INFO (coreLoadExecutor-1328-thread-1) [ x:core1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001/core1/core1/index/
[junit4] 2> 505668 WARN (coreLoadExecutor-1328-thread-1) [ x:core1] o.a.s.c.SolrCore [core1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001/core1/core1/index' doesn't exist. Creating new index...
[junit4] 2> 505669 INFO (coreLoadExecutor-1328-thread-1) [ x:core1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001/core1/core1/index
[junit4] 2> 505669 INFO (coreLoadExecutor-1328-thread-1) [ x:core1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=26, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 505669 INFO (coreLoadExecutor-1328-thread-1) [ x:core1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(NRTCachingDirectory(RAMDirectory@315cfaea lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@73a5d97a; maxCacheMB=0.0361328125 maxMergeSizeMB=0.3232421875)),segFN=segments_1,generation=1}
[junit4] 2> 505669 INFO (coreLoadExecutor-1328-thread-1) [ x:core1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 505682 INFO (OldIndexDirectoryCleanupThreadForCore-core1) [ x:core1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core core1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001/core1/core1/
[junit4] 2> 505682 WARN (OldIndexDirectoryCleanupThreadForCore-core1) [ x:core1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001/core1/core1/ does not point to a valid data directory; skipping clean-up of old index directories.
[junit4] 2> 505684 INFO (coreLoadExecutor-1328-thread-1) [ x:core1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 505689 INFO (coreLoadExecutor-1328-thread-1) [ x:core1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 505690 INFO (coreLoadExecutor-1328-thread-1) [ x:core1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 505692 INFO (coreLoadExecutor-1328-thread-1) [ x:core1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 505693 INFO (coreLoadExecutor-1328-thread-1) [ x:core1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 505695 INFO (coreLoadExecutor-1328-thread-1) [ x:core1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,/update/csv,/update/json/docs,/admin/luke,/select,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 505695 INFO (coreLoadExecutor-1328-thread-1) [ x:core1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 505696 INFO (coreLoadExecutor-1328-thread-1) [ x:core1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 505696 INFO (coreLoadExecutor-1328-thread-1) [ x:core1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 505696 INFO (coreLoadExecutor-1328-thread-1) [ x:core1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=10, maxMergeAtOnceExplicit=36, maxMergedSegmentMB=84.21875, floorSegmentMB=0.31640625, forceMergeDeletesPctAllowed=8.503416155674447, segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4892377842049237
[junit4] 2> 505696 INFO (coreLoadExecutor-1328-thread-1) [ x:core1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(NRTCachingDirectory(RAMDirectory@315cfaea lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@73a5d97a; maxCacheMB=0.0361328125 maxMergeSizeMB=0.3232421875)),segFN=segments_1,generation=1}
[junit4] 2> 505697 INFO (coreLoadExecutor-1328-thread-1) [ x:core1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 505697 INFO (coreLoadExecutor-1328-thread-1) [ x:core1] o.a.s.s.SolrIndexSearcher Opening Searcher@41946c2d[core1] main
[junit4] 2> 505697 INFO (coreLoadExecutor-1328-thread-1) [ x:core1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001/core1/conf
[junit4] 2> 505697 INFO (coreLoadExecutor-1328-thread-1) [ x:core1] o.a.s.r.RestManager Initializing RestManager with initArgs: {storageDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001/core1/conf}
[junit4] 2> 505697 INFO (coreLoadExecutor-1328-thread-1) [ x:core1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using file:dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001/core1/conf
[junit4] 2> 505697 INFO (coreLoadExecutor-1328-thread-1) [ x:core1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 505698 INFO (coreLoadExecutor-1328-thread-1) [ x:core1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 505698 INFO (coreLoadExecutor-1328-thread-1) [ x:core1] o.a.s.c.CoreContainer registering core: core1
[junit4] 2> 505698 INFO (searcherExecutor-1329-thread-1-processing-x:core1) [ x:core1] o.a.s.c.SolrCore [core1] Registered new searcher Searcher@41946c2d[core1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 505702 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001/core2'
[junit4] 2> 505702 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 505702 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ ] o.a.s.c.SolrResourceLoader using system property solr.solr.home: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001
[junit4] 2> 505709 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ ] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 505712 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 505718 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ ] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig-minimal.xml
[junit4] 2> 505721 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ ] o.a.s.s.IndexSchema [core2] Schema name=tiny
[junit4] 2> 505724 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ ] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 505726 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ ] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001/core2'
[junit4] 2> 505726 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ ] o.a.s.c.CoreContainer Creating SolrCore 'core2' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001/core2
[junit4] 2> 505726 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 505726 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.c.SolrCore [[core2] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001/core2], dataDir=[null]
[junit4] 2> 505726 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.c.SolrCore JMX monitoring not detected for core: core2
[junit4] 2> 505727 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001/core2/core2
[junit4] 2> 505727 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001/core2/core2/index/
[junit4] 2> 505727 WARN (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.c.SolrCore [core2] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001/core2/core2/index' doesn't exist. Creating new index...
[junit4] 2> 505727 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001/core2/core2/index
[junit4] 2> 505729 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=46, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 505730 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@65ab9e87 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1ab579f5),segFN=segments_1,generation=1}
[junit4] 2> 505730 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 505732 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 505733 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 505734 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 505735 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 505736 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 505737 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,/update/csv,/update/json/docs,/admin/luke,/select,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 505738 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 505738 INFO (OldIndexDirectoryCleanupThreadForCore-core2) [ x:core2] o.a.s.c.SolrCore Looking for old index directories to cleanup for core core2 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001/core2/core2/
[junit4] 2> 505738 WARN (OldIndexDirectoryCleanupThreadForCore-core2) [ x:core2] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001/core2/core2/ does not point to a valid data directory; skipping clean-up of old index directories.
[junit4] 2> 505738 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 505739 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 505739 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=30, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6377010055693046]
[junit4] 2> 505742 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@65ab9e87 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1ab579f5),segFN=segments_1,generation=1}
[junit4] 2> 505742 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 505742 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.s.SolrIndexSearcher Opening Searcher@6b189eb5[core2] main
[junit4] 2> 505742 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001/core2/conf
[junit4] 2> 505742 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.r.RestManager Initializing RestManager with initArgs: {storageDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001/core2/conf}
[junit4] 2> 505742 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using file:dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001/core2/conf
[junit4] 2> 505742 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 505742 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 505743 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.c.CoreContainer registering core: core2
[junit4] 2> 505743 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001/lazy1'
[junit4] 2> 505743 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 505743 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.c.SolrResourceLoader using system property solr.solr.home: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001
[junit4] 2> 505749 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 505750 INFO (searcherExecutor-1333-thread-1-processing-x:core2) [ x:core2] o.a.s.c.SolrCore [core2] Registered new searcher Searcher@6b189eb5[core2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 505752 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 505758 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig-minimal.xml
[junit4] 2> 505762 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.s.IndexSchema [lazy1] Schema name=tiny
[junit4] 2> 505765 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 505766 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001/lazy1'
[junit4] 2> 505766 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.c.CoreContainer Creating SolrCore 'lazy1' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001/lazy1
[junit4] 2> 505767 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 505767 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.SolrCore [[lazy1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001/lazy1], dataDir=[null]
[junit4] 2> 505767 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.SolrCore JMX monitoring not detected for core: lazy1
[junit4] 2> 505767 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001/lazy1/lazy1
[junit4] 2> 505768 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001/lazy1/lazy1/index/
[junit4] 2> 505768 WARN (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.SolrCore [lazy1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001/lazy1/lazy1/index' doesn't exist. Creating new index...
[junit4] 2> 505768 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001/lazy1/lazy1/index
[junit4] 2> 505768 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=22, maxMergeAtOnceExplicit=13, maxMergedSegmentMB=50.9775390625, floorSegmentMB=0.4296875, forceMergeDeletesPctAllowed=17.32956106656155, segmentsPerTier=12.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 505769 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(NRTCachingDirectory(RAMDirectory@3a56d207 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@33465d1b; maxCacheMB=0.07421875 maxMergeSizeMB=0.0634765625)),segFN=segments_1,generation=1}
[junit4] 2> 505769 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 505771 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 505772 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 505773 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 505774 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 505775 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 505776 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,/update/csv,/update/json/docs,/admin/luke,/select,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 505776 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 505777 INFO (OldIndexDirectoryCleanupThreadForCore-lazy1) [ x:lazy1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core lazy1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001/lazy1/lazy1/
[junit4] 2> 505777 WARN (OldIndexDirectoryCleanupThreadForCore-lazy1) [ x:lazy1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001/lazy1/lazy1/ does not point to a valid data directory; skipping clean-up of old index directories.
[junit4] 2> 505777 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 505777 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 505777 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=38, maxMergeAtOnceExplicit=38, maxMergedSegmentMB=1.6328125, floorSegmentMB=1.451171875, forceMergeDeletesPctAllowed=13.299749720806654, segmentsPerTier=20.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 505778 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(NRTCachingDirectory(RAMDirectory@3a56d207 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@33465d1b; maxCacheMB=0.07421875 maxMergeSizeMB=0.0634765625)),segFN=segments_1,generation=1}
[junit4] 2> 505778 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 505778 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.s.SolrIndexSearcher Opening Searcher@65a0bcac[lazy1] main
[junit4] 2> 505778 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001/lazy1/conf
[junit4] 2> 505778 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.r.RestManager Initializing RestManager with initArgs: {storageDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001/lazy1/conf}
[junit4] 2> 505778 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using file:dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001/lazy1/conf
[junit4] 2> 505779 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 505780 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 505780 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.SolrCores Opening transient core lazy1
[junit4] 2> 505780 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.CoreContainer registering core: lazy1
[junit4] 2> 505780 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.CoreContainer Shutting down CoreContainer instance=713243136
[junit4] 2> 505780 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:core1] o.a.s.c.SolrCore [core1] CLOSING SolrCore org.apache.solr.core.SolrCore@6d42f9e
[junit4] 2> 505780 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:core1] o.a.s.u.DirectUpdateHandler2 closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 505781 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:core1] o.a.s.u.SolrCoreState Closing SolrCoreState
[junit4] 2> 505781 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:core1] o.a.s.u.DefaultSolrCoreState SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 505781 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:core1] o.a.s.u.DefaultSolrCoreState closing IndexWriter with IndexWriterCloser
[junit4] 2> 505786 INFO (searcherExecutor-1337-thread-1-processing-x:lazy1) [ x:lazy1] o.a.s.c.SolrCore [lazy1] Registered new searcher Searcher@65a0bcac[lazy1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 505787 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:core1] o.a.s.c.SolrCore [core1] Closing main searcher on request.
[junit4] 2> 505787 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:core1] o.a.s.c.CachingDirectoryFactory Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 505787 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:core1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001/core1/core1/index [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001/core1/core1/index;done=false>>]
[junit4] 2> 505787 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:core1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001/core1/core1/index
[junit4] 2> 505787 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:core1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001/core1/core1 [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001/core1/core1;done=false>>]
[junit4] 2> 505787 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:core1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001/core1/core1
[junit4] 2> 505787 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.c.SolrCore [core2] CLOSING SolrCore org.apache.solr.core.SolrCore@6e0b7a35
[junit4] 2> 505787 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.u.DirectUpdateHandler2 closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 505788 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.u.SolrCoreState Closing SolrCoreState
[junit4] 2> 505788 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.u.DefaultSolrCoreState SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 505788 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.u.DefaultSolrCoreState closing IndexWriter with IndexWriterCloser
[junit4] 2> 505788 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.c.SolrCore [core2] Closing main searcher on request.
[junit4] 2> 505788 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.c.CachingDirectoryFactory Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 505788 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001/core2/core2/index [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001/core2/core2/index;done=false>>]
[junit4] 2> 505788 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001/core2/core2/index
[junit4] 2> 505788 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001/core2/core2 [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001/core2/core2;done=false>>]
[junit4] 2> 505788 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001/core2/core2
[junit4] 2> 505788 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.SolrCore [lazy1] CLOSING SolrCore org.apache.solr.core.SolrCore@6ce9418c
[junit4] 2> 505788 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.u.DirectUpdateHandler2 closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 505788 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.u.SolrCoreState Closing SolrCoreState
[junit4] 2> 505788 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.u.DefaultSolrCoreState SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 505789 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.u.DefaultSolrCoreState closing IndexWriter with IndexWriterCloser
[junit4] 2> 505789 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.SolrCore [lazy1] Closing main searcher on request.
[junit4] 2> 505789 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.CachingDirectoryFactory Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 505789 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001/lazy1/lazy1/index [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001/lazy1/lazy1/index;done=false>>]
[junit4] 2> 505789 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001/lazy1/lazy1/index
[junit4] 2> 505789 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001/lazy1/lazy1 [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001/lazy1/lazy1;done=false>>]
[junit4] 2> 505789 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-001/lazy1/lazy1
[junit4] 2> 505789 INFO (TEST-TestCoreDiscovery.testDiscovery-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.SolrTestCaseJ4 ###Ending testDiscovery
[junit4] 2> 505793 INFO (TEST-TestCoreDiscovery.testDuplicateNames-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.SolrTestCaseJ4 ###Starting testDuplicateNames
[junit4] 2> 505798 INFO (TEST-TestCoreDiscovery.testDuplicateNames-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 505798 INFO (TEST-TestCoreDiscovery.testDuplicateNames-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.SolrResourceLoader using system property solr.solr.home: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-002
[junit4] 2> 505798 INFO (TEST-TestCoreDiscovery.testDuplicateNames-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-002'
[junit4] 2> 505798 INFO (TEST-TestCoreDiscovery.testDuplicateNames-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 505798 INFO (TEST-TestCoreDiscovery.testDuplicateNames-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.SolrResourceLoader using system property solr.solr.home: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-002
[junit4] 2> 505798 INFO (TEST-TestCoreDiscovery.testDuplicateNames-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-002/solr.xml
[junit4] 2> 505803 INFO (TEST-TestCoreDiscovery.testDuplicateNames-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-002
[junit4] 2> 505803 INFO (TEST-TestCoreDiscovery.testDuplicateNames-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.CoreContainer New CoreContainer 791235771
[junit4] 2> 505803 INFO (TEST-TestCoreDiscovery.testDuplicateNames-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-002]
[junit4] 2> 505803 WARN (TEST-TestCoreDiscovery.testDuplicateNames-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-002/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-002/lib
[junit4] 2> 505803 INFO (TEST-TestCoreDiscovery.testDuplicateNames-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 600000,connTimeout : 60000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 505806 INFO (TEST-TestCoreDiscovery.testDuplicateNames-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=600000&connTimeout=60000&retry=true
[junit4] 2> 505807 INFO (TEST-TestCoreDiscovery.testDuplicateNames-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.SolrCores Allocating transient cache for 2 transient cores
[junit4] 2> 505807 INFO (TEST-TestCoreDiscovery.testDuplicateNames-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 505807 INFO (TEST-TestCoreDiscovery.testDuplicateNames-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 505807 INFO (TEST-TestCoreDiscovery.testDuplicateNames-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 505807 INFO (TEST-TestCoreDiscovery.testDuplicateNames-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 505808 INFO (TEST-TestCoreDiscovery.testDuplicateNames-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-002
[junit4] 2> 505809 INFO (TEST-TestCoreDiscovery.testDuplicateNames-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=core1, config=solrconfig-minimal.xml, loadOnStartup=true, schema=schema-tiny.xml, configSetProperties=configsetprops.json, transient=false, dataDir=stuffandnonsense}
[junit4] 2> 505809 INFO (TEST-TestCoreDiscovery.testDuplicateNames-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.CorePropertiesLocator Found core core1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-002/core1
[junit4] 2> 505810 INFO (TEST-TestCoreDiscovery.testDuplicateNames-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=core1, config=solrconfig-minimal.xml, loadOnStartup=false, schema=schema-tiny.xml, configSetProperties=configsetprops.json, transient=false, dataDir=stuffandnonsense}
[junit4] 2> 505810 INFO (TEST-TestCoreDiscovery.testDuplicateNames-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.CorePropertiesLocator Found core core1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-002/core2
[junit4] 2> 505810 INFO (TEST-TestCoreDiscovery.testDuplicateNames-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.CorePropertiesLocator Found 2 core definitions
[junit4] 2> 505810 INFO (TEST-TestCoreDiscovery.testDuplicateNames-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.CoreContainer Shutting down CoreContainer instance=791235771
[junit4] 2> 505810 INFO (TEST-TestCoreDiscovery.testDuplicateNames-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.SolrTestCaseJ4 ###Ending testDuplicateNames
[junit4] 2> 505820 INFO (TEST-TestCoreDiscovery.testRootDirectoryResolution-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.SolrTestCaseJ4 ###Starting testRootDirectoryResolution
[junit4] 2> 505820 INFO (TEST-TestCoreDiscovery.testRootDirectoryResolution-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-003'
[junit4] 2> 505820 INFO (TEST-TestCoreDiscovery.testRootDirectoryResolution-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 505820 INFO (TEST-TestCoreDiscovery.testRootDirectoryResolution-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 505830 INFO (TEST-TestCoreDiscovery.testRootDirectoryResolution-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.SolrTestCaseJ4 ###Ending testRootDirectoryResolution
[junit4] 2> 505833 INFO (TEST-TestCoreDiscovery.testNonCoreDirCantRead-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.SolrTestCaseJ4 ###Starting testNonCoreDirCantRead
[junit4] 2> 505837 INFO (TEST-TestCoreDiscovery.testNonCoreDirCantRead-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 505837 INFO (TEST-TestCoreDiscovery.testNonCoreDirCantRead-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.SolrResourceLoader using system property solr.solr.home: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-004
[junit4] 2> 505837 INFO (TEST-TestCoreDiscovery.testNonCoreDirCantRead-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-004'
[junit4] 2> 505838 INFO (TEST-TestCoreDiscovery.testNonCoreDirCantRead-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 505838 INFO (TEST-TestCoreDiscovery.testNonCoreDirCantRead-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.SolrResourceLoader using system property solr.solr.home: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-004
[junit4] 2> 505838 INFO (TEST-TestCoreDiscovery.testNonCoreDirCantRead-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-004/solr.xml
[junit4] 2> 505842 INFO (TEST-TestCoreDiscovery.testNonCoreDirCantRead-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-004
[junit4] 2> 505842 INFO (TEST-TestCoreDiscovery.testNonCoreDirCantRead-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.CoreContainer New CoreContainer 1875409158
[junit4] 2> 505842 INFO (TEST-TestCoreDiscovery.testNonCoreDirCantRead-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-004]
[junit4] 2> 505842 WARN (TEST-TestCoreDiscovery.testNonCoreDirCantRead-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-004/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-004/lib
[junit4] 2> 505843 INFO (TEST-TestCoreDiscovery.testNonCoreDirCantRead-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 600000,connTimeout : 60000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 505845 INFO (TEST-TestCoreDiscovery.testNonCoreDirCantRead-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=600000&connTimeout=60000&retry=true
[junit4] 2> 505846 INFO (TEST-TestCoreDiscovery.testNonCoreDirCantRead-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.SolrCores Allocating transient cache for 2 transient cores
[junit4] 2> 505846 INFO (TEST-TestCoreDiscovery.testNonCoreDirCantRead-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 505846 INFO (TEST-TestCoreDiscovery.testNonCoreDirCantRead-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 505847 INFO (TEST-TestCoreDiscovery.testNonCoreDirCantRead-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 505847 INFO (TEST-TestCoreDiscovery.testNonCoreDirCantRead-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 505847 INFO (TEST-TestCoreDiscovery.testNonCoreDirCantRead-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-004
[junit4] 2> 505848 WARN (TEST-TestCoreDiscovery.testNonCoreDirCantRead-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.CorePropertiesLocator Error visiting /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-004/cantReadDir: java.nio.file.AccessDeniedException: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-004/cantReadDir
[junit4] 2> 505848 INFO (TEST-TestCoreDiscovery.testNonCoreDirCantRead-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=core1, config=solrconfig-minimal.xml, loadOnStartup=true, schema=schema-tiny.xml, configSetProperties=configsetprops.json, transient=false, dataDir=stuffandnonsense}
[junit4] 2> 505848 INFO (TEST-TestCoreDiscovery.testNonCoreDirCantRead-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.CorePropertiesLocator Found core core1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-004/core1
[junit4] 2> 505849 INFO (TEST-TestCoreDiscovery.testNonCoreDirCantRead-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=core2, config=solrconfig-minimal.xml, loadOnStartup=false, schema=schema-tiny.xml, configSetProperties=configsetprops.json, transient=false, dataDir=core2}
[junit4] 2> 505849 INFO (TEST-TestCoreDiscovery.testNonCoreDirCantRead-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.CorePropertiesLocator Found core core2 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-004/core2
[junit4] 2> 505849 INFO (TEST-TestCoreDiscovery.testNonCoreDirCantRead-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.CorePropertiesLocator Found 2 core definitions
[junit4] 2> 505849 INFO (coreLoadExecutor-1352-thread-1-processing-x:lazy1) [ x:lazy1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-004/core1'
[junit4] 2> 505850 INFO (coreLoadExecutor-1352-thread-1-processing-x:lazy1) [ x:lazy1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 505850 INFO (coreLoadExecutor-1352-thread-1-processing-x:lazy1) [ x:lazy1] o.a.s.c.SolrResourceLoader using system property solr.solr.home: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-004
[junit4] 2> 505857 INFO (coreLoadExecutor-1352-thread-1-processing-x:lazy1) [ x:lazy1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 505860 INFO (coreLoadExecutor-1352-thread-1-processing-x:lazy1) [ x:lazy1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 505866 INFO (coreLoadExecutor-1352-thread-1-processing-x:lazy1) [ x:lazy1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig-minimal.xml
[junit4] 2> 505869 INFO (coreLoadExecutor-1352-thread-1-processing-x:lazy1) [ x:lazy1] o.a.s.s.IndexSchema [core1] Schema name=tiny
[junit4] 2> 505892 INFO (coreLoadExecutor-1352-thread-1-processing-x:lazy1) [ x:lazy1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 505894 INFO (coreLoadExecutor-1352-thread-1-processing-x:lazy1) [ x:lazy1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-004/core1'
[junit4] 2> 505894 INFO (coreLoadExecutor-1352-thread-1-processing-x:lazy1) [ x:lazy1] o.a.s.c.CoreContainer Creating SolrCore 'core1' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-004/core1
[junit4] 2> 505894 INFO (coreLoadExecutor-1352-thread-1-processing-x:lazy1) [ x:core1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 505894 INFO (coreLoadExecutor-1352-thread-1-processing-x:lazy1) [ x:core1] o.a.s.c.SolrCore [[core1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-004/core1], dataDir=[null]
[junit4] 2> 505894 INFO (coreLoadExecutor-1352-thread-1-processing-x:lazy1) [ x:core1] o.a.s.c.SolrCore JMX monitoring not detected for core: core1
[junit4] 2> 505895 INFO (coreLoadExecutor-1352-thread-1-processing-x:lazy1) [ x:core1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-004/core1/stuffandnonsense
[junit4] 2> 505895 INFO (coreLoadExecutor-1352-thread-1-processing-x:lazy1) [ x:core1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-004/core1/stuffandnonsense/index/
[junit4] 2> 505895 WARN (coreLoadExecutor-1352-thread-1-processing-x:lazy1) [ x:core1] o.a.s.c.SolrCore [core1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-004/core1/stuffandnonsense/index' doesn't exist. Creating new index...
[junit4] 2> 505895 INFO (coreLoadExecutor-1352-thread-1-processing-x:lazy1) [ x:core1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-004/core1/stuffandnonsense/index
[junit4] 2> 505895 INFO (coreLoadExecutor-1352-thread-1-processing-x:lazy1) [ x:core1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=26, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 505896 INFO (coreLoadExecutor-1352-thread-1-processing-x:lazy1) [ x:core1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(NRTCachingDirectory(RAMDirectory@55bf2199 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@f795616; maxCacheMB=0.0361328125 maxMergeSizeMB=0.3232421875)),segFN=segments_1,generation=1}
[junit4] 2> 505896 INFO (coreLoadExecutor-1352-thread-1-processing-x:lazy1) [ x:core1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 505896 INFO (OldIndexDirectoryCleanupThreadForCore-core1) [ x:core1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core core1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-004/core1/stuffandnonsense/
[junit4] 2> 505896 WARN (OldIndexDirectoryCleanupThreadForCore-core1) [ x:core1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-004/core1/stuffandnonsense/ does not point to a valid data directory; skipping clean-up of old index directories.
[junit4] 2> 505898 INFO (coreLoadExecutor-1352-thread-1-processing-x:lazy1) [ x:core1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 505899 INFO (coreLoadExecutor-1352-thread-1-processing-x:lazy1) [ x:core1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 505900 INFO (coreLoadExecutor-1352-thread-1-processing-x:lazy1) [ x:core1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 505901 INFO (coreLoadExecutor-1352-thread-1-processing-x:lazy1) [ x:core1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 505902 INFO (coreLoadExecutor-1352-thread-1-processing-x:lazy1) [ x:core1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 505903 INFO (coreLoadExecutor-1352-thread-1-processing-x:lazy1) [ x:core1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,/update/csv,/update/json/docs,/admin/luke,/select,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 505903 INFO (coreLoadExecutor-1352-thread-1-processing-x:lazy1) [ x:core1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 505904 INFO (coreLoadExecutor-1352-thread-1-processing-x:lazy1) [ x:core1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 505904 INFO (coreLoadExecutor-1352-thread-1-processing-x:lazy1) [ x:core1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 505904 INFO (coreLoadExecutor-1352-thread-1-processing-x:lazy1) [ x:core1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=10, maxMergeAtOnceExplicit=36, maxMergedSegmentMB=84.21875, floorSegmentMB=0.31640625, forceMergeDeletesPctAllowed=8.503416155674447, segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4892377842049237
[junit4] 2> 505904 INFO (coreLoadExecutor-1352-thread-1-processing-x:lazy1) [ x:core1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(NRTCachingDirectory(RAMDirectory@55bf2199 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@f795616; maxCacheMB=0.0361328125 maxMergeSizeMB=0.3232421875)),segFN=segments_1,generation=1}
[junit4] 2> 505904 INFO (coreLoadExecutor-1352-thread-1-processing-x:lazy1) [ x:core1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 505904 INFO (coreLoadExecutor-1352-thread-1-processing-x:lazy1) [ x:core1] o.a.s.s.SolrIndexSearcher Opening Searcher@b843de2[core1] main
[junit4] 2> 505905 INFO (coreLoadExecutor-1352-thread-1-processing-x:lazy1) [ x:core1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-004/core1/conf
[junit4] 2> 505905 INFO (coreLoadExecutor-1352-thread-1-processing-x:lazy1) [ x:core1] o.a.s.r.RestManager Initializing RestManager with initArgs: {storageDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-004/core1/conf}
[junit4] 2> 505905 INFO (coreLoadExecutor-1352-thread-1-processing-x:lazy1) [ x:core1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using file:dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-004/core1/conf
[junit4] 2> 505905 INFO (coreLoadExecutor-1352-thread-1-processing-x:lazy1) [ x:core1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 505905 INFO (coreLoadExecutor-1352-thread-1-processing-x:lazy1) [ x:core1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 505905 INFO (coreLoadExecutor-1352-thread-1-processing-x:lazy1) [ x:core1] o.a.s.c.CoreContainer registering core: core1
[junit4] 2> 505905 INFO (searcherExecutor-1353-thread-1-processing-x:core1) [ x:core1] o.a.s.c.SolrCore [core1] Registered new searcher Searcher@b843de2[core1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 505905 INFO (TEST-TestCoreDiscovery.testNonCoreDirCantRead-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-004/core2'
[junit4] 2> 505906 INFO (TEST-TestCoreDiscovery.testNonCoreDirCantRead-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 505906 INFO (TEST-TestCoreDiscovery.testNonCoreDirCantRead-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.SolrResourceLoader using system property solr.solr.home: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-004
[junit4] 2> 505911 INFO (TEST-TestCoreDiscovery.testNonCoreDirCantRead-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 505913 INFO (TEST-TestCoreDiscovery.testNonCoreDirCantRead-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 505918 INFO (TEST-TestCoreDiscovery.testNonCoreDirCantRead-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig-minimal.xml
[junit4] 2> 505921 INFO (TEST-TestCoreDiscovery.testNonCoreDirCantRead-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.s.IndexSchema [core2] Schema name=tiny
[junit4] 2> 505924 INFO (TEST-TestCoreDiscovery.testNonCoreDirCantRead-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 505925 INFO (TEST-TestCoreDiscovery.testNonCoreDirCantRead-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-004/core2'
[junit4] 2> 505925 INFO (TEST-TestCoreDiscovery.testNonCoreDirCantRead-seed#[F1B0EF4985C4E60C]) [ x:lazy1] o.a.s.c.CoreContainer Creating SolrCore 'core2' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-004/core2
[junit4] 2> 505925 INFO (TEST-TestCoreDiscovery.testNonCoreDirCantRead-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 505926 INFO (TEST-TestCoreDiscovery.testNonCoreDirCantRead-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.c.SolrCore [[core2] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-004/core2], dataDir=[null]
[junit4] 2> 505926 INFO (TEST-TestCoreDiscovery.testNonCoreDirCantRead-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.c.SolrCore JMX monitoring not detected for core: core2
[junit4] 2> 505926 INFO (TEST-TestCoreDiscovery.testNonCoreDirCantRead-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-004/core2/core2
[junit4] 2> 505926 INFO (TEST-TestCoreDiscovery.testNonCoreDirCantRead-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-004/core2/core2/index/
[junit4] 2> 505926 WARN (TEST-TestCoreDiscovery.testNonCoreDirCantRead-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.c.SolrCore [core2] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-004/core2/core2/index' doesn't exist. Creating new index...
[junit4] 2> 505926 INFO (TEST-TestCoreDiscovery.testNonCoreDirCantRead-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-004/core2/core2/index
[junit4] 2> 505927 INFO (TEST-TestCoreDiscovery.testNonCoreDirCantRead-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=21, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=1.560546875, noCFSRatio=0.10741877895367775]
[junit4] 2> 505927 INFO (TEST-TestCoreDiscovery.testNonCoreDirCantRead-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@278fdda5 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@73a6b82b),segFN=segments_1,generation=1}
[junit4] 2> 505927 INFO (TEST-TestCoreDiscovery.testNonCoreDirCantRead-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 505928 INFO (OldIndexDirectoryCleanupThreadForCore-core2) [ x:core2] o.a.s.c.SolrCore Looking for old index directories to cleanup for core core2 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-004/core2/core2/
[junit4] 2> 505928 WARN (OldIndexDirectoryCleanupThreadForCore-core2) [ x:core2] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-004/core2/core2/ does not point to a valid data directory; skipping clean-up of old index directories.
[junit4] 2> 505929 INFO (TEST-TestCoreDiscovery.testNonCoreDirCantRead-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 505930 INFO (TEST-TestCoreDiscovery.testNonCoreDirCantRead-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 505931 INFO (TEST-TestCoreDiscovery.testNonCoreDirCantRead-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 505931 INFO (TEST-TestCoreDiscovery.testNonCoreDirCantRead-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 505932 INFO (TEST-TestCoreDiscovery.testNonCoreDirCantRead-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 505933 INFO (TEST-TestCoreDiscovery.testNonCoreDirCantRead-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,/update/csv,/update/json/docs,/admin/luke,/select,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 505934 INFO (TEST-TestCoreDiscovery.testNonCoreDirCantRead-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 505934 INFO (TEST-TestCoreDiscovery.testNonCoreDirCantRead-seed#[F1B0EF4985C4E60C]) [ x:core2] o.a.s.u.CommitTracker Ha
[...truncated too long message...]
core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-013/relativeCoreDir/core3/data
[junit4] 2> 507259 INFO (TEST-TestCoreDiscovery.testAlternateRelativeCoreDir-seed#[F1B0EF4985C4E60C]) [ x:core3] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-013/relativeCoreDir/core3/data/index [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-013/relativeCoreDir/core3/data/index;done=false>>]
[junit4] 2> 507259 INFO (TEST-TestCoreDiscovery.testAlternateRelativeCoreDir-seed#[F1B0EF4985C4E60C]) [ x:core3] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_F1B0EF4985C4E60C-001/tempDir-013/relativeCoreDir/core3/data/index
[junit4] 2> 507259 INFO (TEST-TestCoreDiscovery.testAlternateRelativeCoreDir-seed#[F1B0EF4985C4E60C]) [ x:core3] o.a.s.SolrTestCaseJ4 ###Ending testAlternateRelativeCoreDir
[junit4] 2> 507260 INFO (SUITE-TestCoreDiscovery-seed#[F1B0EF4985C4E60C]-worker) [ x:core3] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> 628336 ERROR (SUITE-TestCoreDiscovery-seed#[F1B0EF4985C4E60C]-worker) [ x:core3] o.a.s.SolrTestCaseJ4 ERROR: SolrIndexSearcher opens=27 closes=26
[junit4] 2> Dec 07, 2015 11:01:33 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> Dec 07, 2015 11:01:53 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> SEVERE: 1 thread leaked from SUITE scope at org.apache.solr.core.TestCoreDiscovery:
[junit4] 2> 1) Thread[id=3187, name=searcherExecutor-1461-thread-1, state=WAITING, group=TGRP-TestCoreDiscovery]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
[junit4] 2> at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> Dec 07, 2015 11:01:53 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> INFO: Starting to interrupt leaked threads:
[junit4] 2> 1) Thread[id=3187, name=searcherExecutor-1461-thread-1, state=WAITING, group=TGRP-TestCoreDiscovery]
[junit4] 2> Dec 07, 2015 11:01:56 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> SEVERE: There are still zombie threads that couldn't be terminated:
[junit4] 2> 1) Thread[id=3187, name=searcherExecutor-1461-thread-1, state=WAITING, group=TGRP-TestCoreDiscovery]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
[junit4] 2> at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene60): {}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=en_ZA, timezone=America/Kralendijk
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_66 (64-bit)/cpus=4,threads=2,free=213739392,total=482869248
[junit4] 2> NOTE: All tests run in this JVM: [ReplicationFactorTest, DirectUpdateHandlerTest, OverseerTaskQueueTest, TestTolerantSearch, DistribJoinFromCollectionTest, CloudExitableDirectoryReaderTest, DeleteInactiveReplicaTest, TestExtendedDismaxParser, SimpleFacetsTest, FullSolrCloudDistribCmdsTest, TestConfigSetsAPI, TestManagedSchemaFieldResource, SharedFSAutoReplicaFailoverTest, SuggesterWFSTTest, TestElisionMultitermQuery, PluginInfoTest, CoreAdminHandlerTest, TestFreeTextSuggestions, HdfsLockFactoryTest, TestStressReorder, TestSha256AuthenticationProvider, BinaryUpdateRequestHandlerTest, SuggesterTest, TestManagedSchema, TestCoreDiscovery]
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestCoreDiscovery -Dtests.seed=F1B0EF4985C4E60C -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=en_ZA -Dtests.timezone=America/Kralendijk -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[junit4] ERROR 0.00s J2 | TestCoreDiscovery (suite) <<<
[junit4] > Throwable #1: java.lang.AssertionError: ERROR: SolrIndexSearcher opens=27 closes=26
[junit4] > at __randomizedtesting.SeedInfo.seed([F1B0EF4985C4E60C]:0)
[junit4] > at org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:453)
[junit4] > at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:225)
[junit4] > at java.lang.Thread.run(Thread.java:745)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.core.TestCoreDiscovery:
[junit4] > 1) Thread[id=3187, name=searcherExecutor-1461-thread-1, state=WAITING, group=TGRP-TestCoreDiscovery]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
[junit4] > at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > at __randomizedtesting.SeedInfo.seed([F1B0EF4985C4E60C]:0)Throwable #3: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
[junit4] > 1) Thread[id=3187, name=searcherExecutor-1461-thread-1, state=WAITING, group=TGRP-TestCoreDiscovery]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
[junit4] > at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > at __randomizedtesting.SeedInfo.seed([F1B0EF4985C4E60C]:0)
[junit4] Completed [47/564 (1!)] on J2 in 145.95s, 12 tests, 1 failure, 2 errors <<< FAILURES!
[...truncated 1593 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:789: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:726: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1436: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:991: There were test failures: 564 suites (8 ignored), 2241 tests, 3 suite-level errors, 1403 ignored (9 assumptions) [seed: F1B0EF4985C4E60C]
Total time: 218 minutes 26 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 874 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/874/
1 tests failed.
FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test
Error Message:
Captured an uncaught exception in thread: Thread[id=13020, name=collection5, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=13020, name=collection5, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:52750: collection already exists: awholynewstresscollection_collection5_0
at __randomizedtesting.SeedInfo.seed([D79AC41903F460C5]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:871)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:807)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1574)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1595)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:881)
Build Log:
[...truncated 10368 lines...]
[junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D79AC41903F460C5-001/init-core-data-001
[junit4] 2> 1144523 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[D79AC41903F460C5]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
[junit4] 2> 1144523 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[D79AC41903F460C5]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
[junit4] 2> 1144535 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1144535 INFO (Thread-8344) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1144535 INFO (Thread-8344) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1144635 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.ZkTestServer start zk server on port:42200
[junit4] 2> 1144635 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1144636 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1144638 INFO (zkCallback-1132-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7975ca98 name:ZooKeeperConnection Watcher:127.0.0.1:42200 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1144638 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1144638 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1144638 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 1144642 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1144642 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1144660 INFO (zkCallback-1133-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@25336067 name:ZooKeeperConnection Watcher:127.0.0.1:42200/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1144660 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1144660 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1144660 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
[junit4] 2> 1144662 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
[junit4] 2> 1144665 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
[junit4] 2> 1144666 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
[junit4] 2> 1144668 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 1144668 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 1144670 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 1144670 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
[junit4] 2> 1144672 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1144672 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1144674 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 1144674 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
[junit4] 2> 1144676 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 1144676 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
[junit4] 2> 1144677 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 1144677 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
[junit4] 2> 1144678 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 1144679 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 1144680 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1144680 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 1144681 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1144682 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1144683 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 1144683 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 1144685 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 1144685 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
[junit4] 2> 1145023 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D79AC41903F460C5-001/control-001/cores/collection1
[junit4] 2> 1145025 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.e.j.s.Server jetty-9.3.6.v20151106
[junit4] 2> 1145026 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@44cc7e58{/,null,AVAILABLE}
[junit4] 2> 1145027 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.e.j.s.ServerConnector Started ServerConnector@7a6ad6a5{HTTP/1.1,[http/1.1]}{127.0.0.1:40164}
[junit4] 2> 1145027 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.e.j.s.Server Started @1148241ms
[junit4] 2> 1145027 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D79AC41903F460C5-001/tempDir-001/control/data, hostContext=/, hostPort=40164, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D79AC41903F460C5-001/control-001/cores}
[junit4] 2> 1145027 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 1145027 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D79AC41903F460C5-001/control-001'
[junit4] 2> 1145027 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1145027 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 1145028 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1145032 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1145033 INFO (zkCallback-1134-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@64c75ac3 name:ZooKeeperConnection Watcher:127.0.0.1:42200/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1145033 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1145033 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1145034 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1145034 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D79AC41903F460C5-001/control-001/solr.xml
[junit4] 2> 1145039 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D79AC41903F460C5-001/control-001/cores
[junit4] 2> 1145039 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.CoreContainer New CoreContainer 227661634
[junit4] 2> 1145039 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D79AC41903F460C5-001/control-001]
[junit4] 2> 1145039 WARN (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D79AC41903F460C5-001/control-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D79AC41903F460C5-001/control-001/lib
[junit4] 2> 1145040 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 1145042 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1145042 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1145042 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1145042 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42200/solr
[junit4] 2> 1145042 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 1145043 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1145043 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1145044 INFO (zkCallback-1136-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@74d78773 name:ZooKeeperConnection Watcher:127.0.0.1:42200 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1145045 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1145045 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1145047 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [n:127.0.0.1:40164_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1145049 INFO (zkCallback-1137-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@f667785 name:ZooKeeperConnection Watcher:127.0.0.1:42200/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1145049 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [n:127.0.0.1:40164_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1145050 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [n:127.0.0.1:40164_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
[junit4] 2> 1145052 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [n:127.0.0.1:40164_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 1145056 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [n:127.0.0.1:40164_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 1145058 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [n:127.0.0.1:40164_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 1145060 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [n:127.0.0.1:40164_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 1145063 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [n:127.0.0.1:40164_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 1145065 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [n:127.0.0.1:40164_ ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 1145066 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [n:127.0.0.1:40164_ ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 1145067 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [n:127.0.0.1:40164_ ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 1145068 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [n:127.0.0.1:40164_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40164_
[junit4] 2> 1145069 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [n:127.0.0.1:40164_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:40164_
[junit4] 2> 1145070 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [n:127.0.0.1:40164_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 1145071 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [n:127.0.0.1:40164_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 1145072 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [n:127.0.0.1:40164_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1145073 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [n:127.0.0.1:40164_ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94990819713286148-127.0.0.1:40164_-n_0000000000
[junit4] 2> 1145073 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [n:127.0.0.1:40164_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:40164_
[junit4] 2> 1145073 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [n:127.0.0.1:40164_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
[junit4] 2> 1145074 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [n:127.0.0.1:40164_ ] o.a.s.c.Overseer Overseer (id=94990819713286148-127.0.0.1:40164_-n_0000000000) starting
[junit4] 2> 1145076 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [n:127.0.0.1:40164_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
[junit4] 2> 1145081 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [n:127.0.0.1:40164_ ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 1145081 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [n:127.0.0.1:40164_ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 1145081 INFO (OverseerCollectionConfigSetProcessor-94990819713286148-127.0.0.1:40164_-n_0000000000) [n:127.0.0.1:40164_ ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
[junit4] 2> 1145082 INFO (OverseerStateUpdate-94990819713286148-127.0.0.1:40164_-n_0000000000) [n:127.0.0.1:40164_ ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 1145105 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [n:127.0.0.1:40164_ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 1145105 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [n:127.0.0.1:40164_ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 1145106 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [n:127.0.0.1:40164_ ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D79AC41903F460C5-001/control-001/cores
[junit4] 2> 1145107 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [n:127.0.0.1:40164_ ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=control_collection, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 1145107 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [n:127.0.0.1:40164_ ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D79AC41903F460C5-001/control-001/cores/collection1
[junit4] 2> 1145107 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [n:127.0.0.1:40164_ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
[junit4] 2> 1145108 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [n:127.0.0.1:40164_ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4] 2> 1145108 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [n:127.0.0.1:40164_ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 1145109 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 1145109 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 1145110 INFO (OverseerStateUpdate-94990819713286148-127.0.0.1:40164_-n_0000000000) [n:127.0.0.1:40164_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:40164",
[junit4] 2> "node_name":"127.0.0.1:40164_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 1145111 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 1145111 INFO (OverseerStateUpdate-94990819713286148-127.0.0.1:40164_-n_0000000000) [n:127.0.0.1:40164_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:40164",
[junit4] 2> "node_name":"127.0.0.1:40164_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 1145111 INFO (OverseerStateUpdate-94990819713286148-127.0.0.1:40164_-n_0000000000) [n:127.0.0.1:40164_ ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
[junit4] 2> 1145111 INFO (OverseerStateUpdate-94990819713286148-127.0.0.1:40164_-n_0000000000) [n:127.0.0.1:40164_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 1145113 INFO (zkCallback-1137-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1146111 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 1146111 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
[junit4] 2> 1146112 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 1146112 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 1146112 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1146112 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D79AC41903F460C5-001/control-001/cores/collection1'
[junit4] 2> 1146112 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1146112 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 1146114 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 1146123 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 1146127 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 1146135 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection x:collection1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1146141 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 1146248 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 1146270 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 1146271 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 1146282 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 1146284 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 1146285 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1146286 WARN (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 1146286 WARN (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 1146287 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1146287 WARN (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 1146287 WARN (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 1146288 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4] 2> 1146288 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 1146288 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1146288 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D79AC41903F460C5-001/control-001/cores/collection1], dataDir=[null]
[junit4] 2> 1146289 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5a595f61
[junit4] 2> 1146289 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D79AC41903F460C5-001/control-001/cores/collection1/data
[junit4] 2> 1146289 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D79AC41903F460C5-001/control-001/cores/collection1/data/index/
[junit4] 2> 1146289 WARN (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D79AC41903F460C5-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1146289 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D79AC41903F460C5-001/control-001/cores/collection1/data/index
[junit4] 2> 1146290 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=43, maxMergeAtOnceExplicit=14, maxMergedSegmentMB=66.142578125, floorSegmentMB=1.455078125, forceMergeDeletesPctAllowed=29.567575441761708, segmentsPerTier=36.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.25357201707665694
[junit4] 2> 1146290 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@6940fd64 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@55aa31c2),segFN=segments_1,generation=1}
[junit4] 2> 1146290 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 1146291 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D79AC41903F460C5-001/control-001/cores/collection1/data/
[junit4] 2> 1146291 WARN (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D79AC41903F460C5-001/control-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
[junit4] 2> 1146294 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1146294 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1146294 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1146294 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1146294 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1146294 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1146294 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1146294 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1146294 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1146294 WARN (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,args = {defaults={a=A,b=B}}}
[junit4] 2> 1146296 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1146297 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1146297 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1146298 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1146301 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/dump,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 1146301 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 1146302 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1146302 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1146302 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1146303 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1146303 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=18, maxMergeAtOnceExplicit=28, maxMergedSegmentMB=45.3935546875, floorSegmentMB=0.5771484375, forceMergeDeletesPctAllowed=9.072947969992404, segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8218034873123675
[junit4] 2> 1146303 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@6940fd64 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@55aa31c2),segFN=segments_1,generation=1}
[junit4] 2> 1146303 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 1146303 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@45783dbc[collection1] main
[junit4] 2> 1146303 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 1146304 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1146304 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 1146304 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1146304 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
[junit4] 2> 1146305 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1146305 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 1146305 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1146305 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 1146305 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 1146305 INFO (searcherExecutor-2377-thread-1-processing-n:127.0.0.1:40164_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@45783dbc[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1146306 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
[junit4] 2> 1146306 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
[junit4] 2> 1146306 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
[junit4] 2> 1146306 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1519853117250732032
[junit4] 2> 1146308 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 2.0ms to seed version buckets with highest version 1519853117250732032
[junit4] 2> 1146308 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
[junit4] 2> 1146308 INFO (coreLoadExecutor-2376-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 1146308 INFO (coreZkRegister-2370-thread-1-processing-n:127.0.0.1:40164_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:40164 collection:control_collection shard:shard1
[junit4] 2> 1146310 INFO (coreZkRegister-2370-thread-1-processing-n:127.0.0.1:40164_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 1146313 INFO (coreZkRegister-2370-thread-1-processing-n:127.0.0.1:40164_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/94990819713286148-core_node1-n_0000000000
[junit4] 2> 1146319 INFO (coreZkRegister-2370-thread-1-processing-n:127.0.0.1:40164_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1
[junit4] 2> 1146322 INFO (coreZkRegister-2370-thread-1-processing-n:127.0.0.1:40164_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1146323 INFO (coreZkRegister-2370-thread-1-processing-n:127.0.0.1:40164_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1146323 INFO (coreZkRegister-2370-thread-1-processing-n:127.0.0.1:40164_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:40164/collection1/
[junit4] 2> 1146323 INFO (coreZkRegister-2370-thread-1-processing-n:127.0.0.1:40164_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1146323 INFO (coreZkRegister-2370-thread-1-processing-n:127.0.0.1:40164_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:40164/collection1/ has no replicas
[junit4] 2> 1146323 INFO (OverseerStateUpdate-94990819713286148-127.0.0.1:40164_-n_0000000000) [n:127.0.0.1:40164_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection"} current state version: 1
[junit4] 2> 1146325 INFO (coreZkRegister-2370-thread-1-processing-n:127.0.0.1:40164_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 1146327 INFO (coreZkRegister-2370-thread-1-processing-n:127.0.0.1:40164_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
[junit4] 2> 1146328 INFO (coreZkRegister-2370-thread-1-processing-n:127.0.0.1:40164_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:40164/collection1/ shard1
[junit4] 2> 1146329 INFO (OverseerStateUpdate-94990819713286148-127.0.0.1:40164_-n_0000000000) [n:127.0.0.1:40164_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:40164",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 1
[junit4] 2> 1146431 INFO (zkCallback-1137-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1146479 INFO (coreZkRegister-2370-thread-1-processing-n:127.0.0.1:40164_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:40164/collection1/ and leader is http://127.0.0.1:40164/collection1/
[junit4] 2> 1146480 INFO (coreZkRegister-2370-thread-1-processing-n:127.0.0.1:40164_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:40164
[junit4] 2> 1146480 INFO (coreZkRegister-2370-thread-1-processing-n:127.0.0.1:40164_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1146480 INFO (coreZkRegister-2370-thread-1-processing-n:127.0.0.1:40164_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
[junit4] 2> 1146480 INFO (coreZkRegister-2370-thread-1-processing-n:127.0.0.1:40164_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:40164_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 1146481 INFO (OverseerStateUpdate-94990819713286148-127.0.0.1:40164_-n_0000000000) [n:127.0.0.1:40164_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:40164",
[junit4] 2> "node_name":"127.0.0.1:40164_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 2
[junit4] 2> 1146482 INFO (OverseerStateUpdate-94990819713286148-127.0.0.1:40164_-n_0000000000) [n:127.0.0.1:40164_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:40164",
[junit4] 2> "node_name":"127.0.0.1:40164_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 1146584 INFO (zkCallback-1137-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1146610 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1146611 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1146612 INFO (zkCallback-1139-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@62d26535 name:ZooKeeperConnection Watcher:127.0.0.1:42200/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1146612 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1146612 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1146612 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 1146614 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 1146904 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D79AC41903F460C5-001/shard-1-001/cores/collection1
[junit4] 2> 1146905 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D79AC41903F460C5-001/shard-1-001
[junit4] 2> 1146906 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.e.j.s.Server jetty-9.3.6.v20151106
[junit4] 2> 1146907 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1f823f8e{/,null,AVAILABLE}
[junit4] 2> 1146907 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.e.j.s.ServerConnector Started ServerConnector@140756fa{HTTP/1.1,[http/1.1]}{127.0.0.1:41579}
[junit4] 2> 1146908 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.e.j.s.Server Started @1150121ms
[junit4] 2> 1146908 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D79AC41903F460C5-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/, hostPort=41579, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D79AC41903F460C5-001/shard-1-001/cores}
[junit4] 2> 1146908 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 1146908 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D79AC41903F460C5-001/shard-1-001'
[junit4] 2> 1146908 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1146908 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 1146908 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1146909 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1146910 INFO (zkCallback-1140-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@564c3859 name:ZooKeeperConnection Watcher:127.0.0.1:42200/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1146910 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1146911 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1146911 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1146911 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D79AC41903F460C5-001/shard-1-001/solr.xml
[junit4] 2> 1146916 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D79AC41903F460C5-001/shard-1-001/cores
[junit4] 2> 1146916 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.CoreContainer New CoreContainer 1877587170
[junit4] 2> 1146916 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D79AC41903F460C5-001/shard-1-001]
[junit4] 2> 1146916 WARN (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D79AC41903F460C5-001/shard-1-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D79AC41903F460C5-001/shard-1-001/lib
[junit4] 2> 1146917 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 1146918 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1146918 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1146918 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1146918 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42200/solr
[junit4] 2> 1146918 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 1146918 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1146919 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1146920 INFO (zkCallback-1142-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7ea9bb2a name:ZooKeeperConnection Watcher:127.0.0.1:42200 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1146923 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1146924 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1146939 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [n:127.0.0.1:41579_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1146939 INFO (zkCallback-1143-thread-1-processing-n:127.0.0.1:41579_) [n:127.0.0.1:41579_ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3cab6281 name:ZooKeeperConnection Watcher:127.0.0.1:42200/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1146939 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [n:127.0.0.1:41579_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1146957 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [n:127.0.0.1:41579_ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 1147967 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [n:127.0.0.1:41579_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41579_
[junit4] 2> 1147968 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [n:127.0.0.1:41579_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:41579_
[junit4] 2> 1147968 INFO (zkCallback-1137-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1147968 INFO (zkCallback-1143-thread-1-processing-n:127.0.0.1:41579_) [n:127.0.0.1:41579_ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1147971 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [n:127.0.0.1:41579_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1147971 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [n:127.0.0.1:41579_ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94990819713286152-127.0.0.1:41579_-n_0000000001
[junit4] 2> 1147972 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [n:127.0.0.1:41579_ ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/94990819713286148-127.0.0.1:40164_-n_0000000000 to know if I could be the leader
[junit4] 2> 1147976 INFO (zkCallback-1139-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1148005 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [n:127.0.0.1:41579_ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 1148005 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [n:127.0.0.1:41579_ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 1148005 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [n:127.0.0.1:41579_ ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D79AC41903F460C5-001/shard-1-001/cores
[junit4] 2> 1148006 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [n:127.0.0.1:41579_ ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=collection1, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 1148006 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [n:127.0.0.1:41579_ ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D79AC41903F460C5-001/shard-1-001/cores/collection1
[junit4] 2> 1148006 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [n:127.0.0.1:41579_ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
[junit4] 2> 1148007 INFO (coreLoadExecutor-2387-thread-1-processing-n:127.0.0.1:41579_) [n:127.0.0.1:41579_ c:collection1 x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 1148007 INFO (coreLoadExecutor-2387-thread-1-processing-n:127.0.0.1:41579_) [n:127.0.0.1:41579_ c:collection1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 1148008 INFO (OverseerStateUpdate-94990819713286148-127.0.0.1:40164_-n_0000000000) [n:127.0.0.1:40164_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:41579",
[junit4] 2> "node_name":"127.0.0.1:41579_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"} current state version: 3
[junit4] 2> 1148009 INFO (OverseerStateUpdate-94990819713286148-127.0.0.1:40164_-n_0000000000) [n:127.0.0.1:40164_ ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:41579",
[junit4] 2> "node_name":"127.0.0.1:41579_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"}
[junit4] 2> 1148009 INFO (OverseerStateUpdate-94990819713286148-127.0.0.1:40164_-n_0000000000) [n:127.0.0.1:40164_ ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
[junit4] 2> 1148009 INFO (OverseerStateUpdate-94990819713286148-127.0.0.1:40164_-n_0000000000) [n:127.0.0.1:40164_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2
[junit4] 2> 1148010 INFO (coreLoadExecutor-2387-thread-1-processing-n:127.0.0.1:41579_) [n:127.0.0.1:41579_ c:collection1 x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 1148012 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [n:127.0.0.1:41579_ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4] 2> 1148012 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[D79AC41903F460C5]) [n:127.0.0.1:41579_ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 1148115 INFO (zkCallback-1137-thread-1-processing-n:127.0.0.1:40164_) [n:127.0.0.1:40164_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1148119 INFO (zkCallback-1139-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1148119 INFO (zkCallback-1143-thread-1-processing-n:127.0.0.1:41579_) [n:127.0.0.1:41579_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1149011 INFO (coreLoadExecutor-2387-thread-1-processing-n:127.0.0.1:41579_) [n:127.0.0.1:41579_ c:collection1 x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 1149011 INFO (coreLoadExecutor-2387-thread-1-processing-n:127.0.0.1:41579_) [n:127.0.0.1:41579_ c:collection1 x:collection1] o.a.s.c.ZkController Check for collection zkNode:collection1
[junit4] 2> 1149011 INFO (coreLoadExecutor-2387-thread-1-processing-n:127.0.0.1:41579_) [n:127.0.0.1:41579_ c:collection1 x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 1149011 INFO (coreLoadExecutor-2387-thread-1-processing-n:127.0.0.1:41579_) [n:127.0.0.1:41579_ c:collection1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/collection1
[junit4] 2> 1149012 INFO (coreLoadExecutor-2387-thread-1-processing-n:127.0.0.1:41579_) [n:127.0.0.1:41579_ c:collection1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1149012 INFO (coreLoadExecutor-2387-thread-1-processing-n:127.0.0.1:41579_) [n:127.0.0.1:41579_ c:collection1 x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D79AC41903F460C5-001/shard-1-001/cores/collection1'
[junit4] 2> 1149012 INFO (coreLoadExecutor-2387-thread-1-processing-n:127.0.0.1:41579_) [n:127.0.0.1:41579_ c:collection1 x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1149012 INFO (coreLoadExecutor-2387-thread-1-processing-n:127.0.0.1:41579_) [n:127.0.0.1:41579_ c:collection1 x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 1149013 INFO (coreLoadExecutor-2387-thread-1-processing-n:127.0.0.1:41579_) [n:127.0.0.1:41579_ c:collection1 x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 1149018 INFO (coreLoadExecutor-2387-thread-1-processing-n:127.0.0.1:41579_) [n:127.0.0.1:41579_ c:collection1 x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 1149022 INFO (coreLoadExecutor-2387-thread-1-processing-n:127.0.0.1:41579_) [n:127.0.0.1:41579_ c:collection1 x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 1149029 INFO (coreLoadExecutor-2387-thread-1-processing-n:127.0.0.1:41579_) [n:127.0.0.1:41579_ c:collection1 x:collection1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1149035 INFO (coreLoadExecutor-2387-thread-1-processing-n:127.0.0.1:41579_) [n:127.0.0.1:41579_ c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 1149262 INFO (coreLoadExecutor-2387-thread-1-processing-n:127.0.0.1:41579_) [n:127.0.0.1:41579_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 1149270 INFO (coreLoadExecutor-2387-thread-1-processing-n:127.0.0.1:41579_) [n:127.0.0.1:41579_ c:collection1 x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 1149271 INFO (coreLoadExecutor-2387-thread-1-processing-n:127.0.0.1:41579_) [n:127.0.0.1:41579_ c:collection1 x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 1149279 INFO (coreLoadExecutor-2387-thread-1-processing-n:127.0.0.1:41579_) [n:127.0.0.1:41579_ c:collection1 x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 1149281 INFO (coreLoadExecutor-2387-thread-1-processing-n:127.0.0.1:41579_) [n:127.0.0.1:41579_ c:collection1 x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 1149282 INFO (coreLoadExecutor-2387-thread-1-processing-n:127.0.0.1:41579_) [n:127.0.0.1:41579_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1149283 WARN (coreLoadExecutor-2387-thread-1-processing-n:127.0.0.1:41579_) [n:127.0.0.1:41579_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 1149283 WARN (coreLoadExecutor-2387-thread-1-processing-n:127.0.0.1:41579_) [n:127.0.0.1:41579_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 1149283 INFO (coreLoadExecutor-2387-thread-1-processing-n:127.0.0.1:41579_) [n:127.0.0.1:41579_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1149283 WARN (coreLoadExecutor-2387-thread-1-processing-n:127.0.0.1:41579_) [n:127.0.0.1:41579_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 1149283 WARN (coreLoadExecutor-2387-thread-1-processing-n:127.0.0.1:41579_) [n:127.0.0.1:41579_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 1149315 INFO (coreLoadExecutor-2387-thread-1-processing-n:127.0.0.1:41579_) [n:127.0.0.1:41579_ c:collection1 x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4] 2> 1149315 INFO (coreLoadExecutor-2387-thread-1-processing-n:127.0.0.1:41579_) [n:127.0.0.1:41579_ c:collection1 x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 1149315 INFO (coreLoadExecutor-2387-thread-1-processing-n:127.0.0.1:41579_) [n:127.0.0.1:41579_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1149316 INFO (coreLoadExecutor-2387-thread-1-processing-n:127.0.0.1:41579_) [n:127.0.0.1:41579_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D79AC41903F460C5-001/shard-1-001/cores/collection1], dataDir=[null]
[junit4] 2> 1149316 INFO (coreLoadExecutor-2387-thread-1-processing-n:127.0.0.1:41579_) [n:127.0.0.1:41579_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5a595f61
[junit4] 2> 1149316 INFO (coreLoadExecutor-2387-thread-1-processing-n:127.0.0.1:41579_) [n:127.0.0.1:41579_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D79AC41903F460C5-001/shard-1-001/cores/collection1/data
[junit4] 2> 1149316 INFO (coreLoadExecutor-2387-thread-1-processing-n:127.0.0.1:41579_) [n:127.0.0.1:41579_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D79AC41903F460C5-001/shard-1-001/cores/collection1/data/index/
[junit4] 2> 1149316 WARN (coreLoadExecutor-2387-thread-1-processing-n:127.0.0.1:41579_) [n:127.0.0.1:41579_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D79AC41903F460C5-001/shard-1-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1149317 INFO (coreLoadExecutor-2387-thread-1-processing-n:127.0.0.1:41579_) [n:127.0.0.1:41579_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D79AC41903F460C5-001/shard-1-001/cores/collection1/data/index
[junit4] 2> 1149317 INFO (coreLoadExecutor-2387-thread-1-processing-n:127.0.0.1:41579_) [n:127.0.0.1:41579_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=43, maxMergeAtOnceExplicit=14, maxMergedSegmentMB=66.142578125, floorSegmentMB=1.455078125, forceMergeDeletesPctAllowed=29.567575441761708, segmentsPerTier=36.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.25357201707665694
[junit4] 2> 1149317 INFO (coreLoadExecutor-2387-thread-1-processing-n:127.0.0.1:41579_) [n:127.0.0.1:41579_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@35b731ff lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1991be32),segFN=segments_1,generation=1}
[junit4] 2> 1149317 INFO (coreLoadExecutor-2387-thread-1-processing-n:127.0.0.1:41579_) [n:127.0.0.1:41579_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 1149321 INFO (coreLoadExecutor-2387-thread-1-processing-n:127.0.0.1:41579_) [n:127.0.0.1:41579_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1149322 INFO (coreLoadExecutor-2387-thread-1-processing-n:127.0.0.1:41579_) [n:127.0.0.1:41579_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1149322 INFO (coreLoadExecutor-2387-thread-1-processing-n:127.0.0.1:41579_) [n:127.0.0.1:41579_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1149322 INFO (coreLoadExecutor-2387-thread-1-processing-n:127.0.0.1:41579_) [n:127.0.0.1:41579_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1149322 INFO (coreLoadExecutor-2387-thread-1-processing-n:127.0.0.1:41579_) [n:127.0.0.1:41579_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1149322 INFO (coreLoadExecutor-2387-thread-1-processing-n:127.0.0.1:41579_) [n:127.0.0.1:41579_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1149322 INFO (coreLoadExecutor-2387-thread-1-processing-n:127.0.0.1:41579_) [n:127.0.0.1:41579_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1149322 INFO (coreLoadExecutor-2387-thread-1-processing-n:127.0.0.1:41579_) [n:127.0.0.1:41579_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateP
[...truncated too long message...]
llection already exists: awholynewstresscollection_collection2_0
[junit4] > at __randomizedtesting.SeedInfo.seed([D79AC41903F460C5]:0)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:871)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:807)
[junit4] > at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1574)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1595)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:881)Throwable #4: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=13018, name=collection3, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:52750: Could not find collection : awholynewstresscollection_collection3_0
[junit4] > at __randomizedtesting.SeedInfo.seed([D79AC41903F460C5]:0)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:871)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:807)
[junit4] > at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:888)Throwable #5: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=13015, name=collection0, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:52750: collection already exists: awholynewstresscollection_collection0_0
[junit4] > at __randomizedtesting.SeedInfo.seed([D79AC41903F460C5]:0)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:871)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:807)
[junit4] > at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1574)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1595)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:881)Throwable #6: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=13016, name=collection1, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:52750: collection already exists: awholynewstresscollection_collection1_0
[junit4] > at __randomizedtesting.SeedInfo.seed([D79AC41903F460C5]:0)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:871)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:807)
[junit4] > at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1574)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1595)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:881)
[junit4] 2> 1497952 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[D79AC41903F460C5]-worker) [n:127.0.0.1:58189_ c:addReplicaColl s:shard2 r:core_node6 x:addReplicaColl_shard2_replica3] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: test params are: codec=CheapBastard, sim=RandomSimilarityProvider(queryNorm=false,coord=crazy): {}, locale=es, timezone=Africa/Harare
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_66 (64-bit)/cpus=4,threads=1,free=46221968,total=499646464
[junit4] 2> NOTE: All tests run in this JVM: [CollectionStateFormat2Test, TestCodecSupport, HdfsChaosMonkeyNothingIsSafeTest, SharedFSAutoReplicaFailoverTest, RequestLoggingTest, DistributedMLTComponentTest, LeaderInitiatedRecoveryOnShardRestartTest, DocValuesTest, TestLMJelinekMercerSimilarityFactory, TestCollapseQParserPlugin, TestLeaderElectionZkExpiry, TestDefaultSearchFieldResource, TestMiniSolrCloudClusterBase, TestSolr4Spatial2, TestQueryUtils, TestHashQParserPlugin, TestHashPartitioner, TestCollationFieldDocValues, FacetPivotSmallTest, SegmentsInfoRequestHandlerTest, TestQuerySenderListener, ChaosMonkeyNothingIsSafeTest, TestSolrConfigHandlerConcurrent, HLLUtilTest, CursorPagingTest, SolrPluginUtilsTest, AsyncMigrateRouteKeyTest, CollectionTooManyReplicasTest, TestPartialUpdateDeduplication, TestSystemIdResolver, CachingDirectoryFactoryTest, MoreLikeThisHandlerTest, MinimalSchemaTest, TestSolrConfigHandlerCloud, InfoHandlerTest, TestMacros, TestInitQParser, TestMiniSolrCloudClusterSSL, HighlighterTest, SolrIndexConfigTest, TestAddFieldRealTimeGet, TestRequestStatusCollectionAPI, TestConfigSetImmutable, CollectionsAPIDistributedZkTest]
[junit4] Completed [188/564] on J1 in 354.27s, 1 test, 1 error <<< FAILURES!
[...truncated 1186 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:789: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:726: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987: There were test failures: 564 suites (8 ignored), 2238 tests, 1 error, 33 ignored (18 assumptions) [seed: D79AC41903F460C5]
Total time: 207 minutes 52 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 873 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/873/
2 tests failed.
FAILED: org.apache.solr.handler.TestReplicationHandler.doTestReplicateAfterCoreReload
Error Message:
expected:<[{indexVersion=1449389857132,generation=2,filelist=[_5.cfe, _5.cfs, _5.si, _9.doc, _9.fdt, _9.fdx, _9.fnm, _9.nvd, _9.nvm, _9.si, _9.tim, _9.tip, _a.cfe, _a.cfs, _a.si, segments_2]}]> but was:<[{indexVersion=1449389857132,generation=2,filelist=[_5.cfe, _5.cfs, _5.si, _9.doc, _9.fdt, _9.fdx, _9.fnm, _9.nvd, _9.nvm, _9.si, _9.tim, _9.tip, _a.cfe, _a.cfs, _a.si, segments_2]}, {indexVersion=1449389857132,generation=3,filelist=[_5.cfe, _5.cfs, _5.si, _a.cfe, _a.cfs, _a.si, _b.cfe, _b.cfs, _b.si, segments_3]}]>
Stack Trace:
java.lang.AssertionError: expected:<[{indexVersion=1449389857132,generation=2,filelist=[_5.cfe, _5.cfs, _5.si, _9.doc, _9.fdt, _9.fdx, _9.fnm, _9.nvd, _9.nvm, _9.si, _9.tim, _9.tip, _a.cfe, _a.cfs, _a.si, segments_2]}]> but was:<[{indexVersion=1449389857132,generation=2,filelist=[_5.cfe, _5.cfs, _5.si, _9.doc, _9.fdt, _9.fdx, _9.fnm, _9.nvd, _9.nvm, _9.si, _9.tim, _9.tip, _a.cfe, _a.cfs, _a.si, segments_2]}, {indexVersion=1449389857132,generation=3,filelist=[_5.cfe, _5.cfs, _5.si, _a.cfe, _a.cfs, _a.si, _b.cfe, _b.cfs, _b.si, segments_3]}]>
at __randomizedtesting.SeedInfo.seed([65F7FD935BE4F9B0:4020E6A32BACF7B3]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:147)
at org.apache.solr.handler.TestReplicationHandler.doTestReplicateAfterCoreReload(TestReplicationHandler.java:1140)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test
Error Message:
Error from server at http://127.0.0.1:50806/ze/m: Could not load collection from ZK:awholynewcollection_7
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:50806/ze/m: Could not load collection from ZK:awholynewcollection_7
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.makeRequest(CollectionsAPIDistributedZkTest.java:295)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testErrorHandling(CollectionsAPIDistributedZkTest.java:412)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test(CollectionsAPIDistributedZkTest.java:162)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:965)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:940)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 10661 lines...]
[junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_65F7FD935BE4F9B0-001/init-core-data-001
[junit4] 2> 1375243 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[65F7FD935BE4F9B0]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
[junit4] 2> 1375243 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[65F7FD935BE4F9B0]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /ze/m
[junit4] 2> 1375246 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1375247 INFO (Thread-107581) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1375247 INFO (Thread-107581) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1375347 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.ZkTestServer start zk server on port:51717
[junit4] 2> 1375347 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1375348 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1375351 INFO (zkCallback-717-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@297389d3 name:ZooKeeperConnection Watcher:127.0.0.1:51717 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1375351 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1375351 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1375351 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 1375354 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1375354 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1375355 INFO (zkCallback-718-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@d3d2d61 name:ZooKeeperConnection Watcher:127.0.0.1:51717/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1375355 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1375356 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1375356 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
[junit4] 2> 1375358 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
[junit4] 2> 1375359 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
[junit4] 2> 1375360 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
[junit4] 2> 1375361 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 1375361 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 1375363 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 1375363 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
[junit4] 2> 1375365 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1375365 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1375367 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 1375367 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
[junit4] 2> 1375368 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 1375369 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
[junit4] 2> 1375370 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 1375370 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
[junit4] 2> 1375372 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 1375372 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 1375373 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1375373 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 1375375 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1375375 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1375376 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 1375376 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 1375378 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 1375378 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
[junit4] 2> 1375700 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_65F7FD935BE4F9B0-001/control-001/cores/collection1
[junit4] 2> 1375702 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.e.j.s.Server jetty-9.3.6.v20151106
[junit4] 2> 1375703 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2c55f0f2{/ze/m,null,AVAILABLE}
[junit4] 2> 1375707 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.e.j.s.ServerConnector Started ServerConnector@61f94cd9{HTTP/1.1,[http/1.1]}{127.0.0.1:40855}
[junit4] 2> 1375707 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.e.j.s.Server Started @1379068ms
[junit4] 2> 1375707 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_65F7FD935BE4F9B0-001/tempDir-001/control/data, hostContext=/ze/m, hostPort=40855, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_65F7FD935BE4F9B0-001/control-001/cores}
[junit4] 2> 1375707 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 1375708 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_65F7FD935BE4F9B0-001/control-001'
[junit4] 2> 1375708 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1375708 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 1375708 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1375709 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1375710 INFO (zkCallback-719-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4233cebc name:ZooKeeperConnection Watcher:127.0.0.1:51717/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1375710 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1375710 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1375711 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1375711 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_65F7FD935BE4F9B0-001/control-001/solr.xml
[junit4] 2> 1375716 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_65F7FD935BE4F9B0-001/control-001/cores
[junit4] 2> 1375716 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.CoreContainer New CoreContainer 508989927
[junit4] 2> 1375716 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_65F7FD935BE4F9B0-001/control-001]
[junit4] 2> 1375716 WARN (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_65F7FD935BE4F9B0-001/control-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_65F7FD935BE4F9B0-001/control-001/lib
[junit4] 2> 1375717 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 1375718 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1375719 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1375719 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1375719 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:51717/solr
[junit4] 2> 1375719 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 1375719 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1375720 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1375721 INFO (zkCallback-721-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@51ea3060 name:ZooKeeperConnection Watcher:127.0.0.1:51717 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1375723 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1375723 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1375725 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [n:127.0.0.1:40855_ze%2Fm ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1375726 INFO (zkCallback-722-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@63a88410 name:ZooKeeperConnection Watcher:127.0.0.1:51717/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1375726 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [n:127.0.0.1:40855_ze%2Fm ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1375727 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [n:127.0.0.1:40855_ze%2Fm ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
[junit4] 2> 1375729 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [n:127.0.0.1:40855_ze%2Fm ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 1375731 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [n:127.0.0.1:40855_ze%2Fm ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 1375733 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [n:127.0.0.1:40855_ze%2Fm ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 1375734 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [n:127.0.0.1:40855_ze%2Fm ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 1375736 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [n:127.0.0.1:40855_ze%2Fm ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 1375737 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [n:127.0.0.1:40855_ze%2Fm ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 1375738 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [n:127.0.0.1:40855_ze%2Fm ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 1375739 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [n:127.0.0.1:40855_ze%2Fm ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 1375740 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [n:127.0.0.1:40855_ze%2Fm ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40855_ze%2Fm
[junit4] 2> 1375741 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [n:127.0.0.1:40855_ze%2Fm ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:40855_ze%2Fm
[junit4] 2> 1375742 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [n:127.0.0.1:40855_ze%2Fm ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 1375743 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [n:127.0.0.1:40855_ze%2Fm ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 1375744 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [n:127.0.0.1:40855_ze%2Fm ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1375744 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [n:127.0.0.1:40855_ze%2Fm ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94987128030429188-127.0.0.1:40855_ze%2Fm-n_0000000000
[junit4] 2> 1375745 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [n:127.0.0.1:40855_ze%2Fm ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:40855_ze%2Fm
[junit4] 2> 1375745 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [n:127.0.0.1:40855_ze%2Fm ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
[junit4] 2> 1375746 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [n:127.0.0.1:40855_ze%2Fm ] o.a.s.c.Overseer Overseer (id=94987128030429188-127.0.0.1:40855_ze%2Fm-n_0000000000) starting
[junit4] 2> 1375747 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [n:127.0.0.1:40855_ze%2Fm ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
[junit4] 2> 1375752 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [n:127.0.0.1:40855_ze%2Fm ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 1375753 INFO (OverseerCollectionConfigSetProcessor-94987128030429188-127.0.0.1:40855_ze%2Fm-n_0000000000) [n:127.0.0.1:40855_ze%2Fm ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
[junit4] 2> 1375753 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [n:127.0.0.1:40855_ze%2Fm ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 1375753 INFO (OverseerStateUpdate-94987128030429188-127.0.0.1:40855_ze%2Fm-n_0000000000) [n:127.0.0.1:40855_ze%2Fm ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 1375766 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [n:127.0.0.1:40855_ze%2Fm ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 1375766 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [n:127.0.0.1:40855_ze%2Fm ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 1375767 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [n:127.0.0.1:40855_ze%2Fm ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_65F7FD935BE4F9B0-001/control-001/cores
[junit4] 2> 1375768 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [n:127.0.0.1:40855_ze%2Fm ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=control_collection, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 1375768 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [n:127.0.0.1:40855_ze%2Fm ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_65F7FD935BE4F9B0-001/control-001/cores/collection1
[junit4] 2> 1375768 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [n:127.0.0.1:40855_ze%2Fm ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
[junit4] 2> 1375769 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [n:127.0.0.1:40855_ze%2Fm ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4] 2> 1375769 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [n:127.0.0.1:40855_ze%2Fm ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 1375769 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 1375769 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 1375771 INFO (OverseerStateUpdate-94987128030429188-127.0.0.1:40855_ze%2Fm-n_0000000000) [n:127.0.0.1:40855_ze%2Fm ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:40855/ze/m",
[junit4] 2> "node_name":"127.0.0.1:40855_ze%2Fm",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 1375771 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 1375771 INFO (OverseerStateUpdate-94987128030429188-127.0.0.1:40855_ze%2Fm-n_0000000000) [n:127.0.0.1:40855_ze%2Fm ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:40855/ze/m",
[junit4] 2> "node_name":"127.0.0.1:40855_ze%2Fm",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 1375772 INFO (OverseerStateUpdate-94987128030429188-127.0.0.1:40855_ze%2Fm-n_0000000000) [n:127.0.0.1:40855_ze%2Fm ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
[junit4] 2> 1375772 INFO (OverseerStateUpdate-94987128030429188-127.0.0.1:40855_ze%2Fm-n_0000000000) [n:127.0.0.1:40855_ze%2Fm ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 1375773 INFO (zkCallback-722-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1376772 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 1376772 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
[junit4] 2> 1376772 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 1376773 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 1376773 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1376773 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_65F7FD935BE4F9B0-001/control-001/cores/collection1'
[junit4] 2> 1376773 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1376773 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 1376775 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 1376780 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 1376784 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 1376792 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection x:collection1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1376797 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 1376885 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 1376891 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 1376892 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 1376900 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 1376903 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 1376905 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1376905 WARN (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 1376905 WARN (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 1376905 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1376906 WARN (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 1376906 WARN (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 1376908 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4] 2> 1376908 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 1376909 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1376909 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_65F7FD935BE4F9B0-001/control-001/cores/collection1], dataDir=[null]
[junit4] 2> 1376909 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c8bdfdc
[junit4] 2> 1376910 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_65F7FD935BE4F9B0-001/control-001/cores/collection1/data
[junit4] 2> 1376910 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_65F7FD935BE4F9B0-001/control-001/cores/collection1/data/index/
[junit4] 2> 1376910 WARN (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_65F7FD935BE4F9B0-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1376910 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_65F7FD935BE4F9B0-001/control-001/cores/collection1/data/index
[junit4] 2> 1376910 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=5, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7483287627008464]
[junit4] 2> 1376911 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=RawDirectoryWrapper(RAMDirectory@2b909c94 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@59d2b528),segFN=segments_1,generation=1}
[junit4] 2> 1376911 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 1376911 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_65F7FD935BE4F9B0-001/control-001/cores/collection1/data/
[junit4] 2> 1376912 WARN (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_65F7FD935BE4F9B0-001/control-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
[junit4] 2> 1376920 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1376920 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1376920 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1376920 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1376921 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1376921 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1376921 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1376921 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1376921 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1376921 WARN (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,args = {defaults={a=A,b=B}}}
[junit4] 2> 1376924 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1376924 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1376925 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1376926 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1376929 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/dump,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 1376929 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 1376930 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1376930 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1376931 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1376931 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1376931 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=27, maxMergeAtOnceExplicit=24, maxMergedSegmentMB=2.1689453125, floorSegmentMB=1.953125, forceMergeDeletesPctAllowed=9.08429581176323, segmentsPerTier=21.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.40193571943957784
[junit4] 2> 1376931 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=RawDirectoryWrapper(RAMDirectory@2b909c94 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@59d2b528),segFN=segments_1,generation=1}
[junit4] 2> 1376931 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 1376931 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@73998bda[collection1] main
[junit4] 2> 1376931 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 1376932 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1376932 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 1376933 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1376933 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
[junit4] 2> 1376933 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1376933 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 1376933 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1376933 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 1376933 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 1376934 INFO (searcherExecutor-2936-thread-1-processing-n:127.0.0.1:40855_ze%2Fm x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@73998bda[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1376934 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
[junit4] 2> 1376934 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
[junit4] 2> 1376934 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
[junit4] 2> 1376934 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1519794050254766080
[junit4] 2> 1376936 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 2.0ms to seed version buckets with highest version 1519794050254766080
[junit4] 2> 1376936 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
[junit4] 2> 1376937 INFO (coreLoadExecutor-2935-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 1376937 INFO (coreZkRegister-2929-thread-1-processing-n:127.0.0.1:40855_ze%2Fm x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:40855/ze/m collection:control_collection shard:shard1
[junit4] 2> 1376938 INFO (coreZkRegister-2929-thread-1-processing-n:127.0.0.1:40855_ze%2Fm x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 1376940 INFO (coreZkRegister-2929-thread-1-processing-n:127.0.0.1:40855_ze%2Fm x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/94987128030429188-core_node1-n_0000000000
[junit4] 2> 1376941 INFO (coreZkRegister-2929-thread-1-processing-n:127.0.0.1:40855_ze%2Fm x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1
[junit4] 2> 1376942 INFO (coreZkRegister-2929-thread-1-processing-n:127.0.0.1:40855_ze%2Fm x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1376942 INFO (coreZkRegister-2929-thread-1-processing-n:127.0.0.1:40855_ze%2Fm x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1376942 INFO (coreZkRegister-2929-thread-1-processing-n:127.0.0.1:40855_ze%2Fm x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:40855/ze/m/collection1/
[junit4] 2> 1376942 INFO (coreZkRegister-2929-thread-1-processing-n:127.0.0.1:40855_ze%2Fm x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1376942 INFO (coreZkRegister-2929-thread-1-processing-n:127.0.0.1:40855_ze%2Fm x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:40855/ze/m/collection1/ has no replicas
[junit4] 2> 1376942 INFO (OverseerStateUpdate-94987128030429188-127.0.0.1:40855_ze%2Fm-n_0000000000) [n:127.0.0.1:40855_ze%2Fm ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection"} current state version: 1
[junit4] 2> 1376943 INFO (coreZkRegister-2929-thread-1-processing-n:127.0.0.1:40855_ze%2Fm x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 1376945 INFO (coreZkRegister-2929-thread-1-processing-n:127.0.0.1:40855_ze%2Fm x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
[junit4] 2> 1376946 INFO (coreZkRegister-2929-thread-1-processing-n:127.0.0.1:40855_ze%2Fm x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:40855/ze/m/collection1/ shard1
[junit4] 2> 1376947 INFO (OverseerStateUpdate-94987128030429188-127.0.0.1:40855_ze%2Fm-n_0000000000) [n:127.0.0.1:40855_ze%2Fm ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:40855/ze/m",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 1
[junit4] 2> 1377049 INFO (zkCallback-722-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1377098 INFO (coreZkRegister-2929-thread-1-processing-n:127.0.0.1:40855_ze%2Fm x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:40855/ze/m/collection1/ and leader is http://127.0.0.1:40855/ze/m/collection1/
[junit4] 2> 1377098 INFO (coreZkRegister-2929-thread-1-processing-n:127.0.0.1:40855_ze%2Fm x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:40855/ze/m
[junit4] 2> 1377098 INFO (coreZkRegister-2929-thread-1-processing-n:127.0.0.1:40855_ze%2Fm x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1377098 INFO (coreZkRegister-2929-thread-1-processing-n:127.0.0.1:40855_ze%2Fm x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
[junit4] 2> 1377098 INFO (coreZkRegister-2929-thread-1-processing-n:127.0.0.1:40855_ze%2Fm x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:40855_ze%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 1377100 INFO (OverseerStateUpdate-94987128030429188-127.0.0.1:40855_ze%2Fm-n_0000000000) [n:127.0.0.1:40855_ze%2Fm ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:40855/ze/m",
[junit4] 2> "node_name":"127.0.0.1:40855_ze%2Fm",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 2
[junit4] 2> 1377100 INFO (OverseerStateUpdate-94987128030429188-127.0.0.1:40855_ze%2Fm-n_0000000000) [n:127.0.0.1:40855_ze%2Fm ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:40855/ze/m",
[junit4] 2> "node_name":"127.0.0.1:40855_ze%2Fm",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 1377203 INFO (zkCallback-722-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1377271 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1377271 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1377272 INFO (zkCallback-724-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6ac57580 name:ZooKeeperConnection Watcher:127.0.0.1:51717/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1377273 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1377273 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1377273 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 1377275 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 1377275 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with stateFormat=2
[junit4] 2> 1377275 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1377275 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1377276 INFO (zkCallback-725-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2a60d5fe name:ZooKeeperConnection Watcher:127.0.0.1:51717/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1377276 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1377276 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1377285 INFO (OverseerStateUpdate-94987128030429188-127.0.0.1:40855_ze%2Fm-n_0000000000) [n:127.0.0.1:40855_ze%2Fm ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"create",
[junit4] 2> "name":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "stateFormat":"2"} current state version: 3
[junit4] 2> 1377285 INFO (OverseerStateUpdate-94987128030429188-127.0.0.1:40855_ze%2Fm-n_0000000000) [n:127.0.0.1:40855_ze%2Fm ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
[junit4] 2> 1377390 INFO (OverseerStateUpdate-94987128030429188-127.0.0.1:40855_ze%2Fm-n_0000000000) [n:127.0.0.1:40855_ze%2Fm ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/collection1/state.json
[junit4] 2> 1377653 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_65F7FD935BE4F9B0-001/shard-1-001/cores/collection1
[junit4] 2> 1377654 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_65F7FD935BE4F9B0-001/shard-1-001
[junit4] 2> 1377655 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.e.j.s.Server jetty-9.3.6.v20151106
[junit4] 2> 1377656 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6719c19{/ze/m,null,AVAILABLE}
[junit4] 2> 1377657 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.e.j.s.ServerConnector Started ServerConnector@7034df9b{HTTP/1.1,[http/1.1]}{127.0.0.1:50806}
[junit4] 2> 1377657 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.e.j.s.Server Started @1381018ms
[junit4] 2> 1377658 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_65F7FD935BE4F9B0-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/ze/m, hostPort=50806, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_65F7FD935BE4F9B0-001/shard-1-001/cores}
[junit4] 2> 1377658 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 1377658 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_65F7FD935BE4F9B0-001/shard-1-001'
[junit4] 2> 1377658 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1377658 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 1377658 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1377659 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1377660 INFO (zkCallback-726-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@48d50849 name:ZooKeeperConnection Watcher:127.0.0.1:51717/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1377660 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1377660 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1377661 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1377661 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_65F7FD935BE4F9B0-001/shard-1-001/solr.xml
[junit4] 2> 1377666 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_65F7FD935BE4F9B0-001/shard-1-001/cores
[junit4] 2> 1377666 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.CoreContainer New CoreContainer 1814546386
[junit4] 2> 1377666 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_65F7FD935BE4F9B0-001/shard-1-001]
[junit4] 2> 1377666 WARN (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_65F7FD935BE4F9B0-001/shard-1-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_65F7FD935BE4F9B0-001/shard-1-001/lib
[junit4] 2> 1377666 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 1377667 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1377668 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1377668 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1377668 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:51717/solr
[junit4] 2> 1377668 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 1377668 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1377670 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1377671 INFO (zkCallback-728-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@606f25f7 name:ZooKeeperConnection Watcher:127.0.0.1:51717 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1377672 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1377672 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1377673 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [n:127.0.0.1:50806_ze%2Fm ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1377674 INFO (zkCallback-729-thread-1-processing-n:127.0.0.1:50806_ze%2Fm) [n:127.0.0.1:50806_ze%2Fm ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6e5726f0 name:ZooKeeperConnection Watcher:127.0.0.1:51717/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1377674 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [n:127.0.0.1:50806_ze%2Fm ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1377679 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [n:127.0.0.1:50806_ze%2Fm ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 1378685 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [n:127.0.0.1:50806_ze%2Fm ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50806_ze%2Fm
[junit4] 2> 1378685 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [n:127.0.0.1:50806_ze%2Fm ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:50806_ze%2Fm
[junit4] 2> 1378686 INFO (zkCallback-729-thread-1-processing-n:127.0.0.1:50806_ze%2Fm) [n:127.0.0.1:50806_ze%2Fm ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1378686 INFO (zkCallback-722-thread-1-processing-n:127.0.0.1:40855_ze%2Fm) [n:127.0.0.1:40855_ze%2Fm ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1378686 INFO (zkCallback-724-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1378689 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [n:127.0.0.1:50806_ze%2Fm ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1378690 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [n:127.0.0.1:50806_ze%2Fm ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94987128030429193-127.0.0.1:50806_ze%2Fm-n_0000000001
[junit4] 2> 1378690 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [n:127.0.0.1:50806_ze%2Fm ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/94987128030429188-127.0.0.1:40855_ze%2Fm-n_0000000000 to know if I could be the leader
[junit4] 2> 1378699 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [n:127.0.0.1:50806_ze%2Fm ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 1378699 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [n:127.0.0.1:50806_ze%2Fm ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 1378700 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [n:127.0.0.1:50806_ze%2Fm ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_65F7FD935BE4F9B0-001/shard-1-001/cores
[junit4] 2> 1378701 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [n:127.0.0.1:50806_ze%2Fm ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=collection1, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 1378701 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [n:127.0.0.1:50806_ze%2Fm ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_65F7FD935BE4F9B0-001/shard-1-001/cores/collection1
[junit4] 2> 1378701 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [n:127.0.0.1:50806_ze%2Fm ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
[junit4] 2> 1378702 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [n:127.0.0.1:50806_ze%2Fm ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4] 2> 1378702 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[65F7FD935BE4F9B0]) [n:127.0.0.1:50806_ze%2Fm ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 1378702 INFO (coreLoadExecutor-2946-thread-1-processing-n:127.0.0.1:50806_ze%2Fm) [n:127.0.0.1:50806_ze%2Fm c:collection1 x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 1378703 INFO (coreLoadExecutor-2946-thread-1-processing-n:127.0.0.1:50806_ze%2Fm) [n:127.0.0.1:50806_ze%2Fm c:collection1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 1378704 INFO (coreLoadExecutor-2946-thread-1-processing-n:127.0.0.1:50806_ze%2Fm) [n:127.0.0.1:50806_ze%2Fm c:collection1 x:collection1] o.a.s.c.ZkController Registering watch for collection collection1
[junit4] 2> 1378704 INFO (coreLoadExecutor-2946-thread-1-processing-n:127.0.0.1:50806_ze%2Fm) [n:127.0.0.1:50806_ze%2Fm c:collection1 x:collection1] o.a.s.c.c.ZkStateReader addZkWatch collection1
[junit4] 2> 1378704 INFO (OverseerStateUpdate-94987128030429188-127.0.0.1:40855_ze%2Fm-n_0000000000) [n:127.0.0.1:40855_ze%2Fm ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:50806/ze/m",
[junit4] 2> "node_name":"127.0.0.1:50806_ze%2Fm",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"} current state version: 3
[junit4] 2> 1378704 INFO (coreLoadExecutor-2946-thread-1-processing-n:127.0.0.1:50806_ze%2Fm) [n:127.0.0.1:50806_ze%2Fm c:collection1 x:collection1] o.a.s.c.c.ZkStateReader Add data for collection1 ver 0
[junit4] 2> 1378704 INFO (OverseerStateUpdate-94987128030429188-127.0.0.1:40855_ze%2Fm-n_0000000000) [n:127.0.0.1:40855_ze%2Fm ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:50806/ze/m",
[junit4] 2> "node_name":"127.0.0.1:50806_ze%2Fm",
[junit4] 2> "numShards":"2",
[j
[...truncated too long message...]
cene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_65F7FD935BE4F9B0-001/solr-instance-027/collection1/data [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_65F7FD935BE4F9B0-001/solr-instance-027/collection1/data;done=false>>]
[junit4] 2> 2951300 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[65F7FD935BE4F9B0]) [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_65F7FD935BE4F9B0-001/solr-instance-027/collection1/data
[junit4] 2> 2951301 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[65F7FD935BE4F9B0]) [ x:collection1] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@2e8971c3{/solr,null,UNAVAILABLE}
[junit4] 2> 2951308 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[65F7FD935BE4F9B0]) [ ] o.e.j.s.ServerConnector Stopped ServerConnector@47f4907b{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 2951308 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[65F7FD935BE4F9B0]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1747412649
[junit4] 2> 2951308 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[65F7FD935BE4F9B0]) [ x:collection1] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@4479d71c
[junit4] 2> 2951309 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[65F7FD935BE4F9B0]) [ x:collection1] o.a.s.u.DirectUpdateHandler2 closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 2951309 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[65F7FD935BE4F9B0]) [ x:collection1] o.a.s.u.SolrCoreState Closing SolrCoreState
[junit4] 2> 2951309 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[65F7FD935BE4F9B0]) [ x:collection1] o.a.s.u.DefaultSolrCoreState SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 2951309 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[65F7FD935BE4F9B0]) [ x:collection1] o.a.s.u.DefaultSolrCoreState closing IndexWriter with IndexWriterCloser
[junit4] 2> 2951311 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[65F7FD935BE4F9B0]) [ x:collection1] o.a.s.c.SolrCore [collection1] Closing main searcher on request.
[junit4] 2> 2951311 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[65F7FD935BE4F9B0]) [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing StandardDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 2951311 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[65F7FD935BE4F9B0]) [ x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_65F7FD935BE4F9B0-001/solr-instance-028/collection1/data/index [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_65F7FD935BE4F9B0-001/solr-instance-028/collection1/data/index;done=false>>]
[junit4] 2> 2951311 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[65F7FD935BE4F9B0]) [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_65F7FD935BE4F9B0-001/solr-instance-028/collection1/data/index
[junit4] 2> 2951311 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[65F7FD935BE4F9B0]) [ x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_65F7FD935BE4F9B0-001/solr-instance-028/collection1/data [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_65F7FD935BE4F9B0-001/solr-instance-028/collection1/data;done=false>>]
[junit4] 2> 2951311 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[65F7FD935BE4F9B0]) [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_65F7FD935BE4F9B0-001/solr-instance-028/collection1/data
[junit4] 2> 2951312 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[65F7FD935BE4F9B0]) [ x:collection1] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@28169159{/solr,null,UNAVAILABLE}
[junit4] 2> 2951313 INFO (SUITE-TestReplicationHandler-seed#[65F7FD935BE4F9B0]-worker) [ ] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_65F7FD935BE4F9B0-001
[junit4] 2> NOTE: test params are: codec=CheapBastard, sim=RandomSimilarityProvider(queryNorm=false,coord=yes): {}, locale=es_VE, timezone=America/Aruba
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_66 (64-bit)/cpus=4,threads=1,free=332853912,total=476053504
[junit4] 2> NOTE: All tests run in this JVM: [DefaultValueUpdateProcessorTest, TestTrieFacet, TestMinMaxOnMultiValuedField, TestMissingGroups, TestScoreJoinQPNoScore, DataDrivenBlockJoinTest, TestArbitraryIndexDir, TestChildDocTransformer, TestJsonRequest, TestConfigSetProperties, TestSolrCloudWithKerberosAlt, TestSolrQueryParserDefaultOperatorResource, AnalyticsMergeStrategyTest, CloudMLTQParserTest, HLLSerializationTest, SuggestComponentTest, AlternateDirectoryTest, TestMaxScoreQueryParser, TestLRUStatsCache, TestIBSimilarityFactory, PrimUtilsTest, ResponseLogComponentTest, TestUniqueKeyFieldResource, TestLuceneMatchVersion, TestRemoteStreaming, TestFastOutputStream, MigrateRouteKeyTest, TestImplicitCoreProperties, TestFieldCollectionResource, TestBulkSchemaConcurrent, TestSolrConfigHandler, CloneFieldUpdateProcessorFactoryTest, TestRandomFaceting, HdfsDirectoryTest, JsonLoaderTest, SecurityConfHandlerTest, CopyFieldTest, PreAnalyzedFieldTest, TestAuthenticationFramework, TestComponentsName, RAMDirectoryFactoryTest, PingRequestHandlerTest, TestLMDirichletSimilarityFactory, BufferStoreTest, TestTolerantSearch, XsltUpdateRequestHandlerTest, IgnoreCommitOptimizeUpdateProcessorFactoryTest, TestLRUCache, ConjunctionSolrSpellCheckerTest, TestSmileRequest, ExternalFileFieldSortTest, RuleEngineTest, QueryEqualityTest, TestCloudPivotFacet, SolrRequestParserTest, PeerSyncTest, TestClassNameShortening, OverseerCollectionConfigSetProcessorTest, TestSortByMinMaxFunction, TestSearcherReuse, TestSolrCLIRunExample, DisMaxRequestHandlerTest, TestDistributedSearch, ResourceLoaderTest, TestAtomicUpdateErrorCases, SynonymTokenizerTest, ResponseHeaderTest, StandardRequestHandlerTest, TestFieldTypeResource, TestManagedSchemaDynamicFieldResource, MergeStrategyTest, TestMergePolicyConfig, DeleteReplicaTest, IndexSchemaTest, TestCSVLoader, EchoParamsTest, TestFaceting, TestReqParamsAPI, CdcrUpdateLogTest, TestBadConfig, AnalysisAfterCoreReloadTest, CloudExitableDirectoryReaderTest, TestSchemaVersionResource, TestStressLucene, DateFieldTest, TestClassicSimilarityFactory, TestRangeQuery, PathHierarchyTokenizerFactoryTest, TestOverriddenPrefixQueryForCustomFieldType, HdfsBasicDistributedZkTest, TestRandomRequestDistribution, DocValuesMissingTest, CollectionsAPIDistributedZkTest, TestReplicationHandler]
[junit4] Completed [412/564] on J0 in 625.54s, 13 tests, 1 failure <<< FAILURES!
[...truncated 494 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:789: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:726: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987: There were test failures: 564 suites (8 ignored), 2238 tests, 1 error, 1 failure, 33 ignored (18 assumptions) [seed: 65F7FD935BE4F9B0]
Total time: 216 minutes 2 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 872 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/872/
3 tests failed.
FAILED: org.apache.solr.cloud.CdcrReplicationDistributedZkTest.testReplicationAfterLeaderChange
Error Message:
Timeout while trying to assert number of documents on collection: target_collection
Stack Trace:
java.lang.AssertionError: Timeout while trying to assert number of documents on collection: target_collection
at __randomizedtesting.SeedInfo.seed([B76FFC4460F69B3F:659FB0A73E593D0D]:0)
at org.apache.solr.cloud.BaseCdcrDistributedZkTest.assertNumDocs(BaseCdcrDistributedZkTest.java:265)
at org.apache.solr.cloud.CdcrReplicationDistributedZkTest.testReplicationAfterLeaderChange(CdcrReplicationDistributedZkTest.java:292)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:965)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:940)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.AssertionError: expected:<10> but was:<4>
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at org.apache.solr.cloud.BaseCdcrDistributedZkTest.assertNumDocs(BaseCdcrDistributedZkTest.java:256)
... 42 more
FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test
Error Message:
Captured an uncaught exception in thread: Thread[id=27801, name=collection1, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=27801, name=collection1, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
at __randomizedtesting.SeedInfo.seed([B76FFC4460F69B3F:3F3BC39ECE0AF6C7]:0)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:43225: Could not find collection : awholynewstresscollection_collection1_2
at __randomizedtesting.SeedInfo.seed([B76FFC4460F69B3F]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:871)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:807)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:888)
FAILED: org.apache.solr.cloud.RollingRestartTest.test
Error Message:
Unable to restart (#6): CloudJettyRunner [url=http://127.0.0.1:58263/_/s/collection1]
Stack Trace:
java.lang.AssertionError: Unable to restart (#6): CloudJettyRunner [url=http://127.0.0.1:58263/_/s/collection1]
at __randomizedtesting.SeedInfo.seed([B76FFC4460F69B3F:3F3BC39ECE0AF6C7]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.cloud.RollingRestartTest.restartWithRolesTest(RollingRestartTest.java:104)
at org.apache.solr.cloud.RollingRestartTest.test(RollingRestartTest.java:53)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:965)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:940)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 10433 lines...]
[junit4] Suite: org.apache.solr.cloud.CdcrReplicationDistributedZkTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CdcrReplicationDistributedZkTest_B76FFC4460F69B3F-001/init-core-data-001
[junit4] 2> 1061290 INFO (SUITE-CdcrReplicationDistributedZkTest-seed#[B76FFC4460F69B3F]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
[junit4] 2> 1061290 INFO (SUITE-CdcrReplicationDistributedZkTest-seed#[B76FFC4460F69B3F]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /x_/
[junit4] 2> 1061292 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1061292 INFO (Thread-2639) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1061292 INFO (Thread-2639) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1061392 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.ZkTestServer start zk server on port:43900
[junit4] 2> 1061393 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1061395 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1061397 INFO (zkCallback-768-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@f49107b name:ZooKeeperConnection Watcher:127.0.0.1:43900 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1061397 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1061397 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1061397 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 1061403 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1061410 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1061411 INFO (zkCallback-769-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@cdfea3e name:ZooKeeperConnection Watcher:127.0.0.1:43900/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1061411 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1061411 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1061411 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
[junit4] 2> 1061413 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
[junit4] 2> 1061414 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
[junit4] 2> 1061415 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
[junit4] 2> 1061417 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-cdcr.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 1061417 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 1061419 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 1061419 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
[junit4] 2> 1061421 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1061421 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1061422 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 1061423 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
[junit4] 2> 1061424 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 1061424 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
[junit4] 2> 1061426 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 1061426 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
[junit4] 2> 1061427 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 1061427 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 1061429 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1061429 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 1061430 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1061430 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1061432 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 1061432 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 1061434 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 1061434 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
[junit4] 2> 1061435 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testOps
[junit4] 2> 1061784 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CdcrReplicationDistributedZkTest_B76FFC4460F69B3F-001/jetty-001/cores/collection1
[junit4] 2> 1061786 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.e.j.s.Server jetty-9.3.6.v20151106
[junit4] 2> 1061795 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7221ed5b{/x_,null,AVAILABLE}
[junit4] 2> 1061802 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.e.j.s.ServerConnector Started ServerConnector@2f3f3a64{HTTP/1.1,[http/1.1]}{127.0.0.1:36461}
[junit4] 2> 1061802 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.e.j.s.Server Started @1065655ms
[junit4] 2> 1061802 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {shards=shard1, hostContext=/x_, hostPort=36461, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CdcrReplicationDistributedZkTest_B76FFC4460F69B3F-001/jetty-001/cores}
[junit4] 2> 1061802 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 1061802 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CdcrReplicationDistributedZkTest_B76FFC4460F69B3F-001/jetty-001'
[junit4] 2> 1061802 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1061802 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 1061803 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1061804 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1061811 INFO (zkCallback-770-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6860b671 name:ZooKeeperConnection Watcher:127.0.0.1:43900/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1061811 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1061811 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1061812 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1061812 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CdcrReplicationDistributedZkTest_B76FFC4460F69B3F-001/jetty-001/solr.xml
[junit4] 2> 1061818 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CdcrReplicationDistributedZkTest_B76FFC4460F69B3F-001/jetty-001/cores
[junit4] 2> 1061818 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.CoreContainer New CoreContainer 151017493
[junit4] 2> 1061818 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CdcrReplicationDistributedZkTest_B76FFC4460F69B3F-001/jetty-001]
[junit4] 2> 1061818 WARN (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CdcrReplicationDistributedZkTest_B76FFC4460F69B3F-001/jetty-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CdcrReplicationDistributedZkTest_B76FFC4460F69B3F-001/jetty-001/lib
[junit4] 2> 1061819 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 1061820 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1061820 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1061820 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1061820 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43900/solr
[junit4] 2> 1061820 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 1061821 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1061831 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1061843 INFO (zkCallback-772-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@56a756b0 name:ZooKeeperConnection Watcher:127.0.0.1:43900 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1061847 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1061847 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1061850 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [n:127.0.0.1:36461_x_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1061850 INFO (zkCallback-773-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6bcb3fe8 name:ZooKeeperConnection Watcher:127.0.0.1:43900/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1061850 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [n:127.0.0.1:36461_x_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1061851 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [n:127.0.0.1:36461_x_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
[junit4] 2> 1061853 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [n:127.0.0.1:36461_x_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 1061855 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [n:127.0.0.1:36461_x_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 1061856 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [n:127.0.0.1:36461_x_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 1061858 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [n:127.0.0.1:36461_x_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 1061863 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [n:127.0.0.1:36461_x_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 1061864 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [n:127.0.0.1:36461_x_ ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 1061865 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [n:127.0.0.1:36461_x_ ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 1061866 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [n:127.0.0.1:36461_x_ ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 1061867 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [n:127.0.0.1:36461_x_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36461_x_
[junit4] 2> 1061867 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [n:127.0.0.1:36461_x_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:36461_x_
[junit4] 2> 1061868 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [n:127.0.0.1:36461_x_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 1061869 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [n:127.0.0.1:36461_x_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 1061870 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [n:127.0.0.1:36461_x_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1061870 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [n:127.0.0.1:36461_x_ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94981354981752836-127.0.0.1:36461_x_-n_0000000000
[junit4] 2> 1061871 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [n:127.0.0.1:36461_x_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:36461_x_
[junit4] 2> 1061871 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [n:127.0.0.1:36461_x_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
[junit4] 2> 1061872 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [n:127.0.0.1:36461_x_ ] o.a.s.c.Overseer Overseer (id=94981354981752836-127.0.0.1:36461_x_-n_0000000000) starting
[junit4] 2> 1061873 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [n:127.0.0.1:36461_x_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
[junit4] 2> 1061881 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [n:127.0.0.1:36461_x_ ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 1061883 INFO (OverseerCollectionConfigSetProcessor-94981354981752836-127.0.0.1:36461_x_-n_0000000000) [n:127.0.0.1:36461_x_ ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
[junit4] 2> 1061883 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [n:127.0.0.1:36461_x_ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 1061883 INFO (OverseerStateUpdate-94981354981752836-127.0.0.1:36461_x_-n_0000000000) [n:127.0.0.1:36461_x_ ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 1061897 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [n:127.0.0.1:36461_x_ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 1061897 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [n:127.0.0.1:36461_x_ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 1061898 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [n:127.0.0.1:36461_x_ ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CdcrReplicationDistributedZkTest_B76FFC4460F69B3F-001/jetty-001/cores
[junit4] 2> 1061899 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [n:127.0.0.1:36461_x_ ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=tmp_collection, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 1061899 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [n:127.0.0.1:36461_x_ ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CdcrReplicationDistributedZkTest_B76FFC4460F69B3F-001/jetty-001/cores/collection1
[junit4] 2> 1061899 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [n:127.0.0.1:36461_x_ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
[junit4] 2> 1061903 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 1061903 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 1061904 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [n:127.0.0.1:36461_x_ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2
[junit4] 2> 1061904 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [n:127.0.0.1:36461_x_ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 1061905 INFO (OverseerStateUpdate-94981354981752836-127.0.0.1:36461_x_-n_0000000000) [n:127.0.0.1:36461_x_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:36461/x_",
[junit4] 2> "node_name":"127.0.0.1:36461_x_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"tmp_collection",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 1061905 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 1061906 INFO (OverseerStateUpdate-94981354981752836-127.0.0.1:36461_x_-n_0000000000) [n:127.0.0.1:36461_x_ ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:36461/x_",
[junit4] 2> "node_name":"127.0.0.1:36461_x_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"tmp_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 1061906 INFO (OverseerStateUpdate-94981354981752836-127.0.0.1:36461_x_-n_0000000000) [n:127.0.0.1:36461_x_ ] o.a.s.c.o.ClusterStateMutator building a new cName: tmp_collection
[junit4] 2> 1061906 INFO (OverseerStateUpdate-94981354981752836-127.0.0.1:36461_x_-n_0000000000) [n:127.0.0.1:36461_x_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2
[junit4] 2> 1061907 INFO (zkCallback-773-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1062905 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 1062906 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection x:collection1] o.a.s.c.ZkController Check for collection zkNode:tmp_collection
[junit4] 2> 1062906 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection x:collection1] o.a.s.c.ZkController Creating collection in ZooKeeper:tmp_collection
[junit4] 2> 1062906 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection x:collection1] o.a.s.c.ZkController Looking for collection configName
[junit4] 2> 1062907 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection x:collection1] o.a.s.c.ZkController Only one config set found in zk - using it:conf1
[junit4] 2> 1062907 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/tmp_collection
[junit4] 2> 1062908 INFO (zkCallback-773-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ ] o.a.s.c.c.ZkStateReader A collections change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections, has occurred - updating...
[junit4] 2> 1062908 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/tmp_collection
[junit4] 2> 1062909 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection x:collection1] o.a.s.c.c.ZkStateReader path=/collections/tmp_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1062909 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CdcrReplicationDistributedZkTest_B76FFC4460F69B3F-001/jetty-001/cores/collection1'
[junit4] 2> 1062909 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1062909 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 1062910 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 1062915 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 1062919 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 1062926 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection x:collection1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1062931 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 1063041 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 1063043 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 1063044 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 1063047 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 1063073 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2
[junit4] 2> 1063073 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection tmp_collection
[junit4] 2> 1063073 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1063073 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CdcrReplicationDistributedZkTest_B76FFC4460F69B3F-001/jetty-001/cores/collection1], dataDir=[null]
[junit4] 2> 1063073 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@427ed5b8
[junit4] 2> 1063074 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CdcrReplicationDistributedZkTest_B76FFC4460F69B3F-001/jetty-001/cores/collection1/data
[junit4] 2> 1063074 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CdcrReplicationDistributedZkTest_B76FFC4460F69B3F-001/jetty-001/cores/collection1/data/index/
[junit4] 2> 1063074 WARN (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CdcrReplicationDistributedZkTest_B76FFC4460F69B3F-001/jetty-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1063075 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CdcrReplicationDistributedZkTest_B76FFC4460F69B3F-001/jetty-001/cores/collection1/data/index
[junit4] 2> 1063075 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=34, maxMergeAtOnceExplicit=14, maxMergedSegmentMB=49.3115234375, floorSegmentMB=0.8984375, forceMergeDeletesPctAllowed=5.371060523746926, segmentsPerTier=16.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 1063076 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@447665e1 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3f3f9e0a),segFN=segments_1,generation=1}
[junit4] 2> 1063076 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 1063076 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CdcrReplicationDistributedZkTest_B76FFC4460F69B3F-001/jetty-001/cores/collection1/data/
[junit4] 2> 1063076 WARN (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CdcrReplicationDistributedZkTest_B76FFC4460F69B3F-001/jetty-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
[junit4] 2> 1063080 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "cdcr-processor-chain"
[junit4] 2> 1063080 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1063082 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1063083 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1063084 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1063085 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1063087 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/cdcr,/update,/admin/file
[junit4] 2> 1063087 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 1063088 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.CdcrUpdateLog
[junit4] 2> 1063088 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1063089 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1063089 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1063089 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@602f75dd
[junit4] 2> 1063089 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@447665e1 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3f3f9e0a),segFN=segments_1,generation=1}
[junit4] 2> 1063089 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 1063090 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@6cfe8b89[collection1] main
[junit4] 2> 1063090 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/tmp_collection
[junit4] 2> 1063090 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/tmp_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1063090 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 1063091 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1063091 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
[junit4] 2> 1063091 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1063091 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 1063091 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1063091 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 1063091 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 1063092 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/tmp_collection/cdcr/state
[junit4] 2> 1063094 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.h.CdcrBufferStateManager Created znode /collections/tmp_collection/cdcr/state/buffer
[junit4] 2> 1063095 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.h.CdcrProcessStateManager Created znode /collections/tmp_collection/cdcr/state/process
[junit4] 2> 1063096 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
[junit4] 2> 1063096 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
[junit4] 2> 1063096 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
[junit4] 2> 1063096 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1519701681597579264
[junit4] 2> 1063098 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 2.0ms to seed version buckets with highest version 1519701681597579264
[junit4] 2> 1063098 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
[junit4] 2> 1063098 INFO (coreLoadExecutor-1976-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 1063099 INFO (searcherExecutor-1977-thread-1-processing-n:127.0.0.1:36461_x_ x:collection1 s:shard2 c:tmp_collection r:core_node1) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@6cfe8b89[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1063099 INFO (coreZkRegister-1970-thread-1-processing-n:127.0.0.1:36461_x_ x:collection1 s:shard2 c:tmp_collection r:core_node1) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:36461/x_ collection:tmp_collection shard:shard2
[junit4] 2> 1063104 INFO (coreZkRegister-1970-thread-1-processing-n:127.0.0.1:36461_x_ x:collection1 s:shard2 c:tmp_collection r:core_node1) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/tmp_collection/leader_elect/shard2/election
[junit4] 2> 1063108 INFO (coreZkRegister-1970-thread-1-processing-n:127.0.0.1:36461_x_ x:collection1 s:shard2 c:tmp_collection r:core_node1) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/tmp_collection/leader_elect/shard2/election/94981354981752836-core_node1-n_0000000000
[junit4] 2> 1063109 INFO (coreZkRegister-1970-thread-1-processing-n:127.0.0.1:36461_x_ x:collection1 s:shard2 c:tmp_collection r:core_node1) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard2
[junit4] 2> 1063110 INFO (coreZkRegister-1970-thread-1-processing-n:127.0.0.1:36461_x_ x:collection1 s:shard2 c:tmp_collection r:core_node1) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1063110 INFO (coreZkRegister-1970-thread-1-processing-n:127.0.0.1:36461_x_ x:collection1 s:shard2 c:tmp_collection r:core_node1) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1063110 INFO (coreZkRegister-1970-thread-1-processing-n:127.0.0.1:36461_x_ x:collection1 s:shard2 c:tmp_collection r:core_node1) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:36461/x_/collection1/
[junit4] 2> 1063110 INFO (coreZkRegister-1970-thread-1-processing-n:127.0.0.1:36461_x_ x:collection1 s:shard2 c:tmp_collection r:core_node1) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1063110 INFO (OverseerStateUpdate-94981354981752836-127.0.0.1:36461_x_-n_0000000000) [n:127.0.0.1:36461_x_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"tmp_collection"} current state version: 1
[junit4] 2> 1063110 INFO (coreZkRegister-1970-thread-1-processing-n:127.0.0.1:36461_x_ x:collection1 s:shard2 c:tmp_collection r:core_node1) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:36461/x_/collection1/ has no replicas
[junit4] 2> 1063113 INFO (coreZkRegister-1970-thread-1-processing-n:127.0.0.1:36461_x_ x:collection1 s:shard2 c:tmp_collection r:core_node1) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/tmp_collection/leaders/shard2
[junit4] 2> 1063115 INFO (coreZkRegister-1970-thread-1-processing-n:127.0.0.1:36461_x_ x:collection1 s:shard2 c:tmp_collection r:core_node1) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
[junit4] 2> 1063115 INFO (zkCallback-773-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ ] o.a.s.h.CdcrLeaderStateManager Received new leader state @ tmp_collection:shard2
[junit4] 2> 1063117 INFO (coreZkRegister-1970-thread-1-processing-n:127.0.0.1:36461_x_ x:collection1 s:shard2 c:tmp_collection r:core_node1) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:36461/x_/collection1/ shard2
[junit4] 2> 1063118 INFO (OverseerStateUpdate-94981354981752836-127.0.0.1:36461_x_-n_0000000000) [n:127.0.0.1:36461_x_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"tmp_collection",
[junit4] 2> "base_url":"http://127.0.0.1:36461/x_",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 1
[junit4] 2> 1063220 INFO (zkCallback-773-thread-1-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1063269 INFO (coreZkRegister-1970-thread-1-processing-n:127.0.0.1:36461_x_ x:collection1 s:shard2 c:tmp_collection r:core_node1) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:36461/x_/collection1/ and leader is http://127.0.0.1:36461/x_/collection1/
[junit4] 2> 1063269 INFO (coreZkRegister-1970-thread-1-processing-n:127.0.0.1:36461_x_ x:collection1 s:shard2 c:tmp_collection r:core_node1) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:36461/x_
[junit4] 2> 1063269 INFO (coreZkRegister-1970-thread-1-processing-n:127.0.0.1:36461_x_ x:collection1 s:shard2 c:tmp_collection r:core_node1) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1063269 INFO (coreZkRegister-1970-thread-1-processing-n:127.0.0.1:36461_x_ x:collection1 s:shard2 c:tmp_collection r:core_node1) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
[junit4] 2> 1063269 INFO (coreZkRegister-1970-thread-1-processing-n:127.0.0.1:36461_x_ x:collection1 s:shard2 c:tmp_collection r:core_node1) [n:127.0.0.1:36461_x_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 1063271 INFO (OverseerStateUpdate-94981354981752836-127.0.0.1:36461_x_-n_0000000000) [n:127.0.0.1:36461_x_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:36461/x_",
[junit4] 2> "node_name":"127.0.0.1:36461_x_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"tmp_collection",
[junit4] 2> "operation":"state"} current state version: 2
[junit4] 2> 1063271 INFO (OverseerStateUpdate-94981354981752836-127.0.0.1:36461_x_-n_0000000000) [n:127.0.0.1:36461_x_ ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:36461/x_",
[junit4] 2> "node_name":"127.0.0.1:36461_x_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"tmp_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 1063379 INFO (zkCallback-773-thread-2-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1063733 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CdcrReplicationDistributedZkTest_B76FFC4460F69B3F-001/jetty-002/cores/collection1
[junit4] 2> 1063735 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.e.j.s.Server jetty-9.3.6.v20151106
[junit4] 2> 1063737 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@34f7c21e{/x_,null,AVAILABLE}
[junit4] 2> 1063737 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.e.j.s.ServerConnector Started ServerConnector@2828313b{HTTP/1.1,[http/1.1]}{127.0.0.1:53688}
[junit4] 2> 1063737 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.e.j.s.Server Started @1067590ms
[junit4] 2> 1063737 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {shards=shard2, hostContext=/x_, hostPort=53688, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CdcrReplicationDistributedZkTest_B76FFC4460F69B3F-001/jetty-002/cores}
[junit4] 2> 1063738 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 1063738 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CdcrReplicationDistributedZkTest_B76FFC4460F69B3F-001/jetty-002'
[junit4] 2> 1063738 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1063738 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 1063738 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1063743 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1063745 INFO (zkCallback-774-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@392bb810 name:ZooKeeperConnection Watcher:127.0.0.1:43900/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1063745 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1063745 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1063746 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1063746 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CdcrReplicationDistributedZkTest_B76FFC4460F69B3F-001/jetty-002/solr.xml
[junit4] 2> 1063752 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CdcrReplicationDistributedZkTest_B76FFC4460F69B3F-001/jetty-002/cores
[junit4] 2> 1063752 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.CoreContainer New CoreContainer 1490061214
[junit4] 2> 1063752 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CdcrReplicationDistributedZkTest_B76FFC4460F69B3F-001/jetty-002]
[junit4] 2> 1063752 WARN (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CdcrReplicationDistributedZkTest_B76FFC4460F69B3F-001/jetty-002/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CdcrReplicationDistributedZkTest_B76FFC4460F69B3F-001/jetty-002/lib
[junit4] 2> 1063752 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 1063753 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1063754 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1063754 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1063754 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43900/solr
[junit4] 2> 1063754 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 1063754 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1063755 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1063756 INFO (zkCallback-776-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@754599fe name:ZooKeeperConnection Watcher:127.0.0.1:43900 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1063756 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1063757 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1063758 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [n:127.0.0.1:53688_x_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1063759 INFO (zkCallback-777-thread-1-processing-n:127.0.0.1:53688_x_) [n:127.0.0.1:53688_x_ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3e672e0a name:ZooKeeperConnection Watcher:127.0.0.1:43900/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1063759 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [n:127.0.0.1:53688_x_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1063764 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [n:127.0.0.1:53688_x_ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 1064775 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [n:127.0.0.1:53688_x_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53688_x_
[junit4] 2> 1064775 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [n:127.0.0.1:53688_x_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:53688_x_
[junit4] 2> 1064776 INFO (zkCallback-777-thread-1-processing-n:127.0.0.1:53688_x_) [n:127.0.0.1:53688_x_ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1064776 INFO (zkCallback-773-thread-2-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1064777 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [n:127.0.0.1:53688_x_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1064777 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [n:127.0.0.1:53688_x_ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94981354981752839-127.0.0.1:53688_x_-n_0000000001
[junit4] 2> 1064778 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [n:127.0.0.1:53688_x_ ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/94981354981752836-127.0.0.1:36461_x_-n_0000000000 to know if I could be the leader
[junit4] 2> 1064788 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [n:127.0.0.1:53688_x_ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 1064788 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [n:127.0.0.1:53688_x_ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 1064789 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [n:127.0.0.1:53688_x_ ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CdcrReplicationDistributedZkTest_B76FFC4460F69B3F-001/jetty-002/cores
[junit4] 2> 1064790 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [n:127.0.0.1:53688_x_ ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=tmp_collection, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 1064790 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [n:127.0.0.1:53688_x_ ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CdcrReplicationDistributedZkTest_B76FFC4460F69B3F-001/jetty-002/cores/collection1
[junit4] 2> 1064790 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [n:127.0.0.1:53688_x_ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
[junit4] 2> 1064791 INFO (coreLoadExecutor-1988-thread-1-processing-n:127.0.0.1:53688_x_) [n:127.0.0.1:53688_x_ c:tmp_collection x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 1064791 INFO (coreLoadExecutor-1988-thread-1-processing-n:127.0.0.1:53688_x_) [n:127.0.0.1:53688_x_ c:tmp_collection x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 1064791 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [n:127.0.0.1:53688_x_ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2
[junit4] 2> 1064791 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[B76FFC4460F69B3F]) [n:127.0.0.1:53688_x_ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 1064792 INFO (coreLoadExecutor-1988-thread-1-processing-n:127.0.0.1:53688_x_) [n:127.0.0.1:53688_x_ c:tmp_collection x:collection1] o.a.s.c.ZkController Registering watch for collection tmp_collection
[junit4] 2> 1064792 INFO (coreLoadExecutor-1988-thread-1-processing-n:127.0.0.1:53688_x_) [n:127.0.0.1:53688_x_ c:tmp_collection x:collection1] o.a.s.c.c.ZkStateReader addZkWatch tmp_collection
[junit4] 2> 1064792 INFO (OverseerStateUpdate-94981354981752836-127.0.0.1:36461_x_-n_0000000000) [n:127.0.0.1:36461_x_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:53688/x_",
[junit4] 2> "node_name":"127.0.0.1:53688_x_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"tmp_collection",
[junit4] 2> "operation":"state"} current state version: 3
[junit4] 2> 1064793 INFO (coreLoadExecutor-1988-thread-1-processing-n:127.0.0.1:53688_x_) [n:127.0.0.1:53688_x_ c:tmp_collection x:collection1] o.a.s.c.c.ZkStateReader Deleting data for tmp_collection
[junit4] 2> 1064793 INFO (OverseerStateUpdate-94981354981752836-127.0.0.1:36461_x_-n_0000000000) [n:127.0.0.1:36461_x_ ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:53688/x_",
[junit4] 2> "node_name":"127.0.0.1:53688_x_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"tmp_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 1064793 INFO (OverseerStateUpdate-94981354981752836-127.0.0.1:36461_x_-n_0000000000) [n:127.0.0.1:36461_x_ ] o.a.s.c.o.ReplicaMutator Collection already exists with numShards=2
[junit4] 2> 1064793 INFO (OverseerStateUpdate-94981354981752836-127.0.0.1:36461_x_-n_0000000000) [n:127.0.0.1:36461_x_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 1064795 INFO (coreLoadExecutor-1988-thread-1-processing-n:127.0.0.1:53688_x_) [n:127.0.0.1:53688_x_ c:tmp_collection x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 1064895 INFO (zkCallback-773-thread-2-processing-n:127.0.0.1:36461_x_) [n:127.0.0.1:36461_x_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1064895 INFO (zkCallback-777-thread-1-processing-n:127.0.0.1:53688_x_) [n:127.0.0.1:53688_x_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1065795 INFO (coreLoadExecutor-1988-thread-1-processing-n:127.0.0.1:53688_x_) [n:127.0.0.1:53688_x_ c:tmp_collection x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 1065795 INFO (coreLoadExecutor-1988-thread-1-processing-n:127.0.0.1:53688_x_) [n:127.0.0.1:53688_x_ c:tmp_collection x:collection1] o.a.s.c.ZkController Check for collection zkNode:tmp_collection
[junit4] 2> 1065796 INFO (coreLoadExecutor-1988-thread-1-processing-n:127.0.0.1:53688_x_) [n:127.0.0.1:53688_x_ c:tmp_collection x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 1065796 INFO (coreLoadExecutor-1988-thread-1-processing-n:127.0.0.1:53688_x_) [n:127.0.0.1:53688_x_ c:tmp_collection x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/tmp_collection
[junit4] 2> 1065797 INFO (coreLoadExecutor-1988-thread-1-processing-n:127.0.0.1:53688_x_) [n:127.0.0.1:53688_x_ c:tmp_collection x:collection1] o.a.s.c.c.ZkStateReader path=/collections/tmp_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1065797 INFO (coreLoadExecutor-1988-thread-1-processing-n:127.0.0.1:53688_x_) [n:127.0.0.1:53688_x_ c:tmp_collection x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CdcrReplicationDistributedZkTest_B76FFC4460F69B3F-001/jetty-002/cores/collection1'
[junit4] 2> 1065797 INFO (coreLoadExecutor-1988-thread-1-processing-n:127.0.0.1:53688_x_) [n:127.0.0.1:53688_x_ c:tmp_collection x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1065797 INFO (coreLoadExecutor-1988-thread-1-processing-n:127.0.0.1:53688_x_) [n:127.0.0.1:53688_x_ c:tmp_collection x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 1065798 INFO (coreLoadExecutor-1988-thread-1-processing-n:127.0.0.1:53688_x_) [n:127.0.0.1:53688_x_ c:tmp_collection x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 1065803 INFO (coreLoadExecutor-1988-thread-1-processing-n:127.0.0.1:53688_x_) [n:127.0.0.1:53688_x_ c:tmp_collection x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 1065806 INFO (coreLoadExecutor-1988-thread-1-processing-n:127.0.0.1:53688_x_) [n:127.0.0.1:53688_x_ c:tmp_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 1065823 INFO (coreLoadExecutor-1988-thread-1-processing-n:127.0.0.1:53688_x_) [n:127.0.0.1:53688_x_ c:tmp_collection x:collection1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1065828 INFO (coreLoadExecutor-1988-thread-1-processing-n:127.0.0.1:53688_x_) [n:127.0.0.1:53688_x_ c:tmp_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 1065908 INFO (coreLoadExecutor-1988-thread-1-processing-n:127.0.0.1:53688_x_) [n:127.0.0.1:53688_x_ c:tmp_collection x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 1065909 INFO (coreLoadExecutor-1988-thread-1-processing-n:127.0.0.1:53688_x_) [n:127.0.0.1:53688_x_ c:tmp_collection x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 1065910 INFO (coreLoadExecutor-1988-thread-1-processing-n:127.0.0.1:53688_x_) [n:127.0.0.1:53688_x_ c:tmp_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 1065912 INFO (coreLoadExecutor-1988-thread-1-processing-n:127.0.0.1:53688_x_) [n:127.0.0.1:53688_x_ c:tmp_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 1065927 INFO (coreLoadExecutor-1988-thread-1-processing-n:127.0.0.1:53688_x_) [n:127.0.0.1:53688_x_ c:tmp_collection x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2
[junit4] 2> 1065927 INFO (coreLoadExecutor-1988-thread-1-processing-n:127.0.0.1:53688_x_) [n:127.0.0.1:53688_x_ c:tmp_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection tmp_collection
[junit4] 2> 1065928 INFO (coreLoadExecutor-1988-thread-1-processing-n:127.0.0.1:53688_x_) [n:127.0.0.1:53688_x_ c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1065928 INFO (coreLoadExecutor-1988-thread-1-processing-n:127.0.0.1:53688_x_) [n:127.0.0.1:53688_x_ c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CdcrReplicationDistributedZkTest_B76FFC4460F69B3F-001/jetty-002/cores/collection1], dataDir=[null]
[junit4] 2> 1065928 INFO (coreLoadExecutor-1988-thread-1-processing-n:127.0.0.1:53688_x_) [n:127.0.0.1:53688_x_ c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@427ed5b8
[junit4] 2> 1065928 INFO (coreLoadExecutor-1988-thread-1-processing-n:127.0.0.1:53688_x_) [n:127.0.0.1:53688_x_ c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CdcrReplicationDistributedZkTest_B76FFC4460F69B3F-001/jetty-002/cores/collection1/data
[junit4] 2> 1065928 INFO (coreLoadExecutor-1988-thread-1-processing-n:127.0.0.1:53688_x_) [n:127.0.0.1:53688_x_ c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CdcrReplicationDistributedZkTest_B76FFC4460F69B3F-001/jetty-002/cores/collection1/data/index/
[junit4] 2> 1065928 WARN (coreLoadExecutor-1988-thread-1-processing-n:127.0.0.1:53688_x_) [n:127.0.0.1:53688_x_ c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CdcrReplicationDistributedZkTest_B76FFC4460F69B3F-001/jetty-002/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1065929 INFO (co
[...truncated too long message...]
000019
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard2/election/94981491080691933-core_node11-n_0000000038
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard2/election/94981491080691897-core_node15-n_0000000031
[junit4] 2> 2 /solr/overseer_elect/election/94981491080691837-127.0.0.1:40249__%2Fs-n_0000000053
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard1/election/94981491080691864-core_node14-n_0000000022
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard1/election/94981491080691768-core_node14-n_0000000008
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard2/election/94981491080691828-core_node3-n_0000000018
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard1/election/94981491080692056-core_node14-n_0000000050
[junit4] 2> 2 /solr/overseer_elect/election/94981491080692008-127.0.0.1:38552__%2Fs-n_0000000130
[junit4] 2> 2 /solr/overseer_elect/election/94981491080692035-127.0.0.1:58263__%2Fs-n_0000000144
[junit4] 2> 2 /solr/overseer_elect/election/94981491080691738-127.0.0.1:56511__%2Fs-n_0000000081
[junit4] 2> 2 /solr/overseer_elect/election/94981491080691939-127.0.0.1:58263__%2Fs-n_0000000102
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard2/election/94981491080691750-core_node11-n_0000000005
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard2/election/94981491080692029-core_node11-n_0000000056
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard1/election/94981491080691987-core_node10-n_0000000041
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard2/election/94981491080691924-core_node3-n_0000000036
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard1/election/94981491080692008-core_node14-n_0000000043
[junit4] 2> 2 /solr/overseer_elect/election/94981491080691981-127.0.0.1:40249__%2Fs-n_0000000121
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard2/election/94981491080691993-core_node15-n_0000000049
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard2/election/94981491080691981-core_node11-n_0000000047
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard1/election/94981491080691912-core_node14-n_0000000029
[junit4] 2> 2 /solr/overseer_elect/election/94981491080691912-127.0.0.1:38552__%2Fs-n_0000000088
[junit4] 2> 2 /solr/overseer_elect/election/94981491080691762-127.0.0.1:46468__%2Fs-n_0000000015
[junit4] 2> 2 /solr/overseer_elect/election/94981491080691816-127.0.0.1:38552__%2Fs-n_0000000046
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 123 /solr/collections
[junit4] 2> 56 /solr/overseer/collection-queue-work
[junit4] 2> 54 /solr/overseer/queue
[junit4] 2> 18 /solr/live_nodes
[junit4] 2> 11 /solr/overseer/queue-work
[junit4] 2>
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=RollingRestartTest -Dtests.method=test -Dtests.seed=B76FFC4460F69B3F -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=ko_KR -Dtests.timezone=Pacific/Enderbury -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[junit4] FAILURE 842s J0 | RollingRestartTest.test <<<
[junit4] > Throwable #1: java.lang.AssertionError: Unable to restart (#6): CloudJettyRunner [url=http://127.0.0.1:58263/_/s/collection1]
[junit4] > at __randomizedtesting.SeedInfo.seed([B76FFC4460F69B3F:3F3BC39ECE0AF6C7]:0)
[junit4] > at org.apache.solr.cloud.RollingRestartTest.restartWithRolesTest(RollingRestartTest.java:104)
[junit4] > at org.apache.solr.cloud.RollingRestartTest.test(RollingRestartTest.java:53)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:965)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:940)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 3980040 INFO (SUITE-RollingRestartTest-seed#[B76FFC4460F69B3F]-worker) [n:127.0.0.1:34304__%2Fs c:collection1 s:shard1 r:core_node16 x:collection1] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.RollingRestartTest_B76FFC4460F69B3F-001
[junit4] 2> Dec 05, 2015 8:16:19 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene60): {}, docValues:{}, sim=ClassicSimilarity, locale=ko_KR, timezone=Pacific/Enderbury
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_66 (64-bit)/cpus=4,threads=1,free=242602144,total=521142272
[junit4] 2> NOTE: All tests run in this JVM: [TestReplicationHandler, DistributedQueryElevationComponentTest, TestComponentsName, TestLazyCores, SSLMigrationTest, TestDocBasedVersionConstraints, StressHdfsTest, TestFieldTypeCollectionResource, RuleEngineTest, UUIDFieldTest, ParsingFieldUpdateProcessorsTest, DocumentAnalysisRequestHandlerTest, TestConfigSetProperties, TestExactSharedStatsCache, SolrCoreTest, TestSolrQueryParserDefaultOperatorResource, TestCollectionAPI, URLClassifyProcessorTest, TestNoOpRegenerator, TestFileDictionaryLookup, TestMergePolicyConfig, SyncSliceTest, CdcrVersionReplicationTest, TestAuthenticationFramework, DataDrivenBlockJoinTest, MigrateRouteKeyTest, DisMaxRequestHandlerTest, ConjunctionSolrSpellCheckerTest, RAMDirectoryFactoryTest, SOLR749Test, TestLRUCache, BufferStoreTest, MergeStrategyTest, TestFoldingMultitermQuery, FileBasedSpellCheckerTest, TestTolerantSearch, JSONWriterTest, TestFastOutputStream, DocValuesMissingTest, OverriddenZkACLAndCredentialsProvidersTest, TestDistributedSearch, TestSolrCLIRunExample, TestFaceting, TestFieldResource, ResponseHeaderTest, SolrRequestParserTest, TestDistributedStatsComponentCardinality, CacheHeaderTest, TestAtomicUpdateErrorCases, DefaultValueUpdateProcessorTest, TestUniqueKeyFieldResource, BasicAuthIntegrationTest, SpatialHeatmapFacetsTest, ConnectionManagerTest, TestRandomFaceting, TestAnalyzedSuggestions, DeleteReplicaTest, DistributedVersionInfoTest, TestFieldTypeResource, TestFieldCollectionResource, CloneFieldUpdateProcessorFactoryTest, ResourceLoaderTest, TestJoin, SignatureUpdateProcessorFactoryTest, TestJsonRequest, TestRandomDVFaceting, TestRandomRequestDistribution, HLLSerializationTest, PolyFieldTest, TestOverriddenPrefixQueryForCustomFieldType, TestFunctionQuery, TestPerFieldSimilarityClassic, TriLevelCompositeIdRoutingTest, EchoParamsTest, ReturnFieldsTest, DeleteShardTest, PreAnalyzedFieldTest, RequiredFieldsTest, TestLMDirichletSimilarityFactory, TestSmileRequest, TestArbitraryIndexDir, TestLRUStatsCache, IndexSchemaTest, TestPseudoReturnFields, TestBadConfig, StandardRequestHandlerTest, TestSolr4Spatial, AlternateDirectoryTest, TestCryptoKeys, DistributedQueueTest, TestCloudPivotFacet, TestMinMaxOnMultiValuedField, BasicDistributedZkTest, LeaderElectionIntegrationTest, BasicZkTest, TestZkChroot, TestDistributedGrouping, TestHashPartitioner, TermVectorComponentDistributedTest, DistributedTermsComponentTest, SpellCheckComponentTest, TestGroupingSearch, SolrCmdDistributorTest, BadIndexSchemaTest, TestFiltering, DistanceFunctionTest, XsltUpdateRequestHandlerTest, TestQueryUtils, TestOmitPositions, DocumentBuilderTest, TermVectorComponentTest, TestSolrQueryParser, RegexBoostProcessorTest, JsonLoaderTest, CSVRequestHandlerTest, UpdateParamsTest, TestQuerySenderNoQuery, ResponseLogComponentTest, BadComponentTest, TestStressRecovery, SolrTestCaseJ4Test, TestCursorMarkWithoutUniqueKey, TestDistributedMissingSort, TestEmbeddedSolrServerConstructors, ActionThrottleTest, AliasIntegrationTest, CloudExitableDirectoryReaderTest, CollectionsAPIAsyncDistributedZkTest, DeleteInactiveReplicaTest, DistribDocExpirationUpdateProcessorTest, MultiThreadedOCPTest, OverseerStatusTest, RecoveryAfterSoftCommitTest, RollingRestartTest]
[junit4] Completed [458/564] on J0 in 843.04s, 1 test, 1 failure <<< FAILURES!
[...truncated 338 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:789: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:726: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987: There were test failures: 564 suites (8 ignored), 2237 tests, 1 error, 2 failures, 33 ignored (18 assumptions) [seed: B76FFC4460F69B3F]
Total time: 233 minutes 46 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 871 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/871/
All tests passed
Build Log:
[...truncated 10989 lines...]
[junit4] JVM J1: stdout was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/temp/junit4-J1-20151204_073523_859.sysout
[junit4] >>> JVM J1: stdout (verbatim) ----
[junit4] java.lang.OutOfMemoryError: GC overhead limit exceeded
[junit4] Dumping heap to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/heapdumps/java_pid20638.hprof ...
[junit4] Heap dump file created [607744858 bytes in 5.430 secs]
[junit4] <<< JVM J1: EOF ----
[junit4] JVM J1: stderr was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/temp/junit4-J1-20151204_073523_859.syserr
[junit4] >>> JVM J1: stderr (verbatim) ----
[junit4] WARN: Unhandled exception in event serialization. -> java.lang.OutOfMemoryError: GC overhead limit exceeded
[junit4] at sun.nio.cs.StreamEncoder.write(StreamEncoder.java:133)
[junit4] at java.io.OutputStreamWriter.write(OutputStreamWriter.java:220)
[junit4] at java.io.Writer.write(Writer.java:157)
[junit4] at com.carrotsearch.ant.tasks.junit4.gson.stream.JsonWriter.string(JsonWriter.java:567)
[junit4] at com.carrotsearch.ant.tasks.junit4.gson.stream.JsonWriter.value(JsonWriter.java:414)
[junit4] at com.carrotsearch.ant.tasks.junit4.events.AbstractEvent.writeBinaryProperty(AbstractEvent.java:36)
[junit4] at com.carrotsearch.ant.tasks.junit4.events.AppendStdErrEvent.serialize(AppendStdErrEvent.java:30)
[junit4] at com.carrotsearch.ant.tasks.junit4.events.Serializer$2.run(Serializer.java:101)
[junit4] at com.carrotsearch.ant.tasks.junit4.events.Serializer$2.run(Serializer.java:96)
[junit4] at java.security.AccessController.doPrivileged(Native Method)
[junit4] at com.carrotsearch.ant.tasks.junit4.events.Serializer.flushQueue(Serializer.java:96)
[junit4] at com.carrotsearch.ant.tasks.junit4.events.Serializer.serialize(Serializer.java:81)
[junit4] at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain$3$2.write(SlaveMain.java:457)
[junit4] at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
[junit4] at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140)
[junit4] at java.io.PrintStream.flush(PrintStream.java:338)
[junit4] at java.io.FilterOutputStream.flush(FilterOutputStream.java:140)
[junit4] at java.io.PrintStream.write(PrintStream.java:482)
[junit4] at sun.nio.cs.StreamEncoder.writeBytes(StreamEncoder.java:221)
[junit4] at sun.nio.cs.StreamEncoder.implFlushBuffer(StreamEncoder.java:291)
[junit4] at sun.nio.cs.StreamEncoder.implFlush(StreamEncoder.java:295)
[junit4] at sun.nio.cs.StreamEncoder.flush(StreamEncoder.java:141)
[junit4] at java.io.OutputStreamWriter.flush(OutputStreamWriter.java:229)
[junit4] at org.apache.log4j.helpers.QuietWriter.flush(QuietWriter.java:59)
[junit4] at org.apache.log4j.WriterAppender.subAppend(WriterAppender.java:324)
[junit4] at org.apache.log4j.WriterAppender.append(WriterAppender.java:162)
[junit4] at org.apache.log4j.AppenderSkeleton.doAppend(AppenderSkeleton.java:251)
[junit4] at org.apache.log4j.helpers.AppenderAttachableImpl.appendLoopOnAppenders(AppenderAttachableImpl.java:66)
[junit4] at org.apache.log4j.Category.callAppenders(Category.java:206)
[junit4] at org.apache.log4j.Category.forcedLog(Category.java:391)
[junit4] at org.apache.log4j.Category.log(Category.java:856)
[junit4] at org.slf4j.impl.Log4jLoggerAdapter.info(Log4jLoggerAdapter.java:304)
[junit4] <<< JVM J1: EOF ----
[...truncated 453 lines...]
[junit4] ERROR: JVM J1 ended with an exception, command line: /x1/jenkins/jenkins-slave/tools/hudson.model.JDK/latest1.8/jre/bin/java -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/heapdumps -ea -esa -Dtests.prefix=tests -Dtests.seed=C6B23123F6B85644 -Xmx512M -Dtests.iters= -Dtests.verbose=false -Dtests.infostream=false -Dtests.codec=random -Dtests.postingsformat=random -Dtests.docvaluesformat=random -Dtests.locale=random -Dtests.timezone=random -Dtests.directory=random -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.luceneMatchVersion=6.0.0 -Dtests.cleanthreads=perClass -Djava.util.logging.config.file=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/tools/junit4/logging.properties -Dtests.nightly=true -Dtests.weekly=false -Dtests.monster=false -Dtests.slow=true -Dtests.asserts=true -Dtests.multiplier=2 -DtempDir=./temp -Djava.io.tmpdir=./temp -Djunit4.tempDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/temp -Dcommon.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene -Dclover.db.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/clover/db -Djava.security.policy=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/tools/junit4/solr-tests.policy -Dtests.LUCENE_VERSION=6.0.0 -Djetty.testMode=1 -Djetty.insecurerandom=1 -Dsolr.directoryFactory=org.apache.solr.core.MockDirectoryFactory -Djava.awt.headless=true -Djdk.map.althashing.threshold=0 -Djunit4.childvm.cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1 -Djunit4.childvm.id=1 -Djunit4.childvm.count=3 -Dtests.leaveTemporary=false -Dtests.filterstacks=true -Djava.security.manager=org.apache.lucene.util.TestSecurityManager -Dfile.encoding=ISO-8859-1 -classpath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/classes/test:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-test-framework/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/test-framework/lib/junit4-ant-2.3.1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/test-framework/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/codecs/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-solrj/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/analysis/common/lucene-analyzers-common-6.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/analysis/kuromoji/lucene-analyzers-kuromoji-6.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/analysis/phonetic/lucene-analyzers-phonetic-6.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/codecs/lucene-codecs-6.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/backward-codecs/lucene-backward-codecs-6.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/highlighter/lucene-highlighter-6.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/memory/lucene-memory-6.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/misc/lucene-misc-6.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/spatial/lucene-spatial-6.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/expressions/lucene-expressions-6.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/suggest/lucene-suggest-6.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/grouping/lucene-grouping-6.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/queries/lucene-queries-6.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/queryparser/lucene-queryparser-6.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/join/lucene-join-6.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/sandbox/lucene-sandbox-6.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/antlr4-runtime-4.5.1-1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/asm-5.0.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/asm-commons-5.0.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/caffeine-1.0.1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/commons-cli-1.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/commons-codec-1.10.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/commons-collections-3.2.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/commons-configuration-1.6.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/commons-exec-1.3.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/commons-fileupload-1.2.1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/commons-lang-2.6.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/dom4j-1.6.1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/guava-14.0.1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/hadoop-annotations-2.6.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/hadoop-auth-2.6.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/hadoop-common-2.6.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/hadoop-hdfs-2.6.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/hppc-0.7.1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/htrace-core-3.0.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/jackson-core-2.5.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/jackson-dataformat-smile-2.5.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/jcl-over-slf4j-1.7.7.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/joda-time-2.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/log4j-1.2.17.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/org.restlet-2.3.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/org.restlet.ext.servlet-2.3.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/presto-parser-0.122.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/protobuf-java-2.5.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/slf4j-log4j12-1.7.7.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/slice-0.10.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/spatial4j-0.5.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/t-digest-3.1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/solrj/lib/commons-io-2.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/solrj/lib/httpclient-4.4.1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/solrj/lib/httpcore-4.4.1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/solrj/lib/httpmime-4.4.1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/solrj/lib/jcl-over-slf4j-1.7.7.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/solrj/lib/noggit-0.6.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/solrj/lib/slf4j-api-1.7.7.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/solrj/lib/stax2-api-3.1.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/solrj/lib/woodstox-core-asl-4.4.1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/solrj/lib/zookeeper-3.4.6.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/server/lib/javax.servlet-api-3.1.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/server/lib/jetty-continuation-9.3.6.v20151106.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/server/lib/jetty-deploy-9.3.6.v20151106.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/server/lib/jetty-http-9.3.6.v20151106.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/server/lib/jetty-io-9.3.6.v20151106.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/server/lib/jetty-jmx-9.3.6.v20151106.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/server/lib/jetty-rewrite-9.3.6.v20151106.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/server/lib/jetty-security-9.3.6.v20151106.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/server/lib/jetty-server-9.3.6.v20151106.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/server/lib/jetty-servlet-9.3.6.v20151106.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/server/lib/jetty-servlets-9.3.6.v20151106.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/server/lib/jetty-util-9.3.6.v20151106.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/server/lib/jetty-webapp-9.3.6.v20151106.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/server/lib/jetty-xml-9.3.6.v20151106.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/example/example-DIH/solr/db/lib/derby-10.9.1.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/example/example-DIH/solr/db/lib/hsqldb-1.8.0.10.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/core/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/test-framework/lib/junit-4.10.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/test-framework/lib/randomizedtesting-runner-2.3.1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/antlr-2.7.7.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/antlr4-runtime-4.5.1-1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-core-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-core-api-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-core-avl-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-core-shared-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-i18n-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptor-kerberos-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-admin-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-authn-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-authz-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-changelog-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-collective-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-event-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-exception-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-journal-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-normalization-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-operational-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-referral-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-schema-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-subtree-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-trigger-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-jdbm-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-jdbm1-2.0.0-M2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-kerberos-codec-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-ldif-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-mavibot-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-protocol-kerberos-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-protocol-ldap-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-protocol-shared-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-xdbm-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/api-all-1.0.0-M20.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/bcprov-jdk15-1.45.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/cglib-nodep-2.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/commons-collections-3.2.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/commons-math3-3.4.1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/easymock-3.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/ehcache-core-2.4.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/hadoop-common-2.6.0-tests.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/hadoop-hdfs-2.6.0-tests.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/hadoop-minikdc-2.6.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/jackson-annotations-2.5.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/jackson-databind-2.5.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/jersey-core-1.9.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/jersey-server-1.9.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/jetty-6.1.26.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/jetty-util-6.1.26.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/mina-core-2.0.0-M5.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/objenesis-1.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/presto-parser-0.122.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/slice-0.10.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/analysis/icu/lucene-analyzers-icu-6.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-analysis-extras/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/contrib/analysis-extras/lib/icu4j-54.1.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-launcher.jar:/x1/jenkins/.ant/lib/ivy-2.3.0.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-antlr.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-regexp.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-resolver.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-commons-net.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jmf.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-oro.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-xalan2.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-commons-logging.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jsch.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-junit4.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-javamail.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jai.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jdepend.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-junit.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-bsf.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-swing.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-netrexx.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-bcel.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-testutil.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-log4j.jar:/x1/jenkins/jenkins-slave/tools/hudson.model.JDK/latest1.8/lib/tools.jar:/x1/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.3.1.jar com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe -eventsfile /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/temp/junit4-J1-20151204_073523_859.events @/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/temp/junit4-J1-20151204_073523_859.suites -stdin
[junit4] ERROR: JVM J1 ended with an exception: Quit event not received from the forked process? This may indicate JVM crash or runner bugs.
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4.executeSlave(JUnit4.java:1503)
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4.access$000(JUnit4.java:130)
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:963)
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:960)
[junit4] at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] at java.lang.Thread.run(Thread.java:745)
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:789: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:726: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987: At least one slave process threw an exception, first: Quit event not received from the forked process? This may indicate JVM crash or runner bugs.
Total time: 204 minutes 14 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 870 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/870/
3 tests failed.
FAILED: org.apache.solr.cloud.CdcrReplicationDistributedZkTest.testReplicationAfterLeaderChange
Error Message:
Timeout while trying to assert number of documents on collection: target_collection
Stack Trace:
java.lang.AssertionError: Timeout while trying to assert number of documents on collection: target_collection
at __randomizedtesting.SeedInfo.seed([8FA0AF1B622EEDB7:5D50E3F83C814B85]:0)
at org.apache.solr.cloud.BaseCdcrDistributedZkTest.assertNumDocs(BaseCdcrDistributedZkTest.java:265)
at org.apache.solr.cloud.CdcrReplicationDistributedZkTest.testReplicationAfterLeaderChange(CdcrReplicationDistributedZkTest.java:292)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:965)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:940)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.AssertionError: expected:<10> but was:<4>
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at org.apache.solr.cloud.BaseCdcrDistributedZkTest.assertNumDocs(BaseCdcrDistributedZkTest.java:256)
... 42 more
FAILED: org.apache.solr.cloud.RollingRestartTest.test
Error Message:
Unable to restart (#0): CloudJettyRunner [url=http://127.0.0.1:33276/collection1]
Stack Trace:
java.lang.AssertionError: Unable to restart (#0): CloudJettyRunner [url=http://127.0.0.1:33276/collection1]
at __randomizedtesting.SeedInfo.seed([8FA0AF1B622EEDB7:7F490C1CCD2804F]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.cloud.RollingRestartTest.restartWithRolesTest(RollingRestartTest.java:104)
at org.apache.solr.cloud.RollingRestartTest.test(RollingRestartTest.java:53)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:965)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:940)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest.test
Error Message:
document count mismatch. control=1357 sum(shards)=1355 cloudClient=1355
Stack Trace:
java.lang.AssertionError: document count mismatch. control=1357 sum(shards)=1355 cloudClient=1355
at __randomizedtesting.SeedInfo.seed([8FA0AF1B622EEDB7:7F490C1CCD2804F]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1298)
at org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest.test(ChaosMonkeyNothingIsSafeTest.java:234)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:965)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:940)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 10872 lines...]
[junit4] Suite: org.apache.solr.cloud.RollingRestartTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_8FA0AF1B622EEDB7-001/init-core-data-001
[junit4] 2> 702000 INFO (SUITE-RollingRestartTest-seed#[8FA0AF1B622EEDB7]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
[junit4] 2> 702001 INFO (SUITE-RollingRestartTest-seed#[8FA0AF1B622EEDB7]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
[junit4] 2> 702006 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 702011 INFO (Thread-22391) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 702011 INFO (Thread-22391) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 702112 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.ZkTestServer start zk server on port:47925
[junit4] 2> 702112 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 702115 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 702124 INFO (zkCallback-1010-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@66e3ad02 name:ZooKeeperConnection Watcher:127.0.0.1:47925 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 702124 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 702125 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 702125 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 702128 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 702129 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 702132 INFO (zkCallback-1011-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@33162ce6 name:ZooKeeperConnection Watcher:127.0.0.1:47925/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 702132 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 702132 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 702133 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
[junit4] 2> 702134 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
[junit4] 2> 702136 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
[junit4] 2> 702137 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
[junit4] 2> 702139 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 702139 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 702142 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 702143 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
[junit4] 2> 702145 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 702145 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 702147 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 702147 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
[junit4] 2> 702152 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 702152 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
[junit4] 2> 702153 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 702154 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
[junit4] 2> 702155 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 702155 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 702157 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 702157 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 702159 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 702159 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 702161 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 702161 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 702163 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 702164 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
[junit4] 2> 702512 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_8FA0AF1B622EEDB7-001/control-001/cores/collection1
[junit4] 2> 702515 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.e.j.s.Server jetty-9.3.6.v20151106
[junit4] 2> 702523 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5b9d6ae0{/,null,AVAILABLE}
[junit4] 2> 702531 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.e.j.s.ServerConnector Started ServerConnector@47934ab{HTTP/1.1,[http/1.1]}{127.0.0.1:46519}
[junit4] 2> 702531 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.e.j.s.Server Started @705754ms
[junit4] 2> 702531 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_8FA0AF1B622EEDB7-001/tempDir-001/control/data, hostContext=/, hostPort=46519, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_8FA0AF1B622EEDB7-001/control-001/cores}
[junit4] 2> 702531 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 702531 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_8FA0AF1B622EEDB7-001/control-001'
[junit4] 2> 702531 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 702531 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 702532 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 702536 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 702542 INFO (zkCallback-1012-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@16b91dd1 name:ZooKeeperConnection Watcher:127.0.0.1:47925/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 702542 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 702542 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 702544 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 702544 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_8FA0AF1B622EEDB7-001/control-001/solr.xml
[junit4] 2> 702550 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_8FA0AF1B622EEDB7-001/control-001/cores
[junit4] 2> 702550 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.CoreContainer New CoreContainer 1480917197
[junit4] 2> 702550 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_8FA0AF1B622EEDB7-001/control-001]
[junit4] 2> 702551 WARN (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_8FA0AF1B622EEDB7-001/control-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_8FA0AF1B622EEDB7-001/control-001/lib
[junit4] 2> 702551 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 702553 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 702554 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 702554 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 702554 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:47925/solr
[junit4] 2> 702554 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 702555 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 702557 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 702557 INFO (zkCallback-1014-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@43bd54aa name:ZooKeeperConnection Watcher:127.0.0.1:47925 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 702558 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 702558 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 702563 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [n:127.0.0.1:46519_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 702566 INFO (zkCallback-1015-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1d4f6a72 name:ZooKeeperConnection Watcher:127.0.0.1:47925/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 702567 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [n:127.0.0.1:46519_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 702569 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [n:127.0.0.1:46519_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
[junit4] 2> 702571 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [n:127.0.0.1:46519_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 702574 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [n:127.0.0.1:46519_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 702575 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [n:127.0.0.1:46519_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 702577 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [n:127.0.0.1:46519_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 702581 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [n:127.0.0.1:46519_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 702583 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [n:127.0.0.1:46519_ ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 702585 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [n:127.0.0.1:46519_ ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 702587 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [n:127.0.0.1:46519_ ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 702588 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [n:127.0.0.1:46519_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46519_
[junit4] 2> 702589 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [n:127.0.0.1:46519_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:46519_
[junit4] 2> 702591 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [n:127.0.0.1:46519_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 702592 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [n:127.0.0.1:46519_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 702593 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [n:127.0.0.1:46519_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 702595 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [n:127.0.0.1:46519_ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94968646869057540-127.0.0.1:46519_-n_0000000000
[junit4] 2> 702595 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [n:127.0.0.1:46519_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:46519_
[junit4] 2> 702595 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [n:127.0.0.1:46519_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
[junit4] 2> 702597 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [n:127.0.0.1:46519_ ] o.a.s.c.Overseer Overseer (id=94968646869057540-127.0.0.1:46519_-n_0000000000) starting
[junit4] 2> 702600 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [n:127.0.0.1:46519_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
[junit4] 2> 702621 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [n:127.0.0.1:46519_ ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 702629 INFO (OverseerCollectionConfigSetProcessor-94968646869057540-127.0.0.1:46519_-n_0000000000) [n:127.0.0.1:46519_ ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
[junit4] 2> 702629 INFO (OverseerStateUpdate-94968646869057540-127.0.0.1:46519_-n_0000000000) [n:127.0.0.1:46519_ ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 702629 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [n:127.0.0.1:46519_ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 702655 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [n:127.0.0.1:46519_ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 702655 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [n:127.0.0.1:46519_ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 702655 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [n:127.0.0.1:46519_ ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_8FA0AF1B622EEDB7-001/control-001/cores
[junit4] 2> 702660 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [n:127.0.0.1:46519_ ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=control_collection, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 702661 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [n:127.0.0.1:46519_ ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_8FA0AF1B622EEDB7-001/control-001/cores/collection1
[junit4] 2> 702661 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [n:127.0.0.1:46519_ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
[junit4] 2> 702663 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 702663 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 702682 INFO (OverseerStateUpdate-94968646869057540-127.0.0.1:46519_-n_0000000000) [n:127.0.0.1:46519_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:46519",
[junit4] 2> "node_name":"127.0.0.1:46519_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 702683 INFO (OverseerStateUpdate-94968646869057540-127.0.0.1:46519_-n_0000000000) [n:127.0.0.1:46519_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:46519",
[junit4] 2> "node_name":"127.0.0.1:46519_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 702683 INFO (OverseerStateUpdate-94968646869057540-127.0.0.1:46519_-n_0000000000) [n:127.0.0.1:46519_ ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
[junit4] 2> 702684 INFO (OverseerStateUpdate-94968646869057540-127.0.0.1:46519_-n_0000000000) [n:127.0.0.1:46519_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 702689 INFO (zkCallback-1015-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 702694 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 702694 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [n:127.0.0.1:46519_ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4] 2> 702694 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [n:127.0.0.1:46519_ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 702694 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 702694 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
[junit4] 2> 702697 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 702697 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 702700 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 702700 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_8FA0AF1B622EEDB7-001/control-001/cores/collection1'
[junit4] 2> 702700 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 702700 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 702702 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 702711 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 702715 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 702726 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection x:collection1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
[junit4] 2> 702732 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 702830 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 702836 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 702837 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 702847 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 702849 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 702851 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 702852 WARN (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 702852 WARN (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 702852 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 702854 WARN (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 702854 WARN (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 702855 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4] 2> 702855 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 702855 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore solr.StandardDirectoryFactory
[junit4] 2> 702855 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_8FA0AF1B622EEDB7-001/control-001/cores/collection1], dataDir=[null]
[junit4] 2> 702855 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6b32d96a
[junit4] 2> 702856 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_8FA0AF1B622EEDB7-001/control-001/cores/collection1/data
[junit4] 2> 702856 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_8FA0AF1B622EEDB7-001/control-001/cores/collection1/data/index/
[junit4] 2> 702856 WARN (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_8FA0AF1B622EEDB7-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 702856 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_8FA0AF1B622EEDB7-001/control-001/cores/collection1/data/index
[junit4] 2> 702857 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=941386548, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 702866 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_8FA0AF1B622EEDB7-001/control-001/cores/collection1/data/index,segFN=segments_1,generation=1}
[junit4] 2> 702866 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 702867 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_8FA0AF1B622EEDB7-001/control-001/cores/collection1/data/
[junit4] 2> 702870 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 702870 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
[junit4] 2> 702870 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 702870 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 702870 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 702870 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 702871 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 702871 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 702871 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 702871 WARN (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,args = {defaults={a=A,b=B}}}
[junit4] 2> 702873 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 702874 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 702875 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 702876 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 702879 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/dump,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 702879 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 702880 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 702880 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 702880 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 702880 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 702881 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1641013339, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 702881 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_8FA0AF1B622EEDB7-001/control-001/cores/collection1/data/index,segFN=segments_1,generation=1}
[junit4] 2> 702882 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 702882 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@79f042cb[collection1] main
[junit4] 2> 702882 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 702883 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 702883 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 702883 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 702883 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
[junit4] 2> 702883 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 702885 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 702885 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 702885 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 702885 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 702885 INFO (searcherExecutor-1984-thread-1-processing-n:127.0.0.1:46519_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@79f042cb[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 702886 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
[junit4] 2> 702886 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
[junit4] 2> 702886 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
[junit4] 2> 702886 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1519498350820327424
[junit4] 2> 702888 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 2.0ms to seed version buckets with highest version 1519498350820327424
[junit4] 2> 702888 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
[junit4] 2> 702889 INFO (coreLoadExecutor-1983-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 702890 INFO (coreZkRegister-1977-thread-1-processing-n:127.0.0.1:46519_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:46519 collection:control_collection shard:shard1
[junit4] 2> 702891 INFO (coreZkRegister-1977-thread-1-processing-n:127.0.0.1:46519_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 702895 INFO (coreZkRegister-1977-thread-1-processing-n:127.0.0.1:46519_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/94968646869057540-core_node1-n_0000000000
[junit4] 2> 702896 INFO (coreZkRegister-1977-thread-1-processing-n:127.0.0.1:46519_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1
[junit4] 2> 702898 INFO (coreZkRegister-1977-thread-1-processing-n:127.0.0.1:46519_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 702898 INFO (coreZkRegister-1977-thread-1-processing-n:127.0.0.1:46519_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 702898 INFO (coreZkRegister-1977-thread-1-processing-n:127.0.0.1:46519_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:46519/collection1/
[junit4] 2> 702898 INFO (coreZkRegister-1977-thread-1-processing-n:127.0.0.1:46519_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 702898 INFO (coreZkRegister-1977-thread-1-processing-n:127.0.0.1:46519_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:46519/collection1/ has no replicas
[junit4] 2> 702898 INFO (OverseerStateUpdate-94968646869057540-127.0.0.1:46519_-n_0000000000) [n:127.0.0.1:46519_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection"} current state version: 1
[junit4] 2> 702899 INFO (coreZkRegister-1977-thread-1-processing-n:127.0.0.1:46519_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 702903 INFO (coreZkRegister-1977-thread-1-processing-n:127.0.0.1:46519_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
[junit4] 2> 702911 INFO (coreZkRegister-1977-thread-1-processing-n:127.0.0.1:46519_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:46519/collection1/ shard1
[junit4] 2> 702911 INFO (OverseerStateUpdate-94968646869057540-127.0.0.1:46519_-n_0000000000) [n:127.0.0.1:46519_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:46519",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 1
[junit4] 2> 703016 INFO (zkCallback-1015-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 703063 INFO (coreZkRegister-1977-thread-1-processing-n:127.0.0.1:46519_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:46519/collection1/ and leader is http://127.0.0.1:46519/collection1/
[junit4] 2> 703065 INFO (coreZkRegister-1977-thread-1-processing-n:127.0.0.1:46519_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:46519
[junit4] 2> 703065 INFO (coreZkRegister-1977-thread-1-processing-n:127.0.0.1:46519_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 703065 INFO (coreZkRegister-1977-thread-1-processing-n:127.0.0.1:46519_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
[junit4] 2> 703065 INFO (coreZkRegister-1977-thread-1-processing-n:127.0.0.1:46519_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46519_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 703067 INFO (OverseerStateUpdate-94968646869057540-127.0.0.1:46519_-n_0000000000) [n:127.0.0.1:46519_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:46519",
[junit4] 2> "node_name":"127.0.0.1:46519_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 2
[junit4] 2> 703068 INFO (OverseerStateUpdate-94968646869057540-127.0.0.1:46519_-n_0000000000) [n:127.0.0.1:46519_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:46519",
[junit4] 2> "node_name":"127.0.0.1:46519_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 703170 INFO (zkCallback-1015-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 703196 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 703197 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 703198 INFO (zkCallback-1017-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@62fb9433 name:ZooKeeperConnection Watcher:127.0.0.1:47925/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 703199 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 703199 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 703199 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 703202 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 703202 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with stateFormat=2
[junit4] 2> 703203 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 703203 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 703205 INFO (zkCallback-1018-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5ce7da23 name:ZooKeeperConnection Watcher:127.0.0.1:47925/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 703205 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 703205 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 703207 INFO (OverseerStateUpdate-94968646869057540-127.0.0.1:46519_-n_0000000000) [n:127.0.0.1:46519_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"create",
[junit4] 2> "name":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "stateFormat":"2"} current state version: 3
[junit4] 2> 703207 INFO (OverseerStateUpdate-94968646869057540-127.0.0.1:46519_-n_0000000000) [n:127.0.0.1:46519_ ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
[junit4] 2> 703311 INFO (OverseerStateUpdate-94968646869057540-127.0.0.1:46519_-n_0000000000) [n:127.0.0.1:46519_ ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/collection1/state.json
[junit4] 2> 703540 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_8FA0AF1B622EEDB7-001/shard-1-001/cores/collection1
[junit4] 2> 703541 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_8FA0AF1B622EEDB7-001/shard-1-001
[junit4] 2> 703542 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.e.j.s.Server jetty-9.3.6.v20151106
[junit4] 2> 703543 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@23cef1ef{/,null,AVAILABLE}
[junit4] 2> 703544 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.e.j.s.ServerConnector Started ServerConnector@235befc4{HTTP/1.1,[http/1.1]}{127.0.0.1:47891}
[junit4] 2> 703544 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.e.j.s.Server Started @706767ms
[junit4] 2> 703544 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_8FA0AF1B622EEDB7-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/, hostPort=47891, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_8FA0AF1B622EEDB7-001/shard-1-001/cores}
[junit4] 2> 703544 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 703544 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_8FA0AF1B622EEDB7-001/shard-1-001'
[junit4] 2> 703544 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 703544 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 703545 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 703552 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 703555 INFO (zkCallback-1019-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7318558b name:ZooKeeperConnection Watcher:127.0.0.1:47925/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 703555 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 703555 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 703562 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 703562 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_8FA0AF1B622EEDB7-001/shard-1-001/solr.xml
[junit4] 2> 703567 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_8FA0AF1B622EEDB7-001/shard-1-001/cores
[junit4] 2> 703567 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.CoreContainer New CoreContainer 1133233543
[junit4] 2> 703567 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_8FA0AF1B622EEDB7-001/shard-1-001]
[junit4] 2> 703567 WARN (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_8FA0AF1B622EEDB7-001/shard-1-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_8FA0AF1B622EEDB7-001/shard-1-001/lib
[junit4] 2> 703568 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 703570 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 703570 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 703570 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 703570 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:47925/solr
[junit4] 2> 703570 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 703570 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 703571 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 703573 INFO (zkCallback-1021-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5a2f4288 name:ZooKeeperConnection Watcher:127.0.0.1:47925 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 703580 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 703581 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 703585 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [n:127.0.0.1:47891_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 703586 INFO (zkCallback-1022-thread-1-processing-n:127.0.0.1:47891_) [n:127.0.0.1:47891_ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6d7cb5b2 name:ZooKeeperConnection Watcher:127.0.0.1:47925/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 703586 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [n:127.0.0.1:47891_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 703591 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [n:127.0.0.1:47891_ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 704596 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [n:127.0.0.1:47891_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47891_
[junit4] 2> 704596 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [n:127.0.0.1:47891_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:47891_
[junit4] 2> 704597 INFO (zkCallback-1022-thread-1-processing-n:127.0.0.1:47891_) [n:127.0.0.1:47891_ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 704597 INFO (zkCallback-1015-thread-1-processing-n:127.0.0.1:46519_) [n:127.0.0.1:46519_ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 704597 INFO (zkCallback-1017-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 704600 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [n:127.0.0.1:47891_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 704600 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [n:127.0.0.1:47891_ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94968646869057545-127.0.0.1:47891_-n_0000000001
[junit4] 2> 704601 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [n:127.0.0.1:47891_ ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/94968646869057540-127.0.0.1:46519_-n_0000000000 to know if I could be the leader
[junit4] 2> 704611 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [n:127.0.0.1:47891_ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 704611 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [n:127.0.0.1:47891_ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 704611 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [n:127.0.0.1:47891_ ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_8FA0AF1B622EEDB7-001/shard-1-001/cores
[junit4] 2> 704612 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [n:127.0.0.1:47891_ ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=collection1, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 704612 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [n:127.0.0.1:47891_ ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_8FA0AF1B622EEDB7-001/shard-1-001/cores/collection1
[junit4] 2> 704612 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [n:127.0.0.1:47891_ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
[junit4] 2> 704613 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [n:127.0.0.1:47891_ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4] 2> 704613 INFO (TEST-RollingRestartTest.test-seed#[8FA0AF1B622EEDB7]) [n:127.0.0.1:47891_ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 704614 INFO (coreLoadExecutor-1994-thread-1-processing-n:127.0.0.1:47891_) [n:127.0.0.1:47891_ c:collection1 x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 704614 INFO (coreLoadExecutor-1994-thread-1-processing-n:127.0.0.1:47891_) [n:127.0.0.1:47891_ c:collection1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 704615 INFO (coreLoadExecutor-1994-thread-1-processing-n:127.0.0.1:47891_) [n:127.0.0.1:47891_ c:collection1 x:collection1] o.a.s.c.ZkController Registering watch for collection collection1
[junit4] 2> 704615 INFO (coreLoadExecutor-1994-thread-1-processing-n:127.0.0.1:47891_) [n:127.0.0.1:47891_ c:collection1 x:collection1] o.a.s.c.c.ZkStateReader addZkWatch collection1
[junit4] 2> 704615 INFO (OverseerStateUpdate-94968646869057540-127.0.0.1:46519_-n_0000000000) [n:127.0.0.1:46519_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:47891",
[junit4] 2> "node_name":"127.0.0.1:47891_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"} current state version: 3
[junit4] 2> 704615 INFO (coreLoadExecutor-1994-thread-1-processing-n:127.0.0.1:47891_) [n:127.0.0.1:47891_ c:collection1 x:collection1] o.a.s.c.c.ZkStateReader Add data for collection1 ver 0
[junit4] 2> 704616 INFO (coreLoadExecutor-1994-thread-1-processing-n:127.0.0.1:47891_) [n:127.0.0.1:47891_ c:collection1 x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 704616 INFO (OverseerStateUpdate-94968646869057540-127.0.0.1:46519_-n_0000000000) [n:127.0.0.1:46519_ ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:47891",
[junit4] 2> "node_name":"127.0.0.1:47891_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"}
[junit4] 2> 704616 INFO (OverseerStateUpdate-94968646869057540-127.0.0.1:46519_-n_0000000000) [n:127.0.0.1:46519_ ] o.a.s.c.o.ReplicaMutator Collection already exists with numShards=2
[junit4] 2> 704616 INFO (OverseerStateUpdate-94968646869057540-127.0.0.1:46519_-n_0000000000) [n:127.0.0.1:46519_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2
[junit4] 2> 704718 INFO (OverseerStateUpdate-94968646869057540-127.0.0.1:46519_-n_0000000000) [n:127.0.0.1:46519_ ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/collection1/state.json version: 0
[junit4] 2> 704719 INFO (zkCallback-1022-thread-1-processing-n:127.0.0.1:47891_) [n:127.0.0.1:47891_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json for collection collection1 has occurred - updating... (live nodes size: 2)
[junit4] 2> 704719 INFO (zkCallback-1022-thread-1-processing-n:127.0.0.1:47891_) [n:127.0.0.1:47891_ ] o.a.s.c.c.ZkStateReader Updating data for collection1 from 0 to 1
[junit4] 2> 705616 INFO (coreLoadExecutor-1994-thread-1-processing-n:127.0.0.1:47891_) [n:127.0.0.1:47891_ c:collection1 x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 705616 INFO (coreLoadExecutor-1994-thread-1-processing-n:127.0.0.1:47891_) [n:127.0.0.1:47891_ c:collection1 x:collection1] o.a.s.c.ZkController Check for collection zkNode:collection1
[junit4] 2> 705616 INFO (coreLoadExecutor-1994-thread-1-processing-n:127.0.0.1:47891_) [n:127.0.0.1:47891_ c:collection1 x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 705617 INFO (coreLoadExecutor-1994-thread-1-processing-n:127.0.0.1:47891_) [n:127.0.0.1:47891_ c:collection1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/collection1
[junit4] 2> 705617 INFO (coreLoadExecutor-1994-thread-1-processing-n:127.0.0.1:47891_) [n:127.0.0.1:47891_ c:collection1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 705617 INFO (coreLoadExecutor-1994-thread-1-processing-n:127.0.0.1:47891_) [n:127.0.0.1:47891_ c:collection1 x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud
[...truncated too long message...]
alse>>]
[junit4] 2> 3171391 INFO (zkCallback-3440-thread-1-processing-n:127.0.0.1:53661_) [n:127.0.0.1:53661_ c:target_collection s:shard1 r:core_node4 x:target_collection_shard1_replica2] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CdcrReplicationDistributedZkTest_8FA0AF1B622EEDB7-001/jetty-088/cores/target_collection_shard1_replica2/data
[junit4] 2> 3171392 INFO (TEST-CdcrReplicationDistributedZkTest.testResilienceWithDeleteByQueryOnTarget-seed#[8FA0AF1B622EEDB7]) [ ] o.e.j.s.ServerConnector Stopped ServerConnector@47ba0643{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 3171392 INFO (TEST-CdcrReplicationDistributedZkTest.testResilienceWithDeleteByQueryOnTarget-seed#[8FA0AF1B622EEDB7]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@7fa70129{/,null,UNAVAILABLE}
[junit4] 2> 3171393 INFO (TEST-CdcrReplicationDistributedZkTest.testResilienceWithDeleteByQueryOnTarget-seed#[8FA0AF1B622EEDB7]) [n:127.0.0.1:53661_ c:target_collection s:shard1 r:core_node4 x:target_collection_shard1_replica2] o.a.s.SolrTestCaseJ4 ###Ending testResilienceWithDeleteByQueryOnTarget
[junit4] 2> 3171399 INFO (TEST-CdcrReplicationDistributedZkTest.testResilienceWithDeleteByQueryOnTarget-seed#[8FA0AF1B622EEDB7]) [n:127.0.0.1:53661_ c:target_collection s:shard1 r:core_node4 x:target_collection_shard1_replica2] o.a.s.c.ZkTestServer connecting to 127.0.0.1:52962 52962
[junit4] 2> 3171575 INFO (Thread-52770) [n:127.0.0.1:33801_ c:target_collection s:shard2 r:core_node4 x:target_collection_shard2_replica1] o.a.s.c.ZkTestServer connecting to 127.0.0.1:52962 52962
[junit4] 2> 3171577 WARN (Thread-52770) [n:127.0.0.1:33801_ c:target_collection s:shard2 r:core_node4 x:target_collection_shard2_replica1] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 39 /solr/aliases.json
[junit4] 2> 16 /solr/configs/conf1
[junit4] 2> 8 /solr/security.json
[junit4] 2> 2 /solr/collections/source_collection/leaders/shard1/leader
[junit4] 2> 2 /solr/collections/source_collection/leaders/shard2/leader
[junit4] 2> 2 /solr/collections/tmp_collection/leaders/shard2/leader
[junit4] 2> 2 /solr/collections/target_collection/leaders/shard2/leader
[junit4] 2> 2 /solr/collections/tmp_collection/leaders/shard1/leader
[junit4] 2> 2 /solr/collections/target_collection/leaders/shard1/leader
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 39 /solr/clusterstate.json
[junit4] 2> 8 /solr/collections/tmp_collection/cdcr/state/process
[junit4] 2> 8 /solr/collections/tmp_collection/cdcr/state/buffer
[junit4] 2> 7 /solr/collections/source_collection/cdcr/state/process
[junit4] 2> 4 /solr/collections/target_collection/cdcr/state/buffer
[junit4] 2> 4 /solr/collections/source_collection/state.json
[junit4] 2> 4 /solr/collections/source_collection/cdcr/state/buffer
[junit4] 2> 4 /solr/collections/target_collection/cdcr/state/process
[junit4] 2> 4 /solr/collections/target_collection/state.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 39 /solr/live_nodes
[junit4] 2> 39 /solr/collections
[junit4] 2> 7 /solr/overseer/collection-queue-work
[junit4] 2> 5 /solr/overseer/queue
[junit4] 2> 4 /solr/overseer/queue-work
[junit4] 2>
[junit4] 2> 3171578 INFO (SUITE-CdcrReplicationDistributedZkTest-seed#[8FA0AF1B622EEDB7]-worker) [n:127.0.0.1:53661_ c:target_collection s:shard1 r:core_node4 x:target_collection_shard1_replica2] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CdcrReplicationDistributedZkTest_8FA0AF1B622EEDB7-001
[junit4] 2> Dec 03, 2015 2:16:59 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=HighCompressionCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=HIGH_COMPRESSION, chunkSize=21508, maxDocsPerChunk=803, blockSize=2), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=HIGH_COMPRESSION, chunkSize=21508, blockSize=2)), sim=ClassicSimilarity, locale=en_PH, timezone=America/Marigot
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_66 (64-bit)/cpus=4,threads=1,free=111271424,total=507510784
[junit4] 2> NOTE: All tests run in this JVM: [TestMissingGroups, TestFileDictionaryLookup, TestSmileRequest, TestSolrConfigHandler, TestOverriddenPrefixQueryForCustomFieldType, TestXIncludeConfig, TestCopyFieldCollectionResource, TestCollationField, HighlighterConfigTest, TestSweetSpotSimilarityFactory, AutoCommitTest, MigrateRouteKeyTest, TestReversedWildcardFilterFactory, TestPerFieldSimilarityClassic, TestMinMaxOnMultiValuedField, TestPerFieldSimilarity, HLLSerializationTest, TestConfigSets, TestMaxScoreQueryParser, TestFieldTypeCollectionResource, RegexBoostProcessorTest, DirectUpdateHandlerOptimizeTest, TestIndexingPerformance, CurrencyFieldXmlFileTest, FieldMutatingUpdateProcessorTest, TestJmxIntegration, FieldAnalysisRequestHandlerTest, SuggesterWFSTTest, ZkStateReaderTest, TestReload, AnalyticsMergeStrategyTest, ConnectionManagerTest, UnloadDistributedZkTest, TestRestoreCore, CdcrUpdateLogTest, UpdateParamsTest, SliceStateTest, TestClassicSimilarityFactory, SuggesterTSTTest, TestShardHandlerFactory, DateMathParserTest, TestSolrDeletionPolicy1, TestGroupingSearch, AtomicUpdatesTest, BadIndexSchemaTest, BasicAuthIntegrationTest, TestManagedSchema, ShowFileRequestHandlerTest, TestNoOpRegenerator, TestSchemaVersionResource, CoreAdminRequestStatusTest, TestAuthenticationFramework, LukeRequestHandlerTest, XmlUpdateRequestHandlerTest, AddBlockUpdateTest, TestFuzzyAnalyzedSuggestions, TestPHPSerializedResponseWriter, TestChildDocTransformer, HdfsBasicDistributedZkTest, TestCSVResponseWriter, TestFastWriter, BufferStoreTest, TestCollectionAPI, ClusterStateTest, TestClassNameShortening, TestSort, TestSolrCloudWithKerberosAlt, TestNRTOpen, RuleEngineTest, TestIndexSearcher, FullSolrCloudDistribCmdsTest, DataDrivenBlockJoinTest, CloneFieldUpdateProcessorFactoryTest, DocValuesMultiTest, TestRecovery, TestSortByMinMaxFunction, StatelessScriptUpdateProcessorFactoryTest, SuggestComponentTest, TestDistribDocBasedVersion, OverseerTest, DistanceUnitsTest, TestStressReorder, SolrCoreCheckLockOnStartupTest, TestSearchPerf, TestOrdValues, LeaderElectionTest, TestWriterPerf, ParsingFieldUpdateProcessorsTest, TestFieldCollectionResource, TestUniqueKeyFieldResource, TestCoreDiscovery, StressHdfsTest, BasicDistributedZkTest, ChaosMonkeySafeLeaderTest, CollectionsAPIDistributedZkTest, ClusterStateUpdateTest, TestZkChroot, TestRandomDVFaceting, TestFaceting, TestHashPartitioner, TermVectorComponentDistributedTest, TestJoin, TestStressVersions, HardAutoCommitTest, DistributedTermsComponentTest, TestCoreContainer, SimpleFacetsTest, StatsComponentTest, SolrCmdDistributorTest, ConvertedLegacyTest, TestFiltering, BasicFunctionalityTest, TestLazyCores, DirectUpdateHandlerTest, TestBadConfig, DistributedQueryElevationComponentTest, SimplePostToolTest, AnalysisAfterCoreReloadTest, TestExtendedDismaxParser, CoreAdminHandlerTest, TestFoldingMultitermQuery, SuggesterTest, PolyFieldTest, SchemaVersionSpecificBehaviorTest, TestAtomicUpdateErrorCases, TestRemoteStreaming, DebugComponentTest, TestQueryTypes, TermsComponentTest, DocumentBuilderTest, RequiredFieldsTest, TestArbitraryIndexDir, UpdateRequestProcessorFactoryTest, TestAnalyzedSuggestions, TestPartialUpdateDeduplication, CSVRequestHandlerTest, SearchHandlerTest, TestLFUCache, PreAnalyzedFieldTest, TestSystemIdResolver, TestSuggestSpellingConverter, DateFieldTest, RAMDirectoryFactoryTest, TestSolrJ, TestLRUCache, TestUtils, TestDocumentBuilder, ZkNodePropsTest, FileUtilsTest, CircularListTest, TestRTGBase, CursorPagingTest, TestTolerantSearch, ActionThrottleTest, AssignTest, AsyncCallRequestStatusResponseTest, BaseCdcrDistributedZkTest, CdcrReplicationDistributedZkTest]
[junit4] Completed [443/563] on J2 in 856.16s, 11 tests, 1 failure <<< FAILURES!
[...truncated 395 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:789: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:726: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987: There were test failures: 563 suites (8 ignored), 2234 tests, 3 failures, 33 ignored (18 assumptions) [seed: 8FA0AF1B622EEDB7]
Total time: 204 minutes 36 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 869 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/869/
3 tests failed.
FAILED: org.apache.solr.hadoop.MorphlineBasicMiniMRTest.mrRun
Error Message:
Failed on local exception: java.io.IOException: Broken pipe; Host Details : local host is: "lucene1-us-west/10.41.0.5"; destination host is: "lucene1-us-west.apache.org":54009;
Stack Trace:
java.io.IOException: Failed on local exception: java.io.IOException: Broken pipe; Host Details : local host is: "lucene1-us-west/10.41.0.5"; destination host is: "lucene1-us-west.apache.org":54009;
at __randomizedtesting.SeedInfo.seed([95E0BA3EA72990BC:9BB20E30A6BFA2B3]:0)
at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:772)
at org.apache.hadoop.ipc.Client.call(Client.java:1472)
at org.apache.hadoop.ipc.Client.call(Client.java:1399)
at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232)
at com.sun.proxy.$Proxy109.getClusterMetrics(Unknown Source)
at org.apache.hadoop.yarn.api.impl.pb.client.ApplicationClientProtocolPBClientImpl.getClusterMetrics(ApplicationClientProtocolPBClientImpl.java:202)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
at com.sun.proxy.$Proxy110.getClusterMetrics(Unknown Source)
at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.getYarnClusterMetrics(YarnClientImpl.java:461)
at org.apache.hadoop.mapred.ResourceMgrDelegate.getClusterMetrics(ResourceMgrDelegate.java:151)
at org.apache.hadoop.mapred.YARNRunner.getClusterMetrics(YARNRunner.java:179)
at org.apache.hadoop.mapreduce.Cluster.getClusterStatus(Cluster.java:246)
at org.apache.hadoop.mapred.JobClient$3.run(JobClient.java:719)
at org.apache.hadoop.mapred.JobClient$3.run(JobClient.java:717)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.hadoop.mapred.JobClient.getClusterStatus(JobClient.java:717)
at org.apache.solr.hadoop.MapReduceIndexerTool.run(MapReduceIndexerTool.java:644)
at org.apache.solr.hadoop.MapReduceIndexerTool.run(MapReduceIndexerTool.java:607)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.solr.hadoop.MorphlineBasicMiniMRTest.mrRun(MorphlineBasicMiniMRTest.java:363)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: Broken pipe
at sun.nio.ch.FileDispatcherImpl.write0(Native Method)
at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47)
at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)
at sun.nio.ch.IOUtil.write(IOUtil.java:65)
at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:471)
at org.apache.hadoop.net.SocketOutputStream$Writer.performIO(SocketOutputStream.java:63)
at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:142)
at org.apache.hadoop.net.SocketOutputStream.write(SocketOutputStream.java:159)
at org.apache.hadoop.net.SocketOutputStream.write(SocketOutputStream.java:117)
at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140)
at java.io.DataOutputStream.flush(DataOutputStream.java:123)
at org.apache.hadoop.ipc.Client$Connection$3.run(Client.java:1030)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
... 1 more
FAILED: org.apache.solr.hadoop.MorphlineGoLiveMiniMRTest.test
Error Message:
Failed on local exception: java.io.IOException: Connection reset by peer; Host Details : local host is: "lucene1-us-west/10.41.0.5"; destination host is: "lucene1-us-west.apache.org":56245;
Stack Trace:
java.io.IOException: Failed on local exception: java.io.IOException: Connection reset by peer; Host Details : local host is: "lucene1-us-west/10.41.0.5"; destination host is: "lucene1-us-west.apache.org":56245;
at __randomizedtesting.SeedInfo.seed([95E0BA3EA72990BC:1DB485E409D5FD44]:0)
at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:772)
at org.apache.hadoop.ipc.Client.call(Client.java:1472)
at org.apache.hadoop.ipc.Client.call(Client.java:1399)
at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232)
at com.sun.proxy.$Proxy111.getClusterMetrics(Unknown Source)
at org.apache.hadoop.yarn.api.impl.pb.client.ApplicationClientProtocolPBClientImpl.getClusterMetrics(ApplicationClientProtocolPBClientImpl.java:202)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
at com.sun.proxy.$Proxy112.getClusterMetrics(Unknown Source)
at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.getYarnClusterMetrics(YarnClientImpl.java:461)
at org.apache.hadoop.mapred.ResourceMgrDelegate.getClusterMetrics(ResourceMgrDelegate.java:151)
at org.apache.hadoop.mapred.YARNRunner.getClusterMetrics(YARNRunner.java:179)
at org.apache.hadoop.mapreduce.Cluster.getClusterStatus(Cluster.java:246)
at org.apache.hadoop.mapred.JobClient$3.run(JobClient.java:719)
at org.apache.hadoop.mapred.JobClient$3.run(JobClient.java:717)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.hadoop.mapred.JobClient.getClusterStatus(JobClient.java:717)
at org.apache.solr.hadoop.MapReduceIndexerTool.run(MapReduceIndexerTool.java:644)
at org.apache.solr.hadoop.MapReduceIndexerTool.run(MapReduceIndexerTool.java:607)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.solr.hadoop.MorphlineGoLiveMiniMRTest.test(MorphlineGoLiveMiniMRTest.java:402)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:964)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:939)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: Connection reset by peer
at sun.nio.ch.FileDispatcherImpl.write0(Native Method)
at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47)
at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)
at sun.nio.ch.IOUtil.write(IOUtil.java:65)
at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:471)
at org.apache.hadoop.net.SocketOutputStream$Writer.performIO(SocketOutputStream.java:63)
at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:142)
at org.apache.hadoop.net.SocketOutputStream.write(SocketOutputStream.java:159)
at org.apache.hadoop.net.SocketOutputStream.write(SocketOutputStream.java:117)
at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140)
at java.io.DataOutputStream.flush(DataOutputStream.java:123)
at org.apache.hadoop.ipc.Client$Connection$3.run(Client.java:1030)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
... 1 more
FAILED: junit.framework.TestSuite.org.apache.solr.hadoop.MorphlineGoLiveMiniMRTest
Error Message:
1 thread leaked from SUITE scope at org.apache.solr.hadoop.MorphlineGoLiveMiniMRTest: 1) Thread[id=472, name=Node Status Updater, state=TIMED_WAITING, group=TGRP-MorphlineGoLiveMiniMRTest] at java.lang.Object.wait(Native Method) at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl$1.run(NodeStatusUpdaterImpl.java:659) at java.lang.Thread.run(Thread.java:745)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.hadoop.MorphlineGoLiveMiniMRTest:
1) Thread[id=472, name=Node Status Updater, state=TIMED_WAITING, group=TGRP-MorphlineGoLiveMiniMRTest]
at java.lang.Object.wait(Native Method)
at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl$1.run(NodeStatusUpdaterImpl.java:659)
at java.lang.Thread.run(Thread.java:745)
at __randomizedtesting.SeedInfo.seed([95E0BA3EA72990BC]:0)
Build Log:
[...truncated 17952 lines...]
[junit4] Suite: org.apache.solr.hadoop.MorphlineBasicMiniMRTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/init-core-data-001
[junit4] 2> 0 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
[junit4] 2> 2292 WARN (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.u.NativeCodeLoader Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
[junit4] 1> Formatting using clusterid: testClusterID
[junit4] 2> 2397 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.n.FSNamesystem No KeyProvider found.
[junit4] 2> 2438 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.n.FSNamesystem fsLock is fair:true
[junit4] 2> 2513 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.c.C.deprecation hadoop.configured.node.mapping is deprecated. Instead, use net.topology.configured.node.mapping
[junit4] 2> 2513 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.b.DatanodeManager dfs.block.invalidate.limit=1000
[junit4] 2> 2514 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.b.DatanodeManager dfs.namenode.datanode.registration.ip-hostname-check=true
[junit4] 2> 2517 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.b.BlockManager dfs.namenode.startup.delay.block.deletion.sec is set to 000:00:00:00.000
[junit4] 2> 2522 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.b.BlockManager The block deletion will start around 2015 dets 02 08:38:09
[junit4] 2> 2526 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.u.GSet Computing capacity for map BlocksMap
[junit4] 2> 2526 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.u.GSet VM type = 64-bit
[junit4] 2> 2529 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.u.GSet 2.0% max memory 455.5 MB = 9.1 MB
[junit4] 2> 2529 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.u.GSet capacity = 2^20 = 1048576 entries
[junit4] 2> 2576 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.b.BlockManager dfs.block.access.token.enable=false
[junit4] 2> 2577 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.b.BlockManager defaultReplication = 2
[junit4] 2> 2577 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.b.BlockManager maxReplication = 512
[junit4] 2> 2577 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.b.BlockManager minReplication = 1
[junit4] 2> 2577 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.b.BlockManager maxReplicationStreams = 2
[junit4] 2> 2577 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.b.BlockManager shouldCheckForEnoughRacks = false
[junit4] 2> 2578 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.b.BlockManager replicationRecheckInterval = 3000
[junit4] 2> 2578 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.b.BlockManager encryptDataTransfer = false
[junit4] 2> 2579 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.b.BlockManager maxNumBlocksToLog = 1000
[junit4] 2> 2592 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.n.FSNamesystem fsOwner = jenkins (auth:SIMPLE)
[junit4] 2> 2592 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.n.FSNamesystem supergroup = supergroup
[junit4] 2> 2592 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.n.FSNamesystem isPermissionEnabled = true
[junit4] 2> 2593 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.n.FSNamesystem HA Enabled: false
[junit4] 2> 2598 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.n.FSNamesystem Append Enabled: true
[junit4] 2> 3123 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.u.GSet Computing capacity for map INodeMap
[junit4] 2> 3123 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.u.GSet VM type = 64-bit
[junit4] 2> 3124 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.u.GSet 1.0% max memory 455.5 MB = 4.6 MB
[junit4] 2> 3124 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.u.GSet capacity = 2^19 = 524288 entries
[junit4] 2> 3124 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.n.NameNode Caching file names occuring more than 10 times
[junit4] 2> 3140 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.u.GSet Computing capacity for map cachedBlocks
[junit4] 2> 3140 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.u.GSet VM type = 64-bit
[junit4] 2> 3140 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.u.GSet 0.25% max memory 455.5 MB = 1.1 MB
[junit4] 2> 3140 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.u.GSet capacity = 2^17 = 131072 entries
[junit4] 2> 3142 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.n.FSNamesystem dfs.namenode.safemode.threshold-pct = 0.9990000128746033
[junit4] 2> 3143 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.n.FSNamesystem dfs.namenode.safemode.min.datanodes = 0
[junit4] 2> 3150 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.n.FSNamesystem dfs.namenode.safemode.extension = 0
[junit4] 2> 3152 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.n.FSNamesystem Retry cache on namenode is enabled
[junit4] 2> 3153 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.n.FSNamesystem Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000 millis
[junit4] 2> 3158 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.u.GSet Computing capacity for map NameNodeRetryCache
[junit4] 2> 3158 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.u.GSet VM type = 64-bit
[junit4] 2> 3159 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.u.GSet 0.029999999329447746% max memory 455.5 MB = 139.9 KB
[junit4] 2> 3159 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.u.GSet capacity = 2^14 = 16384 entries
[junit4] 2> 3170 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.n.NNConf ACLs enabled? false
[junit4] 2> 3170 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.n.NNConf XAttrs enabled? true
[junit4] 2> 3170 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.n.NNConf Maximum size of an xattr: 16384
[junit4] 2> 3337 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.n.FSImage Allocated new BlockPoolId: BP-2124238042-10.41.0.5-1449016690132
[junit4] 2> 3358 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/name1 has been successfully formatted.
[junit4] 2> 3364 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/name2 has been successfully formatted.
[junit4] 2> 3827 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.n.NNStorageRetentionManager Going to retain 1 images with txid >= 0
[junit4] 2> 3836 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.n.NameNode createNameNode []
[junit4] 2> 3957 WARN (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
[junit4] 2> 4129 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.m.i.MetricsSystemImpl Scheduled snapshot period at 10 second(s).
[junit4] 2> 4129 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.m.i.MetricsSystemImpl NameNode metrics system started
[junit4] 2> 4132 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.n.NameNode fs.defaultFS is hdfs://127.0.0.1:0
[junit4] 2> 4247 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.DFSUtil Starting Web-server for hdfs at: http://localhost:0
[junit4] 2> 4431 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.m.log Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
[junit4] 2> 4445 WARN (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 4476 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.HttpServer2 Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
[junit4] 2> 4480 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.HttpServer2 Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context hdfs
[junit4] 2> 4480 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.HttpServer2 Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
[junit4] 2> 4480 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.HttpServer2 Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
[junit4] 2> 4534 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.HttpServer2 Added filter 'org.apache.hadoop.hdfs.web.AuthFilter' (class=org.apache.hadoop.hdfs.web.AuthFilter)
[junit4] 2> 4537 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.HttpServer2 addJerseyResourcePackage: packageName=org.apache.hadoop.hdfs.server.namenode.web.resources;org.apache.hadoop.hdfs.web.resources, pathSpec=/webhdfs/v1/*
[junit4] 2> 4576 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.HttpServer2 Jetty bound to port 60998
[junit4] 2> 4577 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 4662 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_60998_hdfs____.3s8h14/webapp
[junit4] 2> 4986 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
[junit4] 2> 6691 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:60998
[junit4] 2> 6705 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.n.FSNamesystem No KeyProvider found.
[junit4] 2> 6705 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.n.FSNamesystem fsLock is fair:true
[junit4] 2> 6714 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.b.DatanodeManager dfs.block.invalidate.limit=1000
[junit4] 2> 6715 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.b.DatanodeManager dfs.namenode.datanode.registration.ip-hostname-check=true
[junit4] 2> 6719 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.b.BlockManager dfs.namenode.startup.delay.block.deletion.sec is set to 000:00:00:00.000
[junit4] 2> 6719 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.b.BlockManager The block deletion will start around 2015 dets 02 08:38:13
[junit4] 2> 6720 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.u.GSet Computing capacity for map BlocksMap
[junit4] 2> 6724 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.u.GSet VM type = 64-bit
[junit4] 2> 6725 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.u.GSet 2.0% max memory 455.5 MB = 9.1 MB
[junit4] 2> 6725 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.u.GSet capacity = 2^20 = 1048576 entries
[junit4] 2> 6726 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.b.BlockManager dfs.block.access.token.enable=false
[junit4] 2> 6726 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.b.BlockManager defaultReplication = 2
[junit4] 2> 6726 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.b.BlockManager maxReplication = 512
[junit4] 2> 6726 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.b.BlockManager minReplication = 1
[junit4] 2> 6726 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.b.BlockManager maxReplicationStreams = 2
[junit4] 2> 6726 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.b.BlockManager shouldCheckForEnoughRacks = false
[junit4] 2> 6727 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.b.BlockManager replicationRecheckInterval = 3000
[junit4] 2> 6727 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.b.BlockManager encryptDataTransfer = false
[junit4] 2> 6727 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.b.BlockManager maxNumBlocksToLog = 1000
[junit4] 2> 6728 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.n.FSNamesystem fsOwner = jenkins (auth:SIMPLE)
[junit4] 2> 6728 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.n.FSNamesystem supergroup = supergroup
[junit4] 2> 6728 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.n.FSNamesystem isPermissionEnabled = true
[junit4] 2> 6729 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.n.FSNamesystem HA Enabled: false
[junit4] 2> 6729 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.n.FSNamesystem Append Enabled: true
[junit4] 2> 6730 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.u.GSet Computing capacity for map INodeMap
[junit4] 2> 6730 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.u.GSet VM type = 64-bit
[junit4] 2> 6730 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.u.GSet 1.0% max memory 455.5 MB = 4.6 MB
[junit4] 2> 6731 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.u.GSet capacity = 2^19 = 524288 entries
[junit4] 2> 6733 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.n.NameNode Caching file names occuring more than 10 times
[junit4] 2> 6733 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.u.GSet Computing capacity for map cachedBlocks
[junit4] 2> 6733 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.u.GSet VM type = 64-bit
[junit4] 2> 6735 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.u.GSet 0.25% max memory 455.5 MB = 1.1 MB
[junit4] 2> 6736 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.u.GSet capacity = 2^17 = 131072 entries
[junit4] 2> 6736 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.n.FSNamesystem dfs.namenode.safemode.threshold-pct = 0.9990000128746033
[junit4] 2> 6736 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.n.FSNamesystem dfs.namenode.safemode.min.datanodes = 0
[junit4] 2> 6737 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.n.FSNamesystem dfs.namenode.safemode.extension = 0
[junit4] 2> 6737 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.n.FSNamesystem Retry cache on namenode is enabled
[junit4] 2> 6737 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.n.FSNamesystem Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000 millis
[junit4] 2> 6737 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.u.GSet Computing capacity for map NameNodeRetryCache
[junit4] 2> 6738 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.u.GSet VM type = 64-bit
[junit4] 2> 6738 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.u.GSet 0.029999999329447746% max memory 455.5 MB = 139.9 KB
[junit4] 2> 6740 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.u.GSet capacity = 2^14 = 16384 entries
[junit4] 2> 6755 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.n.NNConf ACLs enabled? false
[junit4] 2> 6755 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.n.NNConf XAttrs enabled? true
[junit4] 2> 6755 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.n.NNConf Maximum size of an xattr: 16384
[junit4] 2> 6778 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.c.Storage Lock on /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/name1/in_use.lock acquired by nodename 32071@lucene1-us-west
[junit4] 2> 6785 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.c.Storage Lock on /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/name2/in_use.lock acquired by nodename 32071@lucene1-us-west
[junit4] 2> 6794 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.n.FileJournalManager Recovering unfinalized segments in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/name1/current
[junit4] 2> 6795 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.n.FileJournalManager Recovering unfinalized segments in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/name2/current
[junit4] 2> 6795 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.n.FSImage No edit log streams selected.
[junit4] 2> 6860 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.n.FSImageFormatPBINode Loading 1 INodes.
[junit4] 2> 6902 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.n.FSImageFormatProtobuf Loaded FSImage in 0 seconds.
[junit4] 2> 6903 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.n.FSImage Loaded image for txid 0 from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/name1/current/fsimage_0000000000000000000
[junit4] 2> 6918 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.n.FSNamesystem Need to save fs image? false (staleImage=false, haEnabled=false, isRollingUpgrade=false)
[junit4] 2> 6919 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.n.FSEditLog Starting log segment at 1
[junit4] 2> 6998 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.n.NameCache initialized with 0 entries 0 lookups
[junit4] 2> 6999 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.n.FSNamesystem Finished loading FSImage in 244 msecs
[junit4] 2> 7552 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.n.NameNode RPC server is binding to localhost:0
[junit4] 2> 7600 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.i.CallQueueManager Using callQueue class java.util.concurrent.LinkedBlockingQueue
[junit4] 2> 7647 INFO (Socket Reader #1 for port 50950) [ ] o.a.h.i.Server Starting Socket Reader #1 for port 50950
[junit4] 2> 7725 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.n.NameNode Clients are to use localhost:50950 to access this namenode/service.
[junit4] 2> 7743 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.n.FSNamesystem Registered FSNamesystemState MBean
[junit4] 2> 7804 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.n.FSNamesystem Number of blocks under construction: 0
[junit4] 2> 7804 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.n.FSNamesystem Number of blocks under construction: 0
[junit4] 2> 7804 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.n.FSNamesystem initializing replication queues
[junit4] 2> 7813 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.StateChange STATE* Leaving safe mode after 1 secs
[junit4] 2> 7813 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.StateChange STATE* Network topology has 0 racks and 0 datanodes
[junit4] 2> 7813 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.StateChange STATE* UnderReplicatedBlocks has 0 blocks
[junit4] 2> 7857 INFO (Replication Queue Initializer) [ ] o.a.h.h.s.b.BlockManager Total number of blocks = 0
[junit4] 2> 7861 INFO (Replication Queue Initializer) [ ] o.a.h.h.s.b.BlockManager Number of invalid blocks = 0
[junit4] 2> 7861 INFO (Replication Queue Initializer) [ ] o.a.h.h.s.b.BlockManager Number of under-replicated blocks = 0
[junit4] 2> 7861 INFO (Replication Queue Initializer) [ ] o.a.h.h.s.b.BlockManager Number of over-replicated blocks = 0
[junit4] 2> 7861 INFO (Replication Queue Initializer) [ ] o.a.h.h.s.b.BlockManager Number of blocks being written = 0
[junit4] 2> 7861 INFO (Replication Queue Initializer) [ ] o.a.h.h.StateChange STATE* Replication Queue initialization scan for invalid, over- and under-replicated blocks completed in 36 msec
[junit4] 2> 7938 INFO (IPC Server listener on 50950) [ ] o.a.h.i.Server IPC Server listener on 50950: starting
[junit4] 2> 7950 INFO (IPC Server Responder) [ ] o.a.h.i.Server IPC Server Responder: starting
[junit4] 2> 7970 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.n.NameNode NameNode RPC up at: localhost/127.0.0.1:50950
[junit4] 2> 7970 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.n.FSNamesystem Starting services required for active state
[junit4] 2> 8013 INFO (CacheReplicationMonitor(1996394315)) [ ] o.a.h.h.s.b.CacheReplicationMonitor Starting CacheReplicationMonitor with interval 30000 milliseconds
[junit4] 2> 8013 INFO (CacheReplicationMonitor(1996394315)) [ ] o.a.h.h.s.b.CacheReplicationMonitor Rescanning after 17476992028 milliseconds
[junit4] 2> 8014 INFO (CacheReplicationMonitor(1996394315)) [ ] o.a.h.h.s.b.CacheReplicationMonitor Scanned 0 directive(s) and 0 block(s) in 1 millisecond(s).
[junit4] 2> 8022 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.MiniDFSCluster Starting DataNode 0 with dfs.datanode.data.dir: [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data1,[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data2
[junit4] 2> 8184 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.m.i.MetricsSystemImpl DataNode metrics system started (again)
[junit4] 2> 8186 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.d.DataNode Configured hostname is 127.0.0.1
[junit4] 2> 8197 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.d.DataNode Starting DataNode with maxLockedMemory = 0
[junit4] 2> 8215 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.d.DataNode Opened streaming server at /127.0.0.1:33764
[junit4] 2> 8223 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.d.DataNode Balancing bandwith is 1048576 bytes/s
[junit4] 2> 8224 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.d.DataNode Number threads for balancing is 5
[junit4] 2> 8235 WARN (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 8237 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.HttpServer2 Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
[junit4] 2> 8237 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.HttpServer2 Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context datanode
[junit4] 2> 8237 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.HttpServer2 Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
[junit4] 2> 8238 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.HttpServer2 Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
[junit4] 2> 8284 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.HttpServer2 addJerseyResourcePackage: packageName=org.apache.hadoop.hdfs.server.datanode.web.resources;org.apache.hadoop.hdfs.web.resources, pathSpec=/webhdfs/v1/*
[junit4] 2> 8285 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.HttpServer2 Jetty bound to port 57075
[junit4] 2> 8285 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 8344 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_57075_datanode____.zc8ust/webapp
[junit4] 2> 8518 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
[junit4] 2> 9008 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:57075
[junit4] 2> 9025 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.d.DataNode dnUserName = jenkins
[junit4] 2> 9025 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.d.DataNode supergroup = supergroup
[junit4] 2> 9052 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.i.CallQueueManager Using callQueue class java.util.concurrent.LinkedBlockingQueue
[junit4] 2> 9053 INFO (Socket Reader #1 for port 51312) [ ] o.a.h.i.Server Starting Socket Reader #1 for port 51312
[junit4] 2> 9064 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.d.DataNode Opened IPC server at /127.0.0.1:51312
[junit4] 2> 9089 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.d.DataNode Refresh request received for nameservices: null
[junit4] 2> 9098 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.d.DataNode Starting BPOfferServices for nameservices: <default>
[junit4] 2> 9126 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:50950) [ ] o.a.h.h.s.d.DataNode Block pool <registering> (Datanode Uuid unassigned) service to localhost/127.0.0.1:50950 starting to offer service
[junit4] 2> 9130 INFO (IPC Server Responder) [ ] o.a.h.i.Server IPC Server Responder: starting
[junit4] 2> 9130 INFO (IPC Server listener on 51312) [ ] o.a.h.i.Server IPC Server listener on 51312: starting
[junit4] 2> 9143 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.MiniDFSCluster Starting DataNode 1 with dfs.datanode.data.dir: [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data3,[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data4
[junit4] 2> 9210 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.m.i.MetricsSystemImpl DataNode metrics system started (again)
[junit4] 2> 9210 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.d.DataNode Configured hostname is 127.0.0.1
[junit4] 2> 9211 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.d.DataNode Starting DataNode with maxLockedMemory = 0
[junit4] 2> 9211 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.d.DataNode Opened streaming server at /127.0.0.1:54434
[junit4] 2> 9212 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.d.DataNode Balancing bandwith is 1048576 bytes/s
[junit4] 2> 9212 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.d.DataNode Number threads for balancing is 5
[junit4] 2> 9213 WARN (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 9215 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.HttpServer2 Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
[junit4] 2> 9225 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.HttpServer2 Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context datanode
[junit4] 2> 9225 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.HttpServer2 Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
[junit4] 2> 9225 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.HttpServer2 Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
[junit4] 2> 9226 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.HttpServer2 addJerseyResourcePackage: packageName=org.apache.hadoop.hdfs.server.datanode.web.resources;org.apache.hadoop.hdfs.web.resources, pathSpec=/webhdfs/v1/*
[junit4] 2> 9227 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.HttpServer2 Jetty bound to port 54092
[junit4] 2> 9227 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 9314 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_54092_datanode____.c6b45r/webapp
[junit4] 2> 9461 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
[junit4] 2> 9905 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:50950) [ ] o.a.h.h.s.c.Storage DataNode version: -56 and NameNode layout version: -60
[junit4] 2> 9921 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:50950) [ ] o.a.h.h.s.c.Storage Lock on /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data1/in_use.lock acquired by nodename 32071@lucene1-us-west
[junit4] 2> 9924 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:50950) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data1 is not formatted for BP-2124238042-10.41.0.5-1449016690132
[junit4] 2> 9924 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:50950) [ ] o.a.h.h.s.c.Storage Formatting ...
[junit4] 2> 9936 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:50950) [ ] o.a.h.h.s.c.Storage Lock on /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data2/in_use.lock acquired by nodename 32071@lucene1-us-west
[junit4] 2> 9961 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:50950) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data2 is not formatted for BP-2124238042-10.41.0.5-1449016690132
[junit4] 2> 9961 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:50950) [ ] o.a.h.h.s.c.Storage Formatting ...
[junit4] 2> 9990 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:54092
[junit4] 2> 9993 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.d.DataNode dnUserName = jenkins
[junit4] 2> 9993 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.d.DataNode supergroup = supergroup
[junit4] 2> 9993 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.i.CallQueueManager Using callQueue class java.util.concurrent.LinkedBlockingQueue
[junit4] 2> 9997 INFO (Socket Reader #1 for port 48558) [ ] o.a.h.i.Server Starting Socket Reader #1 for port 48558
[junit4] 2> 10000 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.d.DataNode Opened IPC server at /127.0.0.1:48558
[junit4] 2> 10025 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.d.DataNode Refresh request received for nameservices: null
[junit4] 2> 10025 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [ ] o.a.h.h.s.d.DataNode Starting BPOfferServices for nameservices: <default>
[junit4] 2> 10041 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:50950) [ ] o.a.h.h.s.d.DataNode Block pool <registering> (Datanode Uuid unassigned) service to localhost/127.0.0.1:50950 starting to offer service
[junit4] 2> 10054 INFO (IPC Server Responder) [ ] o.a.h.i.Server IPC Server Responder: starting
[junit4] 2> 10065 INFO (IPC Server listener on 48558) [ ] o.a.h.i.Server IPC Server listener on 48558: starting
[junit4] 2> 10139 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:50950) [ ] o.a.h.h.s.c.Storage DataNode version: -56 and NameNode layout version: -60
[junit4] 2> 10145 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:50950) [ ] o.a.h.h.s.c.Storage Lock on /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data3/in_use.lock acquired by nodename 32071@lucene1-us-west
[junit4] 2> 10146 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:50950) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data3 is not formatted for BP-2124238042-10.41.0.5-1449016690132
[junit4] 2> 10146 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:50950) [ ] o.a.h.h.s.c.Storage Formatting ...
[junit4] 2> 10154 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:50950) [ ] o.a.h.h.s.c.Storage Lock on /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data4/in_use.lock acquired by nodename 32071@lucene1-us-west
[junit4] 2> 10155 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:50950) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data4 is not formatted for BP-2124238042-10.41.0.5-1449016690132
[junit4] 2> 10155 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:50950) [ ] o.a.h.h.s.c.Storage Formatting ...
[junit4] 2> 10272 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:50950) [ ] o.a.h.h.s.c.Storage Analyzing storage directories for bpid BP-2124238042-10.41.0.5-1449016690132
[junit4] 2> 10273 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:50950) [ ] o.a.h.h.s.c.Storage Locking is disabled
[junit4] 2> 10275 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:50950) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data1/current/BP-2124238042-10.41.0.5-1449016690132 is not formatted.
[junit4] 2> 10275 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:50950) [ ] o.a.h.h.s.c.Storage Formatting ...
[junit4] 2> 10275 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:50950) [ ] o.a.h.h.s.c.Storage Formatting block pool BP-2124238042-10.41.0.5-1449016690132 directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data1/current/BP-2124238042-10.41.0.5-1449016690132/current
[junit4] 2> 10278 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:50950) [ ] o.a.h.h.s.c.Storage Locking is disabled
[junit4] 2> 10279 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:50950) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data2/current/BP-2124238042-10.41.0.5-1449016690132 is not formatted.
[junit4] 2> 10279 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:50950) [ ] o.a.h.h.s.c.Storage Formatting ...
[junit4] 2> 10279 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:50950) [ ] o.a.h.h.s.c.Storage Formatting block pool BP-2124238042-10.41.0.5-1449016690132 directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data2/current/BP-2124238042-10.41.0.5-1449016690132/current
[junit4] 2> 10282 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:50950) [ ] o.a.h.h.s.c.Storage Restored 0 block files from trash.
[junit4] 2> 10282 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:50950) [ ] o.a.h.h.s.c.Storage Restored 0 block files from trash.
[junit4] 2> 10284 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:50950) [ ] o.a.h.h.s.d.DataNode Setting up storage: nsid=613065899;bpid=BP-2124238042-10.41.0.5-1449016690132;lv=-56;nsInfo=lv=-60;cid=testClusterID;nsid=613065899;c=0;bpid=BP-2124238042-10.41.0.5-1449016690132;dnuuid=null
[junit4] 2> 10298 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:50950) [ ] o.a.h.h.s.d.DataNode Generated and persisted new Datanode UUID f65bc86f-33db-4d01-9e13-8decd41c9a55
[junit4] 2> 10324 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:50950) [ ] o.a.h.h.s.c.Storage Analyzing storage directories for bpid BP-2124238042-10.41.0.5-1449016690132
[junit4] 2> 10325 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:50950) [ ] o.a.h.h.s.c.Storage Locking is disabled
[junit4] 2> 10326 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:50950) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data3/current/BP-2124238042-10.41.0.5-1449016690132 is not formatted.
[junit4] 2> 10326 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:50950) [ ] o.a.h.h.s.c.Storage Formatting ...
[junit4] 2> 10326 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:50950) [ ] o.a.h.h.s.c.Storage Formatting block pool BP-2124238042-10.41.0.5-1449016690132 directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data3/current/BP-2124238042-10.41.0.5-1449016690132/current
[junit4] 2> 10329 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:50950) [ ] o.a.h.h.s.c.Storage Locking is disabled
[junit4] 2> 10330 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:50950) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data4/current/BP-2124238042-10.41.0.5-1449016690132 is not formatted.
[junit4] 2> 10331 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:50950) [ ] o.a.h.h.s.c.Storage Formatting ...
[junit4] 2> 10331 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:50950) [ ] o.a.h.h.s.c.Storage Formatting block pool BP-2124238042-10.41.0.5-1449016690132 directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data4/current/BP-2124238042-10.41.0.5-1449016690132/current
[junit4] 2> 10333 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:50950) [ ] o.a.h.h.s.c.Storage Restored 0 block files from trash.
[junit4] 2> 10333 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:50950) [ ] o.a.h.h.s.c.Storage Restored 0 block files from trash.
[junit4] 2> 10335 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:50950) [ ] o.a.h.h.s.d.DataNode Setting up storage: nsid=613065899;bpid=BP-2124238042-10.41.0.5-1449016690132;lv=-56;nsInfo=lv=-60;cid=testClusterID;nsid=613065899;c=0;bpid=BP-2124238042-10.41.0.5-1449016690132;dnuuid=null
[junit4] 2> 10338 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:50950) [ ] o.a.h.h.s.d.DataNode Generated and persisted new Datanode UUID da336448-8d0d-4c44-bd1b-0750e76a5219
[junit4] 2> 10405 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:50950) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Added new volume: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data1/current
[junit4] 2> 10408 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:50950) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Added volume - /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data1/current, StorageType: DISK
[junit4] 2> 10408 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:50950) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Added new volume: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data2/current
[junit4] 2> 10409 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:50950) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Added volume - /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data2/current, StorageType: DISK
[junit4] 2> 10423 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:50950) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Added new volume: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data3/current
[junit4] 2> 10433 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:50950) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Added volume - /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data3/current, StorageType: DISK
[junit4] 2> 10434 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:50950) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Added new volume: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data4/current
[junit4] 2> 10434 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA72990BC-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:50950) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Added volume - /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_95E0BA3EA7299
[...truncated too long message...]
2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.getMBeanInfo(MetricsSourceAdapter.java:151)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getClassName(DefaultMBeanServerInterceptor.java:1804)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.safeGetClassName(DefaultMBeanServerInterceptor.java:1595)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.checkMBeanPermission(DefaultMBeanServerInterceptor.java:1813)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.exclusiveUnregisterMBean(DefaultMBeanServerInterceptor.java:430)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.unregisterMBean(DefaultMBeanServerInterceptor.java:415)
[junit4] 2> at com.sun.jmx.mbeanserver.JmxMBeanServer.unregisterMBean(JmxMBeanServer.java:546)
[junit4] 2> at org.apache.hadoop.metrics2.util.MBeans.unregister(MBeans.java:81)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stopMBeans(MetricsSourceAdapter.java:227)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stop(MetricsSourceAdapter.java:212)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stopSources(MetricsSystemImpl.java:461)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stop(MetricsSystemImpl.java:212)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.shutdown(MetricsSystemImpl.java:592)
[junit4] 2> at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdownInstance(DefaultMetricsSystem.java:72)
[junit4] 2> at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdown(DefaultMetricsSystem.java:68)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.metrics.NameNodeMetrics.shutdown(NameNodeMetrics.java:145)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.NameNode.stop(NameNode.java:822)
[junit4] 2> at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1720)
[junit4] 2> at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1699)
[junit4] 2> at org.apache.solr.hadoop.MorphlineGoLiveMiniMRTest.teardownClass(MorphlineGoLiveMiniMRTest.java:236)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:497)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:834)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> Caused by: java.lang.NullPointerException
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlocksMap.size(BlocksMap.java:198)
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.getTotalBlocks(BlockManager.java:3291)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlocksTotal(FSNamesystem.java:6223)
[junit4] 2> ... 53 more
[junit4] 2> 261138 INFO (SUITE-MorphlineGoLiveMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [n:127.0.0.1:55225_ c:collection1 s:shard1 r:core_node5 x:collection1] o.a.h.m.i.MetricsSystemImpl JobHistoryServer metrics system stopped.
[junit4] 2> 261138 INFO (SUITE-MorphlineGoLiveMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [n:127.0.0.1:55225_ c:collection1 s:shard1 r:core_node5 x:collection1] o.a.h.m.i.MetricsSystemImpl JobHistoryServer metrics system shutdown complete.
[junit4] 2> 261143 INFO (SUITE-MorphlineGoLiveMiniMRTest-seed#[95E0BA3EA72990BC]-worker) [n:127.0.0.1:55225_ c:collection1 s:shard1 r:core_node5 x:collection1] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineGoLiveMiniMRTest_95E0BA3EA72990BC-001
[junit4] 2> Dec 02, 2015 12:42:30 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> SEVERE: 1 thread leaked from SUITE scope at org.apache.solr.hadoop.MorphlineGoLiveMiniMRTest:
[junit4] 2> 1) Thread[id=472, name=Node Status Updater, state=TIMED_WAITING, group=TGRP-MorphlineGoLiveMiniMRTest]
[junit4] 2> at java.lang.Object.wait(Native Method)
[junit4] 2> at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl$1.run(NodeStatusUpdaterImpl.java:659)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene60): {}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=false,coord=yes): {}, locale=hi, timezone=Etc/GMT-7
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_66 (64-bit)/cpus=4,threads=9,free=271297488,total=420478976
[junit4] 2> NOTE: All tests run in this JVM: [MapReduceIndexerToolArgumentParserTest, MorphlineGoLiveMiniMRTest]
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=MorphlineGoLiveMiniMRTest -Dtests.seed=95E0BA3EA72990BC -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=hi -Dtests.timezone=Etc/GMT-7 -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[junit4] ERROR 0.00s J0 | MorphlineGoLiveMiniMRTest (suite) <<<
[junit4] > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.hadoop.MorphlineGoLiveMiniMRTest:
[junit4] > 1) Thread[id=472, name=Node Status Updater, state=TIMED_WAITING, group=TGRP-MorphlineGoLiveMiniMRTest]
[junit4] > at java.lang.Object.wait(Native Method)
[junit4] > at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl$1.run(NodeStatusUpdaterImpl.java:659)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > at __randomizedtesting.SeedInfo.seed([95E0BA3EA72990BC]:0)
[junit4] Completed [7/7] on J0 in 254.86s, 2 tests, 2 errors <<< FAILURES!
[...truncated 13 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:253: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:457: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987: There were test failures: 7 suites, 35 tests, 1 suite-level error, 2 errors, 1 ignored [seed: 95E0BA3EA72990BC]
Total time: 228 minutes 2 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 868 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/868/
1 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.SyncSliceTest
Error Message:
ObjectTracker found 3 object(s) that were not released!!! [TransactionLog]
Stack Trace:
java.lang.AssertionError: ObjectTracker found 3 object(s) that were not released!!! [TransactionLog]
at __randomizedtesting.SeedInfo.seed([64967A30CCFDD1B0]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNull(Assert.java:551)
at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:224)
at sun.reflect.GeneratedMethodAccessor23.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:834)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 10342 lines...]
[junit4] Suite: org.apache.solr.cloud.SyncSliceTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest_64967A30CCFDD1B0-001/init-core-data-001
[junit4] 2> 858726 INFO (SUITE-SyncSliceTest-seed#[64967A30CCFDD1B0]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
[junit4] 2> 858726 INFO (SUITE-SyncSliceTest-seed#[64967A30CCFDD1B0]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /h_/hb
[junit4] 2> 858744 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 858744 INFO (Thread-11899) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 858744 INFO (Thread-11899) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 858844 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.ZkTestServer start zk server on port:43685
[junit4] 2> 858844 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 858863 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 858875 INFO (zkCallback-525-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6b2aa8fc name:ZooKeeperConnection Watcher:127.0.0.1:43685 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 858875 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 858875 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 858875 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 858878 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 858896 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 858911 INFO (zkCallback-526-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@14b00696 name:ZooKeeperConnection Watcher:127.0.0.1:43685/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 858911 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 858912 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 858912 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
[junit4] 2> 858913 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
[junit4] 2> 858914 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
[junit4] 2> 858915 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
[junit4] 2> 858916 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 858917 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 858918 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 858918 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
[junit4] 2> 858920 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 858920 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 858921 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 858921 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
[junit4] 2> 858922 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 858922 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
[junit4] 2> 858923 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 858924 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
[junit4] 2> 858925 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 858925 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 858926 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 858926 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 858927 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 858927 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 858928 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 858928 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 858929 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 858929 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
[junit4] 2> 859231 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest_64967A30CCFDD1B0-001/control-001/cores/collection1
[junit4] 2> 859233 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.e.j.s.Server jetty-9.2.13.v20150730
[junit4] 2> 859302 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@238cd0c{/h_/hb,null,AVAILABLE}
[junit4] 2> 859305 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.e.j.s.ServerConnector Started ServerConnector@159b18c0{HTTP/1.1}{127.0.0.1:39648}
[junit4] 2> 859305 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.e.j.s.Server Started @862275ms
[junit4] 2> 859305 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest_64967A30CCFDD1B0-001/tempDir-001/control/data, hostContext=/h_/hb, hostPort=39648, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest_64967A30CCFDD1B0-001/control-001/cores}
[junit4] 2> 859305 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 859305 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest_64967A30CCFDD1B0-001/control-001'
[junit4] 2> 859305 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 859305 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 859306 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 859335 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 859343 INFO (zkCallback-527-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1544c8e2 name:ZooKeeperConnection Watcher:127.0.0.1:43685/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 859343 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 859343 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 859346 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 859346 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest_64967A30CCFDD1B0-001/control-001/solr.xml
[junit4] 2> 859351 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest_64967A30CCFDD1B0-001/control-001/cores
[junit4] 2> 859351 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.CoreContainer New CoreContainer 511935536
[junit4] 2> 859351 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest_64967A30CCFDD1B0-001/control-001]
[junit4] 2> 859351 WARN (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest_64967A30CCFDD1B0-001/control-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest_64967A30CCFDD1B0-001/control-001/lib
[junit4] 2> 859351 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 859352 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 859353 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 859353 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 859353 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43685/solr
[junit4] 2> 859353 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 859353 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 859371 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 859383 INFO (zkCallback-529-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@49e7bd09 name:ZooKeeperConnection Watcher:127.0.0.1:43685 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 859384 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 859384 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 859407 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [n:127.0.0.1:39648_h_%2Fhb ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 859410 INFO (zkCallback-530-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3980ece2 name:ZooKeeperConnection Watcher:127.0.0.1:43685/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 859410 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [n:127.0.0.1:39648_h_%2Fhb ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 859411 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [n:127.0.0.1:39648_h_%2Fhb ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
[junit4] 2> 859412 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [n:127.0.0.1:39648_h_%2Fhb ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 859414 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [n:127.0.0.1:39648_h_%2Fhb ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 859416 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [n:127.0.0.1:39648_h_%2Fhb ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 859417 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [n:127.0.0.1:39648_h_%2Fhb ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 859419 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [n:127.0.0.1:39648_h_%2Fhb ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 859420 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [n:127.0.0.1:39648_h_%2Fhb ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 859421 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [n:127.0.0.1:39648_h_%2Fhb ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 859421 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [n:127.0.0.1:39648_h_%2Fhb ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 859422 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [n:127.0.0.1:39648_h_%2Fhb ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39648_h_%2Fhb
[junit4] 2> 859422 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [n:127.0.0.1:39648_h_%2Fhb ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:39648_h_%2Fhb
[junit4] 2> 859424 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [n:127.0.0.1:39648_h_%2Fhb ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 859424 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [n:127.0.0.1:39648_h_%2Fhb ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 859425 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [n:127.0.0.1:39648_h_%2Fhb ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 859426 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [n:127.0.0.1:39648_h_%2Fhb ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94956671415025668-127.0.0.1:39648_h_%2Fhb-n_0000000000
[junit4] 2> 859426 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [n:127.0.0.1:39648_h_%2Fhb ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:39648_h_%2Fhb
[junit4] 2> 859426 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [n:127.0.0.1:39648_h_%2Fhb ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
[junit4] 2> 859427 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [n:127.0.0.1:39648_h_%2Fhb ] o.a.s.c.Overseer Overseer (id=94956671415025668-127.0.0.1:39648_h_%2Fhb-n_0000000000) starting
[junit4] 2> 859428 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [n:127.0.0.1:39648_h_%2Fhb ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
[junit4] 2> 859432 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [n:127.0.0.1:39648_h_%2Fhb ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 859433 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [n:127.0.0.1:39648_h_%2Fhb ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 859433 INFO (OverseerCollectionConfigSetProcessor-94956671415025668-127.0.0.1:39648_h_%2Fhb-n_0000000000) [n:127.0.0.1:39648_h_%2Fhb ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
[junit4] 2> 859433 INFO (OverseerStateUpdate-94956671415025668-127.0.0.1:39648_h_%2Fhb-n_0000000000) [n:127.0.0.1:39648_h_%2Fhb ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 859449 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [n:127.0.0.1:39648_h_%2Fhb ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 859449 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [n:127.0.0.1:39648_h_%2Fhb ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 859450 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [n:127.0.0.1:39648_h_%2Fhb ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest_64967A30CCFDD1B0-001/control-001/cores
[junit4] 2> 859451 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [n:127.0.0.1:39648_h_%2Fhb ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=control_collection, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 859451 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [n:127.0.0.1:39648_h_%2Fhb ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest_64967A30CCFDD1B0-001/control-001/cores/collection1
[junit4] 2> 859451 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [n:127.0.0.1:39648_h_%2Fhb ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 859452 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [n:127.0.0.1:39648_h_%2Fhb ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4] 2> 859452 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [n:127.0.0.1:39648_h_%2Fhb ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 859452 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 859452 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 859453 INFO (OverseerStateUpdate-94956671415025668-127.0.0.1:39648_h_%2Fhb-n_0000000000) [n:127.0.0.1:39648_h_%2Fhb ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:39648/h_/hb",
[junit4] 2> "node_name":"127.0.0.1:39648_h_%2Fhb",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 859453 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 859454 INFO (OverseerStateUpdate-94956671415025668-127.0.0.1:39648_h_%2Fhb-n_0000000000) [n:127.0.0.1:39648_h_%2Fhb ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:39648/h_/hb",
[junit4] 2> "node_name":"127.0.0.1:39648_h_%2Fhb",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 859454 INFO (OverseerStateUpdate-94956671415025668-127.0.0.1:39648_h_%2Fhb-n_0000000000) [n:127.0.0.1:39648_h_%2Fhb ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
[junit4] 2> 859454 INFO (OverseerStateUpdate-94956671415025668-127.0.0.1:39648_h_%2Fhb-n_0000000000) [n:127.0.0.1:39648_h_%2Fhb ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 859455 INFO (zkCallback-530-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 860454 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 860454 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
[junit4] 2> 860454 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 860454 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 860455 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 860455 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest_64967A30CCFDD1B0-001/control-001/cores/collection1'
[junit4] 2> 860455 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 860455 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 860467 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 860473 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 860476 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 860485 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
[junit4] 2> 860528 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 860803 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 860809 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 860809 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 860867 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 860869 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 860872 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 860873 WARN (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 860874 WARN (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 860874 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 860874 WARN (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 860874 WARN (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 860875 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4] 2> 860875 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 860875 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 860876 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest_64967A30CCFDD1B0-001/control-001/cores/collection1], dataDir=[null]
[junit4] 2> 860876 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@278873f0
[junit4] 2> 860884 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest_64967A30CCFDD1B0-001/control-001/cores/collection1/data
[junit4] 2> 860885 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest_64967A30CCFDD1B0-001/control-001/cores/collection1/data/index/
[junit4] 2> 860885 WARN (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest_64967A30CCFDD1B0-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 860885 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest_64967A30CCFDD1B0-001/control-001/cores/collection1/data/index
[junit4] 2> 860886 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@1171e53b
[junit4] 2> 860911 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(NRTCachingDirectory(NIOFSDirectory@/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest_64967A30CCFDD1B0-001/index-NIOFSDirectory-002 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6335dbf9; maxCacheMB=0.53515625 maxMergeSizeMB=0.939453125)),segFN=segments_1,generation=1}
[junit4] 2> 860911 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 860912 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest_64967A30CCFDD1B0-001/control-001/cores/collection1/data/
[junit4] 2> 860912 WARN (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest_64967A30CCFDD1B0-001/control-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
[junit4] 2> 860915 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 860916 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
[junit4] 2> 860916 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 860916 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 860916 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 860916 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 860916 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 860916 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 860916 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 860916 WARN (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,args = {defaults={a=A,b=B}}}
[junit4] 2> 860918 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 860919 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 860920 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 860920 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 860923 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/dump,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 860923 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 860931 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 860931 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 860932 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
[junit4] 2> 860932 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
[junit4] 2> 860935 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=47, maxMergeAtOnceExplicit=25, maxMergedSegmentMB=65.8642578125, floorSegmentMB=0.5087890625, forceMergeDeletesPctAllowed=29.72099191828035, segmentsPerTier=37.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8178443928580095
[junit4] 2> 860937 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(NRTCachingDirectory(NIOFSDirectory@/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest_64967A30CCFDD1B0-001/index-NIOFSDirectory-002 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6335dbf9; maxCacheMB=0.53515625 maxMergeSizeMB=0.939453125)),segFN=segments_1,generation=1}
[junit4] 2> 860937 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 860937 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@4324075[collection1] main
[junit4] 2> 860938 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 860938 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 860938 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 860939 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 860939 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
[junit4] 2> 860939 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 860940 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 860940 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 860940 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 860940 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 860940 INFO (searcherExecutor-1665-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@4324075[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 860940 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
[junit4] 2> 860940 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
[junit4] 2> 860941 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
[junit4] 2> 860941 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1519306744939937792
[junit4] 2> 860943 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 2.0ms to seed version buckets with highest version 1519306744939937792
[junit4] 2> 860944 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
[junit4] 2> 860957 INFO (coreLoadExecutor-1664-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 860958 INFO (coreZkRegister-1658-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:39648/h_/hb collection:control_collection shard:shard1
[junit4] 2> 860959 INFO (coreZkRegister-1658-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 860999 INFO (coreZkRegister-1658-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/94956671415025668-core_node1-n_0000000000
[junit4] 2> 861009 INFO (coreZkRegister-1658-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1
[junit4] 2> 861032 INFO (coreZkRegister-1658-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 861032 INFO (coreZkRegister-1658-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 861032 INFO (coreZkRegister-1658-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:39648/h_/hb/collection1/
[junit4] 2> 861032 INFO (coreZkRegister-1658-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 861032 INFO (coreZkRegister-1658-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:39648/h_/hb/collection1/ has no replicas
[junit4] 2> 861033 INFO (coreZkRegister-1658-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 861034 INFO (OverseerStateUpdate-94956671415025668-127.0.0.1:39648_h_%2Fhb-n_0000000000) [n:127.0.0.1:39648_h_%2Fhb ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection"} current state version: 1
[junit4] 2> 861035 INFO (zkCallback-530-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 861039 INFO (coreZkRegister-1658-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
[junit4] 2> 861054 INFO (OverseerStateUpdate-94956671415025668-127.0.0.1:39648_h_%2Fhb-n_0000000000) [n:127.0.0.1:39648_h_%2Fhb ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:39648/h_/hb",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 2
[junit4] 2> 861055 INFO (coreZkRegister-1658-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:39648/h_/hb/collection1/ shard1
[junit4] 2> 861156 INFO (zkCallback-530-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 861157 INFO (coreZkRegister-1658-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:39648/h_/hb/collection1/ and leader is http://127.0.0.1:39648/h_/hb/collection1/
[junit4] 2> 861157 INFO (coreZkRegister-1658-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:39648/h_/hb
[junit4] 2> 861157 INFO (coreZkRegister-1658-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 861157 INFO (coreZkRegister-1658-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
[junit4] 2> 861157 INFO (coreZkRegister-1658-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39648_h_%2Fhb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 861159 INFO (OverseerStateUpdate-94956671415025668-127.0.0.1:39648_h_%2Fhb-n_0000000000) [n:127.0.0.1:39648_h_%2Fhb ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:39648/h_/hb",
[junit4] 2> "node_name":"127.0.0.1:39648_h_%2Fhb",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 3
[junit4] 2> 861160 INFO (OverseerStateUpdate-94956671415025668-127.0.0.1:39648_h_%2Fhb-n_0000000000) [n:127.0.0.1:39648_h_%2Fhb ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:39648/h_/hb",
[junit4] 2> "node_name":"127.0.0.1:39648_h_%2Fhb",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 861271 INFO (zkCallback-530-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 861455 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 861456 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 861457 INFO (zkCallback-532-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2e9df3c0 name:ZooKeeperConnection Watcher:127.0.0.1:43685/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 861457 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 861457 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 861457 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 861466 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 861466 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with stateFormat=2
[junit4] 2> 861466 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 861512 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 861523 INFO (zkCallback-533-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3c1b44f name:ZooKeeperConnection Watcher:127.0.0.1:43685/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 861523 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 861523 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 861525 INFO (OverseerStateUpdate-94956671415025668-127.0.0.1:39648_h_%2Fhb-n_0000000000) [n:127.0.0.1:39648_h_%2Fhb ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"create",
[junit4] 2> "name":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "stateFormat":"2"} current state version: 4
[junit4] 2> 861526 INFO (OverseerStateUpdate-94956671415025668-127.0.0.1:39648_h_%2Fhb-n_0000000000) [n:127.0.0.1:39648_h_%2Fhb ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
[junit4] 2> 861628 INFO (OverseerStateUpdate-94956671415025668-127.0.0.1:39648_h_%2Fhb-n_0000000000) [n:127.0.0.1:39648_h_%2Fhb ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/collection1/state.json
[junit4] 2> 861892 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest_64967A30CCFDD1B0-001/shard-1-001/cores/collection1
[junit4] 2> 861893 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest_64967A30CCFDD1B0-001/shard-1-001
[junit4] 2> 861901 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.e.j.s.Server jetty-9.2.13.v20150730
[junit4] 2> 861979 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@201e8ab0{/h_/hb,null,AVAILABLE}
[junit4] 2> 861980 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.e.j.s.ServerConnector Started ServerConnector@b109ba9{HTTP/1.1}{127.0.0.1:56410}
[junit4] 2> 861980 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.e.j.s.Server Started @864950ms
[junit4] 2> 861980 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest_64967A30CCFDD1B0-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/h_/hb, hostPort=56410, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest_64967A30CCFDD1B0-001/shard-1-001/cores}
[junit4] 2> 861980 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 861980 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest_64967A30CCFDD1B0-001/shard-1-001'
[junit4] 2> 861980 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 861980 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 861981 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 861995 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 862005 INFO (zkCallback-534-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5d6fe955 name:ZooKeeperConnection Watcher:127.0.0.1:43685/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 862005 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 862005 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 862006 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 862006 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest_64967A30CCFDD1B0-001/shard-1-001/solr.xml
[junit4] 2> 862011 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest_64967A30CCFDD1B0-001/shard-1-001/cores
[junit4] 2> 862011 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.CoreContainer New CoreContainer 228641951
[junit4] 2> 862011 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest_64967A30CCFDD1B0-001/shard-1-001]
[junit4] 2> 862011 WARN (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest_64967A30CCFDD1B0-001/shard-1-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest_64967A30CCFDD1B0-001/shard-1-001/lib
[junit4] 2> 862011 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 862012 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 862012 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 862012 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 862013 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43685/solr
[junit4] 2> 862013 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 862013 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 862013 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 862014 INFO (zkCallback-536-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@40a54d03 name:ZooKeeperConnection Watcher:127.0.0.1:43685 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 862015 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 862015 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 862016 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [n:127.0.0.1:56410_h_%2Fhb ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 862017 INFO (zkCallback-537-thread-1-processing-n:127.0.0.1:56410_h_%2Fhb) [n:127.0.0.1:56410_h_%2Fhb ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@55c50d4a name:ZooKeeperConnection Watcher:127.0.0.1:43685/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 862017 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [n:127.0.0.1:56410_h_%2Fhb ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 862021 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [n:127.0.0.1:56410_h_%2Fhb ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 863025 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [n:127.0.0.1:56410_h_%2Fhb ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56410_h_%2Fhb
[junit4] 2> 863026 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [n:127.0.0.1:56410_h_%2Fhb ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:56410_h_%2Fhb
[junit4] 2> 863027 INFO (zkCallback-530-thread-1-processing-n:127.0.0.1:39648_h_%2Fhb) [n:127.0.0.1:39648_h_%2Fhb ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 863027 INFO (zkCallback-532-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 863027 INFO (zkCallback-537-thread-1-processing-n:127.0.0.1:56410_h_%2Fhb) [n:127.0.0.1:56410_h_%2Fhb ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 863029 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [n:127.0.0.1:56410_h_%2Fhb ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 863029 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [n:127.0.0.1:56410_h_%2Fhb ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94956671415025673-127.0.0.1:56410_h_%2Fhb-n_0000000001
[junit4] 2> 863029 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [n:127.0.0.1:56410_h_%2Fhb ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/94956671415025668-127.0.0.1:39648_h_%2Fhb-n_0000000000 to know if I could be the leader
[junit4] 2> 863039 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [n:127.0.0.1:56410_h_%2Fhb ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 863039 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [n:127.0.0.1:56410_h_%2Fhb ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 863039 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [n:127.0.0.1:56410_h_%2Fhb ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest_64967A30CCFDD1B0-001/shard-1-001/cores
[junit4] 2> 863040 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [n:127.0.0.1:56410_h_%2Fhb ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=collection1, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 863040 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [n:127.0.0.1:56410_h_%2Fhb ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest_64967A30CCFDD1B0-001/shard-1-001/cores/collection1
[junit4] 2> 863040 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [n:127.0.0.1:56410_h_%2Fhb ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 863045 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [n:127.0.0.1:56410_h_%2Fhb ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4] 2> 863045 INFO (TEST-SyncSliceTest.test-seed#[64967A30CCFDD1B0]) [n:127.0.0.1:56410_h_%2Fhb ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 863046 INFO (coreLoadExecutor-1675-thread-1-processing-n:127.0.0.1:56410_h_%2Fhb) [n:127.0.0.1:56410_h_%2Fhb c:collection1 x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 863046 INFO (coreLoadExecutor-1675-thread-1-processing-n:127.0.0.1:56410_h_%2Fhb) [n:127.0.0.1:56410_h_%2Fhb c:collection1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 863047 INFO (coreLoadExecutor-1675-thread-1-processing-n:127.0.0.1:56410_h_%2Fhb) [n:127.0.0.1:56410_h_%2Fhb c:collection1 x:collection1] o.a.s.c.ZkController Registering watch for collection collection1
[junit4] 2> 863047 INFO (coreLoadExecutor-1675-thread-1-processing-n:127.0.0.1:56410_h_%2Fhb) [n:127.0.0.1:56410_h_%2Fhb c:collection1 x:collection1] o.a.s.c.c.ZkStateReader addZkWatch collection1
[junit4] 2> 863047 INFO (OverseerStateUpdate-94956671415025668-127.0.0.1:39648_h_%2Fhb-n_0000000000) [n:127.0.0.1:39648_h_%2Fhb ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:56410/h_/hb",
[junit4] 2> "node_name":"127.0.0.1:56410_h_%2Fhb",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"} current state version: 4
[junit4] 2> 863047 INFO (coreLoadExecutor-1675-thread-1-processing-n:127.0.0.1:56410_h_%2Fhb) [n:127.0.0.1:56410_h_%2Fhb c:collection1 x:collection1] o.a.s.c.c.ZkStateReader Add data for collection1 ver 0
[junit4] 2> 863048 INFO (coreLoadExecutor-1675-thread-1-processing-n:127.0.0.1:56410_h_%2Fhb) [n:127.0.0.1:56410_h_%2Fhb c:collection1 x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 863048 INFO (OverseerStateUpdate-94956671415025668-127.0.0.1:39648_h_%2Fhb-n_0000000000) [n:127.0.0.1:39648_h_%2Fhb ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:56410/h_/hb",
[junit4] 2> "node_name":"127.0.0.1:56410_h_%2Fhb",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"}
[junit4] 2> 863048 INFO (OverseerStateUpdate-94956671415025668-127.0.0.1:39648_h_%2Fhb-n_0000000000) [n:127.0.0.1:39648_h_%2Fhb ] o.a.s.c.o.ReplicaMutator Collection already exists with numShards=1
[junit4] 2> 863048 INFO (OverseerStateUpdate-94956671415025668-127.0.0.1:39648_h_%2Fhb-n_0000000000) [n:127.0.0.1:39648_h_%2Fhb ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 863150 INFO (OverseerStateUpdate-94956671415025668-127.0.0.1:39648_h_%2Fhb-n_0000000000) [n:127.0.0.1:39648_h_%2Fhb ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/collection1/state.json version: 0
[junit4] 2> 863150 INFO (zkCallback-537-thread-1-processing-n:127.0.0.1:56410_h_%2Fhb) [n:127.0.0.1:56410_h_%2Fhb ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json for collection collection1 has occurred - updating... (live nodes size: 2)
[junit4] 2> 863151 INFO (zkCallback-537-thread-1-processing-n:127.0.0.1:56410_h_%2Fhb) [n:127.0.0.1:56410_h_%2Fhb ] o.a.s.c.c.ZkStateReader Updating data for collection1 from 0 to 1
[junit4] 2> 864048 INFO (coreLoadExecutor-1675-thread-1-processing-n:127.0.0.1:56410_h_%2Fhb) [n:127.0.0.1:56410_h_%2Fhb c:collection1 x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 864048 INFO (coreLoadExecutor-1675-thread-1-processing-n:127.0.0.1:56410_h_%2Fhb) [n:127.0.0.1:56410_h_%2Fhb c:collection1 x:collection1] o.a.s.c.ZkController Check for collection zkNode:collection1
[junit4] 2> 864048 INFO (coreLoadExecutor-1675-thread-1-processing-n:127.0.0.1:56410_h_%2Fhb) [n:127.0.0.1:56410_h_%2Fhb c:collection1 x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 864048 INFO (coreLoadExecutor-1675-thread-1-processing-n:127.0.0.1:56410_h_%2Fhb) [n:127.0.0.1:56410_h_%2Fhb c:collection1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/collection1
[junit4] 2> 864049 INFO (coreLoadExecutor-1675-thread-1-processing-n:127.0.0.1:56410_h_%2Fhb) [n:127.0.0.1:56410_h_%2Fhb c:collection1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 864049 INFO (coreLoadExecutor-1675-thread-1-processing-n:127.0.0.1:56410_h_%2Fhb) [n:127.0.0.1:56410_h_%2Fhb c:collection1 x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest_64967A30CCFDD1B0-001/shard-1-001/cores/collection1'
[junit4] 2> 864049 INFO (coreLoadExecutor-1675-thread-1-processing-n:127.0.0.1:56410_h_%2Fhb) [n:127.0.0.1:56410_h_%2Fhb c:collection1 x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 864049 INFO (coreLoadExecutor-1675-thread-1-processing-n:127.0.0.1:56410_h_%2Fhb) [n:127.0.0.1:56410_h_%2Fhb c:collection1 x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 864050 INFO (coreLoadExecutor-1675-thread-1-processing-n:127.0.0.1:56410_h_%2Fhb) [n:127.0.0.1:56410_h_%2Fhb c:collection1 x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 864055 INFO (coreLoadExecutor-1675-thread-1-processing-n:127.0.0.1:56410_h_%2Fhb) [n:127.0.0.1:56410_h_%2Fhb c:collection1 x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 864058 INFO (coreLoadExecutor-1675-thread-1-processing-n:127.0.0.1:56410_h_%2Fhb) [n:127.0.0.1:56410_h_%2Fhb c:collection1 x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 864100 INFO (coreLoadExecutor-1675-thread-1-processing-n:127.0.0.1:56410_h_%2Fhb) [n:127.0.0.1:56410_h_%2Fhb c:collection1 x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
[junit4] 2> 864105 INFO (coreLoadExecutor-1675-thread-1-processing-n:127.0.0.1:56410_h_%2Fhb) [n:127.0.0.1:56410_h_%2Fhb c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 864190 INFO (coreLoadExecutor-1675-thread-1-processing-n:127.0.0.1:56410_h_%2Fhb) [n:127.0.0.1:56410_h_%2Fhb c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 864195 INFO (coreLoadExecutor-1675-thread-1-processing-n:127.0.0.1:56410_h_%2Fhb) [n:127.0.0.1:56410_h_%2Fhb c:collection1 x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 864196 INFO (coreLoadExecutor-1675-thread-1-processing-n:127.0.0.1:56410_h_%2Fhb) [n:127.0.0.1:56410_h_%2Fhb c:collection1 x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 864204 INFO (coreLoadExecutor-1675-thread-1-processing-n:127.0.0.1:56410_h_%2Fhb) [n:127.0.0.1:56410_h_%2Fhb c:collection1 x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 864206 INFO (coreLoadExecutor-1675-thread-1-processing-n:127.0.0.1:56410_h_%2Fhb) [n:127.0.0.1:56410_h_%2Fhb c:collection1 x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 864207 INFO (coreLoadExecutor-1675-thread-1-processing-n:127.0.0.1:56410_h_%2Fhb) [n:127.0.0.1:56410_h_%2Fhb c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 864208 WARN (coreLoadExecutor-1675-thread-1-processing-n:127.0.0.1:56410_h_%2Fhb) [n:127.0.0.1:56410_h_%2Fhb c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 864208 WARN (coreLoadExecutor-1675-thread-1-processing-n:127.0.0.1:56410_h_%2Fhb) [n:127.0.0.1:56410_h_%2Fhb c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 864208 INFO (coreLoadExecutor-1675-thread-1-processing-n:127.0.0.1:56410_h_%2Fhb) [n:127.0.0.1:56410_h_%2Fhb c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 864208 WARN (coreLoadExecutor-1675-thread-1-processing-n:127.0.0.1:56410_h_%2Fhb) [n:127.0.0.1:56410_h_%2Fhb c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 864209 WARN (coreLoadExecutor-1675-thread-1-processing-n:127.0.0.1:56410_h_%2Fhb) [n:127.0.0.1:56410_h_%2Fhb c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 864209 INFO (coreLoadExecutor-1675-thread-1-processing-n:127.0.0.1:56410_h_%2Fhb) [n:127.0.0.1:56410_h_%2Fhb c:collection1 x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4] 2> 864209 INFO (coreLoadExecutor-1675-thread-1-processing-n:127.0.0.1:56410_h_%2Fhb) [n:127.0.0.1:56410_h_%2Fhb c:collection1 x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 864210 INFO (coreLoadExecutor-1675-thread-1-processing-n:127.0.0.1:56410_h_%2Fhb) [n:127.0.0.1:56410_h_%2Fhb c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 864210 INFO (coreLoadExecutor-1675-thread-1-processing-n:127.0.0.1:56410_h_%2Fhb) [n:127.0.0.1:56410_h_%2Fhb c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest_64967A30CCFDD1B0-001/shard-1-001/cores/collection1], dataDir=[null]
[junit4] 2> 864210 INFO (coreLoadExecutor-1675-thread-1-processing-n:127.0.0.1:56410_h_%2Fhb) [n:127.0.0.1:56410_h_%2Fhb c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@278873f0
[junit4] 2> 864211 INFO (coreLoadExecutor-1675-thread-1-processing-n:127.0.0.1:56410_h_%2Fhb) [n:127.0.0.1:56410_h_%2Fhb c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest_64967A30CCFDD1B0-001/shard-1-001/cores/collection1/data
[junit4] 2> 864211 INFO (coreLoadExecutor-1675-thread-1-processing-n:127.0.0.1:56410_h_%2Fhb) [n:127.0.0.1:56410_h_%2Fhb c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest_64967A30CCFDD1B0-001/shard-1-001/cores/collection1/data/index/
[junit4] 2> 864211 WARN (coreLoadExecutor-1675-thread-1-processing-n:127.0.0.1:56410_h_%2Fhb) [n:127.0.0.1:56410_h_%2Fhb c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest_64967A30CCFDD1B0-001/shard-1-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 864212 INFO (coreLoadExecutor-1675-thread-1-processing-n:127.0.0.1:56410_h_%2Fhb) [n:127.0.0.1:56410_h_%2Fhb c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest_64967A30CCFDD1B0-001/shard-1-001/cores/collection1/data/index
[junit4] 2> 864212 INFO (coreLoadExecutor-1675-thread-1-processing-n:127.0.0.1:56410_h_%2Fhb) [n:127.0.0.1:56410_h_%2Fhb c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@1856f837
[junit4] 2> 864213 INFO (coreLoadExecutor-1675-thread-1-processing-n:127.0.0.1:56410_h_%2Fhb) [n:127.0.0.1:56410_h_%2Fhb c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(NRTCachingDirectory(NIOFSDirectory@/x1/jenkins/jenkins-slave/workspace/Lucene-
[...truncated too long message...]
-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-collective-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-event-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-exception-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-journal-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-normalization-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-operational-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-referral-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-schema-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-subtree-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-trigger-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-jdbm-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-jdbm1-2.0.0-M2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-kerberos-codec-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-ldif-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-mavibot-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-protocol-kerberos-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-protocol-ldap-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-protocol-shared-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-xdbm-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/api-all-1.0.0-M20.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/bcprov-jdk15-1.45.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/cglib-nodep-2.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/commons-collections-3.2.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/commons-math3-3.4.1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/easymock-3.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/ehcache-core-2.4.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/hadoop-common-2.6.0-tests.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/hadoop-hdfs-2.6.0-tests.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/hadoop-minikdc-2.6.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/jackson-annotations-2.5.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/jackson-databind-2.5.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/jcl-over-slf4j-1.7.7.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/jersey-core-1.9.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/jersey-server-1.9.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/jetty-6.1.26.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/jetty-util-6.1.26.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/mina-core-2.0.0-M5.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/objenesis-1.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/presto-parser-0.122.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/slice-0.10.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/analysis/icu/lucene-analyzers-icu-6.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-analysis-extras/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/contrib/analysis-extras/lib/icu4j-54.1.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-launcher.jar:/x1/jenkins/.ant/lib/ivy-2.3.0.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-antlr.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-regexp.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-resolver.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-commons-net.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jmf.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-oro.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-xalan2.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-commons-logging.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jsch.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-junit4.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-javamail.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jai.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jdepend.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-junit.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-bsf.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-swing.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-netrexx.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-bcel.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-testutil.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-log4j.jar:/x1/jenkins/jenkins-slave/tools/hudson.model.JDK/latest1.8/lib/tools.jar:/x1/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.3.1.jar com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe -eventsfile /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/temp/junit4-J1-20151130_223557_430.events @/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/temp/junit4-J1-20151130_223557_430.suites -stdin
[junit4] ERROR: JVM J1 ended with an exception: Quit event not received from the forked process? This may indicate JVM crash or runner bugs.
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4.executeSlave(JUnit4.java:1503)
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4.access$000(JUnit4.java:130)
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:963)
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:960)
[junit4] at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] at java.lang.Thread.run(Thread.java:745)
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987: At least one slave process threw an exception, first: Quit event not received from the forked process? This may indicate JVM crash or runner bugs.
Total time: 230 minutes 4 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 867 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/867/
3 tests failed.
FAILED: org.apache.solr.hadoop.MorphlineBasicMiniMRTest.mrRun
Error Message:
Failed on local exception: java.io.IOException: Broken pipe; Host Details : local host is: "lucene1-us-west/10.41.0.5"; destination host is: "lucene1-us-west.apache.org":36292;
Stack Trace:
java.io.IOException: Failed on local exception: java.io.IOException: Broken pipe; Host Details : local host is: "lucene1-us-west/10.41.0.5"; destination host is: "lucene1-us-west.apache.org":36292;
at __randomizedtesting.SeedInfo.seed([C7794755BD01335C:C92BF35BBC970153]:0)
at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:772)
at org.apache.hadoop.ipc.Client.call(Client.java:1472)
at org.apache.hadoop.ipc.Client.call(Client.java:1399)
at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232)
at com.sun.proxy.$Proxy110.getClusterMetrics(Unknown Source)
at org.apache.hadoop.yarn.api.impl.pb.client.ApplicationClientProtocolPBClientImpl.getClusterMetrics(ApplicationClientProtocolPBClientImpl.java:202)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
at com.sun.proxy.$Proxy111.getClusterMetrics(Unknown Source)
at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.getYarnClusterMetrics(YarnClientImpl.java:461)
at org.apache.hadoop.mapred.ResourceMgrDelegate.getClusterMetrics(ResourceMgrDelegate.java:151)
at org.apache.hadoop.mapred.YARNRunner.getClusterMetrics(YARNRunner.java:179)
at org.apache.hadoop.mapreduce.Cluster.getClusterStatus(Cluster.java:246)
at org.apache.hadoop.mapred.JobClient$3.run(JobClient.java:719)
at org.apache.hadoop.mapred.JobClient$3.run(JobClient.java:717)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.hadoop.mapred.JobClient.getClusterStatus(JobClient.java:717)
at org.apache.solr.hadoop.MapReduceIndexerTool.run(MapReduceIndexerTool.java:644)
at org.apache.solr.hadoop.MapReduceIndexerTool.run(MapReduceIndexerTool.java:607)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.solr.hadoop.MorphlineBasicMiniMRTest.mrRun(MorphlineBasicMiniMRTest.java:363)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: Broken pipe
at sun.nio.ch.FileDispatcherImpl.write0(Native Method)
at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47)
at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)
at sun.nio.ch.IOUtil.write(IOUtil.java:65)
at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:471)
at org.apache.hadoop.net.SocketOutputStream$Writer.performIO(SocketOutputStream.java:63)
at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:142)
at org.apache.hadoop.net.SocketOutputStream.write(SocketOutputStream.java:159)
at org.apache.hadoop.net.SocketOutputStream.write(SocketOutputStream.java:117)
at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140)
at java.io.DataOutputStream.flush(DataOutputStream.java:123)
at org.apache.hadoop.ipc.Client$Connection$3.run(Client.java:1030)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
... 1 more
FAILED: junit.framework.TestSuite.org.apache.solr.hadoop.MorphlineBasicMiniMRTest
Error Message:
1 thread leaked from SUITE scope at org.apache.solr.hadoop.MorphlineBasicMiniMRTest: 1) Thread[id=442, name=Node Status Updater, state=TIMED_WAITING, group=TGRP-MorphlineBasicMiniMRTest] at java.lang.Object.wait(Native Method) at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl$1.run(NodeStatusUpdaterImpl.java:659) at java.lang.Thread.run(Thread.java:745)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.hadoop.MorphlineBasicMiniMRTest:
1) Thread[id=442, name=Node Status Updater, state=TIMED_WAITING, group=TGRP-MorphlineBasicMiniMRTest]
at java.lang.Object.wait(Native Method)
at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl$1.run(NodeStatusUpdaterImpl.java:659)
at java.lang.Thread.run(Thread.java:745)
at __randomizedtesting.SeedInfo.seed([C7794755BD01335C]:0)
FAILED: org.apache.solr.hadoop.MorphlineGoLiveMiniMRTest.test
Error Message:
Failed on local exception: java.io.IOException: Connection reset by peer; Host Details : local host is: "lucene1-us-west/10.41.0.5"; destination host is: "lucene1-us-west.apache.org":32774;
Stack Trace:
java.io.IOException: Failed on local exception: java.io.IOException: Connection reset by peer; Host Details : local host is: "lucene1-us-west/10.41.0.5"; destination host is: "lucene1-us-west.apache.org":32774;
at __randomizedtesting.SeedInfo.seed([C7794755BD01335C:4F2D788F13FD5EA4]:0)
at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:772)
at org.apache.hadoop.ipc.Client.call(Client.java:1472)
at org.apache.hadoop.ipc.Client.call(Client.java:1399)
at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232)
at com.sun.proxy.$Proxy108.getClusterMetrics(Unknown Source)
at org.apache.hadoop.yarn.api.impl.pb.client.ApplicationClientProtocolPBClientImpl.getClusterMetrics(ApplicationClientProtocolPBClientImpl.java:202)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
at com.sun.proxy.$Proxy109.getClusterMetrics(Unknown Source)
at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.getYarnClusterMetrics(YarnClientImpl.java:461)
at org.apache.hadoop.mapred.ResourceMgrDelegate.getClusterMetrics(ResourceMgrDelegate.java:151)
at org.apache.hadoop.mapred.YARNRunner.getClusterMetrics(YARNRunner.java:179)
at org.apache.hadoop.mapreduce.Cluster.getClusterStatus(Cluster.java:246)
at org.apache.hadoop.mapred.JobClient$3.run(JobClient.java:719)
at org.apache.hadoop.mapred.JobClient$3.run(JobClient.java:717)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.hadoop.mapred.JobClient.getClusterStatus(JobClient.java:717)
at org.apache.solr.hadoop.MapReduceIndexerTool.run(MapReduceIndexerTool.java:644)
at org.apache.solr.hadoop.MapReduceIndexerTool.run(MapReduceIndexerTool.java:607)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.solr.hadoop.MorphlineGoLiveMiniMRTest.test(MorphlineGoLiveMiniMRTest.java:402)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:964)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:939)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: Connection reset by peer
at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
at sun.nio.ch.IOUtil.read(IOUtil.java:197)
at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380)
at org.apache.hadoop.net.SocketInputStream$Reader.performIO(SocketInputStream.java:57)
at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:142)
at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161)
at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131)
at java.io.FilterInputStream.read(FilterInputStream.java:133)
at java.io.FilterInputStream.read(FilterInputStream.java:133)
at org.apache.hadoop.ipc.Client$Connection$PingInputStream.read(Client.java:513)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read(BufferedInputStream.java:265)
at java.io.DataInputStream.readInt(DataInputStream.java:387)
at org.apache.hadoop.ipc.Client$Connection.receiveRpcResponse(Client.java:1071)
at org.apache.hadoop.ipc.Client$Connection.run(Client.java:966)
Build Log:
[...truncated 17694 lines...]
[junit4] Suite: org.apache.solr.hadoop.MorphlineBasicMiniMRTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/init-core-data-001
[junit4] 2> 0 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
[junit4] 2> 2314 WARN (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.u.NativeCodeLoader Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
[junit4] 1> Formatting using clusterid: testClusterID
[junit4] 2> 2410 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.n.FSNamesystem No KeyProvider found.
[junit4] 2> 2446 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.n.FSNamesystem fsLock is fair:true
[junit4] 2> 2520 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.c.C.deprecation hadoop.configured.node.mapping is deprecated. Instead, use net.topology.configured.node.mapping
[junit4] 2> 2520 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.b.DatanodeManager dfs.block.invalidate.limit=1000
[junit4] 2> 2520 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.b.DatanodeManager dfs.namenode.datanode.registration.ip-hostname-check=true
[junit4] 2> 2523 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.b.BlockManager dfs.namenode.startup.delay.block.deletion.sec is set to 000:00:00:00.000
[junit4] 2> 2528 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.b.BlockManager The block deletion will start around 2015 Nov 30 05:01:50
[junit4] 2> 2531 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.u.GSet Computing capacity for map BlocksMap
[junit4] 2> 2531 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.u.GSet VM type = 64-bit
[junit4] 2> 2534 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.u.GSet 2.0% max memory 455.5 MB = 9.1 MB
[junit4] 2> 2542 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.u.GSet capacity = 2^20 = 1048576 entries
[junit4] 2> 2568 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.b.BlockManager dfs.block.access.token.enable=false
[junit4] 2> 2568 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.b.BlockManager defaultReplication = 2
[junit4] 2> 2568 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.b.BlockManager maxReplication = 512
[junit4] 2> 2569 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.b.BlockManager minReplication = 1
[junit4] 2> 2569 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.b.BlockManager maxReplicationStreams = 2
[junit4] 2> 2569 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.b.BlockManager shouldCheckForEnoughRacks = false
[junit4] 2> 2569 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.b.BlockManager replicationRecheckInterval = 3000
[junit4] 2> 2570 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.b.BlockManager encryptDataTransfer = false
[junit4] 2> 2570 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.b.BlockManager maxNumBlocksToLog = 1000
[junit4] 2> 2582 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.n.FSNamesystem fsOwner = jenkins (auth:SIMPLE)
[junit4] 2> 2582 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.n.FSNamesystem supergroup = supergroup
[junit4] 2> 2582 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.n.FSNamesystem isPermissionEnabled = true
[junit4] 2> 2584 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.n.FSNamesystem HA Enabled: false
[junit4] 2> 2589 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.n.FSNamesystem Append Enabled: true
[junit4] 2> 3036 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.u.GSet Computing capacity for map INodeMap
[junit4] 2> 3036 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.u.GSet VM type = 64-bit
[junit4] 2> 3037 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.u.GSet 1.0% max memory 455.5 MB = 4.6 MB
[junit4] 2> 3038 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.u.GSet capacity = 2^19 = 524288 entries
[junit4] 2> 3039 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.n.NameNode Caching file names occuring more than 10 times
[junit4] 2> 3053 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.u.GSet Computing capacity for map cachedBlocks
[junit4] 2> 3053 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.u.GSet VM type = 64-bit
[junit4] 2> 3053 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.u.GSet 0.25% max memory 455.5 MB = 1.1 MB
[junit4] 2> 3053 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.u.GSet capacity = 2^17 = 131072 entries
[junit4] 2> 3055 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.n.FSNamesystem dfs.namenode.safemode.threshold-pct = 0.9990000128746033
[junit4] 2> 3062 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.n.FSNamesystem dfs.namenode.safemode.min.datanodes = 0
[junit4] 2> 3062 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.n.FSNamesystem dfs.namenode.safemode.extension = 0
[junit4] 2> 3064 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.n.FSNamesystem Retry cache on namenode is enabled
[junit4] 2> 3065 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.n.FSNamesystem Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000 millis
[junit4] 2> 3080 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.u.GSet Computing capacity for map NameNodeRetryCache
[junit4] 2> 3082 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.u.GSet VM type = 64-bit
[junit4] 2> 3082 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.u.GSet 0.029999999329447746% max memory 455.5 MB = 139.9 KB
[junit4] 2> 3082 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.u.GSet capacity = 2^14 = 16384 entries
[junit4] 2> 3114 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.n.NNConf ACLs enabled? false
[junit4] 2> 3114 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.n.NNConf XAttrs enabled? true
[junit4] 2> 3119 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.n.NNConf Maximum size of an xattr: 16384
[junit4] 2> 3329 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.n.FSImage Allocated new BlockPoolId: BP-1013089143-10.41.0.5-1448838110672
[junit4] 2> 3355 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/name1 has been successfully formatted.
[junit4] 2> 3359 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/name2 has been successfully formatted.
[junit4] 2> 3698 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.n.NNStorageRetentionManager Going to retain 1 images with txid >= 0
[junit4] 2> 3700 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.n.NameNode createNameNode []
[junit4] 2> 3758 WARN (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
[junit4] 2> 3930 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.m.i.MetricsSystemImpl Scheduled snapshot period at 10 second(s).
[junit4] 2> 3930 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.m.i.MetricsSystemImpl NameNode metrics system started
[junit4] 2> 3933 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.n.NameNode fs.defaultFS is hdfs://127.0.0.1:0
[junit4] 2> 4037 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.DFSUtil Starting Web-server for hdfs at: http://localhost:0
[junit4] 2> 4174 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.m.log Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
[junit4] 2> 4187 WARN (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 4217 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.HttpServer2 Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
[junit4] 2> 4220 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.HttpServer2 Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context hdfs
[junit4] 2> 4220 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.HttpServer2 Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
[junit4] 2> 4220 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.HttpServer2 Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
[junit4] 2> 4274 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.HttpServer2 Added filter 'org.apache.hadoop.hdfs.web.AuthFilter' (class=org.apache.hadoop.hdfs.web.AuthFilter)
[junit4] 2> 4276 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.HttpServer2 addJerseyResourcePackage: packageName=org.apache.hadoop.hdfs.server.namenode.web.resources;org.apache.hadoop.hdfs.web.resources, pathSpec=/webhdfs/v1/*
[junit4] 2> 4315 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.HttpServer2 Jetty bound to port 37039
[junit4] 2> 4315 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 4402 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_37039_hdfs____.1c20f8/webapp
[junit4] 2> 4608 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
[junit4] 2> 5826 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37039
[junit4] 2> 5839 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.n.FSNamesystem No KeyProvider found.
[junit4] 2> 5840 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.n.FSNamesystem fsLock is fair:true
[junit4] 2> 5846 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.b.DatanodeManager dfs.block.invalidate.limit=1000
[junit4] 2> 5846 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.b.DatanodeManager dfs.namenode.datanode.registration.ip-hostname-check=true
[junit4] 2> 5846 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.b.BlockManager dfs.namenode.startup.delay.block.deletion.sec is set to 000:00:00:00.000
[junit4] 2> 5847 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.b.BlockManager The block deletion will start around 2015 Nov 30 05:01:53
[junit4] 2> 5847 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.u.GSet Computing capacity for map BlocksMap
[junit4] 2> 5847 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.u.GSet VM type = 64-bit
[junit4] 2> 5847 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.u.GSet 2.0% max memory 455.5 MB = 9.1 MB
[junit4] 2> 5847 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.u.GSet capacity = 2^20 = 1048576 entries
[junit4] 2> 5848 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.b.BlockManager dfs.block.access.token.enable=false
[junit4] 2> 5848 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.b.BlockManager defaultReplication = 2
[junit4] 2> 5848 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.b.BlockManager maxReplication = 512
[junit4] 2> 5848 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.b.BlockManager minReplication = 1
[junit4] 2> 5848 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.b.BlockManager maxReplicationStreams = 2
[junit4] 2> 5849 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.b.BlockManager shouldCheckForEnoughRacks = false
[junit4] 2> 5849 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.b.BlockManager replicationRecheckInterval = 3000
[junit4] 2> 5849 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.b.BlockManager encryptDataTransfer = false
[junit4] 2> 5849 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.b.BlockManager maxNumBlocksToLog = 1000
[junit4] 2> 5849 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.n.FSNamesystem fsOwner = jenkins (auth:SIMPLE)
[junit4] 2> 5849 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.n.FSNamesystem supergroup = supergroup
[junit4] 2> 5849 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.n.FSNamesystem isPermissionEnabled = true
[junit4] 2> 5850 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.n.FSNamesystem HA Enabled: false
[junit4] 2> 5850 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.n.FSNamesystem Append Enabled: true
[junit4] 2> 5850 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.u.GSet Computing capacity for map INodeMap
[junit4] 2> 5850 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.u.GSet VM type = 64-bit
[junit4] 2> 5850 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.u.GSet 1.0% max memory 455.5 MB = 4.6 MB
[junit4] 2> 5850 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.u.GSet capacity = 2^19 = 524288 entries
[junit4] 2> 5851 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.n.NameNode Caching file names occuring more than 10 times
[junit4] 2> 5851 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.u.GSet Computing capacity for map cachedBlocks
[junit4] 2> 5851 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.u.GSet VM type = 64-bit
[junit4] 2> 5851 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.u.GSet 0.25% max memory 455.5 MB = 1.1 MB
[junit4] 2> 5851 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.u.GSet capacity = 2^17 = 131072 entries
[junit4] 2> 5852 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.n.FSNamesystem dfs.namenode.safemode.threshold-pct = 0.9990000128746033
[junit4] 2> 5852 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.n.FSNamesystem dfs.namenode.safemode.min.datanodes = 0
[junit4] 2> 5852 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.n.FSNamesystem dfs.namenode.safemode.extension = 0
[junit4] 2> 5852 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.n.FSNamesystem Retry cache on namenode is enabled
[junit4] 2> 5852 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.n.FSNamesystem Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000 millis
[junit4] 2> 5852 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.u.GSet Computing capacity for map NameNodeRetryCache
[junit4] 2> 5852 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.u.GSet VM type = 64-bit
[junit4] 2> 5852 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.u.GSet 0.029999999329447746% max memory 455.5 MB = 139.9 KB
[junit4] 2> 5852 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.u.GSet capacity = 2^14 = 16384 entries
[junit4] 2> 5854 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.n.NNConf ACLs enabled? false
[junit4] 2> 5855 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.n.NNConf XAttrs enabled? true
[junit4] 2> 5855 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.n.NNConf Maximum size of an xattr: 16384
[junit4] 2> 5862 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.c.Storage Lock on /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/name1/in_use.lock acquired by nodename 1460@lucene1-us-west
[junit4] 2> 5868 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.c.Storage Lock on /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/name2/in_use.lock acquired by nodename 1460@lucene1-us-west
[junit4] 2> 5873 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.n.FileJournalManager Recovering unfinalized segments in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/name1/current
[junit4] 2> 5873 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.n.FileJournalManager Recovering unfinalized segments in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/name2/current
[junit4] 2> 5874 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.n.FSImage No edit log streams selected.
[junit4] 2> 5897 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.n.FSImageFormatPBINode Loading 1 INodes.
[junit4] 2> 5911 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.n.FSImageFormatProtobuf Loaded FSImage in 0 seconds.
[junit4] 2> 5911 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.n.FSImage Loaded image for txid 0 from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/name1/current/fsimage_0000000000000000000
[junit4] 2> 5918 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.n.FSNamesystem Need to save fs image? false (staleImage=false, haEnabled=false, isRollingUpgrade=false)
[junit4] 2> 5918 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.n.FSEditLog Starting log segment at 1
[junit4] 2> 5967 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.n.NameCache initialized with 0 entries 0 lookups
[junit4] 2> 5967 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.n.FSNamesystem Finished loading FSImage in 112 msecs
[junit4] 2> 6406 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.n.NameNode RPC server is binding to localhost:0
[junit4] 2> 6429 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.i.CallQueueManager Using callQueue class java.util.concurrent.LinkedBlockingQueue
[junit4] 2> 6466 INFO (Socket Reader #1 for port 42777) [ ] o.a.h.i.Server Starting Socket Reader #1 for port 42777
[junit4] 2> 6540 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.n.NameNode Clients are to use localhost:42777 to access this namenode/service.
[junit4] 2> 6543 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.n.FSNamesystem Registered FSNamesystemState MBean
[junit4] 2> 6577 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.n.FSNamesystem Number of blocks under construction: 0
[junit4] 2> 6578 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.n.FSNamesystem Number of blocks under construction: 0
[junit4] 2> 6578 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.n.FSNamesystem initializing replication queues
[junit4] 2> 6579 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.StateChange STATE* Leaving safe mode after 0 secs
[junit4] 2> 6579 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.StateChange STATE* Network topology has 0 racks and 0 datanodes
[junit4] 2> 6579 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.StateChange STATE* UnderReplicatedBlocks has 0 blocks
[junit4] 2> 6590 INFO (Replication Queue Initializer) [ ] o.a.h.h.s.b.BlockManager Total number of blocks = 0
[junit4] 2> 6602 INFO (Replication Queue Initializer) [ ] o.a.h.h.s.b.BlockManager Number of invalid blocks = 0
[junit4] 2> 6602 INFO (Replication Queue Initializer) [ ] o.a.h.h.s.b.BlockManager Number of under-replicated blocks = 0
[junit4] 2> 6602 INFO (Replication Queue Initializer) [ ] o.a.h.h.s.b.BlockManager Number of over-replicated blocks = 0
[junit4] 2> 6602 INFO (Replication Queue Initializer) [ ] o.a.h.h.s.b.BlockManager Number of blocks being written = 0
[junit4] 2> 6602 INFO (Replication Queue Initializer) [ ] o.a.h.h.StateChange STATE* Replication Queue initialization scan for invalid, over- and under-replicated blocks completed in 21 msec
[junit4] 2> 6704 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.n.NameNode NameNode RPC up at: localhost/127.0.0.1:42777
[junit4] 2> 6705 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.n.FSNamesystem Starting services required for active state
[junit4] 2> 6700 INFO (IPC Server Responder) [ ] o.a.h.i.Server IPC Server Responder: starting
[junit4] 2> 6701 INFO (IPC Server listener on 42777) [ ] o.a.h.i.Server IPC Server listener on 42777: starting
[junit4] 2> 6746 INFO (CacheReplicationMonitor(2046693306)) [ ] o.a.h.h.s.b.CacheReplicationMonitor Starting CacheReplicationMonitor with interval 30000 milliseconds
[junit4] 2> 6746 INFO (CacheReplicationMonitor(2046693306)) [ ] o.a.h.h.s.b.CacheReplicationMonitor Rescanning after 17298411960 milliseconds
[junit4] 2> 6747 INFO (CacheReplicationMonitor(2046693306)) [ ] o.a.h.h.s.b.CacheReplicationMonitor Scanned 0 directive(s) and 0 block(s) in 1 millisecond(s).
[junit4] 2> 6747 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.MiniDFSCluster Starting DataNode 0 with dfs.datanode.data.dir: [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data1,[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data2
[junit4] 2> 6883 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.m.i.MetricsSystemImpl DataNode metrics system started (again)
[junit4] 2> 6884 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.d.DataNode Configured hostname is 127.0.0.1
[junit4] 2> 6892 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.d.DataNode Starting DataNode with maxLockedMemory = 0
[junit4] 2> 6901 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.d.DataNode Opened streaming server at /127.0.0.1:36248
[junit4] 2> 6905 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.d.DataNode Balancing bandwith is 1048576 bytes/s
[junit4] 2> 6905 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.d.DataNode Number threads for balancing is 5
[junit4] 2> 6910 WARN (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 6912 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.HttpServer2 Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
[junit4] 2> 6912 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.HttpServer2 Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context datanode
[junit4] 2> 6912 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.HttpServer2 Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
[junit4] 2> 6912 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.HttpServer2 Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
[junit4] 2> 6918 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.HttpServer2 addJerseyResourcePackage: packageName=org.apache.hadoop.hdfs.server.datanode.web.resources;org.apache.hadoop.hdfs.web.resources, pathSpec=/webhdfs/v1/*
[junit4] 2> 6918 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.HttpServer2 Jetty bound to port 43088
[junit4] 2> 6918 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 6947 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_43088_datanode____o5xcc8/webapp
[junit4] 2> 7096 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
[junit4] 2> 7498 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43088
[junit4] 2> 7514 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.d.DataNode dnUserName = jenkins
[junit4] 2> 7514 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.d.DataNode supergroup = supergroup
[junit4] 2> 7560 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.i.CallQueueManager Using callQueue class java.util.concurrent.LinkedBlockingQueue
[junit4] 2> 7561 INFO (Socket Reader #1 for port 51911) [ ] o.a.h.i.Server Starting Socket Reader #1 for port 51911
[junit4] 2> 7569 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.d.DataNode Opened IPC server at /127.0.0.1:51911
[junit4] 2> 7589 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.d.DataNode Refresh request received for nameservices: null
[junit4] 2> 7603 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.d.DataNode Starting BPOfferServices for nameservices: <default>
[junit4] 2> 7640 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:42777) [ ] o.a.h.h.s.d.DataNode Block pool <registering> (Datanode Uuid unassigned) service to localhost/127.0.0.1:42777 starting to offer service
[junit4] 2> 7696 INFO (IPC Server Responder) [ ] o.a.h.i.Server IPC Server Responder: starting
[junit4] 2> 7701 INFO (IPC Server listener on 51911) [ ] o.a.h.i.Server IPC Server listener on 51911: starting
[junit4] 2> 7771 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.MiniDFSCluster Starting DataNode 1 with dfs.datanode.data.dir: [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data3,[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data4
[junit4] 2> 7966 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.m.i.MetricsSystemImpl DataNode metrics system started (again)
[junit4] 2> 7967 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.d.DataNode Configured hostname is 127.0.0.1
[junit4] 2> 7967 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.d.DataNode Starting DataNode with maxLockedMemory = 0
[junit4] 2> 7967 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.d.DataNode Opened streaming server at /127.0.0.1:36478
[junit4] 2> 7968 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.d.DataNode Balancing bandwith is 1048576 bytes/s
[junit4] 2> 7968 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.d.DataNode Number threads for balancing is 5
[junit4] 2> 7969 WARN (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 7971 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.HttpServer2 Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
[junit4] 2> 7971 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.HttpServer2 Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context datanode
[junit4] 2> 7971 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.HttpServer2 Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
[junit4] 2> 7971 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.HttpServer2 Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
[junit4] 2> 7972 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.HttpServer2 addJerseyResourcePackage: packageName=org.apache.hadoop.hdfs.server.datanode.web.resources;org.apache.hadoop.hdfs.web.resources, pathSpec=/webhdfs/v1/*
[junit4] 2> 7972 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.HttpServer2 Jetty bound to port 46965
[junit4] 2> 7972 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 8040 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_46965_datanode____.tmc55v/webapp
[junit4] 2> 8326 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
[junit4] 2> 8680 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:42777) [ ] o.a.h.h.s.c.Storage DataNode version: -56 and NameNode layout version: -60
[junit4] 2> 8693 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:42777) [ ] o.a.h.h.s.c.Storage Lock on /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data1/in_use.lock acquired by nodename 1460@lucene1-us-west
[junit4] 2> 8695 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:42777) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data1 is not formatted for BP-1013089143-10.41.0.5-1448838110672
[junit4] 2> 8712 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:42777) [ ] o.a.h.h.s.c.Storage Formatting ...
[junit4] 2> 8760 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:42777) [ ] o.a.h.h.s.c.Storage Lock on /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data2/in_use.lock acquired by nodename 1460@lucene1-us-west
[junit4] 2> 8761 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:42777) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data2 is not formatted for BP-1013089143-10.41.0.5-1448838110672
[junit4] 2> 8761 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:42777) [ ] o.a.h.h.s.c.Storage Formatting ...
[junit4] 2> 8780 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46965
[junit4] 2> 8781 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.d.DataNode dnUserName = jenkins
[junit4] 2> 8781 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.d.DataNode supergroup = supergroup
[junit4] 2> 8781 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.i.CallQueueManager Using callQueue class java.util.concurrent.LinkedBlockingQueue
[junit4] 2> 8798 INFO (Socket Reader #1 for port 33729) [ ] o.a.h.i.Server Starting Socket Reader #1 for port 33729
[junit4] 2> 8815 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.d.DataNode Opened IPC server at /127.0.0.1:33729
[junit4] 2> 8833 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.d.DataNode Refresh request received for nameservices: null
[junit4] 2> 8833 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[C7794755BD01335C]-worker) [ ] o.a.h.h.s.d.DataNode Starting BPOfferServices for nameservices: <default>
[junit4] 2> 8841 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:42777) [ ] o.a.h.h.s.d.DataNode Block pool <registering> (Datanode Uuid unassigned) service to localhost/127.0.0.1:42777 starting to offer service
[junit4] 2> 8851 INFO (IPC Server Responder) [ ] o.a.h.i.Server IPC Server Responder: starting
[junit4] 2> 8855 INFO (IPC Server listener on 33729) [ ] o.a.h.i.Server IPC Server listener on 33729: starting
[junit4] 2> 8930 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:42777) [ ] o.a.h.h.s.c.Storage DataNode version: -56 and NameNode layout version: -60
[junit4] 2> 8933 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:42777) [ ] o.a.h.h.s.c.Storage Analyzing storage directories for bpid BP-1013089143-10.41.0.5-1448838110672
[junit4] 2> 8933 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:42777) [ ] o.a.h.h.s.c.Storage Locking is disabled
[junit4] 2> 8935 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:42777) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data1/current/BP-1013089143-10.41.0.5-1448838110672 is not formatted.
[junit4] 2> 8935 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:42777) [ ] o.a.h.h.s.c.Storage Formatting ...
[junit4] 2> 8935 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:42777) [ ] o.a.h.h.s.c.Storage Formatting block pool BP-1013089143-10.41.0.5-1448838110672 directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data1/current/BP-1013089143-10.41.0.5-1448838110672/current
[junit4] 2> 8939 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:42777) [ ] o.a.h.h.s.c.Storage Lock on /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data3/in_use.lock acquired by nodename 1460@lucene1-us-west
[junit4] 2> 8939 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:42777) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data3 is not formatted for BP-1013089143-10.41.0.5-1448838110672
[junit4] 2> 8940 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:42777) [ ] o.a.h.h.s.c.Storage Formatting ...
[junit4] 2> 8942 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:42777) [ ] o.a.h.h.s.c.Storage Locking is disabled
[junit4] 2> 8943 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:42777) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data2/current/BP-1013089143-10.41.0.5-1448838110672 is not formatted.
[junit4] 2> 8943 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:42777) [ ] o.a.h.h.s.c.Storage Formatting ...
[junit4] 2> 8943 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:42777) [ ] o.a.h.h.s.c.Storage Formatting block pool BP-1013089143-10.41.0.5-1448838110672 directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data2/current/BP-1013089143-10.41.0.5-1448838110672/current
[junit4] 2> 8945 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:42777) [ ] o.a.h.h.s.c.Storage Lock on /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data4/in_use.lock acquired by nodename 1460@lucene1-us-west
[junit4] 2> 8946 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:42777) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data4 is not formatted for BP-1013089143-10.41.0.5-1448838110672
[junit4] 2> 8947 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:42777) [ ] o.a.h.h.s.c.Storage Formatting ...
[junit4] 2> 8948 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:42777) [ ] o.a.h.h.s.c.Storage Restored 0 block files from trash.
[junit4] 2> 8948 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:42777) [ ] o.a.h.h.s.c.Storage Restored 0 block files from trash.
[junit4] 2> 8962 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:42777) [ ] o.a.h.h.s.d.DataNode Setting up storage: nsid=698522968;bpid=BP-1013089143-10.41.0.5-1448838110672;lv=-56;nsInfo=lv=-60;cid=testClusterID;nsid=698522968;c=0;bpid=BP-1013089143-10.41.0.5-1448838110672;dnuuid=null
[junit4] 2> 8967 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:42777) [ ] o.a.h.h.s.d.DataNode Generated and persisted new Datanode UUID 290d5820-6ee2-4fe4-bb8e-f375cd91dc15
[junit4] 2> 9121 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:42777) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Added new volume: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data1/current
[junit4] 2> 9123 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:42777) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Added volume - /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data1/current, StorageType: DISK
[junit4] 2> 9124 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:42777) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Added new volume: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data2/current
[junit4] 2> 9135 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:42777) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Added volume - /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data2/current, StorageType: DISK
[junit4] 2> 9156 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:42777) [ ] o.a.h.h.s.c.Storage Analyzing storage directories for bpid BP-1013089143-10.41.0.5-1448838110672
[junit4] 2> 9156 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:42777) [ ] o.a.h.h.s.c.Storage Locking is disabled
[junit4] 2> 9157 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:42777) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data3/current/BP-1013089143-10.41.0.5-1448838110672 is not formatted.
[junit4] 2> 9157 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:42777) [ ] o.a.h.h.s.c.Storage Formatting ...
[junit4] 2> 9157 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:42777) [ ] o.a.h.h.s.c.Storage Formatting block pool BP-1013089143-10.41.0.5-1448838110672 directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data3/current/BP-1013089143-10.41.0.5-1448838110672/current
[junit4] 2> 9161 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:42777) [ ] o.a.h.h.s.c.Storage Locking is disabled
[junit4] 2> 9162 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:42777) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data4/current/BP-1013089143-10.41.0.5-1448838110672 is not formatted.
[junit4] 2> 9162 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:42777) [ ] o.a.h.h.s.c.Storage Formatting ...
[junit4] 2> 9162 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:42777) [ ] o.a.h.h.s.c.Storage Formatting block pool BP-1013089143-10.41.0.5-1448838110672 directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data4/current/BP-1013089143-10.41.0.5-1448838110672/current
[junit4] 2> 9165 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:42777) [ ] o.a.h.h.s.c.Storage Restored 0 block files from trash.
[junit4] 2> 9165 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:42777) [ ] o.a.h.h.s.c.Storage Restored 0 block files from trash.
[junit4] 2> 9176 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:42777) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Registered FSDatasetState MBean
[junit4] 2> 9178 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:42777) [ ] o.a.h.h.s.d.DataNode Setting up storage: nsid=698522968;bpid=BP-1013089143-10.41.0.5-1448838110672;lv=-56;nsInfo=lv=-60;cid=testClusterID;nsid=698522968;c=0;bpid=BP-1013089143-10.41.0.5-1448838110672;dnuuid=null
[junit4] 2> 9182 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:42777) [ ] o.a.h.h.s.d.DataNode Generated and persisted new Datanode UUID 457ed1af-f8f5-4b9a-8062-f99029a54e1b
[junit4] 2> 9183 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:42777) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Added new volume: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data3/current
[junit4] 2> 9194 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:42777) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Added volume - /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data3/current, StorageType: DISK
[junit4] 2> 9195 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:42777) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Added new volume: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data4/current
[junit4] 2> 9195 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_C7794755BD01335C-001/tempDir-002/hdfs/build/dfs/data/data3
[...truncated too long message...]
ndby state
[junit4] 2> 106250 INFO (SUITE-MorphlineGoLiveMiniMRTest-seed#[C7794755BD01335C]-worker) [n:127.0.0.1:58285_d_ c:collection1 s:shard1 r:core_node5 x:collection1] o.m.log Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0
[junit4] 2> 106352 INFO (SUITE-MorphlineGoLiveMiniMRTest-seed#[C7794755BD01335C]-worker) [n:127.0.0.1:58285_d_ c:collection1 s:shard1 r:core_node5 x:collection1] o.a.h.m.i.MetricsSystemImpl Stopping JobHistoryServer metrics system...
[junit4] 2> 106354 ERROR (SUITE-MorphlineGoLiveMiniMRTest-seed#[C7794755BD01335C]-worker) [n:127.0.0.1:58285_d_ c:collection1 s:shard1 r:core_node5 x:collection1] o.a.h.m.l.MethodMetric Error invoking method getBlocksTotal
[junit4] 2> java.lang.reflect.InvocationTargetException
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:497)
[junit4] 2> at org.apache.hadoop.metrics2.lib.MethodMetric$2.snapshot(MethodMetric.java:111)
[junit4] 2> at org.apache.hadoop.metrics2.lib.MethodMetric.snapshot(MethodMetric.java:144)
[junit4] 2> at org.apache.hadoop.metrics2.lib.MetricsRegistry.snapshot(MetricsRegistry.java:387)
[junit4] 2> at org.apache.hadoop.metrics2.lib.MetricsSourceBuilder$1.getMetrics(MetricsSourceBuilder.java:79)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.getMetrics(MetricsSourceAdapter.java:195)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.updateJmxCache(MetricsSourceAdapter.java:172)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.getMBeanInfo(MetricsSourceAdapter.java:151)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getClassName(DefaultMBeanServerInterceptor.java:1804)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.safeGetClassName(DefaultMBeanServerInterceptor.java:1595)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.checkMBeanPermission(DefaultMBeanServerInterceptor.java:1813)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.exclusiveUnregisterMBean(DefaultMBeanServerInterceptor.java:430)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.unregisterMBean(DefaultMBeanServerInterceptor.java:415)
[junit4] 2> at com.sun.jmx.mbeanserver.JmxMBeanServer.unregisterMBean(JmxMBeanServer.java:546)
[junit4] 2> at org.apache.hadoop.metrics2.util.MBeans.unregister(MBeans.java:81)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stopMBeans(MetricsSourceAdapter.java:227)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stop(MetricsSourceAdapter.java:212)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stopSources(MetricsSystemImpl.java:461)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stop(MetricsSystemImpl.java:212)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.shutdown(MetricsSystemImpl.java:592)
[junit4] 2> at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdownInstance(DefaultMetricsSystem.java:72)
[junit4] 2> at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdown(DefaultMetricsSystem.java:68)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.metrics.NameNodeMetrics.shutdown(NameNodeMetrics.java:145)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.NameNode.stop(NameNode.java:822)
[junit4] 2> at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1720)
[junit4] 2> at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1699)
[junit4] 2> at org.apache.solr.hadoop.MorphlineGoLiveMiniMRTest.teardownClass(MorphlineGoLiveMiniMRTest.java:236)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:497)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:834)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> Caused by: java.lang.NullPointerException
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlocksMap.size(BlocksMap.java:198)
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.getTotalBlocks(BlockManager.java:3291)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlocksTotal(FSNamesystem.java:6223)
[junit4] 2> ... 53 more
[junit4] 2> 106370 INFO (SUITE-MorphlineGoLiveMiniMRTest-seed#[C7794755BD01335C]-worker) [n:127.0.0.1:58285_d_ c:collection1 s:shard1 r:core_node5 x:collection1] o.a.h.m.i.MetricsSystemImpl JobHistoryServer metrics system stopped.
[junit4] 2> 106370 INFO (SUITE-MorphlineGoLiveMiniMRTest-seed#[C7794755BD01335C]-worker) [n:127.0.0.1:58285_d_ c:collection1 s:shard1 r:core_node5 x:collection1] o.a.h.m.i.MetricsSystemImpl JobHistoryServer metrics system shutdown complete.
[junit4] 2> 106374 INFO (SUITE-MorphlineGoLiveMiniMRTest-seed#[C7794755BD01335C]-worker) [n:127.0.0.1:58285_d_ c:collection1 s:shard1 r:core_node5 x:collection1] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J1/temp/solr.hadoop.MorphlineGoLiveMiniMRTest_C7794755BD01335C-001
[junit4] 2> NOTE: test params are: codec=CheapBastard, sim=RandomSimilarityProvider(queryNorm=false,coord=yes): {}, locale=vi_VN, timezone=Europe/Tiraspol
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_66 (64-bit)/cpus=4,threads=9,free=165137024,total=337641472
[junit4] 2> NOTE: All tests run in this JVM: [MorphlineReducerTest, MorphlineGoLiveMiniMRTest]
[junit4] Completed [7/7] on J1 in 107.12s, 2 tests, 1 error <<< FAILURES!
[...truncated 13 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:253: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:457: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987: There were test failures: 7 suites, 35 tests, 1 suite-level error, 2 errors, 1 ignored [seed: C7794755BD01335C]
Total time: 241 minutes 25 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 866 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/866/
2 tests failed.
FAILED: org.apache.lucene.search.TestDimensionalRangeQuery.testRandomLongsBig
Error Message:
Test abandoned because suite timeout was reached.
Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
at __randomizedtesting.SeedInfo.seed([917F7B8A4974424D]:0)
FAILED: junit.framework.TestSuite.org.apache.lucene.search.TestDimensionalRangeQuery
Error Message:
Suite timeout exceeded (>= 7200000 msec).
Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
at __randomizedtesting.SeedInfo.seed([917F7B8A4974424D]:0)
Build Log:
[...truncated 1779 lines...]
[junit4] Suite: org.apache.lucene.search.TestDimensionalRangeQuery
[junit4] 2> nov 29, 2015 5:32:36 AM com.carrotsearch.randomizedtesting.ThreadLeakControl$2 evaluate
[junit4] 2> WARNING: Suite execution timed out: org.apache.lucene.search.TestDimensionalRangeQuery
[junit4] 2> 1) Thread[id=9, name=JUnit4-serializer-daemon, state=TIMED_WAITING, group=main]
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at com.carrotsearch.ant.tasks.junit4.events.Serializer$1.run(Serializer.java:47)
[junit4] 2> 2) Thread[id=8314, name=TEST-TestDimensionalRangeQuery.testRandomLongsBig-seed#[917F7B8A4974424D], state=RUNNABLE, group=TGRP-TestDimensionalRangeQuery]
[junit4] 2> at java.lang.Throwable.fillInStackTrace(Native Method)
[junit4] 2> at java.lang.Throwable.fillInStackTrace(Throwable.java:783)
[junit4] 2> at java.lang.Throwable.<init>(Throwable.java:250)
[junit4] 2> at java.lang.Exception.<init>(Exception.java:54)
[junit4] 2> at java.lang.RuntimeException.<init>(RuntimeException.java:51)
[junit4] 2> at java.lang.UnsupportedOperationException.<init>(UnsupportedOperationException.java:42)
[junit4] 2> at org.apache.lucene.codecs.DocValuesConsumer$1$1.remove(DocValuesConsumer.java:274)
[junit4] 2> at org.apache.lucene.util.TestUtil.checkIterator(TestUtil.java:162)
[junit4] 2> at org.apache.lucene.codecs.asserting.AssertingDocValuesFormat$AssertingDocValuesConsumer.addNumericField(AssertingDocValuesFormat.java:88)
[junit4] 2> at org.apache.lucene.codecs.perfield.PerFieldDocValuesFormat$FieldsWriter.addNumericField(PerFieldDocValuesFormat.java:111)
[junit4] 2> at org.apache.lucene.codecs.DocValuesConsumer.mergeNumericField(DocValuesConsumer.java:252)
[junit4] 2> at org.apache.lucene.codecs.DocValuesConsumer.merge(DocValuesConsumer.java:163)
[junit4] 2> at org.apache.lucene.index.SegmentMerger.mergeDocValues(SegmentMerger.java:162)
[junit4] 2> at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:106)
[junit4] 2> at org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4062)
[junit4] 2> at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3642)
[junit4] 2> at org.apache.lucene.index.SerialMergeScheduler.merge(SerialMergeScheduler.java:40)
[junit4] 2> at org.apache.lucene.index.IndexWriter.maybeMerge(IndexWriter.java:1917)
[junit4] 2> at org.apache.lucene.index.IndexWriter.doAfterSegmentFlushed(IndexWriter.java:4706)
[junit4] 2> at org.apache.lucene.index.DocumentsWriter$MergePendingEvent.process(DocumentsWriter.java:689)
[junit4] 2> at org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:4737)
[junit4] 2> at org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:4728)
[junit4] 2> at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1464)
[junit4] 2> at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1242)
[junit4] 2> at org.apache.lucene.index.RandomIndexWriter.addDocument(RandomIndexWriter.java:170)
[junit4] 2> at org.apache.lucene.search.TestDimensionalRangeQuery.verifyLongs(TestDimensionalRangeQuery.java:206)
[junit4] 2> at org.apache.lucene.search.TestDimensionalRangeQuery.doTestRandomLongs(TestDimensionalRangeQuery.java:145)
[junit4] 2> at org.apache.lucene.search.TestDimensionalRangeQuery.testRandomLongsBig(TestDimensionalRangeQuery.java:112)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:497)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
[junit4] 2> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4] 2> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 3) Thread[id=1, name=main, state=WAITING, group=main]
[junit4] 2> at java.lang.Object.wait(Native Method)
[junit4] 2> at java.lang.Thread.join(Thread.java:1245)
[junit4] 2> at java.lang.Thread.join(Thread.java:1319)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:601)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.run(RandomizedRunner.java:450)
[junit4] 2> at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.execute(SlaveMain.java:244)
[junit4] 2> at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.main(SlaveMain.java:355)
[junit4] 2> at com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe.main(SlaveMainSafe.java:10)
[junit4] 2> 4) Thread[id=8313, name=SUITE-TestDimensionalRangeQuery-seed#[917F7B8A4974424D], state=RUNNABLE, group=TGRP-TestDimensionalRangeQuery]
[junit4] 2> at java.lang.Thread.getStackTrace(Thread.java:1552)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$4.run(ThreadLeakControl.java:688)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$4.run(ThreadLeakControl.java:685)
[junit4] 2> at java.security.AccessController.doPrivileged(Native Method)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.getStackTrace(ThreadLeakControl.java:685)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.getThreadsWithTraces(ThreadLeakControl.java:701)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.formatThreadStacksFull(ThreadLeakControl.java:681)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.access$1000(ThreadLeakControl.java:64)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$2.evaluate(ThreadLeakControl.java:414)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:681)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.access$200(RandomizedRunner.java:140)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:591)
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestDimensionalRangeQuery -Dtests.method=testRandomLongsBig -Dtests.seed=917F7B8A4974424D -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=es_PR -Dtests.timezone=Asia/Qyzylorda -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[junit4] ERROR 6993s J0 | TestDimensionalRangeQuery.testRandomLongsBig <<<
[junit4] > Throwable #1: java.lang.Exception: Test abandoned because suite timeout was reached.
[junit4] > at __randomizedtesting.SeedInfo.seed([917F7B8A4974424D]:0)
[junit4] 2> nov 29, 2015 5:32:36 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> nov 29, 2015 5:32:56 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> SEVERE: 1 thread leaked from SUITE scope at org.apache.lucene.search.TestDimensionalRangeQuery:
[junit4] 2> 1) Thread[id=8314, name=TEST-TestDimensionalRangeQuery.testRandomLongsBig-seed#[917F7B8A4974424D], state=RUNNABLE, group=TGRP-TestDimensionalRangeQuery]
[junit4] 2> at java.lang.Throwable.fillInStackTrace(Native Method)
[junit4] 2> at java.lang.Throwable.fillInStackTrace(Throwable.java:783)
[junit4] 2> at java.lang.Throwable.<init>(Throwable.java:250)
[junit4] 2> at java.lang.Exception.<init>(Exception.java:54)
[junit4] 2> at java.lang.RuntimeException.<init>(RuntimeException.java:51)
[junit4] 2> at java.lang.UnsupportedOperationException.<init>(UnsupportedOperationException.java:42)
[junit4] 2> at org.apache.lucene.codecs.DocValuesConsumer$1$1.remove(DocValuesConsumer.java:274)
[junit4] 2> at org.apache.lucene.util.TestUtil.checkIterator(TestUtil.java:162)
[junit4] 2> at org.apache.lucene.codecs.asserting.AssertingDocValuesFormat$AssertingDocValuesConsumer.addNumericField(AssertingDocValuesFormat.java:88)
[junit4] 2> at org.apache.lucene.codecs.perfield.PerFieldDocValuesFormat$FieldsWriter.addNumericField(PerFieldDocValuesFormat.java:111)
[junit4] 2> at org.apache.lucene.codecs.DocValuesConsumer.mergeNumericField(DocValuesConsumer.java:252)
[junit4] 2> at org.apache.lucene.codecs.DocValuesConsumer.merge(DocValuesConsumer.java:163)
[junit4] 2> at org.apache.lucene.index.SegmentMerger.mergeDocValues(SegmentMerger.java:162)
[junit4] 2> at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:106)
[junit4] 2> at org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4062)
[junit4] 2> at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3642)
[junit4] 2> at org.apache.lucene.index.SerialMergeScheduler.merge(SerialMergeScheduler.java:40)
[junit4] 2> at org.apache.lucene.index.IndexWriter.maybeMerge(IndexWriter.java:1917)
[junit4] 2> at org.apache.lucene.index.IndexWriter.doAfterSegmentFlushed(IndexWriter.java:4706)
[junit4] 2> at org.apache.lucene.index.DocumentsWriter$MergePendingEvent.process(DocumentsWriter.java:689)
[junit4] 2> at org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:4737)
[junit4] 2> at org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:4728)
[junit4] 2> at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1464)
[junit4] 2> at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1242)
[junit4] 2> at org.apache.lucene.index.RandomIndexWriter.addDocument(RandomIndexWriter.java:170)
[junit4] 2> at org.apache.lucene.search.TestDimensionalRangeQuery.verifyLongs(TestDimensionalRangeQuery.java:206)
[junit4] 2> at org.apache.lucene.search.TestDimensionalRangeQuery.doTestRandomLongs(TestDimensionalRangeQuery.java:145)
[junit4] 2> at org.apache.lucene.search.TestDimensionalRangeQuery.testRandomLongsBig(TestDimensionalRangeQuery.java:112)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:497)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
[junit4] 2> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4] 2> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> nov 29, 2015 5:32:56 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> INFO: Starting to interrupt leaked threads:
[junit4] 2> 1) Thread[id=8314, name=TEST-TestDimensionalRangeQuery.testRandomLongsBig-seed#[917F7B8A4974424D], state=RUNNABLE, group=TGRP-TestDimensionalRangeQuery]
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/core/test/J0/temp/lucene.search.TestDimensionalRangeQuery_917F7B8A4974424D-001
[junit4] 2> Nov 28, 2015 11:32:57 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> INFO: All leaked threads terminated.
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene60): {id=BlockTreeOrds(blocksize=128)}, docValues:{id=DocValuesFormat(name=Asserting), value=DocValuesFormat(name=Direct)}, sim=ClassicSimilarity, locale=es_PR, timezone=Asia/Qyzylorda
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_66 (64-bit)/cpus=4,threads=1,free=253681832,total=501219328
[junit4] 2> NOTE: All tests run in this JVM: [MultiCollectorTest, FuzzyTermOnShortTermsTest, TestDeterminizeLexicon, TestSimpleFSLockFactory, TestMultiPhraseQuery, TestNoDeletionPolicy, TestSortedSetSelector, TestSpanMultiTermQueryWrapper, TestLucene54DocValuesFormat, TestVersion, TestMinimize, TestNoMergePolicy, TestInPlaceMergeSorter, TestTermVectorsWriter, TestLucene50CompoundFormat, TestBlockPostingsFormat2, TestCrash, TestSingleInstanceLockFactory, TestMultiLevelSkipList, TestLucene50StoredFieldsFormatHighCompression, TestBinaryDocument, TestLucene50StoredFieldsFormat, TestParallelTermEnum, TestSleepingLockWrapper, TestDeletionPolicy, TestPositiveScoresOnlyCollector, TestFieldValueQuery, TestSpanNearQuery, TestUniqueTermCount, TestLSBRadixSorter, TestParallelCompositeReader, TestTermsEnum, TestIndexWriterExceptions2, TestSortRandom, Test2BNumericDocValues, TestFieldType, TestByteBlockPool, TestSearcherManager, TestRollingBuffer, TestDoc, TestThreadedForceMerge, TestApproximationSearchEquivalence, TestExitableDirectoryReader, TestIndexWriterLockRelease, TestUnicodeUtil, TestIndexWriter, TestCustomNorms, TestPrefixRandom, TestSpanContainQuery, TestQueryBuilder, TestDocValuesIndexing, TestScoreCachingWrappingScorer, TestVirtualMethod, TestIndexWriterUnicode, TestFilterIterator, TestIndexReaderClose, TestLockFactory, TestTermRangeQuery, TestMultiValuedNumericRangeQuery, TestBlockPostingsFormat, TestPagedBytes, TestMatchNoDocsQuery, TestAttributeSource, TestFixedBitSet, TestIndexWriterForceMerge, TestSortedNumericSortField, TestPositionIncrement, TestIndexWriterWithThreads, TestNumericRangeQuery32, TestShardSearching, TestMultiMMap, TestBasics, TestIndexWriterDelete, TestIndexWriterMergePolicy, TestPersistentSnapshotDeletionPolicy, TestAtomicUpdate, TestStressAdvance, TestIndexWriterCommit, TestTimeLimitingCollector, TestHighCompressionMode, TestNeverDelete, TestTopDocsMerge, TestRollingUpdates, TestSnapshotDeletionPolicy, TestNRTReaderWithThreads, TestPerFieldPostingsFormat, TestConsistentFieldNumbers, TestWeakIdentityMap, TestDirectoryReader, TestSegmentMerger, TestPhraseQuery, TestBagOfPositions, TestRegexpRandom2, TestToken, TestFieldsReader, TestBooleanMinShouldMatch, TestTermsEnum2, TestNumericUtils, TestIndexWriterOnDiskFull, TestCodecHoldsOpenFiles, TestReaderClosed, TestDocBoost, TestIntsRef, TestSimpleAttributeImpl, TestTermdocPerf, TestIndexCommit, TestTerm, Test2BTerms, TestNewestSegment, Test2BPagedBytes, TestForUtil, TestLucene50SegmentInfoFormat, TestLucene50TermVectorsFormat, TestLucene53NormsFormat, TestExceedMaxTermLength, TestFieldReuse, TestFilterDirectoryReader, TestIndexWriterDeleteByQuery, TestIndexWriterFromReader, TestIndexWriterMaxDocs, TestIndexWriterOnVMError, TestDimensionalRangeQuery]
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestDimensionalRangeQuery -Dtests.seed=917F7B8A4974424D -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=es_PR -Dtests.timezone=Asia/Qyzylorda -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[junit4] ERROR 0.00s J0 | TestDimensionalRangeQuery (suite) <<<
[junit4] > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
[junit4] > at __randomizedtesting.SeedInfo.seed([917F7B8A4974424D]:0)
[junit4] Completed [401/401] on J0 in 7220.21s, 13 tests, 2 errors <<< FAILURES!
[...truncated 12 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build.xml:50: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987: There were test failures: 401 suites (1 ignored), 3301 tests, 1 suite-level error, 1 error, 28 ignored (24 assumptions) [seed: 917F7B8A4974424D]
Total time: 165 minutes 8 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 865 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/865/
All tests passed
Build Log:
[...truncated 10505 lines...]
[junit4] JVM J0: stdout was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/temp/junit4-J0-20151128_021352_874.sysout
[junit4] >>> JVM J0: stdout (verbatim) ----
[junit4] java.lang.OutOfMemoryError: GC overhead limit exceeded
[junit4] Dumping heap to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/heapdumps/java_pid18126.hprof ...
[junit4] Heap dump file created [680742281 bytes in 5.994 secs]
[junit4] <<< JVM J0: EOF ----
[junit4] JVM J0: stderr was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/temp/junit4-J0-20151128_021352_874.syserr
[junit4] >>> JVM J0: stderr (verbatim) ----
[junit4]
[junit4] Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "RecoveryThread-awholynewstresscollection_collection0_0_shard1_replica2"
[junit4]
[junit4] Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "collection0"
[junit4]
[junit4] Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "collection4"
[junit4] WARN: Unhandled exception in event serialization. -> java.lang.OutOfMemoryError: GC overhead limit exceeded
[junit4] <<< JVM J0: EOF ----
[...truncated 1058 lines...]
[junit4] ERROR: JVM J0 ended with an exception, command line: /x1/jenkins/jenkins-slave/tools/hudson.model.JDK/latest1.8/jre/bin/java -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/heapdumps -ea -esa -Dtests.prefix=tests -Dtests.seed=62ABDD368D1EB562 -Xmx512M -Dtests.iters= -Dtests.verbose=false -Dtests.infostream=false -Dtests.codec=random -Dtests.postingsformat=random -Dtests.docvaluesformat=random -Dtests.locale=random -Dtests.timezone=random -Dtests.directory=random -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.luceneMatchVersion=6.0.0 -Dtests.cleanthreads=perClass -Djava.util.logging.config.file=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/tools/junit4/logging.properties -Dtests.nightly=true -Dtests.weekly=false -Dtests.monster=false -Dtests.slow=true -Dtests.asserts=true -Dtests.multiplier=2 -DtempDir=./temp -Djava.io.tmpdir=./temp -Djunit4.tempDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/temp -Dcommon.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene -Dclover.db.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/clover/db -Djava.security.policy=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/tools/junit4/solr-tests.policy -Dtests.LUCENE_VERSION=6.0.0 -Djetty.testMode=1 -Djetty.insecurerandom=1 -Dsolr.directoryFactory=org.apache.solr.core.MockDirectoryFactory -Djava.awt.headless=true -Djdk.map.althashing.threshold=0 -Djunit4.childvm.cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0 -Djunit4.childvm.id=0 -Djunit4.childvm.count=3 -Dtests.leaveTemporary=false -Dtests.filterstacks=true -Djava.security.manager=org.apache.lucene.util.TestSecurityManager -Dfile.encoding=UTF-8 -classpath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/classes/test:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-test-framework/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/test-framework/lib/junit4-ant-2.3.1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/test-framework/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/codecs/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-solrj/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/analysis/common/lucene-analyzers-common-6.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/analysis/kuromoji/lucene-analyzers-kuromoji-6.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/analysis/phonetic/lucene-analyzers-phonetic-6.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/codecs/lucene-codecs-6.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/backward-codecs/lucene-backward-codecs-6.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/highlighter/lucene-highlighter-6.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/memory/lucene-memory-6.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/misc/lucene-misc-6.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/spatial/lucene-spatial-6.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/expressions/lucene-expressions-6.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/suggest/lucene-suggest-6.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/grouping/lucene-grouping-6.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/queries/lucene-queries-6.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/queryparser/lucene-queryparser-6.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/join/lucene-join-6.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/sandbox/lucene-sandbox-6.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/antlr4-runtime-4.5.1-1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/asm-5.0.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/asm-commons-5.0.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/caffeine-1.0.1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/commons-cli-1.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/commons-codec-1.10.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/commons-collections-3.2.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/commons-configuration-1.6.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/commons-exec-1.3.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/commons-fileupload-1.2.1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/commons-lang-2.6.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/dom4j-1.6.1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/guava-14.0.1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/hadoop-annotations-2.6.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/hadoop-auth-2.6.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/hadoop-common-2.6.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/hadoop-hdfs-2.6.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/hppc-0.7.1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/htrace-core-3.0.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/jackson-core-2.5.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/jackson-dataformat-smile-2.5.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/joda-time-2.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/log4j-1.2.17.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/org.restlet-2.3.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/org.restlet.ext.servlet-2.3.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/presto-parser-0.122.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/protobuf-java-2.5.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/slf4j-log4j12-1.7.7.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/slice-0.10.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/spatial4j-0.5.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/t-digest-3.1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/solrj/lib/commons-io-2.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/solrj/lib/httpclient-4.4.1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/solrj/lib/httpcore-4.4.1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/solrj/lib/httpmime-4.4.1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/solrj/lib/noggit-0.6.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/solrj/lib/slf4j-api-1.7.7.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/solrj/lib/stax2-api-3.1.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/solrj/lib/woodstox-core-asl-4.4.1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/solrj/lib/zookeeper-3.4.6.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/server/lib/javax.servlet-api-3.1.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/server/lib/jetty-continuation-9.2.13.v20150730.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/server/lib/jetty-deploy-9.2.13.v20150730.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/server/lib/jetty-http-9.2.13.v20150730.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/server/lib/jetty-io-9.2.13.v20150730.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/server/lib/jetty-jmx-9.2.13.v20150730.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/server/lib/jetty-rewrite-9.2.13.v20150730.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/server/lib/jetty-security-9.2.13.v20150730.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/server/lib/jetty-server-9.2.13.v20150730.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/server/lib/jetty-servlet-9.2.13.v20150730.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/server/lib/jetty-servlets-9.2.13.v20150730.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/server/lib/jetty-util-9.2.13.v20150730.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/server/lib/jetty-webapp-9.2.13.v20150730.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/server/lib/jetty-xml-9.2.13.v20150730.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/example/example-DIH/solr/db/lib/derby-10.9.1.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/example/example-DIH/solr/db/lib/hsqldb-1.8.0.10.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/core/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/test-framework/lib/junit-4.10.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/test-framework/lib/randomizedtesting-runner-2.3.1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/antlr-2.7.7.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/antlr4-runtime-4.5.1-1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-core-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-core-api-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-core-avl-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-core-shared-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-i18n-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptor-kerberos-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-admin-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-authn-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-authz-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-changelog-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-collective-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-event-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-exception-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-journal-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-normalization-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-operational-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-referral-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-schema-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-subtree-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-trigger-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-jdbm-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-jdbm1-2.0.0-M2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-kerberos-codec-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-ldif-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-mavibot-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-protocol-kerberos-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-protocol-ldap-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-protocol-shared-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-xdbm-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/api-all-1.0.0-M20.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/bcprov-jdk15-1.45.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/cglib-nodep-2.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/commons-collections-3.2.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/commons-math3-3.4.1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/easymock-3.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/ehcache-core-2.4.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/hadoop-common-2.6.0-tests.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/hadoop-hdfs-2.6.0-tests.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/hadoop-minikdc-2.6.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/jackson-annotations-2.5.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/jackson-databind-2.5.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/jcl-over-slf4j-1.7.7.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/jersey-core-1.9.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/jersey-server-1.9.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/jetty-6.1.26.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/jetty-util-6.1.26.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/mina-core-2.0.0-M5.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/objenesis-1.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/presto-parser-0.122.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/slice-0.10.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/analysis/icu/lucene-analyzers-icu-6.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-analysis-extras/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/contrib/analysis-extras/lib/icu4j-54.1.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-launcher.jar:/x1/jenkins/.ant/lib/ivy-2.3.0.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-antlr.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-regexp.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-resolver.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-commons-net.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jmf.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-oro.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-xalan2.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-commons-logging.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jsch.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-junit4.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-javamail.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jai.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jdepend.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-junit.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-bsf.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-swing.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-netrexx.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-bcel.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-testutil.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-log4j.jar:/x1/jenkins/jenkins-slave/tools/hudson.model.JDK/latest1.8/lib/tools.jar:/x1/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.3.1.jar com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe -eventsfile /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/temp/junit4-J0-20151128_021352_874.events @/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/temp/junit4-J0-20151128_021352_874.suites -stdin
[junit4] ERROR: JVM J0 ended with an exception: Quit event not received from the forked process? This may indicate JVM crash or runner bugs.
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4.executeSlave(JUnit4.java:1503)
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4.access$000(JUnit4.java:130)
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:963)
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:960)
[junit4] at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] at java.lang.Thread.run(Thread.java:745)
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987: At least one slave process threw an exception, first: Quit event not received from the forked process? This may indicate JVM crash or runner bugs.
Total time: 223 minutes 55 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 864 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/864/
1 tests failed.
FAILED: org.apache.solr.handler.TestReplicationHandler.doTestStressReplication
Error Message:
timed out waiting for collection1 startAt time to exceed: Thu Nov 26 10:31:56 ART 2015
Stack Trace:
java.lang.AssertionError: timed out waiting for collection1 startAt time to exceed: Thu Nov 26 10:31:56 ART 2015
at __randomizedtesting.SeedInfo.seed([A5CD47800916B7F7:7E6647460C3EDE44]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.handler.TestReplicationHandler.watchCoreStartAt(TestReplicationHandler.java:1415)
at org.apache.solr.handler.TestReplicationHandler.doTestStressReplication(TestReplicationHandler.java:767)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 10733 lines...]
[junit4] JVM J2: stdout was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/temp/junit4-J2-20151126_125439_974.sysout
[junit4] >>> JVM J2: stdout (verbatim) ----
[junit4] java.lang.OutOfMemoryError: GC overhead limit exceeded
[junit4] Dumping heap to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/heapdumps/java_pid24522.hprof ...
[junit4] Heap dump file created [605623924 bytes in 7.082 secs]
[junit4] <<< JVM J2: EOF ----
[junit4] JVM J2: stderr was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/temp/junit4-J2-20151126_125439_974.syserr
[junit4] >>> JVM J2: stderr (verbatim) ----
[junit4] WARN: Unhandled exception in event serialization. -> java.lang.OutOfMemoryError: GC overhead limit exceeded
[junit4] at java.nio.CharBuffer.wrap(CharBuffer.java:373)
[junit4] at sun.nio.cs.StreamEncoder.implWrite(StreamEncoder.java:265)
[junit4] at sun.nio.cs.StreamEncoder.write(StreamEncoder.java:125)
[junit4] at sun.nio.cs.StreamEncoder.write(StreamEncoder.java:135)
[junit4] at java.io.OutputStreamWriter.write(OutputStreamWriter.java:220)
[junit4] at java.io.Writer.write(Writer.java:157)
[junit4] at com.carrotsearch.ant.tasks.junit4.gson.stream.JsonWriter.close(JsonWriter.java:344)
[junit4] at com.carrotsearch.ant.tasks.junit4.gson.stream.JsonWriter.endObject(JsonWriter.java:312)
[junit4] at com.carrotsearch.ant.tasks.junit4.events.AppendStdErrEvent.serialize(AppendStdErrEvent.java:31)
[junit4] at com.carrotsearch.ant.tasks.junit4.events.Serializer$2.run(Serializer.java:101)
[junit4] at com.carrotsearch.ant.tasks.junit4.events.Serializer$2.run(Serializer.java:96)
[junit4] at java.security.AccessController.doPrivileged(Native Method)
[junit4] at com.carrotsearch.ant.tasks.junit4.events.Serializer.flushQueue(Serializer.java:96)
[junit4] at com.carrotsearch.ant.tasks.junit4.events.Serializer.serialize(Serializer.java:81)
[junit4] at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain$3$2.write(SlaveMain.java:457)
[junit4] at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
[junit4] at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140)
[junit4] at java.io.PrintStream.flush(PrintStream.java:338)
[junit4] at java.io.FilterOutputStream.flush(FilterOutputStream.java:140)
[junit4] at java.io.PrintStream.write(PrintStream.java:482)
[junit4] at sun.nio.cs.StreamEncoder.writeBytes(StreamEncoder.java:221)
[junit4] at sun.nio.cs.StreamEncoder.implFlushBuffer(StreamEncoder.java:291)
[junit4] at sun.nio.cs.StreamEncoder.implFlush(StreamEncoder.java:295)
[junit4] at sun.nio.cs.StreamEncoder.flush(StreamEncoder.java:141)
[junit4] at java.io.OutputStreamWriter.flush(OutputStreamWriter.java:229)
[junit4] at org.apache.log4j.helpers.QuietWriter.flush(QuietWriter.java:59)
[junit4] at org.apache.log4j.WriterAppender.subAppend(WriterAppender.java:324)
[junit4] at org.apache.log4j.WriterAppender.append(WriterAppender.java:162)
[junit4] at org.apache.log4j.AppenderSkeleton.doAppend(AppenderSkeleton.java:251)
[junit4] at org.apache.log4j.helpers.AppenderAttachableImpl.appendLoopOnAppenders(AppenderAttachableImpl.java:66)
[junit4] at org.apache.log4j.Category.callAppenders(Category.java:206)
[junit4] at org.apache.log4j.Category.forcedLog(Category.java:391)
[junit4] <<< JVM J2: EOF ----
[...truncated 98 lines...]
[junit4] Suite: org.apache.solr.handler.TestReplicationHandler
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/init-core-data-001
[junit4] 2> 1767838 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testRateLimitedReplication
[junit4] 2> 1767839 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-001/collection1
[junit4] 2> 1767847 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.e.j.s.Server jetty-9.2.13.v20150730
[junit4] 2> 1767931 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4d7a929f{/solr,null,AVAILABLE}
[junit4] 2> 1767933 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.e.j.s.ServerConnector Started ServerConnector@2183acdb{HTTP/1.1}{127.0.0.1:43387}
[junit4] 2> 1767933 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.e.j.s.Server Started @1770654ms
[junit4] 2> 1767933 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-001/collection1/data, hostContext=/solr, hostPort=43387}
[junit4] 2> 1767933 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 1767933 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-001'
[junit4] 2> 1767934 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1767934 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 1767934 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-001/solr.xml
[junit4] 2> 1767939 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-001/.
[junit4] 2> 1767939 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.c.CoreContainer New CoreContainer 169635052
[junit4] 2> 1767939 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-001]
[junit4] 2> 1767939 WARN (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-001/lib
[junit4] 2> 1767940 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 1767941 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1767941 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1767941 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1767941 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 1767941 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 1767942 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-001/.
[junit4] 2> 1767943 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-001/./collection1, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-001/./collection1/, dataDir=data/}
[junit4] 2> 1767943 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-001/./collection1/
[junit4] 2> 1767943 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 1767971 INFO (coreLoadExecutor-6866-thread-1) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-001/collection1'
[junit4] 2> 1767971 INFO (coreLoadExecutor-6866-thread-1) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1767971 INFO (coreLoadExecutor-6866-thread-1) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 1767977 INFO (coreLoadExecutor-6866-thread-1) [ ] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 1768026 INFO (coreLoadExecutor-6866-thread-1) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 1768037 INFO (coreLoadExecutor-6866-thread-1) [ ] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1768040 INFO (coreLoadExecutor-6866-thread-1) [ ] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 1768042 INFO (coreLoadExecutor-6866-thread-1) [ ] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 1768043 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4] 2> 1768043 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 1768060 INFO (coreLoadExecutor-6866-thread-1) [ ] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-001/collection1'
[junit4] 2> 1768060 INFO (coreLoadExecutor-6866-thread-1) [ ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-001/./collection1
[junit4] 2> 1768087 INFO (coreLoadExecutor-6866-thread-1) [ x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1768098 INFO (coreLoadExecutor-6866-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-001/collection1], dataDir=[null]
[junit4] 2> 1768098 INFO (coreLoadExecutor-6866-thread-1) [ x:collection1] o.a.s.c.SolrCore JMX monitoring not detected for core: collection1
[junit4] 2> 1768098 INFO (coreLoadExecutor-6866-thread-1) [ x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-001/./collection1/data
[junit4] 2> 1768098 INFO (coreLoadExecutor-6866-thread-1) [ x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-001/./collection1/data/index/
[junit4] 2> 1768098 WARN (coreLoadExecutor-6866-thread-1) [ x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-001/./collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1768099 INFO (coreLoadExecutor-6866-thread-1) [ x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-001/./collection1/data/index
[junit4] 2> 1768099 INFO (coreLoadExecutor-6866-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=4, maxMergeAtOnceExplicit=6, maxMergedSegmentMB=71.6650390625, floorSegmentMB=0.44921875, forceMergeDeletesPctAllowed=21.342128916375867, segmentsPerTier=41.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 1768099 INFO (coreLoadExecutor-6866-thread-1) [ x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1c24a61e lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7ad062e6),segFN=segments_1,generation=1}
[junit4] 2> 1768100 INFO (coreLoadExecutor-6866-thread-1) [ x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 1768103 INFO (coreLoadExecutor-6866-thread-1) [ x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1768104 INFO (coreLoadExecutor-6866-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1768105 INFO (coreLoadExecutor-6866-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1768106 INFO (coreLoadExecutor-6866-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1768106 INFO (coreLoadExecutor-6866-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1768110 INFO (coreLoadExecutor-6866-thread-1) [ x:collection1] o.a.s.c.PluginBag requestHandler : 'lazy' created with startup=lazy
[junit4] 2> 1768110 INFO (coreLoadExecutor-6866-thread-1) [ x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,lazy,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,defaults,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 1768111 INFO (coreLoadExecutor-6866-thread-1) [ x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 1768111 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [ x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-001/./collection1/data/
[junit4] 2> 1768123 INFO (coreLoadExecutor-6866-thread-1) [ x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
[junit4] 2> 1768123 INFO (coreLoadExecutor-6866-thread-1) [ x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
[junit4] 2> 1768123 INFO (coreLoadExecutor-6866-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=37, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=1.3662109375, noCFSRatio=1.0]
[junit4] 2> 1768124 INFO (coreLoadExecutor-6866-thread-1) [ x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1c24a61e lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7ad062e6),segFN=segments_1,generation=1}
[junit4] 2> 1768124 INFO (coreLoadExecutor-6866-thread-1) [ x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 1768124 INFO (coreLoadExecutor-6866-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@1f66e494[collection1] main
[junit4] 2> 1768124 INFO (coreLoadExecutor-6866-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-001/collection1/conf
[junit4] 2> 1768124 INFO (coreLoadExecutor-6866-thread-1) [ x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {storageDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-001/collection1/conf}
[junit4] 2> 1768124 INFO (coreLoadExecutor-6866-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using file:dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-001/collection1/conf
[junit4] 2> 1768125 INFO (coreLoadExecutor-6866-thread-1) [ x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 1768125 INFO (coreLoadExecutor-6866-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Replication enabled for following config files: schema.xml,xslt/dummy.xsl
[junit4] 2> 1768125 INFO (coreLoadExecutor-6866-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 1768125 INFO (coreLoadExecutor-6866-thread-1) [ x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 1768125 INFO (searcherExecutor-6867-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@1f66e494[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1768544 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-002/collection1
[junit4] 2> 1768551 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.e.j.s.Server jetty-9.2.13.v20150730
[junit4] 2> 1768582 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@37b049ed{/solr,null,AVAILABLE}
[junit4] 2> 1768582 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.e.j.s.ServerConnector Started ServerConnector@189563c2{HTTP/1.1}{127.0.0.1:60084}
[junit4] 2> 1768582 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.e.j.s.Server Started @1771303ms
[junit4] 2> 1768582 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-002/collection1/data, hostContext=/solr, hostPort=60084}
[junit4] 2> 1768583 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 1768583 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-002'
[junit4] 2> 1768583 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1768583 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 1768583 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-002/solr.xml
[junit4] 2> 1768589 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-002/.
[junit4] 2> 1768589 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.c.CoreContainer New CoreContainer 623802776
[junit4] 2> 1768589 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-002]
[junit4] 2> 1768589 WARN (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-002/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-002/lib
[junit4] 2> 1768591 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 1768592 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1768594 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1768594 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1768594 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 1768594 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 1768594 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-002/.
[junit4] 2> 1768595 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-002/./collection1, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-002/./collection1/, dataDir=data/}
[junit4] 2> 1768595 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-002/./collection1/
[junit4] 2> 1768595 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 1768610 INFO (coreLoadExecutor-6876-thread-1) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-002/collection1'
[junit4] 2> 1768610 INFO (coreLoadExecutor-6876-thread-1) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1768610 INFO (coreLoadExecutor-6876-thread-1) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 1768614 INFO (coreLoadExecutor-6876-thread-1) [ ] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 1768617 INFO (coreLoadExecutor-6876-thread-1) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 1768620 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4] 2> 1768620 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 1768630 INFO (coreLoadExecutor-6876-thread-1) [ ] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1768632 INFO (coreLoadExecutor-6876-thread-1) [ ] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 1768634 INFO (coreLoadExecutor-6876-thread-1) [ ] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 1768635 INFO (coreLoadExecutor-6876-thread-1) [ ] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-002/collection1'
[junit4] 2> 1768635 INFO (coreLoadExecutor-6876-thread-1) [ ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-002/./collection1
[junit4] 2> 1768635 INFO (coreLoadExecutor-6876-thread-1) [ x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1768636 INFO (coreLoadExecutor-6876-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-002/collection1], dataDir=[null]
[junit4] 2> 1768636 INFO (coreLoadExecutor-6876-thread-1) [ x:collection1] o.a.s.c.SolrCore JMX monitoring not detected for core: collection1
[junit4] 2> 1768636 INFO (coreLoadExecutor-6876-thread-1) [ x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-002/./collection1/data
[junit4] 2> 1768636 INFO (coreLoadExecutor-6876-thread-1) [ x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-002/./collection1/data/index/
[junit4] 2> 1768636 WARN (coreLoadExecutor-6876-thread-1) [ x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-002/./collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1768636 INFO (coreLoadExecutor-6876-thread-1) [ x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-002/./collection1/data/index
[junit4] 2> 1768636 INFO (coreLoadExecutor-6876-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=4, maxMergeAtOnceExplicit=6, maxMergedSegmentMB=71.6650390625, floorSegmentMB=0.44921875, forceMergeDeletesPctAllowed=21.342128916375867, segmentsPerTier=41.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 1768643 INFO (coreLoadExecutor-6876-thread-1) [ x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@5f93e50c lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2db80686),segFN=segments_1,generation=1}
[junit4] 2> 1768643 INFO (coreLoadExecutor-6876-thread-1) [ x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 1768649 INFO (coreLoadExecutor-6876-thread-1) [ x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1768650 INFO (coreLoadExecutor-6876-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1768651 INFO (coreLoadExecutor-6876-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1768651 INFO (coreLoadExecutor-6876-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1768652 INFO (coreLoadExecutor-6876-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1768653 INFO (coreLoadExecutor-6876-thread-1) [ x:collection1] o.a.s.c.PluginBag requestHandler : 'lazy' created with startup=lazy
[junit4] 2> 1768653 INFO (coreLoadExecutor-6876-thread-1) [ x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,lazy,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,defaults,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 1768653 INFO (coreLoadExecutor-6876-thread-1) [ x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 1768653 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [ x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-002/./collection1/data/
[junit4] 2> 1768654 INFO (coreLoadExecutor-6876-thread-1) [ x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
[junit4] 2> 1768654 INFO (coreLoadExecutor-6876-thread-1) [ x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
[junit4] 2> 1768654 INFO (coreLoadExecutor-6876-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=37, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=1.3662109375, noCFSRatio=1.0]
[junit4] 2> 1768655 INFO (coreLoadExecutor-6876-thread-1) [ x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@5f93e50c lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2db80686),segFN=segments_1,generation=1}
[junit4] 2> 1768655 INFO (coreLoadExecutor-6876-thread-1) [ x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 1768655 INFO (coreLoadExecutor-6876-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@6cf7bdeb[collection1] main
[junit4] 2> 1768655 INFO (coreLoadExecutor-6876-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-002/collection1/conf
[junit4] 2> 1768655 INFO (coreLoadExecutor-6876-thread-1) [ x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {storageDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-002/collection1/conf}
[junit4] 2> 1768655 INFO (coreLoadExecutor-6876-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using file:dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-002/collection1/conf
[junit4] 2> 1768656 INFO (coreLoadExecutor-6876-thread-1) [ x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 1768663 INFO (coreLoadExecutor-6876-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 1000ms
[junit4] 2> 1768663 INFO (coreLoadExecutor-6876-thread-1) [ x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 1768663 INFO (searcherExecutor-6877-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@6cf7bdeb[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1769045 INFO (qtp143891795-25646) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
[junit4] 2> 1769123 INFO (qtp143891795-25647) [ x:collection1] o.a.s.c.SolrCore [collection1] REMOVING ALL DOCUMENTS FROM INDEX
[junit4] 2> 1769123 INFO (qtp143891795-25647) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {deleteByQuery=*:*} 0 0
[junit4] 2> 1769132 INFO (qtp1353325165-25664) [ x:collection1] o.a.s.c.SolrCore [collection1] REMOVING ALL DOCUMENTS FROM INDEX
[junit4] 2> 1769133 INFO (qtp1353325165-25664) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {deleteByQuery=*:*} 0 0
[junit4] 2> 1769137 INFO (qtp143891795-25648) [ x:collection1] o.a.s.u.UpdateHandler start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 1769141 INFO (qtp143891795-25648) [ x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=2
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1c24a61e lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7ad062e6),segFN=segments_1,generation=1}
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1c24a61e lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7ad062e6),segFN=segments_2,generation=2}
[junit4] 2> 1769144 INFO (qtp143891795-25648) [ x:collection1] o.a.s.c.SolrCore newest commit generation = 2
[junit4] 2> 1769146 INFO (qtp143891795-25648) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@1efeb42c[collection1] main
[junit4] 2> 1769146 INFO (qtp143891795-25648) [ x:collection1] o.a.s.u.UpdateHandler end_commit_flush
[junit4] 2> 1769146 INFO (searcherExecutor-6867-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@1efeb42c[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1769146 INFO (qtp143891795-25648) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2} {commit=} 0 9
[junit4] 2> 1769148 INFO (qtp1353325165-25665) [ x:collection1] o.a.s.u.UpdateHandler start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 1769150 INFO (qtp1353325165-25665) [ x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=2
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@5f93e50c lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2db80686),segFN=segments_1,generation=1}
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@5f93e50c lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2db80686),segFN=segments_2,generation=2}
[junit4] 2> 1769150 INFO (qtp1353325165-25665) [ x:collection1] o.a.s.c.SolrCore newest commit generation = 2
[junit4] 2> 1769150 INFO (qtp1353325165-25665) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@3c0b73dd[collection1] main
[junit4] 2> 1769150 INFO (qtp1353325165-25665) [ x:collection1] o.a.s.u.UpdateHandler end_commit_flush
[junit4] 2> 1769150 INFO (searcherExecutor-6877-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@3c0b73dd[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1769151 INFO (qtp1353325165-25665) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2} {commit=} 0 2
[junit4] 2> 1769163 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.e.j.s.ServerConnector Stopped ServerConnector@2183acdb{HTTP/1.1}{127.0.0.1:0}
[junit4] 2> 1769163 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=169635052
[junit4] 2> 1769164 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ x:collection1] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@59cfda7a
[junit4] 2> 1769164 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ x:collection1] o.a.s.u.UpdateHandler closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0}
[junit4] 2> 1769165 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ x:collection1] o.a.s.u.SolrCoreState Closing SolrCoreState
[junit4] 2> 1769165 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ x:collection1] o.a.s.u.DefaultSolrCoreState SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 1769165 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ x:collection1] o.a.s.u.DefaultSolrCoreState closing IndexWriter with IndexWriterCloser
[junit4] 2> 1769166 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ x:collection1] o.a.s.c.SolrCore [collection1] Closing main searcher on request.
[junit4] 2> 1769166 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 1769166 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-001/./collection1/data [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-001/./collection1/data;done=false>>]
[junit4] 2> 1769166 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-001/./collection1/data
[junit4] 2> 1769166 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-001/./collection1/data/index [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-001/./collection1/data/index;done=false>>]
[junit4] 2> 1769166 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-001/./collection1/data/index
[junit4] 2> 1769166 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ x:collection1] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@4d7a929f{/solr,null,UNAVAILABLE}
[junit4] 2> 1769191 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.e.j.s.ServerConnector Stopped ServerConnector@189563c2{HTTP/1.1}{127.0.0.1:0}
[junit4] 2> 1769191 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=623802776
[junit4] 2> 1769192 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ x:collection1] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@1374d28f
[junit4] 2> 1769192 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ x:collection1] o.a.s.u.UpdateHandler closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0}
[junit4] 2> 1769199 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ x:collection1] o.a.s.u.SolrCoreState Closing SolrCoreState
[junit4] 2> 1769199 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ x:collection1] o.a.s.u.DefaultSolrCoreState SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 1769199 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ x:collection1] o.a.s.u.DefaultSolrCoreState closing IndexWriter with IndexWriterCloser
[junit4] 2> 1769200 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ x:collection1] o.a.s.c.SolrCore [collection1] Closing main searcher on request.
[junit4] 2> 1769200 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 1769200 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-002/./collection1/data [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-002/./collection1/data;done=false>>]
[junit4] 2> 1769200 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-002/./collection1/data
[junit4] 2> 1769200 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-002/./collection1/data/index [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-002/./collection1/data/index;done=false>>]
[junit4] 2> 1769200 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-002/./collection1/data/index
[junit4] 2> 1769200 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ x:collection1] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@37b049ed{/solr,null,UNAVAILABLE}
[junit4] 2> 1769215 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.e.j.s.Server jetty-9.2.13.v20150730
[junit4] 2> 1769275 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5f8b5798{/solr,null,AVAILABLE}
[junit4] 2> 1769275 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.e.j.s.ServerConnector Started ServerConnector@4649472a{HTTP/1.1}{127.0.0.1:58613}
[junit4] 2> 1769275 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.e.j.s.Server Started @1771996ms
[junit4] 2> 1769275 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-001/collection1/data, hostContext=/solr, hostPort=58613}
[junit4] 2> 1769275 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 1769275 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-001'
[junit4] 2> 1769276 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1769276 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 1769276 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-001/solr.xml
[junit4] 2> 1769280 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-001/.
[junit4] 2> 1769280 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.c.CoreContainer New CoreContainer 1715715345
[junit4] 2> 1769280 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-001]
[junit4] 2> 1769280 WARN (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-001/lib
[junit4] 2> 1769281 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 1769282 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1769282 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1769282 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1769282 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 1769282 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 1769283 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-001/.
[junit4] 2> 1769284 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-001/./collection1, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-001/./collection1/, dataDir=data/}
[junit4] 2> 1769284 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-001/./collection1/
[junit4] 2> 1769284 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 1769292 INFO (coreLoadExecutor-6887-thread-1) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-001/collection1'
[junit4] 2> 1769292 INFO (coreLoadExecutor-6887-thread-1) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1769292 INFO (coreLoadExecutor-6887-thread-1) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 1769305 INFO (coreLoadExecutor-6887-thread-1) [ ] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 1769307 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4] 2> 1769307 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 1769320 INFO (coreLoadExecutor-6887-thread-1) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 1769345 INFO (coreLoadExecutor-6887-thread-1) [ ] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1769347 INFO (coreLoadExecutor-6887-thread-1) [ ] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 1769511 INFO (coreLoadExecutor-6887-thread-1) [ ] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 1769513 INFO (coreLoadExecutor-6887-thread-1) [ ] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-001/collection1'
[junit4] 2> 1769513 INFO (coreLoadExecutor-6887-thread-1) [ ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-001/./collection1
[junit4] 2> 1769513 INFO (coreLoadExecutor-6887-thread-1) [ x:collection1] o.a.s.c.SolrCore solr.NRTCachingDirectoryFactory
[junit4] 2> 1769514 INFO (coreLoadExecutor-6887-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-001/collection1], dataDir=[null]
[junit4] 2> 1769514 INFO (coreLoadExecutor-6887-thread-1) [ x:collection1] o.a.s.c.SolrCore JMX monitoring not detected for core: collection1
[junit4] 2> 1769514 INFO (coreLoadExecutor-6887-thread-1) [ x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-001/collection1/data
[junit4] 2> 1769514 INFO (coreLoadExecutor-6887-thread-1) [ x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-001/collection1/data/index/
[junit4] 2> 1769514 WARN (coreLoadExecutor-6887-thread-1) [ x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-001/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1769515 INFO (coreLoadExecutor-6887-thread-1) [ x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-001/collection1/data/index
[junit4] 2> 1769515 INFO (coreLoadExecutor-6887-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=20, maxMergeAtOnceExplicit=29, maxMergedSegmentMB=9.8203125, floorSegmentMB=2.1826171875, forceMergeDeletesPctAllowed=11.212170836584626, segmentsPerTier=43.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.19998214127784764
[junit4] 2> 1769526 INFO (coreLoadExecutor-6887-thread-1) [ x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=NRTCachingDirectory(MMapDirectory@/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-001/collection1/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5654f35d; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4] 2> 1769526 INFO (coreLoadExecutor-6887-thread-1) [ x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 1769536 INFO (coreLoadExecutor-6887-thread-1) [ x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1769538 INFO (coreLoadExecutor-6887-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1769539 INFO (coreLoadExecutor-6887-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1769539 INFO (coreLoadExecutor-6887-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1769540 INFO (coreLoadExecutor-6887-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1769541 INFO (coreLoadExecutor-6887-thread-1) [ x:collection1] o.a.s.c.PluginBag requestHandler : 'lazy' created with startup=lazy
[junit4] 2> 1769541 INFO (coreLoadExecutor-6887-thread-1) [ x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,lazy,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,defaults,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 1769541 INFO (coreLoadExecutor-6887-thread-1) [ x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 1769542 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [ x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-001/collection1/data/
[junit4] 2> 1769542 INFO (coreLoadExecutor-6887-thread-1) [ x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
[junit4] 2> 1769542 INFO (coreLoadExecutor-6887-thread-1) [ x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
[junit4] 2> 1769542 INFO (coreLoadExecutor-6887-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@6474f63a
[junit4] 2> 1769543 INFO (coreLoadExecutor-6887-thread-1) [ x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=NRTCachingDirectory(MMapDirectory@/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-001/collection1/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5654f35d; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4] 2> 1769543 INFO (coreLoadExecutor-6887-thread-1) [ x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 1769543 INFO (coreLoadExecutor-6887-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@605bdb93[collection1] main
[junit4] 2> 1769543 INFO (coreLoadExecutor-6887-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-001/collection1/conf
[junit4] 2> 1769543 INFO (coreLoadExecutor-6887-thread-1) [ x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {storageDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-001/collection1/conf}
[junit4] 2> 1769543 INFO (coreLoadExecutor-6887-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using file:dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-001/collection1/conf
[junit4] 2> 1769544 INFO (coreLoadExecutor-6887-thread-1) [ x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 1769544 INFO (coreLoadExecutor-6887-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 1769544 INFO (coreLoadExecutor-6887-thread-1) [ x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 1769544 INFO (searcherExecutor-6888-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@605bdb93[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1769811 INFO (qtp571164681-25687) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[0]} 0 0
[junit4] 2> 1769814 INFO (qtp571164681-25688) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[1]} 0 0
[junit4] 2> 1769816 INFO (qtp571164681-25689) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[2]} 0 0
[junit4] 2> 1769821 INFO (qtp571164681-25690) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[3]} 0 0
[junit4] 2> 1769831 INFO (qtp571164681-25691) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[4]} 0 4
[junit4] 2> 1769833 INFO (qtp571164681-25687) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[5]} 0 0
[junit4] 2> 1769835 INFO (qtp571164681-25688) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[6]} 0 0
[junit4] 2> 1769837 INFO (qtp571164681-25689) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[7]} 0 0
[junit4] 2> 1769839 INFO (qtp571164681-25690) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[8]} 0 0
[junit4] 2> 1769841 INFO (qtp571164681-25691) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[9]} 0 0
[junit4] 2> 1769863 INFO (qtp571164681-25687) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[10]} 0 19
[junit4] 2> 1769867 INFO (qtp571164681-25688) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[11]} 0 0
[junit4] 2> 1769869 INFO (qtp571164681-25689) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[12]} 0 0
[junit4] 2> 1769870 INFO (qtp571164681-25690) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[13]} 0 0
[junit4] 2> 1769872 INFO (qtp571164681-25691) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[14]} 0 0
[junit4] 2> 1769875 INFO (qtp571164681-25687) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[15]} 0 0
[junit4] 2> 1769877 INFO (qtp571164681-25688) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[16]} 0 0
[junit4] 2> 1769884 INFO (qtp571164681-25689) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[17]} 0 5
[junit4] 2> 1769886 INFO (qtp571164681-25690) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[18]} 0 0
[junit4] 2> 1769888 INFO (qtp571164681-25691) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[19]} 0 0
[junit4] 2> 1769891 INFO (qtp571164681-25687) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[20]} 0 0
[junit4] 2> 1769893 INFO (qtp571164681-25688) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[21]} 0 0
[junit4] 2> 1769895 INFO (qtp571164681-25689) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[22]} 0 0
[junit4] 2> 1769897 INFO (qtp571164681-25690) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[23]} 0 0
[junit4] 2> 1769905 INFO (qtp571164681-25691) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[24]} 0 6
[junit4] 2> 1769907 INFO (qtp571164681-25687) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[25]} 0 0
[junit4] 2> 1769909 INFO (qtp571164681-25688) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[26]} 0 0
[junit4] 2> 1769910 INFO (qtp571164681-25689) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[27]} 0 0
[junit4] 2> 1769912 INFO (qtp571164681-25690) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[28]} 0 0
[junit4] 2> 1769914 INFO (qtp571164681-25691) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[29]} 0 0
[junit4] 2> 1769916 INFO (qtp571164681-25687) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[30]} 0 0
[junit4] 2> 1769923 INFO (qtp571164681-25688) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[31]} 0 5
[junit4] 2> 1769925 INFO (qtp571164681-25689) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[32]} 0 0
[junit4] 2> 1769927 INFO (qtp571164681-25690) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[33]} 0 0
[junit4] 2> 1769935 INFO (qtp571164681-25691) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[34]} 0 0
[junit4] 2> 1769937 INFO (qtp571164681-25687) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[35]} 0 0
[junit4] 2> 1769944 INFO (qtp571164681-25688) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[36]} 0 4
[junit4] 2> 1769952 INFO (qtp571164681-25688) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[37]} 0 0
[junit4] 2> 1769954 INFO (qtp571164681-25688) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[38]} 0 0
[junit4] 2> 1769956 INFO (qtp571164681-25689) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[39]} 0 0
[junit4] 2> 1769958 INFO (qtp571164681-25690) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[40]} 0 0
[junit4] 2> 1769960 INFO (qtp571164681-25691) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[41]} 0 0
[junit4] 2> 1769966 INFO (qtp571164681-25687) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[42]} 0 5
[junit4] 2> 1769968 INFO (qtp571164681-25689) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[43]} 0 0
[junit4] 2> 1769970 INFO (qtp571164681-25688) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[44]} 0 0
[junit4] 2> 1769972 INFO (qtp571164681-25690) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[45]} 0 0
[junit4] 2> 1769974 INFO (qtp571164681-25691) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[46]} 0 0
[junit4] 2> 1769975 INFO (qtp571164681-25687) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[47]} 0 0
[junit4] 2> 1769982 INFO (qtp571164681-25689) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[48]} 0 5
[junit4] 2> 1769984 INFO (qtp571164681-25688) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[49]} 0 0
[junit4] 2> 1769986 INFO (qtp571164681-25690) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[50]} 0 0
[junit4] 2> 1769988 INFO (qtp571164681-25691) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[51]} 0 0
[junit4] 2> 1769994 INFO (qtp571164681-25687) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[52]} 0 4
[junit4] 2> 1769996 INFO (qtp571164681-25689) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[53]} 0 0
[junit4] 2> 1769998 INFO (qtp571164681-25688) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[54]} 0 0
[junit4] 2> 1770000 INFO (qtp571164681-25690) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[55]} 0 0
[junit4] 2> 1770001 INFO (qtp571164681-25691) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[56]} 0 0
[junit4] 2> 1770003 INFO (qtp571164681-25687) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[57]} 0 0
[junit4] 2> 1770009 INFO (qtp571164681-25689) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[58]} 0 4
[junit4] 2> 1770011 INFO (qtp571164681-25688) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[59]} 0 0
[junit4] 2> 1770013 INFO (qtp571164681-25690) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[60]} 0 0
[junit4] 2> 1770015 INFO (qtp571164681-25691) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[61]} 0 0
[junit4] 2> 1770017 INFO (qtp571164681-25687) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[62]} 0 0
[junit4] 2> 1770019 INFO (qtp571164681-25689) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[63]} 0 0
[junit4] 2> 1770025 INFO (qtp571164681-25688) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[64]} 0 4
[junit4] 2> 1770027 INFO (qtp571164681-25690) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[65]} 0 0
[junit4] 2> 1770029 INFO (qtp571164681-25691) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[66]} 0 0
[junit4] 2> 1770031 INFO (qtp571164681-25687) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[67]} 0 0
[junit4] 2> 1770032 INFO (qtp571164681-25689) [ x:collection1] o.a.s.u.UpdateHandler start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 1770080 INFO (qtp571164681-25689) [ x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=2
[junit4] 2> commit{dir=NRTCachingDirectory(MMapDirectory@/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-001/collection1/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5654f35d; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4] 2> commit{dir=NRTCachingDirectory(MMapDirectory@/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A5CD47800916B7F7-001/solr-instance-001/collection1/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5654f35d; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4] 2> 1770081 INFO (qtp571164681-25689) [ x:collection1] o.a.s.c.SolrCore newest commit generation = 2
[junit4] 2> 1770084 INFO (qtp571164681-25689) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@3e69de0d[collection1] main
[junit4] 2> 1770086 INFO (searcherExecutor-6888-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@3e69de0d[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.0.0):c68)))}
[junit4] 2> 1770086 INFO (qtp571164681-25689) [ x:collection1] o.a.s.u.UpdateHandler end_commit_flush
[junit4] 2> 1770086 INFO (qtp571164681-25689) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2} {commit=} 0 54
[junit4] 2> 1770092 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.e.j.s.ServerConnector Stopped ServerConnector@4649472a{HTTP/1.1}{127.0.0.1:0}
[junit4] 2> 1770092 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1715715345
[junit4] 2> 1770092 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ x:collection1] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@5f55886a
[junit4] 2> 1770093 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ x:collection1] o.a.s.u.UpdateHandler closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=68,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 1770095 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ x:collection1] o.a.s.u.SolrCoreState Closing SolrCoreState
[junit4] 2> 1770095 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ x:collection1] o.a.s.u.DefaultSolrCoreState SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 1770095 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[A5CD47800916B7F7]) [ x:collection1] o.a.s.u.DefaultSolrCoreState closing IndexWri
[...truncated too long message...]
2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-collective-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-event-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-exception-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-journal-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-normalization-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-operational-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-referral-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-schema-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-subtree-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-trigger-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-jdbm-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-jdbm1-2.0.0-M2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-kerberos-codec-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-ldif-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-mavibot-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-protocol-kerberos-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-protocol-ldap-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-protocol-shared-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-xdbm-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/api-all-1.0.0-M20.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/bcprov-jdk15-1.45.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/cglib-nodep-2.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/commons-collections-3.2.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/commons-math3-3.4.1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/easymock-3.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/ehcache-core-2.4.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/hadoop-common-2.6.0-tests.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/hadoop-hdfs-2.6.0-tests.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/hadoop-minikdc-2.6.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/jackson-annotations-2.5.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/jackson-databind-2.5.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/jcl-over-slf4j-1.7.7.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/jersey-core-1.9.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/jersey-server-1.9.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/jetty-6.1.26.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/jetty-util-6.1.26.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/mina-core-2.0.0-M5.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/objenesis-1.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/presto-parser-0.122.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/slice-0.10.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/analysis/icu/lucene-analyzers-icu-6.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-analysis-extras/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/contrib/analysis-extras/lib/icu4j-54.1.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-launcher.jar:/x1/jenkins/.ant/lib/ivy-2.3.0.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-antlr.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-regexp.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-resolver.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-commons-net.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jmf.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-oro.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-xalan2.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-commons-logging.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jsch.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-junit4.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-javamail.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jai.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jdepend.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-junit.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-bsf.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-swing.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-netrexx.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-bcel.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-testutil.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-log4j.jar:/x1/jenkins/jenkins-slave/tools/hudson.model.JDK/latest1.8/lib/tools.jar:/x1/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.3.1.jar com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe -eventsfile /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/temp/junit4-J2-20151126_125439_974.events @/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/temp/junit4-J2-20151126_125439_974.suites -stdin
[junit4] ERROR: JVM J2 ended with an exception: Quit event not received from the forked process? This may indicate JVM crash or runner bugs.
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4.executeSlave(JUnit4.java:1503)
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4.access$000(JUnit4.java:130)
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:963)
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:960)
[junit4] at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] at java.lang.Thread.run(Thread.java:745)
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987: At least one slave process threw an exception, first: Quit event not received from the forked process? This may indicate JVM crash or runner bugs.
Total time: 231 minutes 54 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 863 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/863/
3 tests failed.
FAILED: org.apache.solr.cloud.HttpPartitionTest.test
Error Message:
Test abandoned because suite timeout was reached.
Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
at __randomizedtesting.SeedInfo.seed([C9EA21E1D568013F]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.HttpPartitionTest
Error Message:
Suite timeout exceeded (>= 7200000 msec).
Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
at __randomizedtesting.SeedInfo.seed([C9EA21E1D568013F]:0)
FAILED: org.apache.solr.cloud.hdfs.StressHdfsTest.test
Error Message:
No registered leader was found after waiting for 30000ms , collection: delete_data_dir slice: shard1
Stack Trace:
org.apache.solr.common.SolrException: No registered leader was found after waiting for 30000ms , collection: delete_data_dir slice: shard1
at __randomizedtesting.SeedInfo.seed([C9EA21E1D568013F:41BE1E3B7B946CC7]:0)
at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:637)
at org.apache.solr.cloud.hdfs.StressHdfsTest.createAndDeleteCollection(StressHdfsTest.java:161)
at org.apache.solr.cloud.hdfs.StressHdfsTest.test(StressHdfsTest.java:100)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:963)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:938)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 11233 lines...]
[junit4] Suite: org.apache.solr.cloud.hdfs.StressHdfsTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_C9EA21E1D568013F-001/init-core-data-001
[junit4] 2> 4246623 INFO (SUITE-StressHdfsTest-seed#[C9EA21E1D568013F]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /bb/
[junit4] 1> Formatting using clusterid: testClusterID
[junit4] 2> 4246719 WARN (SUITE-StressHdfsTest-seed#[C9EA21E1D568013F]-worker) [ ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
[junit4] 2> 4246723 WARN (SUITE-StressHdfsTest-seed#[C9EA21E1D568013F]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 4246724 INFO (SUITE-StressHdfsTest-seed#[C9EA21E1D568013F]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 4246736 INFO (SUITE-StressHdfsTest-seed#[C9EA21E1D568013F]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_44057_hdfs____.uc6o78/webapp
[junit4] 2> 4246831 INFO (SUITE-StressHdfsTest-seed#[C9EA21E1D568013F]-worker) [ ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
[junit4] 2> 4247069 INFO (SUITE-StressHdfsTest-seed#[C9EA21E1D568013F]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44057
[junit4] 2> 4247144 WARN (SUITE-StressHdfsTest-seed#[C9EA21E1D568013F]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 4247145 INFO (SUITE-StressHdfsTest-seed#[C9EA21E1D568013F]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 4247157 INFO (SUITE-StressHdfsTest-seed#[C9EA21E1D568013F]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_54728_datanode____.lbvjob/webapp
[junit4] 2> 4247251 INFO (SUITE-StressHdfsTest-seed#[C9EA21E1D568013F]-worker) [ ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
[junit4] 2> 4247532 INFO (SUITE-StressHdfsTest-seed#[C9EA21E1D568013F]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:54728
[junit4] 2> 4247579 WARN (SUITE-StressHdfsTest-seed#[C9EA21E1D568013F]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 4247581 INFO (SUITE-StressHdfsTest-seed#[C9EA21E1D568013F]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 4247593 INFO (SUITE-StressHdfsTest-seed#[C9EA21E1D568013F]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_60970_datanode____ao6if3/webapp
[junit4] 2> 4247705 INFO (IPC Server handler 2 on 55501) [ ] BlockStateChange BLOCK* processReport: from storage DS-0b5e16ab-4fd8-4695-821b-28c31ab21791 node DatanodeRegistration(127.0.0.1, datanodeUuid=ee8af65c-0a32-4088-a674-f0b0a27c972a, infoPort=54728, ipcPort=42850, storageInfo=lv=-56;cid=testClusterID;nsid=864581284;c=0), blocks: 0, hasStaleStorages: true, processing time: 0 msecs
[junit4] 2> 4247705 INFO (IPC Server handler 2 on 55501) [ ] BlockStateChange BLOCK* processReport: from storage DS-39b96f7d-8fbf-41c2-93bb-f32a8d9bfea4 node DatanodeRegistration(127.0.0.1, datanodeUuid=ee8af65c-0a32-4088-a674-f0b0a27c972a, infoPort=54728, ipcPort=42850, storageInfo=lv=-56;cid=testClusterID;nsid=864581284;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
[junit4] 2> 4247712 INFO (SUITE-StressHdfsTest-seed#[C9EA21E1D568013F]-worker) [ ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
[junit4] 2> 4247973 INFO (SUITE-StressHdfsTest-seed#[C9EA21E1D568013F]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:60970
[junit4] 2> 4248070 INFO (IPC Server handler 6 on 55501) [ ] BlockStateChange BLOCK* processReport: from storage DS-b5a2244b-890f-4dee-87d3-ab646fc52411 node DatanodeRegistration(127.0.0.1, datanodeUuid=40999e10-e429-4d7f-9009-119a1245709c, infoPort=60970, ipcPort=39633, storageInfo=lv=-56;cid=testClusterID;nsid=864581284;c=0), blocks: 0, hasStaleStorages: true, processing time: 0 msecs
[junit4] 2> 4248071 INFO (IPC Server handler 6 on 55501) [ ] BlockStateChange BLOCK* processReport: from storage DS-fb7cde7c-a98c-488c-8055-c3a35496639f node DatanodeRegistration(127.0.0.1, datanodeUuid=40999e10-e429-4d7f-9009-119a1245709c, infoPort=60970, ipcPort=39633, storageInfo=lv=-56;cid=testClusterID;nsid=864581284;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
[junit4] 2> 4248158 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 4248158 INFO (Thread-75136) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 4248158 INFO (Thread-75136) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 4248258 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.ZkTestServer start zk server on port:60754
[junit4] 2> 4248258 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 4248259 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 4248262 INFO (zkCallback-3004-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@411b01dc name:ZooKeeperConnection Watcher:127.0.0.1:60754 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 4248262 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 4248263 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 4248263 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 4248266 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 4248267 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 4248268 INFO (zkCallback-3005-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@686cc267 name:ZooKeeperConnection Watcher:127.0.0.1:60754/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 4248268 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 4248268 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 4248268 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
[junit4] 2> 4248269 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
[junit4] 2> 4248270 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
[junit4] 2> 4248271 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
[junit4] 2> 4248273 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 4248273 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 4248275 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 4248275 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
[junit4] 2> 4248277 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 4248277 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 4248278 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 4248278 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
[junit4] 2> 4248279 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 4248280 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
[junit4] 2> 4248281 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 4248281 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
[junit4] 2> 4248282 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 4248282 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 4248284 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 4248284 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 4248285 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 4248285 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 4248286 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 4248287 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 4248288 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 4248288 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
[junit4] 2> 4248581 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_C9EA21E1D568013F-001/control-001/cores/collection1
[junit4] 2> 4248582 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.e.j.s.Server jetty-9.2.13.v20150730
[junit4] 2> 4248584 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@17db29ba{/bb,null,AVAILABLE}
[junit4] 2> 4248584 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.e.j.s.ServerConnector Started ServerConnector@7be3a81b{HTTP/1.1}{127.0.0.1:40426}
[junit4] 2> 4248584 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.e.j.s.Server Started @4251474ms
[junit4] 2> 4248584 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:55501/hdfs__localhost_55501__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-trunk_solr_build_solr-core_test_J0_temp_solr.cloud.hdfs.StressHdfsTest_C9EA21E1D568013F-001_tempDir-002_control_data, hostContext=/bb, hostPort=40426, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_C9EA21E1D568013F-001/control-001/cores}
[junit4] 2> 4248585 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 4248585 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_C9EA21E1D568013F-001/control-001'
[junit4] 2> 4248585 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 4248585 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 4248585 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 4248586 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 4248587 INFO (zkCallback-3006-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@45efa888 name:ZooKeeperConnection Watcher:127.0.0.1:60754/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 4248587 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 4248587 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 4248588 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 4248588 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_C9EA21E1D568013F-001/control-001/solr.xml
[junit4] 2> 4248593 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_C9EA21E1D568013F-001/control-001/cores
[junit4] 2> 4248593 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.CoreContainer New CoreContainer 1498185142
[junit4] 2> 4248593 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_C9EA21E1D568013F-001/control-001]
[junit4] 2> 4248593 WARN (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_C9EA21E1D568013F-001/control-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_C9EA21E1D568013F-001/control-001/lib
[junit4] 2> 4248593 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 4248594 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 4248595 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 4248595 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 4248595 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:60754/solr
[junit4] 2> 4248595 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 4248595 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 4248595 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 4248596 INFO (zkCallback-3008-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7ceb1269 name:ZooKeeperConnection Watcher:127.0.0.1:60754 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 4248596 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 4248596 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 4248598 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [n:127.0.0.1:40426_bb ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 4248598 INFO (zkCallback-3009-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@39905816 name:ZooKeeperConnection Watcher:127.0.0.1:60754/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 4248598 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [n:127.0.0.1:40426_bb ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 4248599 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [n:127.0.0.1:40426_bb ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
[junit4] 2> 4248601 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [n:127.0.0.1:40426_bb ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 4248603 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [n:127.0.0.1:40426_bb ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 4248604 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [n:127.0.0.1:40426_bb ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 4248606 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [n:127.0.0.1:40426_bb ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 4248608 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [n:127.0.0.1:40426_bb ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 4248609 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [n:127.0.0.1:40426_bb ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 4248610 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [n:127.0.0.1:40426_bb ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 4248611 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [n:127.0.0.1:40426_bb ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 4248612 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [n:127.0.0.1:40426_bb ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40426_bb
[junit4] 2> 4248612 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [n:127.0.0.1:40426_bb ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:40426_bb
[junit4] 2> 4248614 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [n:127.0.0.1:40426_bb ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 4248615 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [n:127.0.0.1:40426_bb ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 4248616 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [n:127.0.0.1:40426_bb ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 4248616 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [n:127.0.0.1:40426_bb ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94925877019148292-127.0.0.1:40426_bb-n_0000000000
[junit4] 2> 4248616 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [n:127.0.0.1:40426_bb ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:40426_bb
[junit4] 2> 4248616 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [n:127.0.0.1:40426_bb ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
[junit4] 2> 4248617 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [n:127.0.0.1:40426_bb ] o.a.s.c.Overseer Overseer (id=94925877019148292-127.0.0.1:40426_bb-n_0000000000) starting
[junit4] 2> 4248619 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [n:127.0.0.1:40426_bb ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
[junit4] 2> 4248623 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [n:127.0.0.1:40426_bb ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 4248624 INFO (OverseerCollectionConfigSetProcessor-94925877019148292-127.0.0.1:40426_bb-n_0000000000) [n:127.0.0.1:40426_bb ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
[junit4] 2> 4248624 INFO (OverseerStateUpdate-94925877019148292-127.0.0.1:40426_bb-n_0000000000) [n:127.0.0.1:40426_bb ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 4248624 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [n:127.0.0.1:40426_bb ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 4248639 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [n:127.0.0.1:40426_bb ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 4248639 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [n:127.0.0.1:40426_bb ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 4248639 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [n:127.0.0.1:40426_bb ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_C9EA21E1D568013F-001/control-001/cores
[junit4] 2> 4248640 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [n:127.0.0.1:40426_bb ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_C9EA21E1D568013F-001/control-001/cores/collection1, collection=control_collection, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_C9EA21E1D568013F-001/control-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 4248640 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [n:127.0.0.1:40426_bb ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_C9EA21E1D568013F-001/control-001/cores/collection1/
[junit4] 2> 4248640 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [n:127.0.0.1:40426_bb ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 4248641 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [n:127.0.0.1:40426_bb ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4] 2> 4248641 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 4248641 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 4248641 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [n:127.0.0.1:40426_bb ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 4248643 INFO (OverseerStateUpdate-94925877019148292-127.0.0.1:40426_bb-n_0000000000) [n:127.0.0.1:40426_bb ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:40426/bb",
[junit4] 2> "node_name":"127.0.0.1:40426_bb",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 4248643 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 4248643 INFO (OverseerStateUpdate-94925877019148292-127.0.0.1:40426_bb-n_0000000000) [n:127.0.0.1:40426_bb ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:40426/bb",
[junit4] 2> "node_name":"127.0.0.1:40426_bb",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 4248644 INFO (OverseerStateUpdate-94925877019148292-127.0.0.1:40426_bb-n_0000000000) [n:127.0.0.1:40426_bb ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
[junit4] 2> 4248644 INFO (OverseerStateUpdate-94925877019148292-127.0.0.1:40426_bb-n_0000000000) [n:127.0.0.1:40426_bb ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 4248645 INFO (zkCallback-3009-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 4249644 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 4249644 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
[junit4] 2> 4249644 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 4249644 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 4249645 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 4249645 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_C9EA21E1D568013F-001/control-001/cores/collection1'
[junit4] 2> 4249645 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 4249645 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 4249647 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 4249651 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 4249655 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 4249662 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
[junit4] 2> 4249671 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 4249781 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 4249791 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 4249792 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 4249800 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 4249803 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 4249805 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 4249806 WARN (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 4249806 WARN (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 4249806 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 4249807 WARN (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 4249807 WARN (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 4249808 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4] 2> 4249808 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 4249808 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.HdfsDirectoryFactory
[junit4] 2> 4249808 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:55501/solr_hdfs_home
[junit4] 2> 4249808 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 4249808 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_C9EA21E1D568013F-001/control-001/cores/collection1], dataDir=[null]
[junit4] 2> 4249808 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@18e69b8d
[junit4] 2> 4249809 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:55501/solr_hdfs_home/control_collection/core_node1/data
[junit4] 2> 4249817 WARN (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.h.HdfsDirectory The NameNode is in SafeMode - Solr will wait 5 seconds and try again.
[junit4] 2> 4254818 WARN (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.h.HdfsDirectory The NameNode is in SafeMode - Solr will wait 5 seconds and try again.
[junit4] 2> 4259824 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for hdfs://localhost:55501/solr_hdfs_home/control_collection/core_node1/data
[junit4] 2> 4259825 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=hdfs://localhost:55501/solr_hdfs_home/control_collection/core_node1/data/index/
[junit4] 2> 4259834 WARN (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory 'hdfs:/localhost:55501/solr_hdfs_home/control_collection/core_node1/data/index' doesn't exist. Creating new index...
[junit4] 2> 4259834 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:55501/solr_hdfs_home/control_collection/core_node1/data/index
[junit4] 2> 4259841 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 4259841 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
[junit4] 2> 4259841 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Creating new single instance HDFS BlockCache
[junit4] 2> 4259852 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 4259853 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for hdfs://localhost:55501/solr_hdfs_home/control_collection/core_node1/data/index
[junit4] 2> 4259853 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=43, maxMergeAtOnceExplicit=23, maxMergedSegmentMB=75.5009765625, floorSegmentMB=0.970703125, forceMergeDeletesPctAllowed=29.193578687390183, segmentsPerTier=34.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.2875609045286608
[junit4] 2> 4259882 INFO (IPC Server handler 3 on 55501) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33756 is added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0b5e16ab-4fd8-4695-821b-28c31ab21791:NORMAL:127.0.0.1:57723|RBW], ReplicaUnderConstruction[[DISK]DS-b5a2244b-890f-4dee-87d3-ab646fc52411:NORMAL:127.0.0.1:33756|RBW]]} size 0
[junit4] 2> 4259886 INFO (IPC Server handler 1 on 55501) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:57723 is added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0b5e16ab-4fd8-4695-821b-28c31ab21791:NORMAL:127.0.0.1:57723|RBW], ReplicaUnderConstruction[[DISK]DS-b5a2244b-890f-4dee-87d3-ab646fc52411:NORMAL:127.0.0.1:33756|RBW]]} size 0
[junit4] 2> 4259890 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=NRTCachingDirectory(BlockDirectory(HdfsDirectory@b89be12f lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2be7210b); maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
[junit4] 2> 4259890 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 4259891 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in hdfs://localhost:55501/solr_hdfs_home/control_collection/core_node1/data/
[junit4] 2> 4259894 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 4259894 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
[junit4] 2> 4259895 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 4259895 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 4259895 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 4259895 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 4259895 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 4259895 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 4259895 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 4259895 WARN (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,args = {defaults={a=A,b=B}}}
[junit4] 2> 4259897 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 4259898 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 4259899 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 4259900 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 4259903 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/dump,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 4259904 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 4259904 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
[junit4] 2> 4259904 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing HdfsUpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 tlogDfsReplication=2
[junit4] 2> 4259913 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
[junit4] 2> 4259913 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
[junit4] 2> 4259928 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=26, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=1.9365234375, noCFSRatio=0.0]
[junit4] 2> 4259935 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=NRTCachingDirectory(BlockDirectory(HdfsDirectory@b89be12f lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2be7210b); maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
[junit4] 2> 4259935 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 4259935 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@2f1cf4ba[collection1] main
[junit4] 2> 4259935 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 4259936 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 4259936 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 4259936 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 4259936 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
[junit4] 2> 4259936 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 4259937 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 4259937 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 4259937 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 4259937 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 4259939 INFO (searcherExecutor-11467-thread-1-processing-n:127.0.0.1:40426_bb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@2f1cf4ba[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 4259940 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
[junit4] 2> 4259940 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 256 version buckets from index
[junit4] 2> 4259940 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
[junit4] 2> 4259940 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1518814044659646464
[junit4] 2> 4259940 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 0.0ms to seed version buckets with highest version 1518814044659646464
[junit4] 2> 4259940 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
[junit4] 2> 4259941 INFO (coreLoadExecutor-11466-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 4259941 INFO (coreZkRegister-11460-thread-1-processing-n:127.0.0.1:40426_bb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:40426/bb collection:control_collection shard:shard1
[junit4] 2> 4259942 INFO (coreZkRegister-11460-thread-1-processing-n:127.0.0.1:40426_bb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 4259945 INFO (coreZkRegister-11460-thread-1-processing-n:127.0.0.1:40426_bb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/94925877019148292-core_node1-n_0000000000
[junit4] 2> 4259945 INFO (coreZkRegister-11460-thread-1-processing-n:127.0.0.1:40426_bb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1
[junit4] 2> 4259947 INFO (coreZkRegister-11460-thread-1-processing-n:127.0.0.1:40426_bb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 4259947 INFO (coreZkRegister-11460-thread-1-processing-n:127.0.0.1:40426_bb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 4259947 INFO (coreZkRegister-11460-thread-1-processing-n:127.0.0.1:40426_bb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:40426/bb/collection1/
[junit4] 2> 4259947 INFO (coreZkRegister-11460-thread-1-processing-n:127.0.0.1:40426_bb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 4259947 INFO (OverseerStateUpdate-94925877019148292-127.0.0.1:40426_bb-n_0000000000) [n:127.0.0.1:40426_bb ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection"} current state version: 1
[junit4] 2> 4259947 INFO (coreZkRegister-11460-thread-1-processing-n:127.0.0.1:40426_bb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:40426/bb/collection1/ has no replicas
[junit4] 2> 4259948 INFO (zkCallback-3009-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 4259948 INFO (coreZkRegister-11460-thread-1-processing-n:127.0.0.1:40426_bb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 4259950 INFO (coreZkRegister-11460-thread-1-processing-n:127.0.0.1:40426_bb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
[junit4] 2> 4259952 INFO (coreZkRegister-11460-thread-1-processing-n:127.0.0.1:40426_bb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:40426/bb/collection1/ shard1
[junit4] 2> 4259953 INFO (OverseerStateUpdate-94925877019148292-127.0.0.1:40426_bb-n_0000000000) [n:127.0.0.1:40426_bb ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:40426/bb",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 2
[junit4] 2> 4260055 INFO (zkCallback-3009-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 4260103 INFO (coreZkRegister-11460-thread-1-processing-n:127.0.0.1:40426_bb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:40426/bb/collection1/ and leader is http://127.0.0.1:40426/bb/collection1/
[junit4] 2> 4260103 INFO (coreZkRegister-11460-thread-1-processing-n:127.0.0.1:40426_bb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:40426/bb
[junit4] 2> 4260103 INFO (coreZkRegister-11460-thread-1-processing-n:127.0.0.1:40426_bb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 4260104 INFO (coreZkRegister-11460-thread-1-processing-n:127.0.0.1:40426_bb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
[junit4] 2> 4260104 INFO (coreZkRegister-11460-thread-1-processing-n:127.0.0.1:40426_bb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:40426_bb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 4260107 INFO (OverseerStateUpdate-94925877019148292-127.0.0.1:40426_bb-n_0000000000) [n:127.0.0.1:40426_bb ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:40426/bb",
[junit4] 2> "node_name":"127.0.0.1:40426_bb",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 3
[junit4] 2> 4260107 INFO (OverseerStateUpdate-94925877019148292-127.0.0.1:40426_bb-n_0000000000) [n:127.0.0.1:40426_bb ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:40426/bb",
[junit4] 2> "node_name":"127.0.0.1:40426_bb",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 4260146 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 4260146 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 4260147 INFO (zkCallback-3011-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4e07d82e name:ZooKeeperConnection Watcher:127.0.0.1:60754/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 4260148 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 4260148 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 4260148 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 4260150 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 4260151 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with stateFormat=2
[junit4] 2> 4260151 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 4260151 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 4260152 INFO (zkCallback-3012-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@442c0e80 name:ZooKeeperConnection Watcher:127.0.0.1:60754/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 4260152 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 4260153 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 4260155 INFO (OverseerStateUpdate-94925877019148292-127.0.0.1:40426_bb-n_0000000000) [n:127.0.0.1:40426_bb ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"create",
[junit4] 2> "name":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "stateFormat":"2"} current state version: 3
[junit4] 2> 4260155 INFO (OverseerStateUpdate-94925877019148292-127.0.0.1:40426_bb-n_0000000000) [n:127.0.0.1:40426_bb ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
[junit4] 2> 4260155 INFO (zkCallback-3011-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 4260155 INFO (zkCallback-3009-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 4260259 INFO (OverseerStateUpdate-94925877019148292-127.0.0.1:40426_bb-n_0000000000) [n:127.0.0.1:40426_bb ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/collection1/state.json
[junit4] 2> 4260500 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_C9EA21E1D568013F-001/shard-1-001/cores/collection1
[junit4] 2> 4260501 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_C9EA21E1D568013F-001/shard-1-001
[junit4] 2> 4260502 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.e.j.s.Server jetty-9.2.13.v20150730
[junit4] 2> 4260504 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@45b2a67a{/bb,null,AVAILABLE}
[junit4] 2> 4260504 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.e.j.s.ServerConnector Started ServerConnector@8b60120{HTTP/1.1}{127.0.0.1:37100}
[junit4] 2> 4260504 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.e.j.s.Server Started @4263393ms
[junit4] 2> 4260504 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:55501/hdfs__localhost_55501__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-trunk_solr_build_solr-core_test_J0_temp_solr.cloud.hdfs.StressHdfsTest_C9EA21E1D568013F-001_tempDir-002_jetty1, solrconfig=solrconfig.xml, hostContext=/bb, hostPort=37100, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_C9EA21E1D568013F-001/shard-1-001/cores}
[junit4] 2> 4260504 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 4260504 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_C9EA21E1D568013F-001/shard-1-001'
[junit4] 2> 4260505 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 4260505 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 4260505 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 4260506 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 4260507 INFO (zkCallback-3013-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@254cfd18 name:ZooKeeperConnection Watcher:127.0.0.1:60754/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 4260507 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 4260507 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 4260509 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 4260509 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_C9EA21E1D568013F-001/shard-1-001/solr.xml
[junit4] 2> 4260516 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_C9EA21E1D568013F-001/shard-1-001/cores
[junit4] 2> 4260516 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.CoreContainer New CoreContainer 1991130169
[junit4] 2> 4260516 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_C9EA21E1D568013F-001/shard-1-001]
[junit4] 2> 4260516 WARN (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_C9EA21E1D568013F-001/shard-1-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_C9EA21E1D568013F-001/shard-1-001/lib
[junit4] 2> 4260516 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 4260518 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 4260518 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 4260518 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 4260518 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:60754/solr
[junit4] 2> 4260518 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 4260519 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 4260519 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 4260520 INFO (zkCallback-3015-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@54b8461d name:ZooKeeperConnection Watcher:127.0.0.1:60754 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 4260520 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 4260521 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 4260522 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [n:127.0.0.1:37100_bb ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 4260523 INFO (zkCallback-3016-thread-1-processing-n:127.0.0.1:37100_bb) [n:127.0.0.1:37100_bb ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2cf2f8fe name:ZooKeeperConnection Watcher:127.0.0.1:60754/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 4260523 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [n:127.0.0.1:37100_bb ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 4260528 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [n:127.0.0.1:37100_bb ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 4261534 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [n:127.0.0.1:37100_bb ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37100_bb
[junit4] 2> 4261534 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [n:127.0.0.1:37100_bb ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:37100_bb
[junit4] 2> 4261535 INFO (zkCallback-3009-thread-1-processing-n:127.0.0.1:40426_bb) [n:127.0.0.1:40426_bb ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 4261535 INFO (zkCallback-3011-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 4261535 INFO (zkCallback-3016-thread-1-processing-n:127.0.0.1:37100_bb) [n:127.0.0.1:37100_bb ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 4261539 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [n:127.0.0.1:37100_bb ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 4261539 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [n:127.0.0.1:37100_bb ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94925877019148297-127.0.0.1:37100_bb-n_0000000001
[junit4] 2> 4261540 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [n:127.0.0.1:37100_bb ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/94925877019148292-127.0.0.1:40426_bb-n_0000000000 to know if I could be the leader
[junit4] 2> 4261561 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [n:127.0.0.1:37100_bb ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 4261561 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [n:127.0.0.1:37100_bb ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 4261562 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [n:127.0.0.1:37100_bb ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_C9EA21E1D568013F-001/shard-1-001/cores
[junit4] 2> 4261562 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [n:127.0.0.1:37100_bb ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_C9EA21E1D568013F-001/shard-1-001/cores/collection1, collection=collection1, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_C9EA21E1D568013F-001/shard-1-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 4261563 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [n:127.0.0.1:37100_bb ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_C9EA21E1D568013F-001/shard-1-001/cores/collection1/
[junit4] 2> 4261563 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [n:127.0.0.1:37100_bb ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 4261564 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [n:127.0.0.1:37100_bb ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4] 2> 4261564 INFO (TEST-StressHdfsTest.test-seed#[C9EA21E1D568013F]) [n:127.0.0.1:37100_bb ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 4261564 INFO (coreLoadExecutor-11477-thread-1-processing-n:127.0.0.1:37100_bb) [n:127.0.0.1:37100_bb c:collection1 x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 4261565 INFO (coreLoadExecutor-11477-thread-1-processing-n:127.0.0.1:37100_bb) [n:127.0.0.1:37100_bb c:collection1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 4261566 INFO (coreLoadExecutor-11477-thread-1-processing-n:127.0.0.1:37100_bb) [n:127.0.0.1:37100_bb c:collection1 x:collection1] o.a.s.c.ZkController Registering watch for collection collection1
[junit4] 2> 4261566 INFO (coreLoadExecutor-11477-thread-1-processing-n:127.0.0.1:37100_bb) [n:127.0.0.1:37100_bb c:collection1 x:collection1] o.a.s.c.c.ZkStateReader addZkWatch collection1
[junit4] 2> 4261566 INFO (OverseerStateUpdate-94925877019148292-127.0.0.1:40426_bb-n_0000000000) [n:127.0.0.1:40426_bb ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:37100/bb",
[junit4] 2> "node_name":"127.0.0.1:37100_bb",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"} current state version: 4
[junit4] 2> 4261567 INFO (coreLoadExecutor-11477-thread-1-processing-n:127.0.0.1:37100_bb) [n:127.0.0.1:37100_bb c:collection1 x:collection1] o.a.s.c.c.ZkStateReader Add data for collection1 ver 0
[junit4] 2> 4261568 INFO (coreLoadExecutor-11477-thread-1-processing-n:127.0.0.1:37100_bb) [n:127.0.0.1:37100_bb c:collection1 x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 4261568 INFO (OverseerStateUpdate-94925877019148292-127.0.0.1:40426_bb-n_0000000000) [n:127.0.0.1:40426_bb ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:37100/bb",
[junit4] 2> "node_name":"127.0.0.1:37100_bb",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"}
[junit4] 2> 4261569 INFO (OverseerStateUpdate-94925877019148292-127.0.0.1:40426_bb-n_0000000000) [n:127.0.0.1:40426_bb ] o.a.s.c.o.ReplicaMutator Collection already exists with numShards=1
[junit4] 2> 4261569 INFO (OverseerStateUpdate-94925877019148292-127.0.0.1:40426_bb-n_0000000000) [n:127.0.0.1:40426_bb ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 4261671 INFO (OverseerStateUpdate-94925877019148292-127.0.0.1:40426_bb-n_0000000000) [n:127.0.0.1:40426_bb ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/collection1/state.json version: 0
[junit4] 2> 4261672 INFO (zkCallback-3016-thread-1-processing-n:127.0.0.1:37100_bb) [n:127.0.0.1:37100_bb ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json for collection collection1 has occurred - updating... (live nodes size: 2)
[junit4] 2> 4261672 INFO (zkCallback-3016-thread-1-processing-n:127.0.0.1:37100_bb) [n:127.0.0.1:37100_bb ] o.a.s.c.c.ZkStateReader Updating data for collection1 from 0 to 1
[junit4] 2> 4262569 INFO (coreLoadExecutor-11477-thread-1-processing-n:127.0.0.1:37100_bb) [n:127.0.0.1:37100_bb c:collection1 x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 4262569 INFO (coreLoadExecutor-11477-thread-1-processing-n:127.0.0.1:37100_bb) [n:127.0.0.1:37100_bb c:collection1 x:collection1] o.a.s.c.ZkController Check for collection zkNode:collection1
[junit4] 2> 4262569 INFO (coreLoadExecutor-11477-thread-1-processing-n:127.0.0.1:37100_bb) [n:127.0.0.1:37100_bb c
[...truncated too long message...]
127)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 26) Thread[id=6170, name=Scheduler-1631776602, state=WAITING, group=TGRP-HttpPartitionTest]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
[junit4] 2> at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081)
[junit4] 2> at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 27) Thread[id=6520, name=zkCallback-569-thread-6-processing-n:127.0.0.1:60385_yv%2Fx-SendThread(127.0.0.1:53440), state=TIMED_WAITING, group=TGRP-HttpPartitionTest]
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:994)
[junit4] 2> 28) Thread[id=6124, name=qtp1621275060-6124-selector-ServerConnectorManager@2359a388/1, state=RUNNABLE, group=TGRP-HttpPartitionTest]
[junit4] 2> at sun.nio.ch.IOUtil.drain(Native Method)
[junit4] 2> at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:90)
[junit4] 2> at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
[junit4] 2> at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
[junit4] 2> at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
[junit4] 2> at org.eclipse.jetty.io.SelectorManager$ManagedSelector.select(SelectorManager.java:600)
[junit4] 2> at org.eclipse.jetty.io.SelectorManager$ManagedSelector.run(SelectorManager.java:549)
[junit4] 2> at org.eclipse.jetty.util.thread.NonBlockingThread.run(NonBlockingThread.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 29) Thread[id=6173, name=Scheduler-103267164, state=WAITING, group=TGRP-HttpPartitionTest]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
[junit4] 2> at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081)
[junit4] 2> at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 30) Thread[id=6065, name=qtp1394515894-6065-selector-ServerConnectorManager@1c762ec9/0, state=RUNNABLE, group=TGRP-HttpPartitionTest]
[junit4] 2> at sun.nio.ch.EPollArrayWrapper.interrupt(Native Method)
[junit4] 2> at sun.nio.ch.EPollArrayWrapper.interrupt(EPollArrayWrapper.java:317)
[junit4] 2> at sun.nio.ch.EPollSelectorImpl.wakeup(EPollSelectorImpl.java:193)
[junit4] 2> at java.nio.channels.spi.AbstractSelector$1.interrupt(AbstractSelector.java:213)
[junit4] 2> at java.nio.channels.spi.AbstractSelector.begin(AbstractSelector.java:219)
[junit4] 2> at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:78)
[junit4] 2> at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
[junit4] 2> at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
[junit4] 2> at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
[junit4] 2> at org.eclipse.jetty.io.SelectorManager$ManagedSelector.select(SelectorManager.java:600)
[junit4] 2> at org.eclipse.jetty.io.SelectorManager$ManagedSelector.run(SelectorManager.java:549)
[junit4] 2> at org.eclipse.jetty.util.thread.NonBlockingThread.run(NonBlockingThread.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene60): {range_facet_l_dv=BlockTreeOrds(blocksize=128), _version_=PostingsFormat(name=LuceneFixedGap), multiDefault=PostingsFormat(name=LuceneVarGapDocFreqInterval), a_t=PostingsFormat(name=LuceneVarGapDocFreqInterval), intDefault=PostingsFormat(name=LuceneFixedGap), id=BlockTreeOrds(blocksize=128), range_facet_i_dv=PostingsFormat(name=LuceneVarGapDocFreqInterval), text=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), range_facet_l=PostingsFormat(name=LuceneVarGapDocFreqInterval), timestamp=PostingsFormat(name=LuceneVarGapDocFreqInterval)}, docValues:{range_facet_l_dv=DocValuesFormat(name=Direct), range_facet_i_dv=DocValuesFormat(name=Memory), timestamp=DocValuesFormat(name=Memory)}, sim=ClassicSimilarity, locale=de_CH, timezone=CET
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_66 (64-bit)/cpus=4,threads=51,free=207668696,total=513802240
[junit4] 2> NOTE: All tests run in this JVM: [TestImplicitCoreProperties, TestStandardQParsers, SaslZkACLProviderTest, TestLMJelinekMercerSimilarityFactory, TestHdfsUpdateLog, TestManagedSchemaFieldResource, BasicFunctionalityTest, TestRTimerTree, TermVectorComponentTest, ZkControllerTest, DistributedTermsComponentTest, TestHashPartitioner, NumericFieldsTest, SolrInfoMBeanTest, CoreMergeIndexesAdminHandlerTest, OpenExchangeRatesOrgProviderTest, TestWordDelimiterFilterFactory, TestCollectionAPI, TestReplicaProperties, TestDFRSimilarityFactory, WordBreakSolrSpellCheckerTest, TestDocumentBuilder, TestRawResponseWriter, LoggingHandlerTest, SimplePostToolTest, CloneFieldUpdateProcessorFactoryTest, HdfsRecoverLeaseTest, DirectSolrSpellCheckerTest, TestChildDocTransformer, SpellCheckComponentTest, MinimalSchemaTest, DistribJoinFromCollectionTest, TestShortCircuitedRequests, TestSurroundQueryParser, TestDistributedGrouping, TestCloudManagedSchema, IndexBasedSpellCheckerTest, TestCustomSort, TestTrackingShardHandlerFactory, TestSystemIdResolver, TestPartialUpdateDeduplication, ChaosMonkeyNothingIsSafeTest, DistributedMLTComponentTest, TestInitParams, TestSimpleQParserPlugin, TestSolrDeletionPolicy2, TestFiltering, DocumentBuilderTest, ClusterStateUpdateTest, TestBlobHandler, TestDynamicLoading, CollectionsAPIAsyncDistributedZkTest, RulesTest, HttpPartitionTest]
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=HttpPartitionTest -Dtests.seed=C9EA21E1D568013F -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=de_CH -Dtests.timezone=CET -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] ERROR 0.00s J1 | HttpPartitionTest (suite) <<<
[junit4] > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
[junit4] > at __randomizedtesting.SeedInfo.seed([C9EA21E1D568013F]:0)
[junit4] Completed [523/562] on J1 in 7223.70s, 1 test, 2 errors <<< FAILURES!
[...truncated 127 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987: There were test failures: 562 suites (8 ignored), 2228 tests, 1 suite-level error, 2 errors, 208 ignored (17 assumptions) [seed: C9EA21E1D568013F]
Total time: 300 minutes 43 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 862 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/862/
4 tests failed.
FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test
Error Message:
Captured an uncaught exception in thread: Thread[id=30579, name=zkCallback-1344-thread-11, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=30579, name=zkCallback-1344-thread-11, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: java.lang.OutOfMemoryError: GC overhead limit exceeded
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.CollectionsAPIDistributedZkTest
Error Message:
144 threads leaked from SUITE scope at org.apache.solr.cloud.CollectionsAPIDistributedZkTest: 1) Thread[id=26498, name=searcherExecutor-4915-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 2) Thread[id=30080, name=searcherExecutor-7983-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 3) Thread[id=30457, name=searcherExecutor-8170-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 4) Thread[id=26353, name=searcherExecutor-4863-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 5) Thread[id=28453, name=qtp1872157135-28453, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:389) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:531) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$700(QueuedThreadPool.java:47) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:590) at java.lang.Thread.run(Thread.java:745) 6) Thread[id=26326, name=Thread-19482, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at org.apache.solr.core.CloserThread.run(CoreContainer.java:1167) 7) Thread[id=26411, name=searcherExecutor-4899-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 8) Thread[id=30308, name=searcherExecutor-8011-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 9) Thread[id=30846, name=coreZkRegister-4837-thread-9-processing-n:127.0.0.1:34980__a x:awholynewstresscollection_collection0_6_shard3_replica4 s:shard3 c:awholynewstresscollection_collection0_6 r:core_node25, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:108) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:76) at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:350) at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:1058) at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:1044) at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:1000) at org.apache.solr.cloud.ZkController.register(ZkController.java:939) at org.apache.solr.cloud.ZkController$RegisterCoreAsync.call(ZkController.java:233) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:231) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 10) Thread[id=26307, name=qtp1278714666-26307-selector-ServerConnectorManager@4285269e/๑, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) at org.eclipse.jetty.io.SelectorManager$ManagedSelector.select(SelectorManager.java:600) at org.eclipse.jetty.io.SelectorManager$ManagedSelector.run(SelectorManager.java:549) at org.eclipse.jetty.util.thread.NonBlockingThread.run(NonBlockingThread.java:52) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555) at java.lang.Thread.run(Thread.java:745) 11) Thread[id=31125, name=OverseerCollectionConfigSetProcessor-94919882615029840-127.0.0.1:34980__a-n_0000000007, state=TIMED_WAITING, group=Overseer collection creation process.] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:108) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:76) at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:333) at org.apache.solr.cloud.DistributedQueue.fetchZkChildren(DistributedQueue.java:310) at org.apache.solr.cloud.DistributedQueue.firstChild(DistributedQueue.java:289) at org.apache.solr.cloud.DistributedQueue.firstElement(DistributedQueue.java:358) at org.apache.solr.cloud.DistributedQueue.getChildren(DistributedQueue.java:337) at org.apache.solr.cloud.OverseerTaskQueue.peekTopN(OverseerTaskQueue.java:223) at org.apache.solr.cloud.OverseerTaskProcessor.run(OverseerTaskProcessor.java:197) at java.lang.Thread.run(Thread.java:745) 12) Thread[id=30281, name=searcherExecutor-8012-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 13) Thread[id=26185, name=qtp1872157135-26185-selector-ServerConnectorManager@3f26e4d/๐, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) at org.eclipse.jetty.io.SelectorManager$ManagedSelector.select(SelectorManager.java:600) at org.eclipse.jetty.io.SelectorManager$ManagedSelector.run(SelectorManager.java:549) at org.eclipse.jetty.util.thread.NonBlockingThread.run(NonBlockingThread.java:52) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555) at java.lang.Thread.run(Thread.java:745) 14) Thread[id=26492, name=Thread-19578, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at org.apache.solr.core.CloserThread.run(CoreContainer.java:1167) 15) Thread[id=26471, name=qtp986532718-26471-acceptor-๐@59344eed-ServerConnector@587ac47b{HTTP/1.1}{127.0.0.1:๓๗๖๒๐}, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest] at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method) at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:422) at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:250) at org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:377) at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:500) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555) at java.lang.Thread.run(Thread.java:745) 16) Thread[id=30272, name=searcherExecutor-8010-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 17) Thread[id=30381, name=searcherExecutor-8070-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 18) Thread[id=31123, name=zkCallback-1357-thread-27, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 19) Thread[id=30249, name=searcherExecutor-7995-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 20) Thread[id=30033, name=searcherExecutor-7898-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 21) Thread[id=31137, name=RecoveryThread-awholynewstresscollection_collection0_6_shard6_replica2, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:635) at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:623) at org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:319) at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:225) 22) Thread[id=28432, name=qtp1278714666-28432, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:389) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:531) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$700(QueuedThreadPool.java:47) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:590) at java.lang.Thread.run(Thread.java:745) 23) Thread[id=26514, name=searcherExecutor-4928-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 24) Thread[id=30029, name=searcherExecutor-7883-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 25) Thread[id=31083, name=zkCallback-1357-thread-19-processing-n:127.0.0.1:34980__a, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:108) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:76) at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:333) at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:306) at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:255) at org.apache.solr.cloud.ShardLeaderElectionContext.rejoinLeaderElection(ElectionContext.java:620) at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:325) at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:197) at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:157) at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:346) at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:255) at org.apache.solr.cloud.ShardLeaderElectionContext.rejoinLeaderElection(ElectionContext.java:620) at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:325) at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:197) at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:157) at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:346) at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:255) at org.apache.solr.cloud.ShardLeaderElectionContext.rejoinLeaderElection(ElectionContext.java:620) at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:325) at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:197) at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:157) at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:58) at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:388) at org.apache.solr.common.cloud.SolrZkClient$3$1.run(SolrZkClient.java:269) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:231) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 26) Thread[id=31120, name=zkCallback-1357-thread-24-processing-n:127.0.0.1:34980__a, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:108) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:76) at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:385) at org.apache.solr.cloud.Overseer.createOverseerNode(Overseer.java:948) at org.apache.solr.cloud.Overseer.getInQueue(Overseer.java:896) at org.apache.solr.cloud.Overseer.getInQueue(Overseer.java:892) at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:300) at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:197) at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:157) at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:346) at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:255) at org.apache.solr.cloud.ShardLeaderElectionContext.rejoinLeaderElection(ElectionContext.java:620) at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:325) at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:197) at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:157) at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:58) at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:388) at org.apache.solr.common.cloud.SolrZkClient$3$1.run(SolrZkClient.java:269) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:231) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 27) Thread[id=26473, name=qtp986532718-26473-selector-ServerConnectorManager@e1bb8e/๑, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) at org.eclipse.jetty.io.SelectorManager$ManagedSelector.select(SelectorManager.java:600) at org.eclipse.jetty.io.SelectorManager$ManagedSelector.run(SelectorManager.java:549) at org.eclipse.jetty.util.thread.NonBlockingThread.run(NonBlockingThread.java:52) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555) at java.lang.Thread.run(Thread.java:745) 28) Thread[id=31086, name=zkCallback-1357-thread-22-processing-n:127.0.0.1:34980__a, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:108) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:76) at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:333) at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:306) at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:255) at org.apache.solr.cloud.ShardLeaderElectionContext.rejoinLeaderElection(ElectionContext.java:620) at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:325) at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:197) at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:157) at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:58) at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:388) at org.apache.solr.common.cloud.SolrZkClient$3$1.run(SolrZkClient.java:269) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:231) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 29) Thread[id=26338, name=Scheduler-907811868, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 30) Thread[id=30296, name=searcherExecutor-8017-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 31) Thread[id=30290, name=searcherExecutor-8052-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 32) Thread[id=26538, name=searcherExecutor-4939-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 33) Thread[id=30843, name=coreZkRegister-4837-thread-6-processing-n:127.0.0.1:34980__a x:awholynewstresscollection_collection0_6_shard3_replica4 s:shard3 c:awholynewstresscollection_collection0_6 r:core_node25, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:108) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:76) at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:350) at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:1058) at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:1044) at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:1000) at org.apache.solr.cloud.ZkController.register(ZkController.java:939) at org.apache.solr.cloud.ZkController$RegisterCoreAsync.call(ZkController.java:233) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:231) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 34) Thread[id=30398, name=searcherExecutor-8065-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 35) Thread[id=26479, name=Scheduler-1081707331, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 36) Thread[id=31135, name=RecoveryThread-awholynewstresscollection_collection2_6_shard7_replica1, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:635) at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:623) at org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:319) at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:225) 37) Thread[id=30861, name=coreZkRegister-4837-thread-20-processing-n:127.0.0.1:34980__a x:awholynewstresscollection_collection0_6_shard3_replica4 s:shard3 c:awholynewstresscollection_collection0_6 r:core_node25, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:108) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:76) at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:333) at org.apache.solr.cloud.ShardLeaderElectionContext.waitForReplicasToComeUp(ElectionContext.java:562) at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:305) at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:197) at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:157) at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:346) at org.apache.solr.cloud.ZkController.joinElection(ZkController.java:1116) at org.apache.solr.cloud.ZkController.register(ZkController.java:927) at org.apache.solr.cloud.ZkController$RegisterCoreAsync.call(ZkController.java:233) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:231) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 38) Thread[id=26540, name=searcherExecutor-4945-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 39) Thread[id=30021, name=searcherExecutor-7876-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 40) Thread[id=26472, name=qtp986532718-26472-selector-ServerConnectorManager@e1bb8e/๐, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) at org.eclipse.jetty.io.SelectorManager$ManagedSelector.select(SelectorManager.java:600) at org.eclipse.jetty.io.SelectorManager$ManagedSelector.run(SelectorManager.java:549) at org.eclipse.jetty.util.thread.NonBlockingThread.run(NonBlockingThread.java:52) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555) at java.lang.Thread.run(Thread.java:745) 41) Thread[id=26187, name=qtp1872157135-26187-acceptor-๐@486682a2-ServerConnector@2720f105{HTTP/1.1}{127.0.0.1:๕๘๑๓๕}, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest] at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method) at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:422) at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:250) at org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:377) at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:500) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555) at java.lang.Thread.run(Thread.java:745) 42) Thread[id=30260, name=searcherExecutor-7992-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 43) Thread[id=30423, name=searcherExecutor-8094-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 44) Thread[id=30027, name=searcherExecutor-7872-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 45) Thread[id=30492, name=searcherExecutor-8180-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 46) Thread[id=26186, name=qtp1872157135-26186-selector-ServerConnectorManager@3f26e4d/๑, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) at org.eclipse.jetty.io.SelectorManager$ManagedSelector.select(SelectorManager.java:600) at org.eclipse.jetty.io.SelectorManager$ManagedSelector.run(SelectorManager.java:549) at org.eclipse.jetty.util.thread.NonBlockingThread.run(NonBlockingThread.java:52) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555) at java.lang.Thread.run(Thread.java:745) 47) Thread[id=26193, name=Scheduler-975273723, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 48) Thread[id=26315, name=org.eclipse.jetty.server.session.HashSessionManager@1fbea7a3Timer, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 49) Thread[id=28454, name=qtp986532718-28454, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:1071) at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:1044) at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:1000) at org.apache.solr.cloud.ZkController.register(ZkController.java:939) at org.apache.solr.cloud.ZkController.register(ZkController.java:882) at org.apache.solr.core.ZkContainer$2.run(ZkContainer.java:183) at org.apache.solr.core.ZkContainer.registerInZk(ZkContainer.java:212) at org.apache.solr.core.CoreContainer.registerCore(CoreContainer.java:695) at org.apache.solr.core.CoreContainer.create(CoreContainer.java:749) at org.apache.solr.core.CoreContainer.create(CoreContainer.java:715) at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:622) at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestInternal(CoreAdminHandler.java:203) at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:183) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:151) at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:660) at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:436) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:221) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:180) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652) at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:109) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652) at org.eclipse.jetty.servlets.UserAgentFilter.doFilter(UserAgentFilter.java:83) at org.eclipse.jetty.servlets.GzipFilter.doFilter(GzipFilter.java:300) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:221) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97) at org.eclipse.jetty.server.Server.handle(Server.java:499) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:310) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:257) at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:540) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555) at java.lang.Thread.run(Thread.java:745) 50) Thread[id=26383, name=searcherExecutor-4875-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 51) Thread[id=30464, name=searcherExecutor-8135-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 52) Thread[id=30756, name=zkCallback-1357-thread-11-processing-n:127.0.0.1:34980__a-EventThread, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494) 53) Thread[id=30421, name=searcherExecutor-8086-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 54) Thread[id=30847, name=coreZkRegister-4837-thread-10-processing-n:127.0.0.1:34980__a x:awholynewstresscollection_collection0_6_shard3_replica4 s:shard3 c:awholynewstresscollection_collection0_6 r:core_node25, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:108) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:76) at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:350) at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:1058) at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:1044) at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:1000) at org.apache.solr.cloud.ZkController.register(ZkController.java:939) at org.apache.solr.cloud.ZkController$RegisterCoreAsync.call(ZkController.java:233) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:231) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 55) Thread[id=26308, name=qtp1278714666-26308-acceptor-๐@2c80beab-ServerConnector@3134661c{HTTP/1.1}{127.0.0.1:๓๔๙๘๐}, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest] at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method) at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:422) at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:250) at org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:377) at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:500) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555) at java.lang.Thread.run(Thread.java:745) 56) Thread[id=29934, name=qtp986532718-29934, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:1071) at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:1044) at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:1000) at org.apache.solr.cloud.ZkController.register(ZkController.java:939) at org.apache.solr.cloud.ZkController.register(ZkController.java:882) at org.apache.solr.core.ZkContainer$2.run(ZkContainer.java:183) at org.apache.solr.core.ZkContainer.registerInZk(ZkContainer.java:212) at org.apache.solr.core.CoreContainer.registerCore(CoreContainer.java:695) at org.apache.solr.core.CoreContainer.create(CoreContainer.java:749) at org.apache.solr.core.CoreContainer.create(CoreContainer.java:715) at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:622) at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestInternal(CoreAdminHandler.java:203) at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:183) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:151) at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:660) at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:436) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:221) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:180) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652) at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:109) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652) at org.eclipse.jetty.servlets.UserAgentFilter.doFilter(UserAgentFilter.java:83) at org.eclipse.jetty.servlets.GzipFilter.doFilter(GzipFilter.java:300) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:221) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97) at org.eclipse.jetty.server.Server.handle(Server.java:499) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:310) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:257) at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:540) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555) at java.lang.Thread.run(Thread.java:745) 57) Thread[id=30013, name=searcherExecutor-7879-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 58) Thread[id=30014, name=searcherExecutor-7874-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 59) Thread[id=30953, name=searcherExecutor-8502-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 60) Thread[id=31085, name=zkCallback-1357-thread-21-processing-n:127.0.0.1:34980__a, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:108) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:76) at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:333) at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:306) at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:255) at org.apache.solr.cloud.ShardLeaderElectionContext.rejoinLeaderElection(ElectionContext.java:620) at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:325) at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:197) at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:157) at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:346) at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:255) at org.apache.solr.cloud.ShardLeaderElectionContext.rejoinLeaderElection(ElectionContext.java:620) at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:325) at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:197) at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:157) at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:346) at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:255) at org.apache.solr.cloud.ShardLeaderElectionContext.rejoinLeaderElection(ElectionContext.java:620) at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:325) at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:197) at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:157) at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:58) at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:388) at org.apache.solr.common.cloud.SolrZkClient$3$1.run(SolrZkClient.java:269) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:231) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 61) Thread[id=28035, name=qtp1278714666-28035, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:108) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:76) at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:350) at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:1058) at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:1044) at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:1000) at org.apache.solr.cloud.ZkController.register(ZkController.java:939) at org.apache.solr.cloud.ZkController.register(ZkController.java:882) at org.apache.solr.core.ZkContainer$2.run(ZkContainer.java:183) at org.apache.solr.core.ZkContainer.registerInZk(ZkContainer.java:212) at org.apache.solr.core.CoreContainer.registerCore(CoreContainer.java:695) at org.apache.solr.core.CoreContainer.create(CoreContainer.java:749) at org.apache.solr.core.CoreContainer.create(CoreContainer.java:715) at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:622) at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestInternal(CoreAdminHandler.java:203) at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:183) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:151) at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:660) at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:436) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:221) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:180) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652) at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:109) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652) at org.eclipse.jetty.servlets.UserAgentFilter.doFilter(UserAgentFilter.java:83) at org.eclipse.jetty.servlets.GzipFilter.doFilter(GzipFilter.java:300) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:221) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97) at org.eclipse.jetty.server.Server.handle(Server.java:499) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:310) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:257) at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:540) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555) at java.lang.Thread.run(Thread.java:745) 62) Thread[id=26194, name=org.eclipse.jetty.server.session.HashSessionManager@363f8edeTimer, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 63) Thread[id=30964, name=searcherExecutor-8505-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 64) Thread[id=29589, name=qtp1872157135-29589, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:389) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:531) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$700(QueuedThreadPool.java:47) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:590) at java.lang.Thread.run(Thread.java:745) 65) Thread[id=31130, name=RecoveryThread-awholynewstresscollection_collection0_6_shard3_replica4, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:519) at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:225) 66) Thread[id=30373, name=searcherExecutor-8050-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 67) Thread[id=30852, name=coreZkRegister-4837-thread-15-processing-n:127.0.0.1:34980__a x:awholynewstresscollection_collection0_6_shard3_replica4 s:shard3 c:awholynewstresscollection_collection0_6 r:core_node25, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:108) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:76) at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:333) at org.apache.solr.cloud.ShardLeaderElectionContext.waitForReplicasToComeUp(ElectionContext.java:562) at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:305) at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:197) at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:157) at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:346) at org.apache.solr.cloud.ZkController.joinElection(ZkController.java:1116) at org.apache.solr.cloud.ZkController.register(ZkController.java:927) at org.apache.solr.cloud.ZkController$RegisterCoreAsync.call(ZkController.java:233) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:231) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 68) Thread[id=26474, name=qtp986532718-26474, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:1071) at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:1044) at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:1000) at org.apache.solr.cloud.ZkController.register(ZkController.java:939) at org.apache.solr.cloud.ZkController.register(ZkController.java:882) at org.apache.solr.core.ZkContainer$2.run(ZkContainer.java:183) at org.apache.solr.core.ZkContainer.registerInZk(ZkContainer.java:212) at org.apache.solr.core.CoreContainer.registerCore(CoreContainer.java:695) at org.apache.solr.core.CoreContainer.create(CoreContainer.java:749) at org.apache.solr.core.CoreContainer.create(CoreContainer.java:715) at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:622) at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestInternal(CoreAdminHandler.java:203) at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:183) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:151) at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:660) at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:436) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:221) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:180) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652) at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:109) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652) at org.eclipse.jetty.servlets.UserAgentFilter.doFilter(UserAgentFilter.java:83) at org.eclipse.jetty.servlets.GzipFilter.doFilter(GzipFilter.java:300) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:221) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97) at org.eclipse.jetty.server.Server.handle(Server.java:499) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:310) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:257) at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:540) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555) at java.lang.Thread.run(Thread.java:745) 69) Thread[id=31084, name=zkCallback-1357-thread-20, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 70) Thread[id=30288, name=searcherExecutor-8038-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 71) Thread[id=26191, name=qtp1872157135-26191, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:389) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:531) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$700(QueuedThreadPool.java:47) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:590) at java.lang.Thread.run(Thread.java:745) 72) Thread[id=30276, name=searcherExecutor-7993-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 73) Thread[id=30336, name=searcherExecutor-8059-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 74) Thread[id=31070, name=zkCallback-1357-thread-15, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 75) Thread[id=31124, name=OverseerStateUpdate-94919882615029840-127.0.0.1:34980__a-n_0000000007, state=TIMED_WAITING, group=Overseer state updater.] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:108) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:76) at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:333) at org.apache.solr.cloud.DistributedQueue.fetchZkChildren(DistributedQueue.java:310) at org.apache.solr.cloud.DistributedQueue.firstChild(DistributedQueue.java:289) at org.apache.solr.cloud.DistributedQueue.firstElement(DistributedQueue.java:358) at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:165) at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:143) at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:193) at java.lang.Thread.run(Thread.java:745) 76) Thread[id=30967, name=searcherExecutor-8504-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 77) Thread[id=30415, name=searcherExecutor-8071-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 78) Thread[id=31121, name=zkCallback-1357-thread-25, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 79) Thread[id=31136, name=RecoveryThread-awholynewstresscollection_collection1_6_shard3_replica1, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:635) at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:623) at org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:319) at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:225) 80) Thread[id=26212, name=searcherExecutor-4799-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 81) Thread[id=29494, name=qtp1278714666-29494, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:389) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:531) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$700(QueuedThreadPool.java:47) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:590) at java.lang.Thread.run(Thread.java:745) 82) Thread[id=26480, name=org.eclipse.jetty.server.session.HashSessionManager@5acbfad6Timer, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 83) Thread[id=26208, name=Thread-19429, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at org.apache.solr.core.CloserThread.run(CoreContainer.java:1167) 84) Thread[id=26342, name=Scheduler-191524956, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 85) Thread[id=29915, name=qtp1278714666-29915, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:389) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:531) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$700(QueuedThreadPool.java:47) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:590) at java.lang.Thread.run(Thread.java:745) 86) Thread[id=30268, name=searcherExecutor-8003-thread-1, state=WAITING, group=TGRP-Colle
[...truncated too long message...]
rt.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > 108) Thread[id=30849, name=coreZkRegister-4837-thread-12, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > 109) Thread[id=30004, name=searcherExecutor-7851-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
[junit4] > at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > 110) Thread[id=30032, name=searcherExecutor-7888-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
[junit4] > at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > 111) Thread[id=30399, name=searcherExecutor-8114-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
[junit4] > at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > 112) Thread[id=30863, name=coreZkRegister-4837-thread-22, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > 113) Thread[id=30058, name=searcherExecutor-7969-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
[junit4] > at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > 114) Thread[id=30435, name=searcherExecutor-8085-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
[junit4] > at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > at __randomizedtesting.SeedInfo.seed([57661ADF836D448C]:0)
[junit4] Completed [245/561] on J2 in 842.32s, 1 test, 3 errors <<< FAILURES!
[...truncated 836 lines...]
[junit4] JVM J2: stdout was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/temp/junit4-J2-20151124_102418_691.sysout
[junit4] >>> JVM J2: stdout (verbatim) ----
[junit4] java.lang.OutOfMemoryError: GC overhead limit exceeded
[junit4] Dumping heap to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/heapdumps/java_pid28935.hprof ...
[junit4] Heap dump file created [608658146 bytes in 9.695 secs]
[junit4] <<< JVM J2: EOF ----
[junit4] JVM J2: stderr was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/temp/junit4-J2-20151124_102418_691.syserr
[junit4] >>> JVM J2: stderr (verbatim) ----
[junit4]
[junit4] Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "SessionTracker"
[junit4] <<< JVM J2: EOF ----
[...truncated 125 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987: There were test failures: 561 suites (8 ignored), 2227 tests, 2 suite-level errors, 1 error, 1 failure, 1131 ignored (14 assumptions) [seed: 57661ADF836D448C]
Total time: 181 minutes 0 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 861 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/861/
1 tests failed.
FAILED: org.apache.solr.handler.TestReplicationHandler.doTestReplicateAfterCoreReload
Error Message:
expected:<[{indexVersion=1448273855560,generation=2,filelist=[_3zm.cfe, _3zm.cfs, _3zm.si, _3zn.fdt, _3zn.fdx, _3zn.fnm, _3zn.nvd, _3zn.nvm, _3zn.si, _3zn_Direct_0.doc, _3zn_Direct_0.tim, _3zn_Direct_0.tip, _3zo.cfe, _3zo.cfs, _3zo.si, _3zp.cfe, _3zp.cfs, _3zp.si, _3zq.cfe, _3zq.cfs, _3zq.si, _3zr.cfe, _3zr.cfs, _3zr.si, _3zs.cfe, _3zs.cfs, _3zs.si, _3zt.cfe, _3zt.cfs, _3zt.si, _3zu.cfe, _3zu.cfs, _3zu.si, _3zv.cfe, _3zv.cfs, _3zv.si, _3zw.cfe, _3zw.cfs, _3zw.si, _3zx.cfe, _3zx.cfs, _3zx.si, _3zy.cfe, _3zy.cfs, _3zy.si, _3zz.cfe, _3zz.cfs, _3zz.si, _400.cfe, _400.cfs, _400.si, _401.cfe, _401.cfs, _401.si, _402.cfe, _402.cfs, _402.si, _403.cfe, _403.cfs, _403.si, _404.cfe, _404.cfs, _404.si, _405.cfe, _405.cfs, _405.si, _406.cfe, _406.cfs, _406.si, _407.cfe, _407.cfs, _407.si, _408.cfe, _408.cfs, _408.si, _409.cfe, _409.cfs, _409.si, _40a.cfe, _40a.cfs, _40a.si, _40b.cfe, _40b.cfs, _40b.si, _40c.cfe, _40c.cfs, _40c.si, _40d.cfe, _40d.cfs, _40d.si, _40e.cfe, _40e.cfs, _40e.si, _40f.cfe, _40f.cfs, _40f.si, _40g.cfe, _40g.cfs, _40g.si, _40h.cfe, _40h.cfs, _40h.si, _40i.cfe, _40i.cfs, _40i.si, _40j.cfe, _40j.cfs, _40j.si, _40k.cfe, _40k.cfs, _40k.si, _40l.cfe, _40l.cfs, _40l.si, _40m.cfe, _40m.cfs, _40m.si, _40n.cfe, _40n.cfs, _40n.si, _40o.cfe, _40o.cfs, _40o.si, _40p.cfe, _40p.cfs, _40p.si, _40q.cfe, _40q.cfs, _40q.si, _40r.cfe, _40r.cfs, _40r.si, _40s.cfe, _40s.cfs, _40s.si, _40t.cfe, _40t.cfs, _40t.si, _40u.cfe, _40u.cfs, _40u.si, _40v.cfe, _40v.cfs, _40v.si, _40w.cfe, _40w.cfs, _40w.si, _40x.cfe, _40x.cfs, _40x.si, _40z.cfe, _40z.cfs, _40z.si, _410.cfe, _410.cfs, _410.si, _411.cfe, _411.cfs, _411.si, _412.cfe, _412.cfs, _412.si, _413.cfe, _413.cfs, _413.si, _414.cfe, _414.cfs, _414.si, _415.cfe, _415.cfs, _415.si, _416.cfe, _416.cfs, _416.si, _417.cfe, _417.cfs, _417.si, _418.cfe, _418.cfs, _418.si, _419.cfe, _419.cfs, _419.si, _41a.cfe, _41a.cfs, _41a.si, _41b.cfe, _41b.cfs, _41b.si, _41c.cfe, _41c.cfs, _41c.si, _41d.cfe, _41d.cfs, _41d.si, _41e.cfe, _41e.cfs, _41e.si, _41f.cfe, _41f.cfs, _41f.si, _41g.cfe, _41g.cfs, _41g.si, _41h.cfe, _41h.cfs, _41h.si, _41i.cfe, _41i.cfs, _41i.si, _41j.cfe, _41j.cfs, _41j.si, segments_2]}]> but was:<[{indexVersion=1448273855560,generation=2,filelist=[_3zm.cfe, _3zm.cfs, _3zm.si, _3zn.fdt, _3zn.fdx, _3zn.fnm, _3zn.nvd, _3zn.nvm, _3zn.si, _3zn_Direct_0.doc, _3zn_Direct_0.tim, _3zn_Direct_0.tip, _3zo.cfe, _3zo.cfs, _3zo.si, _3zp.cfe, _3zp.cfs, _3zp.si, _3zq.cfe, _3zq.cfs, _3zq.si, _3zr.cfe, _3zr.cfs, _3zr.si, _3zs.cfe, _3zs.cfs, _3zs.si, _3zt.cfe, _3zt.cfs, _3zt.si, _3zu.cfe, _3zu.cfs, _3zu.si, _3zv.cfe, _3zv.cfs, _3zv.si, _3zw.cfe, _3zw.cfs, _3zw.si, _3zx.cfe, _3zx.cfs, _3zx.si, _3zy.cfe, _3zy.cfs, _3zy.si, _3zz.cfe, _3zz.cfs, _3zz.si, _400.cfe, _400.cfs, _400.si, _401.cfe, _401.cfs, _401.si, _402.cfe, _402.cfs, _402.si, _403.cfe, _403.cfs, _403.si, _404.cfe, _404.cfs, _404.si, _405.cfe, _405.cfs, _405.si, _406.cfe, _406.cfs, _406.si, _407.cfe, _407.cfs, _407.si, _408.cfe, _408.cfs, _408.si, _409.cfe, _409.cfs, _409.si, _40a.cfe, _40a.cfs, _40a.si, _40b.cfe, _40b.cfs, _40b.si, _40c.cfe, _40c.cfs, _40c.si, _40d.cfe, _40d.cfs, _40d.si, _40e.cfe, _40e.cfs, _40e.si, _40f.cfe, _40f.cfs, _40f.si, _40g.cfe, _40g.cfs, _40g.si, _40h.cfe, _40h.cfs, _40h.si, _40i.cfe, _40i.cfs, _40i.si, _40j.cfe, _40j.cfs, _40j.si, _40k.cfe, _40k.cfs, _40k.si, _40l.cfe, _40l.cfs, _40l.si, _40m.cfe, _40m.cfs, _40m.si, _40n.cfe, _40n.cfs, _40n.si, _40o.cfe, _40o.cfs, _40o.si, _40p.cfe, _40p.cfs, _40p.si, _40q.cfe, _40q.cfs, _40q.si, _40r.cfe, _40r.cfs, _40r.si, _40s.cfe, _40s.cfs, _40s.si, _40t.cfe, _40t.cfs, _40t.si, _40u.cfe, _40u.cfs, _40u.si, _40v.cfe, _40v.cfs, _40v.si, _40w.cfe, _40w.cfs, _40w.si, _40x.cfe, _40x.cfs, _40x.si, _40z.cfe, _40z.cfs, _40z.si, _410.cfe, _410.cfs, _410.si, _411.cfe, _411.cfs, _411.si, _412.cfe, _412.cfs, _412.si, _413.cfe, _413.cfs, _413.si, _414.cfe, _414.cfs, _414.si, _415.cfe, _415.cfs, _415.si, _416.cfe, _416.cfs, _416.si, _417.cfe, _417.cfs, _417.si, _418.cfe, _418.cfs, _418.si, _419.cfe, _419.cfs, _419.si, _41a.cfe, _41a.cfs, _41a.si, _41b.cfe, _41b.cfs, _41b.si, _41c.cfe, _41c.cfs, _41c.si, _41d.cfe, _41d.cfs, _41d.si, _41e.cfe, _41e.cfs, _41e.si, _41f.cfe, _41f.cfs, _41f.si, _41g.cfe, _41g.cfs, _41g.si, _41h.cfe, _41h.cfs, _41h.si, _41i.cfe, _41i.cfs, _41i.si, _41j.cfe, _41j.cfs, _41j.si, segments_2]}, {indexVersion=1448273855560,generation=3,filelist=[_40x.cfe, _40x.cfs, _40x.si, _40y.fdt, _40y.fdx, _40y.fnm, _40y.nvd, _40y.nvm, _40y.si, _40y_Direct_0.doc, _40y_Direct_0.tim, _40y_Direct_0.tip, _40z.cfe, _40z.cfs, _40z.si, _410.cfe, _410.cfs, _410.si, _411.cfe, _411.cfs, _411.si, _412.cfe, _412.cfs, _412.si, _413.cfe, _413.cfs, _413.si, _414.cfe, _414.cfs, _414.si, _415.cfe, _415.cfs, _415.si, _416.cfe, _416.cfs, _416.si, _417.cfe, _417.cfs, _417.si, _418.cfe, _418.cfs, _418.si, _419.cfe, _419.cfs, _419.si, _41a.cfe, _41a.cfs, _41a.si, _41b.cfe, _41b.cfs, _41b.si, _41c.cfe, _41c.cfs, _41c.si, _41d.cfe, _41d.cfs, _41d.si, _41e.cfe, _41e.cfs, _41e.si, _41f.cfe, _41f.cfs, _41f.si, _41g.cfe, _41g.cfs, _41g.si, _41h.cfe, _41h.cfs, _41h.si, _41i.cfe, _41i.cfs, _41i.si, _41j.cfe, _41j.cfs, _41j.si, segments_3]}]>
Stack Trace:
java.lang.AssertionError: expected:<[{indexVersion=1448273855560,generation=2,filelist=[_3zm.cfe, _3zm.cfs, _3zm.si, _3zn.fdt, _3zn.fdx, _3zn.fnm, _3zn.nvd, _3zn.nvm, _3zn.si, _3zn_Direct_0.doc, _3zn_Direct_0.tim, _3zn_Direct_0.tip, _3zo.cfe, _3zo.cfs, _3zo.si, _3zp.cfe, _3zp.cfs, _3zp.si, _3zq.cfe, _3zq.cfs, _3zq.si, _3zr.cfe, _3zr.cfs, _3zr.si, _3zs.cfe, _3zs.cfs, _3zs.si, _3zt.cfe, _3zt.cfs, _3zt.si, _3zu.cfe, _3zu.cfs, _3zu.si, _3zv.cfe, _3zv.cfs, _3zv.si, _3zw.cfe, _3zw.cfs, _3zw.si, _3zx.cfe, _3zx.cfs, _3zx.si, _3zy.cfe, _3zy.cfs, _3zy.si, _3zz.cfe, _3zz.cfs, _3zz.si, _400.cfe, _400.cfs, _400.si, _401.cfe, _401.cfs, _401.si, _402.cfe, _402.cfs, _402.si, _403.cfe, _403.cfs, _403.si, _404.cfe, _404.cfs, _404.si, _405.cfe, _405.cfs, _405.si, _406.cfe, _406.cfs, _406.si, _407.cfe, _407.cfs, _407.si, _408.cfe, _408.cfs, _408.si, _409.cfe, _409.cfs, _409.si, _40a.cfe, _40a.cfs, _40a.si, _40b.cfe, _40b.cfs, _40b.si, _40c.cfe, _40c.cfs, _40c.si, _40d.cfe, _40d.cfs, _40d.si, _40e.cfe, _40e.cfs, _40e.si, _40f.cfe, _40f.cfs, _40f.si, _40g.cfe, _40g.cfs, _40g.si, _40h.cfe, _40h.cfs, _40h.si, _40i.cfe, _40i.cfs, _40i.si, _40j.cfe, _40j.cfs, _40j.si, _40k.cfe, _40k.cfs, _40k.si, _40l.cfe, _40l.cfs, _40l.si, _40m.cfe, _40m.cfs, _40m.si, _40n.cfe, _40n.cfs, _40n.si, _40o.cfe, _40o.cfs, _40o.si, _40p.cfe, _40p.cfs, _40p.si, _40q.cfe, _40q.cfs, _40q.si, _40r.cfe, _40r.cfs, _40r.si, _40s.cfe, _40s.cfs, _40s.si, _40t.cfe, _40t.cfs, _40t.si, _40u.cfe, _40u.cfs, _40u.si, _40v.cfe, _40v.cfs, _40v.si, _40w.cfe, _40w.cfs, _40w.si, _40x.cfe, _40x.cfs, _40x.si, _40z.cfe, _40z.cfs, _40z.si, _410.cfe, _410.cfs, _410.si, _411.cfe, _411.cfs, _411.si, _412.cfe, _412.cfs, _412.si, _413.cfe, _413.cfs, _413.si, _414.cfe, _414.cfs, _414.si, _415.cfe, _415.cfs, _415.si, _416.cfe, _416.cfs, _416.si, _417.cfe, _417.cfs, _417.si, _418.cfe, _418.cfs, _418.si, _419.cfe, _419.cfs, _419.si, _41a.cfe, _41a.cfs, _41a.si, _41b.cfe, _41b.cfs, _41b.si, _41c.cfe, _41c.cfs, _41c.si, _41d.cfe, _41d.cfs, _41d.si, _41e.cfe, _41e.cfs, _41e.si, _41f.cfe, _41f.cfs, _41f.si, _41g.cfe, _41g.cfs, _41g.si, _41h.cfe, _41h.cfs, _41h.si, _41i.cfe, _41i.cfs, _41i.si, _41j.cfe, _41j.cfs, _41j.si, segments_2]}]> but was:<[{indexVersion=1448273855560,generation=2,filelist=[_3zm.cfe, _3zm.cfs, _3zm.si, _3zn.fdt, _3zn.fdx, _3zn.fnm, _3zn.nvd, _3zn.nvm, _3zn.si, _3zn_Direct_0.doc, _3zn_Direct_0.tim, _3zn_Direct_0.tip, _3zo.cfe, _3zo.cfs, _3zo.si, _3zp.cfe, _3zp.cfs, _3zp.si, _3zq.cfe, _3zq.cfs, _3zq.si, _3zr.cfe, _3zr.cfs, _3zr.si, _3zs.cfe, _3zs.cfs, _3zs.si, _3zt.cfe, _3zt.cfs, _3zt.si, _3zu.cfe, _3zu.cfs, _3zu.si, _3zv.cfe, _3zv.cfs, _3zv.si, _3zw.cfe, _3zw.cfs, _3zw.si, _3zx.cfe, _3zx.cfs, _3zx.si, _3zy.cfe, _3zy.cfs, _3zy.si, _3zz.cfe, _3zz.cfs, _3zz.si, _400.cfe, _400.cfs, _400.si, _401.cfe, _401.cfs, _401.si, _402.cfe, _402.cfs, _402.si, _403.cfe, _403.cfs, _403.si, _404.cfe, _404.cfs, _404.si, _405.cfe, _405.cfs, _405.si, _406.cfe, _406.cfs, _406.si, _407.cfe, _407.cfs, _407.si, _408.cfe, _408.cfs, _408.si, _409.cfe, _409.cfs, _409.si, _40a.cfe, _40a.cfs, _40a.si, _40b.cfe, _40b.cfs, _40b.si, _40c.cfe, _40c.cfs, _40c.si, _40d.cfe, _40d.cfs, _40d.si, _40e.cfe, _40e.cfs, _40e.si, _40f.cfe, _40f.cfs, _40f.si, _40g.cfe, _40g.cfs, _40g.si, _40h.cfe, _40h.cfs, _40h.si, _40i.cfe, _40i.cfs, _40i.si, _40j.cfe, _40j.cfs, _40j.si, _40k.cfe, _40k.cfs, _40k.si, _40l.cfe, _40l.cfs, _40l.si, _40m.cfe, _40m.cfs, _40m.si, _40n.cfe, _40n.cfs, _40n.si, _40o.cfe, _40o.cfs, _40o.si, _40p.cfe, _40p.cfs, _40p.si, _40q.cfe, _40q.cfs, _40q.si, _40r.cfe, _40r.cfs, _40r.si, _40s.cfe, _40s.cfs, _40s.si, _40t.cfe, _40t.cfs, _40t.si, _40u.cfe, _40u.cfs, _40u.si, _40v.cfe, _40v.cfs, _40v.si, _40w.cfe, _40w.cfs, _40w.si, _40x.cfe, _40x.cfs, _40x.si, _40z.cfe, _40z.cfs, _40z.si, _410.cfe, _410.cfs, _410.si, _411.cfe, _411.cfs, _411.si, _412.cfe, _412.cfs, _412.si, _413.cfe, _413.cfs, _413.si, _414.cfe, _414.cfs, _414.si, _415.cfe, _415.cfs, _415.si, _416.cfe, _416.cfs, _416.si, _417.cfe, _417.cfs, _417.si, _418.cfe, _418.cfs, _418.si, _419.cfe, _419.cfs, _419.si, _41a.cfe, _41a.cfs, _41a.si, _41b.cfe, _41b.cfs, _41b.si, _41c.cfe, _41c.cfs, _41c.si, _41d.cfe, _41d.cfs, _41d.si, _41e.cfe, _41e.cfs, _41e.si, _41f.cfe, _41f.cfs, _41f.si, _41g.cfe, _41g.cfs, _41g.si, _41h.cfe, _41h.cfs, _41h.si, _41i.cfe, _41i.cfs, _41i.si, _41j.cfe, _41j.cfs, _41j.si, segments_2]}, {indexVersion=1448273855560,generation=3,filelist=[_40x.cfe, _40x.cfs, _40x.si, _40y.fdt, _40y.fdx, _40y.fnm, _40y.nvd, _40y.nvm, _40y.si, _40y_Direct_0.doc, _40y_Direct_0.tim, _40y_Direct_0.tip, _40z.cfe, _40z.cfs, _40z.si, _410.cfe, _410.cfs, _410.si, _411.cfe, _411.cfs, _411.si, _412.cfe, _412.cfs, _412.si, _413.cfe, _413.cfs, _413.si, _414.cfe, _414.cfs, _414.si, _415.cfe, _415.cfs, _415.si, _416.cfe, _416.cfs, _416.si, _417.cfe, _417.cfs, _417.si, _418.cfe, _418.cfs, _418.si, _419.cfe, _419.cfs, _419.si, _41a.cfe, _41a.cfs, _41a.si, _41b.cfe, _41b.cfs, _41b.si, _41c.cfe, _41c.cfs, _41c.si, _41d.cfe, _41d.cfs, _41d.si, _41e.cfe, _41e.cfs, _41e.si, _41f.cfe, _41f.cfs, _41f.si, _41g.cfe, _41g.cfs, _41g.si, _41h.cfe, _41h.cfs, _41h.si, _41i.cfe, _41i.cfs, _41i.si, _41j.cfe, _41j.cfs, _41j.si, segments_3]}]>
at __randomizedtesting.SeedInfo.seed([6C7ABFFA90A2FF0C:49ADA4CAE0EAF10F]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:147)
at org.apache.solr.handler.TestReplicationHandler.doTestReplicateAfterCoreReload(TestReplicationHandler.java:1136)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 10348 lines...]
[junit4] Suite: org.apache.solr.handler.TestReplicationHandler
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_6C7ABFFA90A2FF0C-001/init-core-data-001
[junit4] 2> 594566 INFO (TEST-TestReplicationHandler.doTestIndexAndConfigAliasReplication-seed#[6C7ABFFA90A2FF0C]) [ ] o.a.s.SolrTestCaseJ4 ###Starting doTestIndexAndConfigAliasReplication
[junit4] 2> 594575 INFO (TEST-TestReplicationHandler.doTestIndexAndConfigAliasReplication-seed#[6C7ABFFA90A2FF0C]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_6C7ABFFA90A2FF0C-001/solr-instance-001/collection1
[junit4] 2> 594593 INFO (TEST-TestReplicationHandler.doTestIndexAndConfigAliasReplication-seed#[6C7ABFFA90A2FF0C]) [ ] o.e.j.s.Server jetty-9.2.13.v20150730
[junit4] 2> 594631 INFO (TEST-TestReplicationHandler.doTestIndexAndConfigAliasReplication-seed#[6C7ABFFA90A2FF0C]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4f80f23b{/solr,null,AVAILABLE}
[junit4] 2> 594636 INFO (TEST-TestReplicationHandler.doTestIndexAndConfigAliasReplication-seed#[6C7ABFFA90A2FF0C]) [ ] o.e.j.s.ServerConnector Started ServerConnector@44afa7ae{HTTP/1.1}{127.0.0.1:55685}
[junit4] 2> 594636 INFO (TEST-TestReplicationHandler.doTestIndexAndConfigAliasReplication-seed#[6C7ABFFA90A2FF0C]) [ ] o.e.j.s.Server Started @597780ms
[junit4] 2> 594636 INFO (TEST-TestReplicationHandler.doTestIndexAndConfigAliasReplication-seed#[6C7ABFFA90A2FF0C]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_6C7ABFFA90A2FF0C-001/solr-instance-001/collection1/data, hostContext=/solr, hostPort=55685}
[junit4] 2> 594637 INFO (TEST-TestReplicationHandler.doTestIndexAndConfigAliasReplication-seed#[6C7ABFFA90A2FF0C]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 594637 INFO (TEST-TestReplicationHandler.doTestIndexAndConfigAliasReplication-seed#[6C7ABFFA90A2FF0C]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_6C7ABFFA90A2FF0C-001/solr-instance-001'
[junit4] 2> 594637 INFO (TEST-TestReplicationHandler.doTestIndexAndConfigAliasReplication-seed#[6C7ABFFA90A2FF0C]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 594637 INFO (TEST-TestReplicationHandler.doTestIndexAndConfigAliasReplication-seed#[6C7ABFFA90A2FF0C]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 594638 INFO (TEST-TestReplicationHandler.doTestIndexAndConfigAliasReplication-seed#[6C7ABFFA90A2FF0C]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_6C7ABFFA90A2FF0C-001/solr-instance-001/solr.xml
[junit4] 2> 594643 INFO (TEST-TestReplicationHandler.doTestIndexAndConfigAliasReplication-seed#[6C7ABFFA90A2FF0C]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_6C7ABFFA90A2FF0C-001/solr-instance-001/.
[junit4] 2> 594643 INFO (TEST-TestReplicationHandler.doTestIndexAndConfigAliasReplication-seed#[6C7ABFFA90A2FF0C]) [ ] o.a.s.c.CoreContainer New CoreContainer 1958035552
[junit4] 2> 594643 INFO (TEST-TestReplicationHandler.doTestIndexAndConfigAliasReplication-seed#[6C7ABFFA90A2FF0C]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_6C7ABFFA90A2FF0C-001/solr-instance-001]
[junit4] 2> 594643 WARN (TEST-TestReplicationHandler.doTestIndexAndConfigAliasReplication-seed#[6C7ABFFA90A2FF0C]) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_6C7ABFFA90A2FF0C-001/solr-instance-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_6C7ABFFA90A2FF0C-001/solr-instance-001/lib
[junit4] 2> 594644 INFO (TEST-TestReplicationHandler.doTestIndexAndConfigAliasReplication-seed#[6C7ABFFA90A2FF0C]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 594645 INFO (TEST-TestReplicationHandler.doTestIndexAndConfigAliasReplication-seed#[6C7ABFFA90A2FF0C]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 594646 INFO (TEST-TestReplicationHandler.doTestIndexAndConfigAliasReplication-seed#[6C7ABFFA90A2FF0C]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 594646 INFO (TEST-TestReplicationHandler.doTestIndexAndConfigAliasReplication-seed#[6C7ABFFA90A2FF0C]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 594646 INFO (TEST-TestReplicationHandler.doTestIndexAndConfigAliasReplication-seed#[6C7ABFFA90A2FF0C]) [ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 594646 INFO (TEST-TestReplicationHandler.doTestIndexAndConfigAliasReplication-seed#[6C7ABFFA90A2FF0C]) [ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 594646 INFO (TEST-TestReplicationHandler.doTestIndexAndConfigAliasReplication-seed#[6C7ABFFA90A2FF0C]) [ ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_6C7ABFFA90A2FF0C-001/solr-instance-001/.
[junit4] 2> 594647 INFO (TEST-TestReplicationHandler.doTestIndexAndConfigAliasReplication-seed#[6C7ABFFA90A2FF0C]) [ ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_6C7ABFFA90A2FF0C-001/solr-instance-001/./collection1, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_6C7ABFFA90A2FF0C-001/solr-instance-001/./collection1/, dataDir=data/}
[junit4] 2> 594647 INFO (TEST-TestReplicationHandler.doTestIndexAndConfigAliasReplication-seed#[6C7ABFFA90A2FF0C]) [ ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_6C7ABFFA90A2FF0C-001/solr-instance-001/./collection1/
[junit4] 2> 594648 INFO (TEST-TestReplicationHandler.doTestIndexAndConfigAliasReplication-seed#[6C7ABFFA90A2FF0C]) [ ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 594655 INFO (coreLoadExecutor-1091-thread-1) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_6C7ABFFA90A2FF0C-001/solr-instance-001/collection1'
[junit4] 2> 594692 INFO (coreLoadExecutor-1091-thread-1) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 594692 INFO (coreLoadExecutor-1091-thread-1) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 594692 INFO (TEST-TestReplicationHandler.doTestIndexAndConfigAliasReplication-seed#[6C7ABFFA90A2FF0C]) [ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4] 2> 594693 INFO (TEST-TestReplicationHandler.doTestIndexAndConfigAliasReplication-seed#[6C7ABFFA90A2FF0C]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 594699 INFO (coreLoadExecutor-1091-thread-1) [ ] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 594702 INFO (coreLoadExecutor-1091-thread-1) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 594712 INFO (coreLoadExecutor-1091-thread-1) [ ] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
[junit4] 2> 594718 INFO (coreLoadExecutor-1091-thread-1) [ ] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 594721 INFO (coreLoadExecutor-1091-thread-1) [ ] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 594726 INFO (coreLoadExecutor-1091-thread-1) [ ] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_6C7ABFFA90A2FF0C-001/solr-instance-001/collection1'
[junit4] 2> 594729 INFO (coreLoadExecutor-1091-thread-1) [ ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_6C7ABFFA90A2FF0C-001/solr-instance-001/./collection1
[junit4] 2> 594729 INFO (coreLoadExecutor-1091-thread-1) [ x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 594729 INFO (coreLoadExecutor-1091-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_6C7ABFFA90A2FF0C-001/solr-instance-001/collection1], dataDir=[null]
[junit4] 2> 594729 INFO (coreLoadExecutor-1091-thread-1) [ x:collection1] o.a.s.c.SolrCore JMX monitoring not detected for core: collection1
[junit4] 2> 594731 INFO (coreLoadExecutor-1091-thread-1) [ x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_6C7ABFFA90A2FF0C-001/solr-instance-001/./collection1/data
[junit4] 2> 594732 INFO (coreLoadExecutor-1091-thread-1) [ x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_6C7ABFFA90A2FF0C-001/solr-instance-001/./collection1/data/index/
[junit4] 2> 594732 WARN (coreLoadExecutor-1091-thread-1) [ x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_6C7ABFFA90A2FF0C-001/solr-instance-001/./collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 594732 INFO (coreLoadExecutor-1091-thread-1) [ x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_6C7ABFFA90A2FF0C-001/solr-instance-001/./collection1/data/index
[junit4] 2> 594732 INFO (coreLoadExecutor-1091-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=37, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7904135572956797]
[junit4] 2> 594738 INFO (coreLoadExecutor-1091-thread-1) [ x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(NRTCachingDirectory(RAMDirectory@3cb2a3ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@49746252; maxCacheMB=0.4599609375 maxMergeSizeMB=0.9892578125)),segFN=segments_1,generation=1}
[junit4] 2> 594738 INFO (coreLoadExecutor-1091-thread-1) [ x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 594751 INFO (coreLoadExecutor-1091-thread-1) [ x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 594753 INFO (coreLoadExecutor-1091-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 594754 INFO (coreLoadExecutor-1091-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 594755 INFO (coreLoadExecutor-1091-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 594755 INFO (coreLoadExecutor-1091-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 594756 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [ x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_6C7ABFFA90A2FF0C-001/solr-instance-001/./collection1/data/
[junit4] 2> 594761 INFO (coreLoadExecutor-1091-thread-1) [ x:collection1] o.a.s.c.PluginBag requestHandler : 'lazy' created with startup=lazy
[junit4] 2> 594761 INFO (coreLoadExecutor-1091-thread-1) [ x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,lazy,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,defaults,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 594761 INFO (coreLoadExecutor-1091-thread-1) [ x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 594773 INFO (coreLoadExecutor-1091-thread-1) [ x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
[junit4] 2> 594773 INFO (coreLoadExecutor-1091-thread-1) [ x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
[junit4] 2> 594774 INFO (coreLoadExecutor-1091-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=47, maxMergeAtOnceExplicit=28, maxMergedSegmentMB=25.931640625, floorSegmentMB=1.41015625, forceMergeDeletesPctAllowed=3.665606259580141, segmentsPerTier=12.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 594774 INFO (coreLoadExecutor-1091-thread-1) [ x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(NRTCachingDirectory(RAMDirectory@3cb2a3ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@49746252; maxCacheMB=0.4599609375 maxMergeSizeMB=0.9892578125)),segFN=segments_1,generation=1}
[junit4] 2> 594774 INFO (coreLoadExecutor-1091-thread-1) [ x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 594774 INFO (coreLoadExecutor-1091-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@4978c0d[collection1] main
[junit4] 2> 594774 INFO (coreLoadExecutor-1091-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_6C7ABFFA90A2FF0C-001/solr-instance-001/collection1/conf
[junit4] 2> 594775 INFO (coreLoadExecutor-1091-thread-1) [ x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {storageDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_6C7ABFFA90A2FF0C-001/solr-instance-001/collection1/conf}
[junit4] 2> 594775 INFO (coreLoadExecutor-1091-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using file:dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_6C7ABFFA90A2FF0C-001/solr-instance-001/collection1/conf
[junit4] 2> 594775 INFO (coreLoadExecutor-1091-thread-1) [ x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 594775 INFO (coreLoadExecutor-1091-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Replication enabled for following config files: schema.xml,xslt/dummy.xsl
[junit4] 2> 594775 INFO (coreLoadExecutor-1091-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 594775 INFO (coreLoadExecutor-1091-thread-1) [ x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 594776 INFO (searcherExecutor-1092-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@4978c0d[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 595195 INFO (TEST-TestReplicationHandler.doTestIndexAndConfigAliasReplication-seed#[6C7ABFFA90A2FF0C]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_6C7ABFFA90A2FF0C-001/solr-instance-002/collection1
[junit4] 2> 595202 INFO (TEST-TestReplicationHandler.doTestIndexAndConfigAliasReplication-seed#[6C7ABFFA90A2FF0C]) [ ] o.e.j.s.Server jetty-9.2.13.v20150730
[junit4] 2> 595218 INFO (TEST-TestReplicationHandler.doTestIndexAndConfigAliasReplication-seed#[6C7ABFFA90A2FF0C]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@743a8ab4{/solr,null,AVAILABLE}
[junit4] 2> 595218 INFO (TEST-TestReplicationHandler.doTestIndexAndConfigAliasReplication-seed#[6C7ABFFA90A2FF0C]) [ ] o.e.j.s.ServerConnector Started ServerConnector@33cadfdd{HTTP/1.1}{127.0.0.1:35182}
[junit4] 2> 595219 INFO (TEST-TestReplicationHandler.doTestIndexAndConfigAliasReplication-seed#[6C7ABFFA90A2FF0C]) [ ] o.e.j.s.Server Started @598362ms
[junit4] 2> 595219 INFO (TEST-TestReplicationHandler.doTestIndexAndConfigAliasReplication-seed#[6C7ABFFA90A2FF0C]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_6C7ABFFA90A2FF0C-001/solr-instance-002/collection1/data, hostContext=/solr, hostPort=35182}
[junit4] 2> 595219 INFO (TEST-TestReplicationHandler.doTestIndexAndConfigAliasReplication-seed#[6C7ABFFA90A2FF0C]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 595219 INFO (TEST-TestReplicationHandler.doTestIndexAndConfigAliasReplication-seed#[6C7ABFFA90A2FF0C]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_6C7ABFFA90A2FF0C-001/solr-instance-002'
[junit4] 2> 595219 INFO (TEST-TestReplicationHandler.doTestIndexAndConfigAliasReplication-seed#[6C7ABFFA90A2FF0C]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 595219 INFO (TEST-TestReplicationHandler.doTestIndexAndConfigAliasReplication-seed#[6C7ABFFA90A2FF0C]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 595219 INFO (TEST-TestReplicationHandler.doTestIndexAndConfigAliasReplication-seed#[6C7ABFFA90A2FF0C]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_6C7ABFFA90A2FF0C-001/solr-instance-002/solr.xml
[junit4] 2> 595224 INFO (TEST-TestReplicationHandler.doTestIndexAndConfigAliasReplication-seed#[6C7ABFFA90A2FF0C]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_6C7ABFFA90A2FF0C-001/solr-instance-002/.
[junit4] 2> 595224 INFO (TEST-TestReplicationHandler.doTestIndexAndConfigAliasReplication-seed#[6C7ABFFA90A2FF0C]) [ ] o.a.s.c.CoreContainer New CoreContainer 1199723343
[junit4] 2> 595224 INFO (TEST-TestReplicationHandler.doTestIndexAndConfigAliasReplication-seed#[6C7ABFFA90A2FF0C]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_6C7ABFFA90A2FF0C-001/solr-instance-002]
[junit4] 2> 595224 WARN (TEST-TestReplicationHandler.doTestIndexAndConfigAliasReplication-seed#[6C7ABFFA90A2FF0C]) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_6C7ABFFA90A2FF0C-001/solr-instance-002/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_6C7ABFFA90A2FF0C-001/solr-instance-002/lib
[junit4] 2> 595234 INFO (TEST-TestReplicationHandler.doTestIndexAndConfigAliasReplication-seed#[6C7ABFFA90A2FF0C]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 595234 INFO (TEST-TestReplicationHandler.doTestIndexAndConfigAliasReplication-seed#[6C7ABFFA90A2FF0C]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 595235 INFO (TEST-TestReplicationHandler.doTestIndexAndConfigAliasReplication-seed#[6C7ABFFA90A2FF0C]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 595235 INFO (TEST-TestReplicationHandler.doTestIndexAndConfigAliasReplication-seed#[6C7ABFFA90A2FF0C]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 595235 INFO (TEST-TestReplicationHandler.doTestIndexAndConfigAliasReplication-seed#[6C7ABFFA90A2FF0C]) [ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 595235 INFO (TEST-TestReplicationHandler.doTestIndexAndConfigAliasReplication-seed#[6C7ABFFA90A2FF0C]) [ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 595236 INFO (TEST-TestReplicationHandler.doTestIndexAndConfigAliasReplication-seed#[6C7ABFFA90A2FF0C]) [ ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_6C7ABFFA90A2FF0C-001/solr-instance-002/.
[junit4] 2> 595237 INFO (TEST-TestReplicationHandler.doTestIndexAndConfigAliasReplication-seed#[6C7ABFFA90A2FF0C]) [ ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_6C7ABFFA90A2FF0C-001/solr-instance-002/./collection1, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_6C7ABFFA90A2FF0C-001/solr-instance-002/./collection1/, dataDir=data/}
[junit4] 2> 595237 INFO (TEST-TestReplicationHandler.doTestIndexAndConfigAliasReplication-seed#[6C7ABFFA90A2FF0C]) [ ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_6C7ABFFA90A2FF0C-001/solr-instance-002/./collection1/
[junit4] 2> 595237 INFO (TEST-TestReplicationHandler.doTestIndexAndConfigAliasReplication-seed#[6C7ABFFA90A2FF0C]) [ ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 595237 INFO (coreLoadExecutor-1101-thread-1) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_6C7ABFFA90A2FF0C-001/solr-instance-002/collection1'
[junit4] 2> 595238 INFO (TEST-TestReplicationHandler.doTestIndexAndConfigAliasReplication-seed#[6C7ABFFA90A2FF0C]) [ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4] 2> 595246 INFO (TEST-TestReplicationHandler.doTestIndexAndConfigAliasReplication-seed#[6C7ABFFA90A2FF0C]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 595249 INFO (coreLoadExecutor-1101-thread-1) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 595249 INFO (coreLoadExecutor-1101-thread-1) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 595256 INFO (coreLoadExecutor-1101-thread-1) [ ] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 595259 INFO (coreLoadExecutor-1101-thread-1) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 595266 INFO (coreLoadExecutor-1101-thread-1) [ ] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
[junit4] 2> 595268 INFO (coreLoadExecutor-1101-thread-1) [ ] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 595279 INFO (coreLoadExecutor-1101-thread-1) [ ] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 595281 INFO (coreLoadExecutor-1101-thread-1) [ ] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_6C7ABFFA90A2FF0C-001/solr-instance-002/collection1'
[junit4] 2> 595292 INFO (coreLoadExecutor-1101-thread-1) [ ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_6C7ABFFA90A2FF0C-001/solr-instance-002/./collection1
[junit4] 2> 595292 INFO (coreLoadExecutor-1101-thread-1) [ x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 595292 INFO (coreLoadExecutor-1101-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_6C7ABFFA90A2FF0C-001/solr-instance-002/collection1], dataDir=[null]
[junit4] 2> 595292 INFO (coreLoadExecutor-1101-thread-1) [ x:collection1] o.a.s.c.SolrCore JMX monitoring not detected for core: collection1
[junit4] 2> 595293 INFO (coreLoadExecutor-1101-thread-1) [ x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_6C7ABFFA90A2FF0C-001/solr-instance-002/./collection1/data
[junit4] 2> 595293 INFO (coreLoadExecutor-1101-thread-1) [ x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_6C7ABFFA90A2FF0C-001/solr-instance-002/./collection1/data/index/
[junit4] 2> 595293 WARN (coreLoadExecutor-1101-thread-1) [ x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_6C7ABFFA90A2FF0C-001/solr-instance-002/./collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 595294 INFO (coreLoadExecutor-1101-thread-1) [ x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_6C7ABFFA90A2FF0C-001/solr-instance-002/./collection1/data/index
[junit4] 2> 595294 INFO (coreLoadExecutor-1101-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=37, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7904135572956797]
[junit4] 2> 595294 INFO (coreLoadExecutor-1101-thread-1) [ x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(NRTCachingDirectory(RAMDirectory@70b39b7f lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1c0df14a; maxCacheMB=0.4599609375 maxMergeSizeMB=0.9892578125)),segFN=segments_1,generation=1}
[junit4] 2> 595294 INFO (coreLoadExecutor-1101-thread-1) [ x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 595296 INFO (coreLoadExecutor-1101-thread-1) [ x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 595297 INFO (coreLoadExecutor-1101-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 595298 INFO (coreLoadExecutor-1101-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 595299 INFO (coreLoadExecutor-1101-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 595300 INFO (coreLoadExecutor-1101-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 595301 INFO (coreLoadExecutor-1101-thread-1) [ x:collection1] o.a.s.c.PluginBag requestHandler : 'lazy' created with startup=lazy
[junit4] 2> 595301 INFO (coreLoadExecutor-1101-thread-1) [ x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,lazy,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,defaults,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 595302 INFO (coreLoadExecutor-1101-thread-1) [ x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 595302 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [ x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_6C7ABFFA90A2FF0C-001/solr-instance-002/./collection1/data/
[junit4] 2> 595302 INFO (coreLoadExecutor-1101-thread-1) [ x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
[junit4] 2> 595302 INFO (coreLoadExecutor-1101-thread-1) [ x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
[junit4] 2> 595303 INFO (coreLoadExecutor-1101-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=47, maxMergeAtOnceExplicit=28, maxMergedSegmentMB=25.931640625, floorSegmentMB=1.41015625, forceMergeDeletesPctAllowed=3.665606259580141, segmentsPerTier=12.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 595309 INFO (coreLoadExecutor-1101-thread-1) [ x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(NRTCachingDirectory(RAMDirectory@70b39b7f lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1c0df14a; maxCacheMB=0.4599609375 maxMergeSizeMB=0.9892578125)),segFN=segments_1,generation=1}
[junit4] 2> 595309 INFO (coreLoadExecutor-1101-thread-1) [ x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 595310 INFO (coreLoadExecutor-1101-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@262d3742[collection1] main
[junit4] 2> 595310 INFO (coreLoadExecutor-1101-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_6C7ABFFA90A2FF0C-001/solr-instance-002/collection1/conf
[junit4] 2> 595310 INFO (coreLoadExecutor-1101-thread-1) [ x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {storageDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_6C7ABFFA90A2FF0C-001/solr-instance-002/collection1/conf}
[junit4] 2> 595310 INFO (coreLoadExecutor-1101-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using file:dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_6C7ABFFA90A2FF0C-001/solr-instance-002/collection1/conf
[junit4] 2> 595310 INFO (coreLoadExecutor-1101-thread-1) [ x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 595312 INFO (coreLoadExecutor-1101-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 1000ms
[junit4] 2> 595312 INFO (coreLoadExecutor-1101-thread-1) [ x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 595313 INFO (searcherExecutor-1102-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@262d3742[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 595711 INFO (qtp1582878819-3334) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
[junit4] 2> 595749 INFO (qtp1582878819-3335) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/select params={q=*:*&sort=id+desc&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 595753 INFO (qtp1582878819-3337) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[0]} 0 1
[junit4] 2> 595755 INFO (qtp1582878819-3338) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[1]} 0 0
[junit4] 2> 595756 INFO (qtp1582878819-3336) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[2]} 0 0
[junit4] 2> 595758 INFO (qtp1582878819-3334) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[3]} 0 0
[junit4] 2> 595760 INFO (qtp1582878819-3335) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[4]} 0 0
[junit4] 2> 595762 INFO (qtp1582878819-3337) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[5]} 0 0
[junit4] 2> 595764 INFO (qtp1582878819-3338) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[6]} 0 0
[junit4] 2> 595765 INFO (qtp1582878819-3336) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[7]} 0 0
[junit4] 2> 595768 INFO (qtp1582878819-3334) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[8]} 0 0
[junit4] 2> 595770 INFO (qtp1582878819-3335) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[9]} 0 0
[junit4] 2> 595772 INFO (qtp1582878819-3337) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[10]} 0 0
[junit4] 2> 595774 INFO (qtp1582878819-3338) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[11]} 0 0
[junit4] 2> 595775 INFO (qtp1582878819-3336) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[12]} 0 0
[junit4] 2> 595777 INFO (qtp1582878819-3334) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[13]} 0 0
[junit4] 2> 595779 INFO (qtp1582878819-3335) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[14]} 0 0
[junit4] 2> 595780 INFO (qtp1582878819-3337) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[15]} 0 0
[junit4] 2> 595782 INFO (qtp1582878819-3338) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[16]} 0 0
[junit4] 2> 595784 INFO (qtp1582878819-3336) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[17]} 0 0
[junit4] 2> 595786 INFO (qtp1582878819-3334) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[18]} 0 0
[junit4] 2> 595787 INFO (qtp1582878819-3335) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[19]} 0 0
[junit4] 2> 595789 INFO (qtp1582878819-3337) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[20]} 0 0
[junit4] 2> 595791 INFO (qtp1582878819-3338) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[21]} 0 0
[junit4] 2> 595792 INFO (qtp1582878819-3336) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[22]} 0 0
[junit4] 2> 595794 INFO (qtp1582878819-3334) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[23]} 0 0
[junit4] 2> 595796 INFO (qtp1582878819-3335) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[24]} 0 0
[junit4] 2> 595798 INFO (qtp1582878819-3337) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[25]} 0 0
[junit4] 2> 595799 INFO (qtp1582878819-3338) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[26]} 0 0
[junit4] 2> 595801 INFO (qtp1582878819-3336) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[27]} 0 0
[junit4] 2> 595803 INFO (qtp1582878819-3334) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[28]} 0 0
[junit4] 2> 595804 INFO (qtp1582878819-3335) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[29]} 0 0
[junit4] 2> 595806 INFO (qtp1582878819-3337) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[30]} 0 0
[junit4] 2> 595808 INFO (qtp1582878819-3338) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[31]} 0 0
[junit4] 2> 595809 INFO (qtp1582878819-3336) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[32]} 0 0
[junit4] 2> 595811 INFO (qtp1582878819-3334) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[33]} 0 0
[junit4] 2> 595813 INFO (qtp1582878819-3335) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[34]} 0 0
[junit4] 2> 595814 INFO (qtp1582878819-3337) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[35]} 0 0
[junit4] 2> 595816 INFO (qtp1582878819-3338) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[36]} 0 0
[junit4] 2> 595818 INFO (qtp1582878819-3336) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[37]} 0 0
[junit4] 2> 595826 INFO (qtp1582878819-3334) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[38]} 0 5
[junit4] 2> 595829 INFO (qtp1582878819-3335) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[39]} 0 1
[junit4] 2> 595830 INFO (qtp1582878819-3337) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[40]} 0 0
[junit4] 2> 595832 INFO (qtp1582878819-3338) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[41]} 0 0
[junit4] 2> 595834 INFO (qtp1582878819-3336) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[42]} 0 0
[junit4] 2> 595836 INFO (qtp1582878819-3334) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[43]} 0 0
[junit4] 2> 595838 INFO (qtp1582878819-3335) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[44]} 0 0
[junit4] 2> 595839 INFO (qtp1582878819-3337) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[45]} 0 0
[junit4] 2> 595841 INFO (qtp1582878819-3338) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[46]} 0 0
[junit4] 2> 595843 INFO (qtp1582878819-3336) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[47]} 0 0
[junit4] 2> 595845 INFO (qtp1582878819-3334) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[48]} 0 0
[junit4] 2> 595846 INFO (qtp1582878819-3335) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[49]} 0 0
[junit4] 2> 595848 INFO (qtp1582878819-3337) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[50]} 0 0
[junit4] 2> 595850 INFO (qtp1582878819-3338) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[51]} 0 0
[junit4] 2> 595852 INFO (qtp1582878819-3336) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[52]} 0 0
[junit4] 2> 595854 INFO (qtp1582878819-3334) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[53]} 0 0
[junit4] 2> 595856 INFO (qtp1582878819-3335) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[54]} 0 0
[junit4] 2> 595857 INFO (qtp1582878819-3337) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[55]} 0 0
[junit4] 2> 595859 INFO (qtp1582878819-3338) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[56]} 0 0
[junit4] 2> 595861 INFO (qtp1582878819-3336) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[57]} 0 0
[junit4] 2> 595862 INFO (qtp1582878819-3334) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[58]} 0 0
[junit4] 2> 595864 INFO (qtp1582878819-3335) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[59]} 0 0
[junit4] 2> 595866 INFO (qtp1582878819-3337) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[60]} 0 0
[junit4] 2> 595868 INFO (qtp1582878819-3338) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[61]} 0 0
[junit4] 2> 595869 INFO (qtp1582878819-3336) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[62]} 0 0
[junit4] 2> 595871 INFO (qtp1582878819-3334) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[63]} 0 0
[junit4] 2> 595873 INFO (qtp1582878819-3335) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[64]} 0 0
[junit4] 2> 595874 INFO (qtp1582878819-3337) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[65]} 0 0
[junit4] 2> 595876 INFO (qtp1582878819-3338) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[66]} 0 0
[junit4] 2> 595878 INFO (qtp1582878819-3336) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[67]} 0 0
[junit4] 2> 595880 INFO (qtp1582878819-3334) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[68]} 0 0
[junit4] 2> 595881 INFO (qtp1582878819-3335) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[69]} 0 0
[junit4] 2> 595883 INFO (qtp1582878819-3337) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[70]} 0 0
[junit4] 2> 595885 INFO (qtp1582878819-3338) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[71]} 0 0
[junit4] 2> 595886 INFO (qtp1582878819-3336) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[72]} 0 0
[junit4] 2> 595888 INFO (qtp1582878819-3334) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[73]} 0 0
[junit4] 2> 595890 INFO (qtp1582878819-3335) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[74]} 0 0
[junit4] 2> 595892 INFO (qtp1582878819-3337) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[75]} 0 0
[junit4] 2> 595894 INFO (qtp1582878819-3338) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[76]} 0 0
[junit4] 2> 595901 INFO (qtp1582878819-3336) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[77]} 0 5
[junit4] 2> 595903 INFO (qtp1582878819-3334) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[78]} 0 0
[junit4] 2> 595905 INFO (qtp1582878819-3335) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[79]} 0 0
[junit4] 2> 595907 INFO (qtp1582878819-3337) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[80]} 0 0
[junit4] 2> 595909 INFO (qtp1582878819-3338) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[81]} 0 0
[junit4] 2> 595911 INFO (qtp1582878819-3336) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[82]} 0 0
[junit4] 2> 595913 INFO (qtp1582878819-3334) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[83]} 0 0
[junit4] 2> 595915 INFO (qtp1582878819-3335) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[84]} 0 0
[junit4] 2> 595916 INFO (qtp1582878819-3337) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[85]} 0 0
[junit4] 2> 595918 INFO (qtp1582878819-3338) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[86]} 0 0
[junit4] 2> 595920 INFO (qtp1582878819-3336) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[87]} 0 0
[junit4] 2> 595922 INFO (qtp1582878819-3334) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[88]} 0 0
[junit4] 2> 595924 INFO (qtp1582878819-3335) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[89]} 0 0
[junit4] 2> 595925 INFO (qtp1582878819-3337) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[90]} 0 0
[junit4] 2> 595927 INFO (qtp1582878819-3338) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[91]} 0 0
[junit4] 2> 595929 INFO (qtp1582878819-3336) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[92]} 0 0
[junit4] 2> 595930 INFO (qtp1582878819-3334) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[93]} 0 0
[junit4] 2> 595932 INFO (qtp1582878819-3335) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[94]} 0 0
[junit4] 2> 595934 INFO (qtp1582878819-3337) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[95]} 0 0
[junit4] 2> 595936 INFO (qtp1582878819-3338) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[96]} 0 0
[junit4] 2> 595938 INFO (qtp1582878819-3336) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[97]} 0 0
[junit4] 2> 595939 INFO (qtp1582878819-3334) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[98]} 0 0
[junit4] 2> 595941 INFO (qtp1582878819-3335) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[99]} 0 0
[junit4] 2> 595943 INFO (qtp1582878819-3337) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[100]} 0 0
[junit4] 2> 595945 INFO (qtp1582878819-3338) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[101]} 0 0
[junit4] 2> 595947 INFO (qtp1582878819-3336) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[102]} 0 0
[junit4] 2> 595949 INFO (qtp1582878819-3334) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[103]} 0 0
[junit4] 2> 595951 INFO (qtp1582878819-3335) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[104]} 0 0
[junit4] 2> 595953 INFO (qtp1582878819-3337) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[105]} 0 0
[junit4] 2> 595955 INFO (qtp1582878819-3338) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[106]} 0 0
[junit4] 2> 595956 INFO (qtp1582878819-3336) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[107]} 0 0
[junit4] 2> 595958 INFO (qtp1582878819-3334) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[108]} 0 0
[junit4] 2> 595960 INFO (qtp1582878819-3335) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[109]} 0 0
[junit4] 2> 595961 INFO (qtp1582878819-3337) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[110]} 0 0
[junit4] 2> 595963 INFO (qtp1582878819-3338) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[111]} 0 0
[junit4] 2> 595965 INFO (qtp1582878819-3336) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[112]} 0 0
[junit4] 2> 595967 INFO (qtp1582878819-3334) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[113]} 0 0
[junit4] 2> 595969 INFO (qtp1582878819-3335) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[114]} 0 0
[junit4] 2> 595970 INFO (qtp1582878819-3337) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[115]} 0 0
[junit4] 2> 595976 INFO (qtp1582878819-3338) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[116]} 0 3
[junit4] 2> 595978 INFO (qtp1582878819-3336) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[117]} 0 0
[junit4] 2> 595980 INFO (qtp1582878819-3334) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[118]} 0 0
[junit4] 2> 595982 INFO (qtp1582878819-3335) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[119]} 0 0
[junit4] 2> 595984 INFO (qtp1582878819-3337) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[120]} 0 0
[junit4] 2> 595986 INFO (qtp1582878819-3338) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[121]} 0 0
[junit4] 2> 595988 INFO (qtp1582878819-3336) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[122]} 0 0
[junit4] 2> 595990 INFO (qtp1582878819-3334) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[123]} 0 0
[junit4] 2> 595992 INFO (qtp1582878819-3335) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[124]} 0 0
[junit4] 2> 595994 INFO (qtp1582878819-3337) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[125]} 0 0
[junit4] 2> 595996 INFO (qtp1582878819-3338) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[126]} 0 0
[junit4] 2> 595998 INFO (qtp1582878819-3336) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[127]} 0 0
[junit4] 2> 595999 INFO (qtp1582878819-3334) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[128]} 0 0
[junit4] 2> 596001 INFO (qtp1582878819-3335) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[129]} 0 0
[junit4] 2> 596003 INFO (qtp1582878819-3337) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[130]} 0 0
[junit4] 2> 596005 INFO (qtp1582878819-3338) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[131]} 0 0
[junit4] 2> 596007 INFO (qtp1582878819-3336) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[132]} 0 0
[junit4] 2> 596008 INFO (qtp1582878819-3334) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[133]} 0 0
[junit4] 2> 596011 INFO (qtp1582878819-3335) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[134]} 0 0
[junit4] 2> 596013 INFO (qtp1582878819-3337) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[135]} 0 0
[junit4] 2> 596015 INFO (qtp1582878819-3338) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[136]} 0 0
[junit4] 2> 596016 INFO (qtp1582878819-3336) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[137]} 0 0
[junit4] 2> 596018 INFO (qtp1582878819-3334) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[138]} 0 0
[junit4] 2> 596022 INFO (qtp1582878819-3335) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[139]} 0 0
[junit4] 2> 596025 INFO (qtp1582878819-3337) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[140]} 0 0
[junit4] 2> 596038 INFO (qtp1582878819-3338) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[141]} 0 0
[junit4] 2> 596042 INFO (qtp1582878819-3336) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[142]} 0 0
[junit4] 2> 596044 INFO (qtp1582878819-3334) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[143]} 0 0
[junit4] 2> 596047 INFO (qtp1582878819-3335) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[144]} 0 0
[junit4] 2> 596049 INFO (qtp1582878819-3337) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[145]} 0 0
[junit4] 2> 596053 INFO (qtp1582878819-3338) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[146]} 0 0
[junit4] 2> 596055 INFO (qtp1582878819-3336) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[147]} 0 0
[junit4] 2> 596058 INFO (qtp1582878819-3334) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[148]} 0 0
[junit4] 2> 596060 INFO (qtp1582878819-3335) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[149]} 0 0
[junit4] 2> 596063 INFO (qtp1582878819-3337) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[150]} 0 0
[junit4] 2> 596066 INFO (qtp1582878819-3338) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[151]} 0 0
[junit4] 2> 596068 INFO (qtp1582878819-3336) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[152]} 0 0
[junit4] 2> 596070 INFO (qtp1582878819-3334) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[153]} 0 0
[junit4] 2> 596075 INFO (qtp1582878819-3335) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[154]} 0 0
[junit4] 2> 596084 INFO (qtp1582878819-3337) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[155]} 0 3
[junit4] 2> 596090 INFO (qtp1582878819-3338) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[156]} 0 0
[junit4] 2> 596093 INFO (qtp1582878819-3336) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[157]} 0 0
[junit4] 2> 596095 INFO (qtp1582878819-3334) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[158]} 0 0
[junit4] 2> 596097 INFO (qtp1582878819-3335) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[159]} 0 0
[junit4] 2> 596100 INFO (qtp1582878819-3337) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[160]} 0 0
[junit4] 2> 596102 INFO (qtp1582878819-3338) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[161]} 0 0
[junit4] 2> 596105 INFO (qtp1582878819-3336) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[162]} 0 0
[junit4] 2> 596106 INFO (qtp1582878819-3334) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[163]} 0 0
[junit4] 2> 596108 INFO (qtp1582878819-3335) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[164]} 0 0
[junit4] 2> 596111 INFO (qtp1582878819-3337) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[165]} 0 0
[junit4] 2> 596114 INFO (qtp1582878819-3338) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[166]} 0 0
[junit4] 2> 596117 INFO (qtp1582878819-3336) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[167]} 0 0
[junit4] 2> 596120 INFO (qtp1582878819-3334) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[168]} 0 0
[junit4] 2> 596123 INFO (qtp1582878819-3335) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[169]} 0 0
[junit4] 2> 596125 INFO (qtp1582878819-3337) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[170]} 0 0
[junit4] 2> 596128 INFO (qtp1582878819-3338) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[171]} 0 0
[junit4] 2> 596131 INFO (qtp1582878819-3336) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[172]} 0 0
[junit4] 2> 596133 INFO (qtp1582878819-3334) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[173]} 0 0
[junit4] 2> 596137 INFO (qtp1582878819-3335) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[174]} 0 0
[junit4] 2> 596139 INFO (qtp1582878819-3337) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[175]} 0 0
[junit4] 2> 596141 INFO (qtp1582878819-3338) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[176]} 0 0
[junit4] 2> 596145 INFO (qtp1582878819-3336) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[177]} 0 0
[junit4] 2> 596150 INFO (qtp1582878819-3334) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[178]} 0 0
[junit4] 2> 596155 INFO (qtp1582878819-3335) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[179]} 0 0
[junit4] 2> 596158 INFO (qtp1582878819-3337) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[180]} 0 0
[junit4] 2> 596160 INFO (qtp1582878819-3338) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[181]} 0 0
[junit4] 2> 596162 INFO (qtp1582878819-3336) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[182]} 0 0
[junit4] 2> 596164 INFO (qtp1582878819-3334) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[183]} 0 0
[junit4] 2> 596166 INFO (qtp1582878819-3335) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[184]} 0 0
[junit4] 2> 596168 INFO (qtp1582878819-3337) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[185]} 0 0
[junit4] 2> 596169 INFO (qtp1582878819-3338) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[186]} 0 0
[junit4] 2> 596171 INFO (qtp1582878819-3336) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[187]} 0 0
[junit4] 2> 596173 INFO (qtp1582878819-3334) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[188]} 0 0
[junit4] 2> 596175 INFO (qtp1582878819-3335) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[189]} 0 0
[junit4] 2> 596176 INFO (qtp1582878819-3337) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[190]} 0 0
[junit4] 2> 596178 INFO (qtp1582878819-3338) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[191]} 0 0
[junit4] 2> 596181 INFO (qtp1582878819-3336) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[192]} 0 0
[junit4] 2> 596182 INFO (qtp1582878819-3334) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[193]} 0 0
[junit4] 2> 596190 INFO (qtp1582878819-3335) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[194]} 0 5
[junit4] 2> 596192 INFO (qtp1582878819-3337) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[195]} 0 0
[junit4] 2> 596194 INFO (qtp1582878819-3338) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[196]} 0 0
[junit4] 2> 596196 INFO (qtp1582878819-3336) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[197]} 0 0
[junit4] 2> 596197 INFO (qtp1582878819-3334) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[198]} 0 0
[junit4] 2> 596199 INFO (qtp1582878819-3335) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[199]} 0 0
[junit4] 2> 596201 INFO (qtp1582878819-3337) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[200]} 0 0
[junit4] 2> 596202 INFO (qtp1582878819-3338) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[201]} 0 0
[junit4] 2> 596205 INFO (qtp1582878819-3336) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[202]} 0 0
[junit4] 2> 596207 INFO (qtp1582878819-3334) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[203]} 0 0
[junit4] 2> 596209 INFO (qtp1582878819-3335) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[204]} 0 0
[junit4] 2> 596212 INFO (qtp1582878819-3337) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[205]} 0 0
[junit4] 2> 596214 INFO (qtp1582878819-3338) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[206]} 0 0
[junit4] 2> 596216 INFO (qtp1582878819-3336) [ x
[...truncated too long message...]
eState SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 1335357 INFO (TEST-TestReplicationHandler.testEmptyCommits-seed#[6C7ABFFA90A2FF0C]) [ x:collection1] o.a.s.u.DefaultSolrCoreState closing IndexWriter with IndexWriterCloser
[junit4] 2> 1335357 INFO (TEST-TestReplicationHandler.testEmptyCommits-seed#[6C7ABFFA90A2FF0C]) [ x:collection1] o.a.s.c.SolrCore [collection1] Closing main searcher on request.
[junit4] 2> 1335357 INFO (TEST-TestReplicationHandler.testEmptyCommits-seed#[6C7ABFFA90A2FF0C]) [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 1335357 INFO (TEST-TestReplicationHandler.testEmptyCommits-seed#[6C7ABFFA90A2FF0C]) [ x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_6C7ABFFA90A2FF0C-001/solr-instance-027/./collection1/data/index [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_6C7ABFFA90A2FF0C-001/solr-instance-027/./collection1/data/index;done=false>>]
[junit4] 2> 1335357 INFO (TEST-TestReplicationHandler.testEmptyCommits-seed#[6C7ABFFA90A2FF0C]) [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_6C7ABFFA90A2FF0C-001/solr-instance-027/./collection1/data/index
[junit4] 2> 1335358 INFO (TEST-TestReplicationHandler.testEmptyCommits-seed#[6C7ABFFA90A2FF0C]) [ x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_6C7ABFFA90A2FF0C-001/solr-instance-027/./collection1/data [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_6C7ABFFA90A2FF0C-001/solr-instance-027/./collection1/data;done=false>>]
[junit4] 2> 1335358 INFO (TEST-TestReplicationHandler.testEmptyCommits-seed#[6C7ABFFA90A2FF0C]) [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_6C7ABFFA90A2FF0C-001/solr-instance-027/./collection1/data
[junit4] 2> 1335358 INFO (TEST-TestReplicationHandler.testEmptyCommits-seed#[6C7ABFFA90A2FF0C]) [ x:collection1] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@70648c7c{/solr,null,UNAVAILABLE}
[junit4] 2> 1335362 INFO (TEST-TestReplicationHandler.testEmptyCommits-seed#[6C7ABFFA90A2FF0C]) [ ] o.e.j.s.ServerConnector Stopped ServerConnector@a17638c{HTTP/1.1}{127.0.0.1:0}
[junit4] 2> 1335362 INFO (TEST-TestReplicationHandler.testEmptyCommits-seed#[6C7ABFFA90A2FF0C]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=885203206
[junit4] 2> 1335362 INFO (TEST-TestReplicationHandler.testEmptyCommits-seed#[6C7ABFFA90A2FF0C]) [ x:collection1] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@15b45ba3
[junit4] 2> 1335362 INFO (TEST-TestReplicationHandler.testEmptyCommits-seed#[6C7ABFFA90A2FF0C]) [ x:collection1] o.a.s.u.UpdateHandler closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 1335362 INFO (TEST-TestReplicationHandler.testEmptyCommits-seed#[6C7ABFFA90A2FF0C]) [ x:collection1] o.a.s.u.SolrCoreState Closing SolrCoreState
[junit4] 2> 1335362 INFO (TEST-TestReplicationHandler.testEmptyCommits-seed#[6C7ABFFA90A2FF0C]) [ x:collection1] o.a.s.u.DefaultSolrCoreState SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 1335362 INFO (TEST-TestReplicationHandler.testEmptyCommits-seed#[6C7ABFFA90A2FF0C]) [ x:collection1] o.a.s.u.DefaultSolrCoreState closing IndexWriter with IndexWriterCloser
[junit4] 2> 1335363 INFO (TEST-TestReplicationHandler.testEmptyCommits-seed#[6C7ABFFA90A2FF0C]) [ x:collection1] o.a.s.c.SolrCore [collection1] Closing main searcher on request.
[junit4] 2> 1335363 INFO (TEST-TestReplicationHandler.testEmptyCommits-seed#[6C7ABFFA90A2FF0C]) [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 1335363 INFO (TEST-TestReplicationHandler.testEmptyCommits-seed#[6C7ABFFA90A2FF0C]) [ x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_6C7ABFFA90A2FF0C-001/solr-instance-028/./collection1/data [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_6C7ABFFA90A2FF0C-001/solr-instance-028/./collection1/data;done=false>>]
[junit4] 2> 1335363 INFO (TEST-TestReplicationHandler.testEmptyCommits-seed#[6C7ABFFA90A2FF0C]) [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_6C7ABFFA90A2FF0C-001/solr-instance-028/./collection1/data
[junit4] 2> 1335363 INFO (TEST-TestReplicationHandler.testEmptyCommits-seed#[6C7ABFFA90A2FF0C]) [ x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_6C7ABFFA90A2FF0C-001/solr-instance-028/./collection1/data/index [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_6C7ABFFA90A2FF0C-001/solr-instance-028/./collection1/data/index;done=false>>]
[junit4] 2> 1335363 INFO (TEST-TestReplicationHandler.testEmptyCommits-seed#[6C7ABFFA90A2FF0C]) [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_6C7ABFFA90A2FF0C-001/solr-instance-028/./collection1/data/index
[junit4] 2> 1335364 INFO (TEST-TestReplicationHandler.testEmptyCommits-seed#[6C7ABFFA90A2FF0C]) [ x:collection1] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@4fa21b9d{/solr,null,UNAVAILABLE}
[junit4] 2> 1335365 INFO (SUITE-TestReplicationHandler-seed#[6C7ABFFA90A2FF0C]-worker) [ ] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_6C7ABFFA90A2FF0C-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene60): {name=PostingsFormat(name=Direct), id=PostingsFormat(name=Direct), newname=PostingsFormat(name=Direct)}, docValues:{}, sim=ClassicSimilarity, locale=pl_PL, timezone=Pacific/Tarawa
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_66 (64-bit)/cpus=4,threads=1,free=37994768,total=527958016
[junit4] 2> NOTE: All tests run in this JVM: [PolyFieldTest, CoreAdminRequestStatusTest, DataDrivenBlockJoinTest, CurrencyFieldOpenExchangeTest, TestDownShardTolerantSearch, TestShardHandlerFactory, TestPseudoReturnFields, TestBinaryField, QueryElevationComponentTest, PrimUtilsTest, TestLuceneMatchVersion, DeleteShardTest, TestCloudPivotFacet, BasicAuthIntegrationTest, ZkStateReaderTest, TestClassicSimilarityFactory, RAMDirectoryFactoryTest, TestRandomDVFaceting, SolrCoreTest, RequiredFieldsTest, TestBulkSchemaAPI, TestFaceting, TestMergePolicyConfig, DistributedQueueTest, TestRandomFaceting, TestPerFieldSimilarityClassic, SyncSliceTest, SharedFSAutoReplicaFailoverTest, ExplicitHLLTest, TestBadConfig, DistributedQueryElevationComponentTest, TestReplicationHandler]
[junit4] Completed [140/560] on J0 in 740.90s, 13 tests, 1 failure <<< FAILURES!
[...truncated 1344 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987: There were test failures: 560 suites (8 ignored), 2217 tests, 1 failure, 32 ignored (18 assumptions) [seed: 6C7ABFFA90A2FF0C]
Total time: 199 minutes 0 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 860 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/860/
3 tests failed.
FAILED: org.apache.solr.hadoop.MorphlineBasicMiniMRTest.mrRun
Error Message:
Failed on local exception: java.io.IOException: Connection reset by peer; Host Details : local host is: "lucene1-us-west/10.41.0.5"; destination host is: "lucene1-us-west.apache.org":35545;
Stack Trace:
java.io.IOException: Failed on local exception: java.io.IOException: Connection reset by peer; Host Details : local host is: "lucene1-us-west/10.41.0.5"; destination host is: "lucene1-us-west.apache.org":35545;
at __randomizedtesting.SeedInfo.seed([51858827D9E21F27:5FD73C29D8742D28]:0)
at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:772)
at org.apache.hadoop.ipc.Client.call(Client.java:1472)
at org.apache.hadoop.ipc.Client.call(Client.java:1399)
at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232)
at com.sun.proxy.$Proxy109.getClusterMetrics(Unknown Source)
at org.apache.hadoop.yarn.api.impl.pb.client.ApplicationClientProtocolPBClientImpl.getClusterMetrics(ApplicationClientProtocolPBClientImpl.java:202)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
at com.sun.proxy.$Proxy110.getClusterMetrics(Unknown Source)
at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.getYarnClusterMetrics(YarnClientImpl.java:461)
at org.apache.hadoop.mapred.ResourceMgrDelegate.getClusterMetrics(ResourceMgrDelegate.java:151)
at org.apache.hadoop.mapred.YARNRunner.getClusterMetrics(YARNRunner.java:179)
at org.apache.hadoop.mapreduce.Cluster.getClusterStatus(Cluster.java:246)
at org.apache.hadoop.mapred.JobClient$3.run(JobClient.java:719)
at org.apache.hadoop.mapred.JobClient$3.run(JobClient.java:717)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.hadoop.mapred.JobClient.getClusterStatus(JobClient.java:717)
at org.apache.solr.hadoop.MapReduceIndexerTool.run(MapReduceIndexerTool.java:644)
at org.apache.solr.hadoop.MapReduceIndexerTool.run(MapReduceIndexerTool.java:607)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.solr.hadoop.MorphlineBasicMiniMRTest.mrRun(MorphlineBasicMiniMRTest.java:363)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: Connection reset by peer
at sun.nio.ch.FileDispatcherImpl.write0(Native Method)
at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47)
at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)
at sun.nio.ch.IOUtil.write(IOUtil.java:65)
at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:471)
at org.apache.hadoop.net.SocketOutputStream$Writer.performIO(SocketOutputStream.java:63)
at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:142)
at org.apache.hadoop.net.SocketOutputStream.write(SocketOutputStream.java:159)
at org.apache.hadoop.net.SocketOutputStream.write(SocketOutputStream.java:117)
at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140)
at java.io.DataOutputStream.flush(DataOutputStream.java:123)
at org.apache.hadoop.ipc.Client$Connection$3.run(Client.java:1030)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
... 1 more
FAILED: junit.framework.TestSuite.org.apache.solr.hadoop.MorphlineBasicMiniMRTest
Error Message:
1 thread leaked from SUITE scope at org.apache.solr.hadoop.MorphlineBasicMiniMRTest: 1) Thread[id=440, name=Node Status Updater, state=TIMED_WAITING, group=TGRP-MorphlineBasicMiniMRTest] at java.lang.Object.wait(Native Method) at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl$1.run(NodeStatusUpdaterImpl.java:659) at java.lang.Thread.run(Thread.java:745)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.hadoop.MorphlineBasicMiniMRTest:
1) Thread[id=440, name=Node Status Updater, state=TIMED_WAITING, group=TGRP-MorphlineBasicMiniMRTest]
at java.lang.Object.wait(Native Method)
at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl$1.run(NodeStatusUpdaterImpl.java:659)
at java.lang.Thread.run(Thread.java:745)
at __randomizedtesting.SeedInfo.seed([51858827D9E21F27]:0)
FAILED: org.apache.solr.hadoop.MorphlineGoLiveMiniMRTest.test
Error Message:
Failed on local exception: java.io.IOException: Broken pipe; Host Details : local host is: "lucene1-us-west/10.41.0.5"; destination host is: "lucene1-us-west.apache.org":40702;
Stack Trace:
java.io.IOException: Failed on local exception: java.io.IOException: Broken pipe; Host Details : local host is: "lucene1-us-west/10.41.0.5"; destination host is: "lucene1-us-west.apache.org":40702;
at __randomizedtesting.SeedInfo.seed([51858827D9E21F27:D9D1B7FD771E72DF]:0)
at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:772)
at org.apache.hadoop.ipc.Client.call(Client.java:1472)
at org.apache.hadoop.ipc.Client.call(Client.java:1399)
at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232)
at com.sun.proxy.$Proxy111.getClusterMetrics(Unknown Source)
at org.apache.hadoop.yarn.api.impl.pb.client.ApplicationClientProtocolPBClientImpl.getClusterMetrics(ApplicationClientProtocolPBClientImpl.java:202)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
at com.sun.proxy.$Proxy112.getClusterMetrics(Unknown Source)
at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.getYarnClusterMetrics(YarnClientImpl.java:461)
at org.apache.hadoop.mapred.ResourceMgrDelegate.getClusterMetrics(ResourceMgrDelegate.java:151)
at org.apache.hadoop.mapred.YARNRunner.getClusterMetrics(YARNRunner.java:179)
at org.apache.hadoop.mapreduce.Cluster.getClusterStatus(Cluster.java:246)
at org.apache.hadoop.mapred.JobClient$3.run(JobClient.java:719)
at org.apache.hadoop.mapred.JobClient$3.run(JobClient.java:717)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.hadoop.mapred.JobClient.getClusterStatus(JobClient.java:717)
at org.apache.solr.hadoop.MapReduceIndexerTool.run(MapReduceIndexerTool.java:644)
at org.apache.solr.hadoop.MapReduceIndexerTool.run(MapReduceIndexerTool.java:607)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.solr.hadoop.MorphlineGoLiveMiniMRTest.test(MorphlineGoLiveMiniMRTest.java:402)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:963)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:938)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: Broken pipe
at sun.nio.ch.FileDispatcherImpl.write0(Native Method)
at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47)
at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)
at sun.nio.ch.IOUtil.write(IOUtil.java:65)
at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:471)
at org.apache.hadoop.net.SocketOutputStream$Writer.performIO(SocketOutputStream.java:63)
at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:142)
at org.apache.hadoop.net.SocketOutputStream.write(SocketOutputStream.java:159)
at org.apache.hadoop.net.SocketOutputStream.write(SocketOutputStream.java:117)
at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140)
at java.io.DataOutputStream.flush(DataOutputStream.java:123)
at org.apache.hadoop.ipc.Client$Connection$3.run(Client.java:1030)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
... 1 more
Build Log:
[...truncated 17911 lines...]
[junit4] Suite: org.apache.solr.hadoop.MorphlineBasicMiniMRTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/init-core-data-001
[junit4] 2> 0 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
[junit4] 2> 1161 WARN (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.u.NativeCodeLoader Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
[junit4] 1> Formatting using clusterid: testClusterID
[junit4] 2> 1260 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.n.FSNamesystem No KeyProvider found.
[junit4] 2> 1342 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.n.FSNamesystem fsLock is fair:true
[junit4] 2> 1428 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.c.C.deprecation hadoop.configured.node.mapping is deprecated. Instead, use net.topology.configured.node.mapping
[junit4] 2> 1428 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.b.DatanodeManager dfs.block.invalidate.limit=1000
[junit4] 2> 1428 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.b.DatanodeManager dfs.namenode.datanode.registration.ip-hostname-check=true
[junit4] 2> 1448 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.b.BlockManager dfs.namenode.startup.delay.block.deletion.sec is set to 000:00:00:00.000
[junit4] 2> 1453 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.b.BlockManager The block deletion will start around 2015 ??? 22 09:27:56
[junit4] 2> 1458 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.u.GSet Computing capacity for map BlocksMap
[junit4] 2> 1458 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.u.GSet VM type = 64-bit
[junit4] 2> 1460 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.u.GSet 2.0% max memory 455.5 MB = 9.1 MB
[junit4] 2> 1461 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.u.GSet capacity = 2^20 = 1048576 entries
[junit4] 2> 1502 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.b.BlockManager dfs.block.access.token.enable=false
[junit4] 2> 1502 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.b.BlockManager defaultReplication = 2
[junit4] 2> 1502 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.b.BlockManager maxReplication = 512
[junit4] 2> 1503 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.b.BlockManager minReplication = 1
[junit4] 2> 1504 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.b.BlockManager maxReplicationStreams = 2
[junit4] 2> 1504 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.b.BlockManager shouldCheckForEnoughRacks = false
[junit4] 2> 1504 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.b.BlockManager replicationRecheckInterval = 3000
[junit4] 2> 1505 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.b.BlockManager encryptDataTransfer = false
[junit4] 2> 1505 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.b.BlockManager maxNumBlocksToLog = 1000
[junit4] 2> 1520 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.n.FSNamesystem fsOwner = jenkins (auth:SIMPLE)
[junit4] 2> 1520 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.n.FSNamesystem supergroup = supergroup
[junit4] 2> 1520 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.n.FSNamesystem isPermissionEnabled = true
[junit4] 2> 1525 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.n.FSNamesystem HA Enabled: false
[junit4] 2> 1530 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.n.FSNamesystem Append Enabled: true
[junit4] 2> 2145 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.u.GSet Computing capacity for map INodeMap
[junit4] 2> 2145 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.u.GSet VM type = 64-bit
[junit4] 2> 2146 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.u.GSet 1.0% max memory 455.5 MB = 4.6 MB
[junit4] 2> 2146 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.u.GSet capacity = 2^19 = 524288 entries
[junit4] 2> 2146 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.n.NameNode Caching file names occuring more than 10 times
[junit4] 2> 2161 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.u.GSet Computing capacity for map cachedBlocks
[junit4] 2> 2161 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.u.GSet VM type = 64-bit
[junit4] 2> 2161 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.u.GSet 0.25% max memory 455.5 MB = 1.1 MB
[junit4] 2> 2161 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.u.GSet capacity = 2^17 = 131072 entries
[junit4] 2> 2165 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.n.FSNamesystem dfs.namenode.safemode.threshold-pct = 0.9990000128746033
[junit4] 2> 2165 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.n.FSNamesystem dfs.namenode.safemode.min.datanodes = 0
[junit4] 2> 2165 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.n.FSNamesystem dfs.namenode.safemode.extension = 0
[junit4] 2> 2168 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.n.FSNamesystem Retry cache on namenode is enabled
[junit4] 2> 2168 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.n.FSNamesystem Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000 millis
[junit4] 2> 2174 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.u.GSet Computing capacity for map NameNodeRetryCache
[junit4] 2> 2174 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.u.GSet VM type = 64-bit
[junit4] 2> 2174 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.u.GSet 0.029999999329447746% max memory 455.5 MB = 139.9 KB
[junit4] 2> 2174 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.u.GSet capacity = 2^14 = 16384 entries
[junit4] 2> 2183 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.n.NNConf ACLs enabled? false
[junit4] 2> 2183 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.n.NNConf XAttrs enabled? true
[junit4] 2> 2184 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.n.NNConf Maximum size of an xattr: 16384
[junit4] 2> 2297 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.n.FSImage Allocated new BlockPoolId: BP-868080200-10.41.0.5-1448195277271
[junit4] 2> 2329 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/name1 has been successfully formatted.
[junit4] 2> 2333 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/name2 has been successfully formatted.
[junit4] 2> 2625 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.n.NNStorageRetentionManager Going to retain 1 images with txid >= 0
[junit4] 2> 2631 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.n.NameNode createNameNode []
[junit4] 2> 2693 WARN (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
[junit4] 2> 2850 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.m.i.MetricsSystemImpl Scheduled snapshot period at 10 second(s).
[junit4] 2> 2850 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.m.i.MetricsSystemImpl NameNode metrics system started
[junit4] 2> 2855 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.n.NameNode fs.defaultFS is hdfs://127.0.0.1:0
[junit4] 2> 2946 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.DFSUtil Starting Web-server for hdfs at: http://localhost:0
[junit4] 2> 3128 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.m.log Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
[junit4] 2> 3143 WARN (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 3187 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.HttpServer2 Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
[junit4] 2> 3191 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.HttpServer2 Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context hdfs
[junit4] 2> 3191 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.HttpServer2 Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
[junit4] 2> 3191 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.HttpServer2 Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
[junit4] 2> 3245 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.HttpServer2 Added filter 'org.apache.hadoop.hdfs.web.AuthFilter' (class=org.apache.hadoop.hdfs.web.AuthFilter)
[junit4] 2> 3247 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.HttpServer2 addJerseyResourcePackage: packageName=org.apache.hadoop.hdfs.server.namenode.web.resources;org.apache.hadoop.hdfs.web.resources, pathSpec=/webhdfs/v1/*
[junit4] 2> 3285 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.HttpServer2 Jetty bound to port 54277
[junit4] 2> 3285 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 3509 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_54277_hdfs____.u3h03n/webapp
[junit4] 2> 4012 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
[junit4] 2> 5077 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:54277
[junit4] 2> 5088 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.n.FSNamesystem No KeyProvider found.
[junit4] 2> 5089 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.n.FSNamesystem fsLock is fair:true
[junit4] 2> 5089 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.b.DatanodeManager dfs.block.invalidate.limit=1000
[junit4] 2> 5089 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.b.DatanodeManager dfs.namenode.datanode.registration.ip-hostname-check=true
[junit4] 2> 5090 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.b.BlockManager dfs.namenode.startup.delay.block.deletion.sec is set to 000:00:00:00.000
[junit4] 2> 5091 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.b.BlockManager The block deletion will start around 2015 ??? 22 09:28:00
[junit4] 2> 5091 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.u.GSet Computing capacity for map BlocksMap
[junit4] 2> 5091 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.u.GSet VM type = 64-bit
[junit4] 2> 5091 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.u.GSet 2.0% max memory 455.5 MB = 9.1 MB
[junit4] 2> 5091 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.u.GSet capacity = 2^20 = 1048576 entries
[junit4] 2> 5092 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.b.BlockManager dfs.block.access.token.enable=false
[junit4] 2> 5092 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.b.BlockManager defaultReplication = 2
[junit4] 2> 5092 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.b.BlockManager maxReplication = 512
[junit4] 2> 5092 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.b.BlockManager minReplication = 1
[junit4] 2> 5092 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.b.BlockManager maxReplicationStreams = 2
[junit4] 2> 5092 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.b.BlockManager shouldCheckForEnoughRacks = false
[junit4] 2> 5092 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.b.BlockManager replicationRecheckInterval = 3000
[junit4] 2> 5092 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.b.BlockManager encryptDataTransfer = false
[junit4] 2> 5093 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.b.BlockManager maxNumBlocksToLog = 1000
[junit4] 2> 5093 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.n.FSNamesystem fsOwner = jenkins (auth:SIMPLE)
[junit4] 2> 5093 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.n.FSNamesystem supergroup = supergroup
[junit4] 2> 5093 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.n.FSNamesystem isPermissionEnabled = true
[junit4] 2> 5093 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.n.FSNamesystem HA Enabled: false
[junit4] 2> 5093 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.n.FSNamesystem Append Enabled: true
[junit4] 2> 5094 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.u.GSet Computing capacity for map INodeMap
[junit4] 2> 5094 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.u.GSet VM type = 64-bit
[junit4] 2> 5094 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.u.GSet 1.0% max memory 455.5 MB = 4.6 MB
[junit4] 2> 5094 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.u.GSet capacity = 2^19 = 524288 entries
[junit4] 2> 5095 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.n.NameNode Caching file names occuring more than 10 times
[junit4] 2> 5095 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.u.GSet Computing capacity for map cachedBlocks
[junit4] 2> 5095 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.u.GSet VM type = 64-bit
[junit4] 2> 5095 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.u.GSet 0.25% max memory 455.5 MB = 1.1 MB
[junit4] 2> 5095 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.u.GSet capacity = 2^17 = 131072 entries
[junit4] 2> 5095 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.n.FSNamesystem dfs.namenode.safemode.threshold-pct = 0.9990000128746033
[junit4] 2> 5096 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.n.FSNamesystem dfs.namenode.safemode.min.datanodes = 0
[junit4] 2> 5096 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.n.FSNamesystem dfs.namenode.safemode.extension = 0
[junit4] 2> 5096 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.n.FSNamesystem Retry cache on namenode is enabled
[junit4] 2> 5096 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.n.FSNamesystem Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000 millis
[junit4] 2> 5096 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.u.GSet Computing capacity for map NameNodeRetryCache
[junit4] 2> 5096 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.u.GSet VM type = 64-bit
[junit4] 2> 5096 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.u.GSet 0.029999999329447746% max memory 455.5 MB = 139.9 KB
[junit4] 2> 5096 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.u.GSet capacity = 2^14 = 16384 entries
[junit4] 2> 5099 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.n.NNConf ACLs enabled? false
[junit4] 2> 5099 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.n.NNConf XAttrs enabled? true
[junit4] 2> 5099 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.n.NNConf Maximum size of an xattr: 16384
[junit4] 2> 5122 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.c.Storage Lock on /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/name1/in_use.lock acquired by nodename 13423@lucene1-us-west
[junit4] 2> 5129 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.c.Storage Lock on /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/name2/in_use.lock acquired by nodename 13423@lucene1-us-west
[junit4] 2> 5134 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.n.FileJournalManager Recovering unfinalized segments in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/name1/current
[junit4] 2> 5135 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.n.FileJournalManager Recovering unfinalized segments in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/name2/current
[junit4] 2> 5135 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.n.FSImage No edit log streams selected.
[junit4] 2> 5225 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.n.FSImageFormatPBINode Loading 1 INodes.
[junit4] 2> 5244 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.n.FSImageFormatProtobuf Loaded FSImage in 0 seconds.
[junit4] 2> 5245 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.n.FSImage Loaded image for txid 0 from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/name1/current/fsimage_0000000000000000000
[junit4] 2> 5254 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.n.FSNamesystem Need to save fs image? false (staleImage=false, haEnabled=false, isRollingUpgrade=false)
[junit4] 2> 5255 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.n.FSEditLog Starting log segment at 1
[junit4] 2> 5376 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.n.NameCache initialized with 0 entries 0 lookups
[junit4] 2> 5376 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.n.FSNamesystem Finished loading FSImage in 277 msecs
[junit4] 2> 5888 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.n.NameNode RPC server is binding to localhost:0
[junit4] 2> 5912 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.i.CallQueueManager Using callQueue class java.util.concurrent.LinkedBlockingQueue
[junit4] 2> 5981 INFO (Socket Reader #1 for port 59254) [ ] o.a.h.i.Server Starting Socket Reader #1 for port 59254
[junit4] 2> 6069 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.n.NameNode Clients are to use localhost:59254 to access this namenode/service.
[junit4] 2> 6072 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.n.FSNamesystem Registered FSNamesystemState MBean
[junit4] 2> 6109 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.n.FSNamesystem Number of blocks under construction: 0
[junit4] 2> 6109 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.n.FSNamesystem Number of blocks under construction: 0
[junit4] 2> 6109 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.n.FSNamesystem initializing replication queues
[junit4] 2> 6111 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.StateChange STATE* Leaving safe mode after 1 secs
[junit4] 2> 6111 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.StateChange STATE* Network topology has 0 racks and 0 datanodes
[junit4] 2> 6111 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.StateChange STATE* UnderReplicatedBlocks has 0 blocks
[junit4] 2> 6116 INFO (Replication Queue Initializer) [ ] o.a.h.h.s.b.BlockManager Total number of blocks = 0
[junit4] 2> 6119 INFO (Replication Queue Initializer) [ ] o.a.h.h.s.b.BlockManager Number of invalid blocks = 0
[junit4] 2> 6119 INFO (Replication Queue Initializer) [ ] o.a.h.h.s.b.BlockManager Number of under-replicated blocks = 0
[junit4] 2> 6119 INFO (Replication Queue Initializer) [ ] o.a.h.h.s.b.BlockManager Number of over-replicated blocks = 0
[junit4] 2> 6119 INFO (Replication Queue Initializer) [ ] o.a.h.h.s.b.BlockManager Number of blocks being written = 0
[junit4] 2> 6119 INFO (Replication Queue Initializer) [ ] o.a.h.h.StateChange STATE* Replication Queue initialization scan for invalid, over- and under-replicated blocks completed in 8 msec
[junit4] 2> 6220 INFO (IPC Server Responder) [ ] o.a.h.i.Server IPC Server Responder: starting
[junit4] 2> 6232 INFO (IPC Server listener on 59254) [ ] o.a.h.i.Server IPC Server listener on 59254: starting
[junit4] 2> 6254 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.n.NameNode NameNode RPC up at: localhost/127.0.0.1:59254
[junit4] 2> 6254 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.n.FSNamesystem Starting services required for active state
[junit4] 2> 6282 INFO (CacheReplicationMonitor(554539879)) [ ] o.a.h.h.s.b.CacheReplicationMonitor Starting CacheReplicationMonitor with interval 30000 milliseconds
[junit4] 2> 6282 INFO (CacheReplicationMonitor(554539879)) [ ] o.a.h.h.s.b.CacheReplicationMonitor Rescanning after 16655579352 milliseconds
[junit4] 2> 6283 INFO (CacheReplicationMonitor(554539879)) [ ] o.a.h.h.s.b.CacheReplicationMonitor Scanned 0 directive(s) and 0 block(s) in 0 millisecond(s).
[junit4] 2> 6285 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.MiniDFSCluster Starting DataNode 0 with dfs.datanode.data.dir: [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data1,[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data2
[junit4] 2> 6389 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.m.i.MetricsSystemImpl DataNode metrics system started (again)
[junit4] 2> 6391 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.d.DataNode Configured hostname is 127.0.0.1
[junit4] 2> 6400 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.d.DataNode Starting DataNode with maxLockedMemory = 0
[junit4] 2> 6409 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.d.DataNode Opened streaming server at /127.0.0.1:39918
[junit4] 2> 6414 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.d.DataNode Balancing bandwith is 1048576 bytes/s
[junit4] 2> 6414 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.d.DataNode Number threads for balancing is 5
[junit4] 2> 6420 WARN (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 6421 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.HttpServer2 Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
[junit4] 2> 6422 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.HttpServer2 Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context datanode
[junit4] 2> 6431 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.HttpServer2 Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
[junit4] 2> 6431 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.HttpServer2 Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
[junit4] 2> 6443 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.HttpServer2 addJerseyResourcePackage: packageName=org.apache.hadoop.hdfs.server.datanode.web.resources;org.apache.hadoop.hdfs.web.resources, pathSpec=/webhdfs/v1/*
[junit4] 2> 6445 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.HttpServer2 Jetty bound to port 49268
[junit4] 2> 6445 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 6472 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_49268_datanode____.uxtxvu/webapp
[junit4] 2> 6613 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
[junit4] 2> 7040 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:49268
[junit4] 2> 7055 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.d.DataNode dnUserName = jenkins
[junit4] 2> 7055 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.d.DataNode supergroup = supergroup
[junit4] 2> 7085 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.i.CallQueueManager Using callQueue class java.util.concurrent.LinkedBlockingQueue
[junit4] 2> 7088 INFO (Socket Reader #1 for port 57128) [ ] o.a.h.i.Server Starting Socket Reader #1 for port 57128
[junit4] 2> 7108 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.d.DataNode Opened IPC server at /127.0.0.1:57128
[junit4] 2> 7127 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.d.DataNode Refresh request received for nameservices: null
[junit4] 2> 7132 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.d.DataNode Starting BPOfferServices for nameservices: <default>
[junit4] 2> 7172 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:59254) [ ] o.a.h.h.s.d.DataNode Block pool <registering> (Datanode Uuid unassigned) service to localhost/127.0.0.1:59254 starting to offer service
[junit4] 2> 7192 INFO (IPC Server Responder) [ ] o.a.h.i.Server IPC Server Responder: starting
[junit4] 2> 7197 INFO (IPC Server listener on 57128) [ ] o.a.h.i.Server IPC Server listener on 57128: starting
[junit4] 2> 7268 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.MiniDFSCluster Starting DataNode 1 with dfs.datanode.data.dir: [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data3,[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data4
[junit4] 2> 7371 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.m.i.MetricsSystemImpl DataNode metrics system started (again)
[junit4] 2> 7371 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.d.DataNode Configured hostname is 127.0.0.1
[junit4] 2> 7371 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.d.DataNode Starting DataNode with maxLockedMemory = 0
[junit4] 2> 7372 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.d.DataNode Opened streaming server at /127.0.0.1:56831
[junit4] 2> 7372 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.d.DataNode Balancing bandwith is 1048576 bytes/s
[junit4] 2> 7372 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.d.DataNode Number threads for balancing is 5
[junit4] 2> 7375 WARN (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 7377 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.HttpServer2 Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
[junit4] 2> 7377 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.HttpServer2 Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context datanode
[junit4] 2> 7377 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.HttpServer2 Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
[junit4] 2> 7377 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.HttpServer2 Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
[junit4] 2> 7378 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.HttpServer2 addJerseyResourcePackage: packageName=org.apache.hadoop.hdfs.server.datanode.web.resources;org.apache.hadoop.hdfs.web.resources, pathSpec=/webhdfs/v1/*
[junit4] 2> 7378 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.HttpServer2 Jetty bound to port 53675
[junit4] 2> 7379 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 7417 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_53675_datanode____5ypijh/webapp
[junit4] 2> 7628 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
[junit4] 2> 7948 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:59254) [ ] o.a.h.h.s.c.Storage DataNode version: -56 and NameNode layout version: -60
[junit4] 2> 7953 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:59254) [ ] o.a.h.h.s.c.Storage Lock on /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data1/in_use.lock acquired by nodename 13423@lucene1-us-west
[junit4] 2> 7955 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:59254) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data1 is not formatted for BP-868080200-10.41.0.5-1448195277271
[junit4] 2> 7955 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:59254) [ ] o.a.h.h.s.c.Storage Formatting ...
[junit4] 2> 7971 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:59254) [ ] o.a.h.h.s.c.Storage Lock on /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data2/in_use.lock acquired by nodename 13423@lucene1-us-west
[junit4] 2> 7972 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:59254) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data2 is not formatted for BP-868080200-10.41.0.5-1448195277271
[junit4] 2> 7972 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:59254) [ ] o.a.h.h.s.c.Storage Formatting ...
[junit4] 2> 8091 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:59254) [ ] o.a.h.h.s.c.Storage Analyzing storage directories for bpid BP-868080200-10.41.0.5-1448195277271
[junit4] 2> 8092 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:59254) [ ] o.a.h.h.s.c.Storage Locking is disabled
[junit4] 2> 8094 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:59254) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data1/current/BP-868080200-10.41.0.5-1448195277271 is not formatted.
[junit4] 2> 8094 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:59254) [ ] o.a.h.h.s.c.Storage Formatting ...
[junit4] 2> 8094 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:59254) [ ] o.a.h.h.s.c.Storage Formatting block pool BP-868080200-10.41.0.5-1448195277271 directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data1/current/BP-868080200-10.41.0.5-1448195277271/current
[junit4] 2> 8100 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:59254) [ ] o.a.h.h.s.c.Storage Locking is disabled
[junit4] 2> 8101 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:59254) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data2/current/BP-868080200-10.41.0.5-1448195277271 is not formatted.
[junit4] 2> 8101 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:59254) [ ] o.a.h.h.s.c.Storage Formatting ...
[junit4] 2> 8101 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:59254) [ ] o.a.h.h.s.c.Storage Formatting block pool BP-868080200-10.41.0.5-1448195277271 directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data2/current/BP-868080200-10.41.0.5-1448195277271/current
[junit4] 2> 8104 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:59254) [ ] o.a.h.h.s.c.Storage Restored 0 block files from trash.
[junit4] 2> 8104 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:59254) [ ] o.a.h.h.s.c.Storage Restored 0 block files from trash.
[junit4] 2> 8113 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:59254) [ ] o.a.h.h.s.d.DataNode Setting up storage: nsid=94744280;bpid=BP-868080200-10.41.0.5-1448195277271;lv=-56;nsInfo=lv=-60;cid=testClusterID;nsid=94744280;c=0;bpid=BP-868080200-10.41.0.5-1448195277271;dnuuid=null
[junit4] 2> 8128 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:59254) [ ] o.a.h.h.s.d.DataNode Generated and persisted new Datanode UUID 4eac65ff-7639-4288-9ffc-da35a558ad8b
[junit4] 2> 8231 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:59254) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Added new volume: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data1/current
[junit4] 2> 8238 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:59254) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Added volume - /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data1/current, StorageType: DISK
[junit4] 2> 8238 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:59254) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Added new volume: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data2/current
[junit4] 2> 8239 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:59254) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Added volume - /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data2/current, StorageType: DISK
[junit4] 2> 8239 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:53675
[junit4] 2> 8250 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.d.DataNode dnUserName = jenkins
[junit4] 2> 8250 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.d.DataNode supergroup = supergroup
[junit4] 2> 8251 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.i.CallQueueManager Using callQueue class java.util.concurrent.LinkedBlockingQueue
[junit4] 2> 8256 INFO (Socket Reader #1 for port 42009) [ ] o.a.h.i.Server Starting Socket Reader #1 for port 42009
[junit4] 2> 8269 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.d.DataNode Opened IPC server at /127.0.0.1:42009
[junit4] 2> 8271 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:59254) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Registered FSDatasetState MBean
[junit4] 2> 8280 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:59254) [ ] o.a.h.h.s.d.DirectoryScanner Periodic Directory Tree Verification scan starting at 1448212731329 with interval 21600000
[junit4] 2> 8292 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.d.DataNode Refresh request received for nameservices: null
[junit4] 2> 8292 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[51858827D9E21F27]-worker) [ ] o.a.h.h.s.d.DataNode Starting BPOfferServices for nameservices: <default>
[junit4] 2> 8293 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:59254) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Adding block pool BP-868080200-10.41.0.5-1448195277271
[junit4] 2> 8300 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:59254) [ ] o.a.h.h.s.d.DataNode Block pool <registering> (Datanode Uuid unassigned) service to localhost/127.0.0.1:59254 starting to offer service
[junit4] 2> 8308 INFO (IPC Server Responder) [ ] o.a.h.i.Server IPC Server Responder: starting
[junit4] 2> 8309 INFO (IPC Server listener on 42009) [ ] o.a.h.i.Server IPC Server listener on 42009: starting
[junit4] 2> 8362 INFO (Thread-90) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Scanning block pool BP-868080200-10.41.0.5-1448195277271 on volume /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data2/current...
[junit4] 2> 8345 INFO (Thread-79) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Scanning block pool BP-868080200-10.41.0.5-1448195277271 on volume /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data1/current...
[junit4] 2> 8566 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:59254) [ ] o.a.h.h.s.c.Storage DataNode version: -56 and NameNode layout version: -60
[junit4] 2> 8598 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:59254) [ ] o.a.h.h.s.c.Storage Lock on /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data3/in_use.lock acquired by nodename 13423@lucene1-us-west
[junit4] 2> 8599 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:59254) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data3 is not formatted for BP-868080200-10.41.0.5-1448195277271
[junit4] 2> 8599 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:59254) [ ] o.a.h.h.s.c.Storage Formatting ...
[junit4] 2> 8611 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:59254) [ ] o.a.h.h.s.c.Storage Lock on /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data4/in_use.lock acquired by nodename 13423@lucene1-us-west
[junit4] 2> 8621 INFO (Thread-79) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Time taken to scan block pool BP-868080200-10.41.0.5-1448195277271 on /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data1/current: 256ms
[junit4] 2> 8636 INFO (Thread-90) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Time taken to scan block pool BP-868080200-10.41.0.5-1448195277271 on /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data2/current: 275ms
[junit4] 2> 8637 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:59254) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Total time to scan all replicas for block pool BP-868080200-10.41.0.5-1448195277271: 343ms
[junit4] 2> 8637 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:59254) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data4 is not formatted for BP-868080200-10.41.0.5-1448195277271
[junit4] 2> 8638 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:59254) [ ] o.a.h.h.s.c.Storage Formatting ...
[junit4] 2> 8641 INFO (Thread-93) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Adding replicas to map for block pool BP-868080200-10.41.0.5-1448195277271 on volume /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data1/current...
[junit4] 2> 8641 INFO (Thread-93) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Time to add replicas to map for block pool BP-868080200-10.41.0.5-1448195277271 on volume /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data1/current: 0ms
[junit4] 2> 8673 INFO (Thread-94) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Adding replicas to map for block pool BP-868080200-10.41.0.5-1448195277271 on volume /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data2/current...
[junit4] 2> 8681 INFO (Thread-94) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Time to add replicas to map for block pool BP-868080200-10.41.0.5-1448195277271 on volume /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data2/current: 0ms
[junit4] 2> 8681 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:59254) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Total time to add all replicas to map: 45ms
[junit4] 2> 8687 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:59254) [ ] o.a.h.h.s.d.DataNode Block pool BP-868080200-10.41.0.5-1448195277271 (Datanode Uuid null) service to localhost/127.0.0.1:59254 beginning handshake with NN
[junit4] 2> 8711 INFO (IPC Server handler 4 on 59254) [ ] o.a.h.h.StateChange BLOCK* registerDatanode: from DatanodeRegistration(127.0.0.1, datanodeUuid=4eac65ff-7639-4288-9ffc-da35a558ad8b, infoPort=49268, ipcPort=57128, storageInfo=lv=-56;cid=testClusterID;nsid=94744280;c=0) storage 4eac65ff-7639-4288-9ffc-da35a558ad8b
[junit4] 2> 8719 INFO (IPC Server handler 4 on 59254) [ ] o.a.h.h.s.b.DatanodeDescriptor Number of failed storage changes from 0 to 0
[junit4] 2> 8735 INFO (IPC Server handler 4 on 59254) [ ] o.a.h.n.NetworkTopology Adding a new node: /default-rack/127.0.0.1:39918
[junit4] 2> 8755 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:59254) [ ] o.a.h.h.s.d.DataNode Block pool Block pool BP-868080200-10.41.0.5-1448195277271 (Datanode Uuid null) service to localhost/127.0.0.1:59254 successfully registered with NN
[junit4] 2> 8755 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:59254) [ ] o.a.h.h.s.d.DataNode For namenode localhost/127.0.0.1:59254 using DELETEREPORT_INTERVAL of 300000 msec BLOCKREPORT_INTERVAL of 21600000msec CACHEREPORT_INTERVAL of 10000msec Initial delay: 0msec; heartBeatInterval=3000
[junit4] 2> 8822 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:59254) [ ] o.a.h.h.s.c.Storage Analyzing storage directories for bpid BP-868080200-10.41.0.5-1448195277271
[junit4] 2> 8822 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:59254) [ ] o.a.h.h.s.c.Storage Locking is disabled
[junit4] 2> 8823 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:59254) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data3/current/BP-868080200-10.41.0.5-1448195277271 is not formatted.
[junit4] 2> 8823 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:59254) [ ] o.a.h.h.s.c.Storage Formatting ...
[junit4] 2> 8823 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_51858827D9E21F27-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:59254) [ ] o.a.h.h.s.c.Storage Formatting block pool BP-868080200-10.41.0.5-1448195277271 directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-N
[...truncated too long message...]
n.FSNamesystem Stopping services started for standby state
[junit4] 2> 409492 INFO (SUITE-MorphlineGoLiveMiniMRTest-seed#[51858827D9E21F27]-worker) [n:127.0.0.1:56452_ c:collection1 s:shard1 r:core_node5 x:collection1] o.m.log Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0
[junit4] 2> 409593 INFO (SUITE-MorphlineGoLiveMiniMRTest-seed#[51858827D9E21F27]-worker) [n:127.0.0.1:56452_ c:collection1 s:shard1 r:core_node5 x:collection1] o.a.h.m.i.MetricsSystemImpl Stopping JobHistoryServer metrics system...
[junit4] 2> 409596 ERROR (SUITE-MorphlineGoLiveMiniMRTest-seed#[51858827D9E21F27]-worker) [n:127.0.0.1:56452_ c:collection1 s:shard1 r:core_node5 x:collection1] o.a.h.m.l.MethodMetric Error invoking method getBlocksTotal
[junit4] 2> java.lang.reflect.InvocationTargetException
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:497)
[junit4] 2> at org.apache.hadoop.metrics2.lib.MethodMetric$2.snapshot(MethodMetric.java:111)
[junit4] 2> at org.apache.hadoop.metrics2.lib.MethodMetric.snapshot(MethodMetric.java:144)
[junit4] 2> at org.apache.hadoop.metrics2.lib.MetricsRegistry.snapshot(MetricsRegistry.java:387)
[junit4] 2> at org.apache.hadoop.metrics2.lib.MetricsSourceBuilder$1.getMetrics(MetricsSourceBuilder.java:79)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.getMetrics(MetricsSourceAdapter.java:195)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.updateJmxCache(MetricsSourceAdapter.java:172)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.getMBeanInfo(MetricsSourceAdapter.java:151)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getClassName(DefaultMBeanServerInterceptor.java:1804)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.safeGetClassName(DefaultMBeanServerInterceptor.java:1595)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.checkMBeanPermission(DefaultMBeanServerInterceptor.java:1813)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.exclusiveUnregisterMBean(DefaultMBeanServerInterceptor.java:430)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.unregisterMBean(DefaultMBeanServerInterceptor.java:415)
[junit4] 2> at com.sun.jmx.mbeanserver.JmxMBeanServer.unregisterMBean(JmxMBeanServer.java:546)
[junit4] 2> at org.apache.hadoop.metrics2.util.MBeans.unregister(MBeans.java:81)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stopMBeans(MetricsSourceAdapter.java:227)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stop(MetricsSourceAdapter.java:212)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stopSources(MetricsSystemImpl.java:461)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stop(MetricsSystemImpl.java:212)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.shutdown(MetricsSystemImpl.java:592)
[junit4] 2> at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdownInstance(DefaultMetricsSystem.java:72)
[junit4] 2> at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdown(DefaultMetricsSystem.java:68)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.metrics.NameNodeMetrics.shutdown(NameNodeMetrics.java:145)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.NameNode.stop(NameNode.java:822)
[junit4] 2> at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1720)
[junit4] 2> at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1699)
[junit4] 2> at org.apache.solr.hadoop.MorphlineGoLiveMiniMRTest.teardownClass(MorphlineGoLiveMiniMRTest.java:236)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:497)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:834)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> Caused by: java.lang.NullPointerException
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlocksMap.size(BlocksMap.java:198)
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.getTotalBlocks(BlockManager.java:3291)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlocksTotal(FSNamesystem.java:6223)
[junit4] 2> ... 53 more
[junit4] 2> 409613 INFO (SUITE-MorphlineGoLiveMiniMRTest-seed#[51858827D9E21F27]-worker) [n:127.0.0.1:56452_ c:collection1 s:shard1 r:core_node5 x:collection1] o.a.h.m.i.MetricsSystemImpl JobHistoryServer metrics system stopped.
[junit4] 2> 409613 INFO (SUITE-MorphlineGoLiveMiniMRTest-seed#[51858827D9E21F27]-worker) [n:127.0.0.1:56452_ c:collection1 s:shard1 r:core_node5 x:collection1] o.a.h.m.i.MetricsSystemImpl JobHistoryServer metrics system shutdown complete.
[junit4] 2> 409618 INFO (SUITE-MorphlineGoLiveMiniMRTest-seed#[51858827D9E21F27]-worker) [n:127.0.0.1:56452_ c:collection1 s:shard1 r:core_node5 x:collection1] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineGoLiveMiniMRTest_51858827D9E21F27-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene60): {}, docValues:{}, sim=ClassicSimilarity, locale=zh_SG, timezone=America/Belize
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_66 (64-bit)/cpus=4,threads=8,free=154021952,total=360185856
[junit4] 2> NOTE: All tests run in this JVM: [MorphlineGoLiveMiniMRTest]
[junit4] Completed [6/7] on J0 in 411.35s, 2 tests, 1 error <<< FAILURES!
[...truncated 16 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:253: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:457: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987: There were test failures: 7 suites, 35 tests, 1 suite-level error, 2 errors, 1 ignored [seed: 51858827D9E21F27]
Total time: 223 minutes 58 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 859 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/859/
4 tests failed.
FAILED: org.apache.solr.hadoop.MorphlineBasicMiniMRTest.mrRun
Error Message:
Failed on local exception: java.io.IOException: Connection reset by peer; Host Details : local host is: "lucene1-us-west/10.41.0.5"; destination host is: "lucene1-us-west.apache.org":48015;
Stack Trace:
java.io.IOException: Failed on local exception: java.io.IOException: Connection reset by peer; Host Details : local host is: "lucene1-us-west/10.41.0.5"; destination host is: "lucene1-us-west.apache.org":48015;
at __randomizedtesting.SeedInfo.seed([77B225C676FF461B:79E091C877697414]:0)
at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:772)
at org.apache.hadoop.ipc.Client.call(Client.java:1472)
at org.apache.hadoop.ipc.Client.call(Client.java:1399)
at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232)
at com.sun.proxy.$Proxy77.getClusterMetrics(Unknown Source)
at org.apache.hadoop.yarn.api.impl.pb.client.ApplicationClientProtocolPBClientImpl.getClusterMetrics(ApplicationClientProtocolPBClientImpl.java:202)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
at com.sun.proxy.$Proxy78.getClusterMetrics(Unknown Source)
at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.getYarnClusterMetrics(YarnClientImpl.java:461)
at org.apache.hadoop.mapred.ResourceMgrDelegate.getClusterMetrics(ResourceMgrDelegate.java:151)
at org.apache.hadoop.mapred.YARNRunner.getClusterMetrics(YARNRunner.java:179)
at org.apache.hadoop.mapreduce.Cluster.getClusterStatus(Cluster.java:246)
at org.apache.hadoop.mapred.JobClient$3.run(JobClient.java:719)
at org.apache.hadoop.mapred.JobClient$3.run(JobClient.java:717)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.hadoop.mapred.JobClient.getClusterStatus(JobClient.java:717)
at org.apache.solr.hadoop.MapReduceIndexerTool.run(MapReduceIndexerTool.java:644)
at org.apache.solr.hadoop.MapReduceIndexerTool.run(MapReduceIndexerTool.java:607)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.solr.hadoop.MorphlineBasicMiniMRTest.mrRun(MorphlineBasicMiniMRTest.java:363)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: Connection reset by peer
at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
at sun.nio.ch.IOUtil.read(IOUtil.java:197)
at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380)
at org.apache.hadoop.net.SocketInputStream$Reader.performIO(SocketInputStream.java:57)
at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:142)
at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161)
at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131)
at java.io.FilterInputStream.read(FilterInputStream.java:133)
at java.io.FilterInputStream.read(FilterInputStream.java:133)
at org.apache.hadoop.ipc.Client$Connection$PingInputStream.read(Client.java:513)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read(BufferedInputStream.java:265)
at java.io.DataInputStream.readInt(DataInputStream.java:387)
at org.apache.hadoop.ipc.Client$Connection.receiveRpcResponse(Client.java:1071)
at org.apache.hadoop.ipc.Client$Connection.run(Client.java:966)
FAILED: junit.framework.TestSuite.org.apache.solr.hadoop.MorphlineBasicMiniMRTest
Error Message:
1 thread leaked from SUITE scope at org.apache.solr.hadoop.MorphlineBasicMiniMRTest: 1) Thread[id=437, name=Node Status Updater, state=TIMED_WAITING, group=TGRP-MorphlineBasicMiniMRTest] at java.lang.Object.wait(Native Method) at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl$1.run(NodeStatusUpdaterImpl.java:659) at java.lang.Thread.run(Thread.java:745)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.hadoop.MorphlineBasicMiniMRTest:
1) Thread[id=437, name=Node Status Updater, state=TIMED_WAITING, group=TGRP-MorphlineBasicMiniMRTest]
at java.lang.Object.wait(Native Method)
at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl$1.run(NodeStatusUpdaterImpl.java:659)
at java.lang.Thread.run(Thread.java:745)
at __randomizedtesting.SeedInfo.seed([77B225C676FF461B]:0)
FAILED: org.apache.solr.hadoop.MorphlineGoLiveMiniMRTest.test
Error Message:
Failed on local exception: java.io.IOException: Connection reset by peer; Host Details : local host is: "lucene1-us-west/10.41.0.5"; destination host is: "lucene1-us-west.apache.org":49533;
Stack Trace:
java.io.IOException: Failed on local exception: java.io.IOException: Connection reset by peer; Host Details : local host is: "lucene1-us-west/10.41.0.5"; destination host is: "lucene1-us-west.apache.org":49533;
at __randomizedtesting.SeedInfo.seed([77B225C676FF461B:FFE61A1CD8032BE3]:0)
at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:772)
at org.apache.hadoop.ipc.Client.call(Client.java:1472)
at org.apache.hadoop.ipc.Client.call(Client.java:1399)
at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232)
at com.sun.proxy.$Proxy111.getClusterMetrics(Unknown Source)
at org.apache.hadoop.yarn.api.impl.pb.client.ApplicationClientProtocolPBClientImpl.getClusterMetrics(ApplicationClientProtocolPBClientImpl.java:202)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
at com.sun.proxy.$Proxy112.getClusterMetrics(Unknown Source)
at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.getYarnClusterMetrics(YarnClientImpl.java:461)
at org.apache.hadoop.mapred.ResourceMgrDelegate.getClusterMetrics(ResourceMgrDelegate.java:151)
at org.apache.hadoop.mapred.YARNRunner.getClusterMetrics(YARNRunner.java:179)
at org.apache.hadoop.mapreduce.Cluster.getClusterStatus(Cluster.java:246)
at org.apache.hadoop.mapred.JobClient$3.run(JobClient.java:719)
at org.apache.hadoop.mapred.JobClient$3.run(JobClient.java:717)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.hadoop.mapred.JobClient.getClusterStatus(JobClient.java:717)
at org.apache.solr.hadoop.MapReduceIndexerTool.run(MapReduceIndexerTool.java:644)
at org.apache.solr.hadoop.MapReduceIndexerTool.run(MapReduceIndexerTool.java:607)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.solr.hadoop.MorphlineGoLiveMiniMRTest.test(MorphlineGoLiveMiniMRTest.java:402)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:963)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:938)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: Connection reset by peer
at sun.nio.ch.FileDispatcherImpl.write0(Native Method)
at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47)
at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)
at sun.nio.ch.IOUtil.write(IOUtil.java:65)
at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:471)
at org.apache.hadoop.net.SocketOutputStream$Writer.performIO(SocketOutputStream.java:63)
at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:142)
at org.apache.hadoop.net.SocketOutputStream.write(SocketOutputStream.java:159)
at org.apache.hadoop.net.SocketOutputStream.write(SocketOutputStream.java:117)
at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140)
at java.io.DataOutputStream.flush(DataOutputStream.java:123)
at org.apache.hadoop.ipc.Client$Connection$3.run(Client.java:1030)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
... 1 more
FAILED: junit.framework.TestSuite.org.apache.solr.hadoop.MorphlineGoLiveMiniMRTest
Error Message:
1 thread leaked from SUITE scope at org.apache.solr.hadoop.MorphlineGoLiveMiniMRTest: 1) Thread[id=470, name=Node Status Updater, state=TIMED_WAITING, group=TGRP-MorphlineGoLiveMiniMRTest] at java.lang.Object.wait(Native Method) at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl$1.run(NodeStatusUpdaterImpl.java:659) at java.lang.Thread.run(Thread.java:745)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.hadoop.MorphlineGoLiveMiniMRTest:
1) Thread[id=470, name=Node Status Updater, state=TIMED_WAITING, group=TGRP-MorphlineGoLiveMiniMRTest]
at java.lang.Object.wait(Native Method)
at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl$1.run(NodeStatusUpdaterImpl.java:659)
at java.lang.Thread.run(Thread.java:745)
at __randomizedtesting.SeedInfo.seed([77B225C676FF461B]:0)
Build Log:
[...truncated 17765 lines...]
[junit4] Suite: org.apache.solr.hadoop.MorphlineBasicMiniMRTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/init-core-data-001
[junit4] 2> 0 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
[junit4] 2> 1179 WARN (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.u.NativeCodeLoader Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
[junit4] 1> Formatting using clusterid: testClusterID
[junit4] 2> 1274 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.n.FSNamesystem No KeyProvider found.
[junit4] 2> 1312 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.n.FSNamesystem fsLock is fair:true
[junit4] 2> 1401 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.c.C.deprecation hadoop.configured.node.mapping is deprecated. Instead, use net.topology.configured.node.mapping
[junit4] 2> 1401 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.b.DatanodeManager dfs.block.invalidate.limit=1000
[junit4] 2> 1401 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.b.DatanodeManager dfs.namenode.datanode.registration.ip-hostname-check=true
[junit4] 2> 1406 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.b.BlockManager dfs.namenode.startup.delay.block.deletion.sec is set to 000:00:00:00.000
[junit4] 2> 1409 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.b.BlockManager The block deletion will start around 2015 Samh 21 16:56:50
[junit4] 2> 1413 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.u.GSet Computing capacity for map BlocksMap
[junit4] 2> 1414 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.u.GSet VM type = 64-bit
[junit4] 2> 1416 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.u.GSet 2.0% max memory 455.5 MB = 9.1 MB
[junit4] 2> 1416 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.u.GSet capacity = 2^20 = 1048576 entries
[junit4] 2> 1447 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.b.BlockManager dfs.block.access.token.enable=false
[junit4] 2> 1447 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.b.BlockManager defaultReplication = 2
[junit4] 2> 1447 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.b.BlockManager maxReplication = 512
[junit4] 2> 1447 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.b.BlockManager minReplication = 1
[junit4] 2> 1448 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.b.BlockManager maxReplicationStreams = 2
[junit4] 2> 1448 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.b.BlockManager shouldCheckForEnoughRacks = false
[junit4] 2> 1448 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.b.BlockManager replicationRecheckInterval = 3000
[junit4] 2> 1448 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.b.BlockManager encryptDataTransfer = false
[junit4] 2> 1448 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.b.BlockManager maxNumBlocksToLog = 1000
[junit4] 2> 1457 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.n.FSNamesystem fsOwner = jenkins (auth:SIMPLE)
[junit4] 2> 1457 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.n.FSNamesystem supergroup = supergroup
[junit4] 2> 1457 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.n.FSNamesystem isPermissionEnabled = true
[junit4] 2> 1458 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.n.FSNamesystem HA Enabled: false
[junit4] 2> 1462 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.n.FSNamesystem Append Enabled: true
[junit4] 2> 1872 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.u.GSet Computing capacity for map INodeMap
[junit4] 2> 1872 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.u.GSet VM type = 64-bit
[junit4] 2> 1873 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.u.GSet 1.0% max memory 455.5 MB = 4.6 MB
[junit4] 2> 1873 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.u.GSet capacity = 2^19 = 524288 entries
[junit4] 2> 1873 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.n.NameNode Caching file names occuring more than 10 times
[junit4] 2> 1888 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.u.GSet Computing capacity for map cachedBlocks
[junit4] 2> 1888 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.u.GSet VM type = 64-bit
[junit4] 2> 1888 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.u.GSet 0.25% max memory 455.5 MB = 1.1 MB
[junit4] 2> 1888 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.u.GSet capacity = 2^17 = 131072 entries
[junit4] 2> 1891 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.n.FSNamesystem dfs.namenode.safemode.threshold-pct = 0.9990000128746033
[junit4] 2> 1891 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.n.FSNamesystem dfs.namenode.safemode.min.datanodes = 0
[junit4] 2> 1891 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.n.FSNamesystem dfs.namenode.safemode.extension = 0
[junit4] 2> 1894 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.n.FSNamesystem Retry cache on namenode is enabled
[junit4] 2> 1894 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.n.FSNamesystem Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000 millis
[junit4] 2> 1908 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.u.GSet Computing capacity for map NameNodeRetryCache
[junit4] 2> 1909 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.u.GSet VM type = 64-bit
[junit4] 2> 1909 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.u.GSet 0.029999999329447746% max memory 455.5 MB = 139.9 KB
[junit4] 2> 1909 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.u.GSet capacity = 2^14 = 16384 entries
[junit4] 2> 1919 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.n.NNConf ACLs enabled? false
[junit4] 2> 1919 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.n.NNConf XAttrs enabled? true
[junit4] 2> 1919 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.n.NNConf Maximum size of an xattr: 16384
[junit4] 2> 2073 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.n.FSImage Allocated new BlockPoolId: BP-1205199271-10.41.0.5-1448117810800
[junit4] 2> 2124 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/name1 has been successfully formatted.
[junit4] 2> 2128 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/name2 has been successfully formatted.
[junit4] 2> 2518 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.n.NNStorageRetentionManager Going to retain 1 images with txid >= 0
[junit4] 2> 2528 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.n.NameNode createNameNode []
[junit4] 2> 2597 WARN (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
[junit4] 2> 2775 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.m.i.MetricsSystemImpl Scheduled snapshot period at 10 second(s).
[junit4] 2> 2775 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.m.i.MetricsSystemImpl NameNode metrics system started
[junit4] 2> 2778 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.n.NameNode fs.defaultFS is hdfs://127.0.0.1:0
[junit4] 2> 2913 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.DFSUtil Starting Web-server for hdfs at: http://localhost:0
[junit4] 2> 3085 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.m.log Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
[junit4] 2> 3100 WARN (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 3162 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.HttpServer2 Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
[junit4] 2> 3166 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.HttpServer2 Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context hdfs
[junit4] 2> 3166 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.HttpServer2 Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
[junit4] 2> 3166 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.HttpServer2 Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
[junit4] 2> 3266 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.HttpServer2 Added filter 'org.apache.hadoop.hdfs.web.AuthFilter' (class=org.apache.hadoop.hdfs.web.AuthFilter)
[junit4] 2> 3268 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.HttpServer2 addJerseyResourcePackage: packageName=org.apache.hadoop.hdfs.server.namenode.web.resources;org.apache.hadoop.hdfs.web.resources, pathSpec=/webhdfs/v1/*
[junit4] 2> 3326 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.HttpServer2 Jetty bound to port 55807
[junit4] 2> 3326 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 3480 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_55807_hdfs____tkk6yx/webapp
[junit4] 2> 3858 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
[junit4] 2> 5155 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:55807
[junit4] 2> 5168 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.n.FSNamesystem No KeyProvider found.
[junit4] 2> 5168 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.n.FSNamesystem fsLock is fair:true
[junit4] 2> 5169 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.b.DatanodeManager dfs.block.invalidate.limit=1000
[junit4] 2> 5169 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.b.DatanodeManager dfs.namenode.datanode.registration.ip-hostname-check=true
[junit4] 2> 5169 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.b.BlockManager dfs.namenode.startup.delay.block.deletion.sec is set to 000:00:00:00.000
[junit4] 2> 5170 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.b.BlockManager The block deletion will start around 2015 Samh 21 16:56:54
[junit4] 2> 5170 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.u.GSet Computing capacity for map BlocksMap
[junit4] 2> 5170 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.u.GSet VM type = 64-bit
[junit4] 2> 5170 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.u.GSet 2.0% max memory 455.5 MB = 9.1 MB
[junit4] 2> 5170 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.u.GSet capacity = 2^20 = 1048576 entries
[junit4] 2> 5171 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.b.BlockManager dfs.block.access.token.enable=false
[junit4] 2> 5171 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.b.BlockManager defaultReplication = 2
[junit4] 2> 5171 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.b.BlockManager maxReplication = 512
[junit4] 2> 5171 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.b.BlockManager minReplication = 1
[junit4] 2> 5171 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.b.BlockManager maxReplicationStreams = 2
[junit4] 2> 5171 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.b.BlockManager shouldCheckForEnoughRacks = false
[junit4] 2> 5171 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.b.BlockManager replicationRecheckInterval = 3000
[junit4] 2> 5171 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.b.BlockManager encryptDataTransfer = false
[junit4] 2> 5172 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.b.BlockManager maxNumBlocksToLog = 1000
[junit4] 2> 5172 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.n.FSNamesystem fsOwner = jenkins (auth:SIMPLE)
[junit4] 2> 5172 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.n.FSNamesystem supergroup = supergroup
[junit4] 2> 5172 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.n.FSNamesystem isPermissionEnabled = true
[junit4] 2> 5172 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.n.FSNamesystem HA Enabled: false
[junit4] 2> 5172 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.n.FSNamesystem Append Enabled: true
[junit4] 2> 5173 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.u.GSet Computing capacity for map INodeMap
[junit4] 2> 5173 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.u.GSet VM type = 64-bit
[junit4] 2> 5173 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.u.GSet 1.0% max memory 455.5 MB = 4.6 MB
[junit4] 2> 5173 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.u.GSet capacity = 2^19 = 524288 entries
[junit4] 2> 5173 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.n.NameNode Caching file names occuring more than 10 times
[junit4] 2> 5173 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.u.GSet Computing capacity for map cachedBlocks
[junit4] 2> 5173 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.u.GSet VM type = 64-bit
[junit4] 2> 5174 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.u.GSet 0.25% max memory 455.5 MB = 1.1 MB
[junit4] 2> 5174 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.u.GSet capacity = 2^17 = 131072 entries
[junit4] 2> 5174 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.n.FSNamesystem dfs.namenode.safemode.threshold-pct = 0.9990000128746033
[junit4] 2> 5174 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.n.FSNamesystem dfs.namenode.safemode.min.datanodes = 0
[junit4] 2> 5174 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.n.FSNamesystem dfs.namenode.safemode.extension = 0
[junit4] 2> 5174 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.n.FSNamesystem Retry cache on namenode is enabled
[junit4] 2> 5174 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.n.FSNamesystem Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000 millis
[junit4] 2> 5174 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.u.GSet Computing capacity for map NameNodeRetryCache
[junit4] 2> 5174 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.u.GSet VM type = 64-bit
[junit4] 2> 5175 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.u.GSet 0.029999999329447746% max memory 455.5 MB = 139.9 KB
[junit4] 2> 5175 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.u.GSet capacity = 2^14 = 16384 entries
[junit4] 2> 5177 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.n.NNConf ACLs enabled? false
[junit4] 2> 5177 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.n.NNConf XAttrs enabled? true
[junit4] 2> 5177 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.n.NNConf Maximum size of an xattr: 16384
[junit4] 2> 5186 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.c.Storage Lock on /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/name1/in_use.lock acquired by nodename 1918@lucene1-us-west
[junit4] 2> 5192 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.c.Storage Lock on /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/name2/in_use.lock acquired by nodename 1918@lucene1-us-west
[junit4] 2> 5197 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.n.FileJournalManager Recovering unfinalized segments in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/name1/current
[junit4] 2> 5197 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.n.FileJournalManager Recovering unfinalized segments in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/name2/current
[junit4] 2> 5198 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.n.FSImage No edit log streams selected.
[junit4] 2> 5224 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.n.FSImageFormatPBINode Loading 1 INodes.
[junit4] 2> 5275 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.n.FSImageFormatProtobuf Loaded FSImage in 0 seconds.
[junit4] 2> 5275 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.n.FSImage Loaded image for txid 0 from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/name1/current/fsimage_0000000000000000000
[junit4] 2> 5283 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.n.FSNamesystem Need to save fs image? false (staleImage=false, haEnabled=false, isRollingUpgrade=false)
[junit4] 2> 5283 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.n.FSEditLog Starting log segment at 1
[junit4] 2> 5335 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.n.NameCache initialized with 0 entries 0 lookups
[junit4] 2> 5335 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.n.FSNamesystem Finished loading FSImage in 158 msecs
[junit4] 2> 5786 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.n.NameNode RPC server is binding to localhost:0
[junit4] 2> 5802 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.i.CallQueueManager Using callQueue class java.util.concurrent.LinkedBlockingQueue
[junit4] 2> 5834 INFO (Socket Reader #1 for port 37156) [ ] o.a.h.i.Server Starting Socket Reader #1 for port 37156
[junit4] 2> 5934 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.n.NameNode Clients are to use localhost:37156 to access this namenode/service.
[junit4] 2> 5938 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.n.FSNamesystem Registered FSNamesystemState MBean
[junit4] 2> 6020 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.n.FSNamesystem Number of blocks under construction: 0
[junit4] 2> 6020 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.n.FSNamesystem Number of blocks under construction: 0
[junit4] 2> 6020 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.n.FSNamesystem initializing replication queues
[junit4] 2> 6023 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.StateChange STATE* Leaving safe mode after 0 secs
[junit4] 2> 6023 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.StateChange STATE* Network topology has 0 racks and 0 datanodes
[junit4] 2> 6023 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.StateChange STATE* UnderReplicatedBlocks has 0 blocks
[junit4] 2> 6039 INFO (Replication Queue Initializer) [ ] o.a.h.h.s.b.BlockManager Total number of blocks = 0
[junit4] 2> 6046 INFO (Replication Queue Initializer) [ ] o.a.h.h.s.b.BlockManager Number of invalid blocks = 0
[junit4] 2> 6046 INFO (Replication Queue Initializer) [ ] o.a.h.h.s.b.BlockManager Number of under-replicated blocks = 0
[junit4] 2> 6046 INFO (Replication Queue Initializer) [ ] o.a.h.h.s.b.BlockManager Number of over-replicated blocks = 0
[junit4] 2> 6046 INFO (Replication Queue Initializer) [ ] o.a.h.h.s.b.BlockManager Number of blocks being written = 0
[junit4] 2> 6046 INFO (Replication Queue Initializer) [ ] o.a.h.h.StateChange STATE* Replication Queue initialization scan for invalid, over- and under-replicated blocks completed in 20 msec
[junit4] 2> 6175 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.n.NameNode NameNode RPC up at: localhost/127.0.0.1:37156
[junit4] 2> 6175 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.n.FSNamesystem Starting services required for active state
[junit4] 2> 6113 INFO (IPC Server Responder) [ ] o.a.h.i.Server IPC Server Responder: starting
[junit4] 2> 6116 INFO (IPC Server listener on 37156) [ ] o.a.h.i.Server IPC Server listener on 37156: starting
[junit4] 2> 6243 INFO (CacheReplicationMonitor(80240763)) [ ] o.a.h.h.s.b.CacheReplicationMonitor Starting CacheReplicationMonitor with interval 30000 milliseconds
[junit4] 2> 6243 INFO (CacheReplicationMonitor(80240763)) [ ] o.a.h.h.s.b.CacheReplicationMonitor Rescanning after 16578113104 milliseconds
[junit4] 2> 6244 INFO (CacheReplicationMonitor(80240763)) [ ] o.a.h.h.s.b.CacheReplicationMonitor Scanned 0 directive(s) and 0 block(s) in 0 millisecond(s).
[junit4] 2> 6248 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.MiniDFSCluster Starting DataNode 0 with dfs.datanode.data.dir: [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data1,[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data2
[junit4] 2> 6523 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.m.i.MetricsSystemImpl DataNode metrics system started (again)
[junit4] 2> 6524 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.d.DataNode Configured hostname is 127.0.0.1
[junit4] 2> 6535 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.d.DataNode Starting DataNode with maxLockedMemory = 0
[junit4] 2> 6545 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.d.DataNode Opened streaming server at /127.0.0.1:52512
[junit4] 2> 6551 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.d.DataNode Balancing bandwith is 1048576 bytes/s
[junit4] 2> 6551 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.d.DataNode Number threads for balancing is 5
[junit4] 2> 6557 WARN (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 6559 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.HttpServer2 Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
[junit4] 2> 6560 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.HttpServer2 Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context datanode
[junit4] 2> 6570 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.HttpServer2 Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
[junit4] 2> 6571 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.HttpServer2 Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
[junit4] 2> 6580 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.HttpServer2 addJerseyResourcePackage: packageName=org.apache.hadoop.hdfs.server.datanode.web.resources;org.apache.hadoop.hdfs.web.resources, pathSpec=/webhdfs/v1/*
[junit4] 2> 6581 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.HttpServer2 Jetty bound to port 54100
[junit4] 2> 6581 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 6616 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_54100_datanode____qoh2hl/webapp
[junit4] 2> 6784 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
[junit4] 2> 7418 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:54100
[junit4] 2> 7425 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.d.DataNode dnUserName = jenkins
[junit4] 2> 7425 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.d.DataNode supergroup = supergroup
[junit4] 2> 7451 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.i.CallQueueManager Using callQueue class java.util.concurrent.LinkedBlockingQueue
[junit4] 2> 7452 INFO (Socket Reader #1 for port 51678) [ ] o.a.h.i.Server Starting Socket Reader #1 for port 51678
[junit4] 2> 7463 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.d.DataNode Opened IPC server at /127.0.0.1:51678
[junit4] 2> 7475 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.d.DataNode Refresh request received for nameservices: null
[junit4] 2> 7479 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.d.DataNode Starting BPOfferServices for nameservices: <default>
[junit4] 2> 7501 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:37156) [ ] o.a.h.h.s.d.DataNode Block pool <registering> (Datanode Uuid unassigned) service to localhost/127.0.0.1:37156 starting to offer service
[junit4] 2> 7535 INFO (IPC Server Responder) [ ] o.a.h.i.Server IPC Server Responder: starting
[junit4] 2> 7535 INFO (IPC Server listener on 51678) [ ] o.a.h.i.Server IPC Server listener on 51678: starting
[junit4] 2> 7580 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.MiniDFSCluster Starting DataNode 1 with dfs.datanode.data.dir: [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data3,[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data4
[junit4] 2> 7684 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.m.i.MetricsSystemImpl DataNode metrics system started (again)
[junit4] 2> 7685 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.d.DataNode Configured hostname is 127.0.0.1
[junit4] 2> 7685 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.d.DataNode Starting DataNode with maxLockedMemory = 0
[junit4] 2> 7686 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.d.DataNode Opened streaming server at /127.0.0.1:56307
[junit4] 2> 7686 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.d.DataNode Balancing bandwith is 1048576 bytes/s
[junit4] 2> 7686 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.d.DataNode Number threads for balancing is 5
[junit4] 2> 7690 WARN (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 7691 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.HttpServer2 Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
[junit4] 2> 7692 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.HttpServer2 Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context datanode
[junit4] 2> 7692 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.HttpServer2 Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
[junit4] 2> 7692 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.HttpServer2 Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
[junit4] 2> 7692 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.HttpServer2 addJerseyResourcePackage: packageName=org.apache.hadoop.hdfs.server.datanode.web.resources;org.apache.hadoop.hdfs.web.resources, pathSpec=/webhdfs/v1/*
[junit4] 2> 7693 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.HttpServer2 Jetty bound to port 37219
[junit4] 2> 7693 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 7769 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_37219_datanode____inpi5/webapp
[junit4] 2> 8015 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
[junit4] 2> 8262 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:37156) [ ] o.a.h.h.s.c.Storage DataNode version: -56 and NameNode layout version: -60
[junit4] 2> 8269 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:37156) [ ] o.a.h.h.s.c.Storage Lock on /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data1/in_use.lock acquired by nodename 1918@lucene1-us-west
[junit4] 2> 8272 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:37156) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data1 is not formatted for BP-1205199271-10.41.0.5-1448117810800
[junit4] 2> 8272 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:37156) [ ] o.a.h.h.s.c.Storage Formatting ...
[junit4] 2> 8279 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:37156) [ ] o.a.h.h.s.c.Storage Lock on /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data2/in_use.lock acquired by nodename 1918@lucene1-us-west
[junit4] 2> 8310 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:37156) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data2 is not formatted for BP-1205199271-10.41.0.5-1448117810800
[junit4] 2> 8310 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:37156) [ ] o.a.h.h.s.c.Storage Formatting ...
[junit4] 2> 8468 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:37156) [ ] o.a.h.h.s.c.Storage Analyzing storage directories for bpid BP-1205199271-10.41.0.5-1448117810800
[junit4] 2> 8468 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:37156) [ ] o.a.h.h.s.c.Storage Locking is disabled
[junit4] 2> 8470 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:37156) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data1/current/BP-1205199271-10.41.0.5-1448117810800 is not formatted.
[junit4] 2> 8470 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:37156) [ ] o.a.h.h.s.c.Storage Formatting ...
[junit4] 2> 8471 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:37156) [ ] o.a.h.h.s.c.Storage Formatting block pool BP-1205199271-10.41.0.5-1448117810800 directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data1/current/BP-1205199271-10.41.0.5-1448117810800/current
[junit4] 2> 8474 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:37156) [ ] o.a.h.h.s.c.Storage Locking is disabled
[junit4] 2> 8475 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:37156) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data2/current/BP-1205199271-10.41.0.5-1448117810800 is not formatted.
[junit4] 2> 8475 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:37156) [ ] o.a.h.h.s.c.Storage Formatting ...
[junit4] 2> 8475 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:37156) [ ] o.a.h.h.s.c.Storage Formatting block pool BP-1205199271-10.41.0.5-1448117810800 directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data2/current/BP-1205199271-10.41.0.5-1448117810800/current
[junit4] 2> 8481 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37219
[junit4] 2> 8481 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.d.DataNode dnUserName = jenkins
[junit4] 2> 8481 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.d.DataNode supergroup = supergroup
[junit4] 2> 8482 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.i.CallQueueManager Using callQueue class java.util.concurrent.LinkedBlockingQueue
[junit4] 2> 8484 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:37156) [ ] o.a.h.h.s.c.Storage Restored 0 block files from trash.
[junit4] 2> 8484 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:37156) [ ] o.a.h.h.s.c.Storage Restored 0 block files from trash.
[junit4] 2> 8488 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:37156) [ ] o.a.h.h.s.d.DataNode Setting up storage: nsid=1731709843;bpid=BP-1205199271-10.41.0.5-1448117810800;lv=-56;nsInfo=lv=-60;cid=testClusterID;nsid=1731709843;c=0;bpid=BP-1205199271-10.41.0.5-1448117810800;dnuuid=null
[junit4] 2> 8489 INFO (Socket Reader #1 for port 39068) [ ] o.a.h.i.Server Starting Socket Reader #1 for port 39068
[junit4] 2> 8492 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:37156) [ ] o.a.h.h.s.d.DataNode Generated and persisted new Datanode UUID 9d9365ed-d3e2-4d66-bfe4-164a93dcb7b8
[junit4] 2> 8494 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.d.DataNode Opened IPC server at /127.0.0.1:39068
[junit4] 2> 8498 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.d.DataNode Refresh request received for nameservices: null
[junit4] 2> 8499 INFO (SUITE-MorphlineBasicMiniMRTest-seed#[77B225C676FF461B]-worker) [ ] o.a.h.h.s.d.DataNode Starting BPOfferServices for nameservices: <default>
[junit4] 2> 8514 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:37156) [ ] o.a.h.h.s.d.DataNode Block pool <registering> (Datanode Uuid unassigned) service to localhost/127.0.0.1:37156 starting to offer service
[junit4] 2> 8517 INFO (IPC Server Responder) [ ] o.a.h.i.Server IPC Server Responder: starting
[junit4] 2> 8526 INFO (IPC Server listener on 39068) [ ] o.a.h.i.Server IPC Server listener on 39068: starting
[junit4] 2> 8555 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:37156) [ ] o.a.h.h.s.c.Storage DataNode version: -56 and NameNode layout version: -60
[junit4] 2> 8558 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:37156) [ ] o.a.h.h.s.c.Storage Lock on /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data3/in_use.lock acquired by nodename 1918@lucene1-us-west
[junit4] 2> 8559 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:37156) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data3 is not formatted for BP-1205199271-10.41.0.5-1448117810800
[junit4] 2> 8559 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:37156) [ ] o.a.h.h.s.c.Storage Formatting ...
[junit4] 2> 8563 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:37156) [ ] o.a.h.h.s.c.Storage Lock on /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data4/in_use.lock acquired by nodename 1918@lucene1-us-west
[junit4] 2> 8564 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:37156) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data4 is not formatted for BP-1205199271-10.41.0.5-1448117810800
[junit4] 2> 8564 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:37156) [ ] o.a.h.h.s.c.Storage Formatting ...
[junit4] 2> 8621 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:37156) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Added new volume: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data1/current
[junit4] 2> 8632 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:37156) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Added volume - /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data1/current, StorageType: DISK
[junit4] 2> 8632 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:37156) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Added new volume: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data2/current
[junit4] 2> 8632 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:37156) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Added volume - /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data2/current, StorageType: DISK
[junit4] 2> 8775 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:37156) [ ] o.a.h.h.s.c.Storage Analyzing storage directories for bpid BP-1205199271-10.41.0.5-1448117810800
[junit4] 2> 8775 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:37156) [ ] o.a.h.h.s.c.Storage Locking is disabled
[junit4] 2> 8776 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:37156) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data3/current/BP-1205199271-10.41.0.5-1448117810800 is not formatted.
[junit4] 2> 8776 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:37156) [ ] o.a.h.h.s.c.Storage Formatting ...
[junit4] 2> 8777 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:37156) [ ] o.a.h.h.s.c.Storage Formatting block pool BP-1205199271-10.41.0.5-1448117810800 directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data3/current/BP-1205199271-10.41.0.5-1448117810800/current
[junit4] 2> 8782 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:37156) [ ] o.a.h.h.s.c.Storage Locking is disabled
[junit4] 2> 8783 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:37156) [ ] o.a.h.h.s.c.Storage Storage directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data4/current/BP-1205199271-10.41.0.5-1448117810800 is not formatted.
[junit4] 2> 8783 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:37156) [ ] o.a.h.h.s.c.Storage Formatting ...
[junit4] 2> 8783 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:37156) [ ] o.a.h.h.s.c.Storage Formatting block pool BP-1205199271-10.41.0.5-1448117810800 directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data4/current/BP-1205199271-10.41.0.5-1448117810800/current
[junit4] 2> 8788 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:37156) [ ] o.a.h.h.s.c.Storage Restored 0 block files from trash.
[junit4] 2> 8788 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:37156) [ ] o.a.h.h.s.c.Storage Restored 0 block files from trash.
[junit4] 2> 8790 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:37156) [ ] o.a.h.h.s.d.DataNode Setting up storage: nsid=1731709843;bpid=BP-1205199271-10.41.0.5-1448117810800;lv=-56;nsInfo=lv=-60;cid=testClusterID;nsid=1731709843;c=0;bpid=BP-1205199271-10.41.0.5-1448117810800;dnuuid=null
[junit4] 2> 8791 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:37156) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Registered FSDatasetState MBean
[junit4] 2> 8804 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:37156) [ ] o.a.h.h.s.d.DirectoryScanner Periodic Directory Tree Verification scan starting at 1448131528644 with interval 21600000
[junit4] 2> 8804 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:37156) [ ] o.a.h.h.s.d.f.i.FsDatasetImpl Adding block pool BP-1205199271-10.41.0.5-1448117810800
[junit4] 2> 8819 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:37156) [ ] o.a.h.h.s.d.DataNode Generated and persisted new Datanode UUID cd98b8ec-1b08-4247-9f85-d39ddb71b466
[junit4] 2> 8820 INFO (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineBasicMiniMRTest_77B225C676FF461B-001/tempDir-002/hdfs/build/dfs/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/sol
[...truncated too long message...]
apter.java:172)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.getMBeanInfo(MetricsSourceAdapter.java:151)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getClassName(DefaultMBeanServerInterceptor.java:1804)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.safeGetClassName(DefaultMBeanServerInterceptor.java:1595)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.checkMBeanPermission(DefaultMBeanServerInterceptor.java:1813)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.exclusiveUnregisterMBean(DefaultMBeanServerInterceptor.java:430)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.unregisterMBean(DefaultMBeanServerInterceptor.java:415)
[junit4] 2> at com.sun.jmx.mbeanserver.JmxMBeanServer.unregisterMBean(JmxMBeanServer.java:546)
[junit4] 2> at org.apache.hadoop.metrics2.util.MBeans.unregister(MBeans.java:81)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stopMBeans(MetricsSourceAdapter.java:227)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stop(MetricsSourceAdapter.java:212)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stopSources(MetricsSystemImpl.java:461)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stop(MetricsSystemImpl.java:212)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.shutdown(MetricsSystemImpl.java:592)
[junit4] 2> at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdownInstance(DefaultMetricsSystem.java:72)
[junit4] 2> at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdown(DefaultMetricsSystem.java:68)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.metrics.NameNodeMetrics.shutdown(NameNodeMetrics.java:145)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.NameNode.stop(NameNode.java:822)
[junit4] 2> at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1720)
[junit4] 2> at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1699)
[junit4] 2> at org.apache.solr.hadoop.MorphlineGoLiveMiniMRTest.teardownClass(MorphlineGoLiveMiniMRTest.java:236)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:497)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:834)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> Caused by: java.lang.NullPointerException
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlocksMap.size(BlocksMap.java:198)
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.getTotalBlocks(BlockManager.java:3291)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlocksTotal(FSNamesystem.java:6223)
[junit4] 2> ... 53 more
[junit4] 2> 382910 INFO (SUITE-MorphlineGoLiveMiniMRTest-seed#[77B225C676FF461B]-worker) [n:127.0.0.1:41333_ c:collection1 s:shard1 r:core_node5 x:collection1] o.a.h.m.i.MetricsSystemImpl JobHistoryServer metrics system stopped.
[junit4] 2> 382911 INFO (SUITE-MorphlineGoLiveMiniMRTest-seed#[77B225C676FF461B]-worker) [n:127.0.0.1:41333_ c:collection1 s:shard1 r:core_node5 x:collection1] o.a.h.m.i.MetricsSystemImpl JobHistoryServer metrics system shutdown complete.
[junit4] 2> 382917 INFO (SUITE-MorphlineGoLiveMiniMRTest-seed#[77B225C676FF461B]-worker) [n:127.0.0.1:41333_ c:collection1 s:shard1 r:core_node5 x:collection1] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-map-reduce/test/J0/temp/solr.hadoop.MorphlineGoLiveMiniMRTest_77B225C676FF461B-001
[junit4] 2> Nov 21, 2015 3:03:09 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> SEVERE: 1 thread leaked from SUITE scope at org.apache.solr.hadoop.MorphlineGoLiveMiniMRTest:
[junit4] 2> 1) Thread[id=470, name=Node Status Updater, state=TIMED_WAITING, group=TGRP-MorphlineGoLiveMiniMRTest]
[junit4] 2> at java.lang.Object.wait(Native Method)
[junit4] 2> at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl$1.run(NodeStatusUpdaterImpl.java:659)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> NOTE: test params are: codec=CheapBastard, sim=RandomSimilarityProvider(queryNorm=true,coord=no): {}, locale=is, timezone=Etc/GMT-2
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_66 (64-bit)/cpus=4,threads=9,free=116357456,total=335020032
[junit4] 2> NOTE: All tests run in this JVM: [MapReduceIndexerToolArgumentParserTest, MorphlineGoLiveMiniMRTest]
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=MorphlineGoLiveMiniMRTest -Dtests.seed=77B225C676FF461B -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=is -Dtests.timezone=Etc/GMT-2 -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] ERROR 0.00s J0 | MorphlineGoLiveMiniMRTest (suite) <<<
[junit4] > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.hadoop.MorphlineGoLiveMiniMRTest:
[junit4] > 1) Thread[id=470, name=Node Status Updater, state=TIMED_WAITING, group=TGRP-MorphlineGoLiveMiniMRTest]
[junit4] > at java.lang.Object.wait(Native Method)
[junit4] > at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl$1.run(NodeStatusUpdaterImpl.java:659)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > at __randomizedtesting.SeedInfo.seed([77B225C676FF461B]:0)
[junit4] Completed [7/7] on J0 in 375.56s, 2 tests, 2 errors <<< FAILURES!
[...truncated 14 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:253: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:457: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987: There were test failures: 7 suites, 35 tests, 2 suite-level errors, 2 errors, 1 ignored [seed: 77B225C676FF461B]
Total time: 226 minutes 35 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 858 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/858/
2 tests failed.
FAILED: org.apache.solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR
Error Message:
There are still nodes recoverying - waited for 330 seconds
Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 330 seconds
at __randomizedtesting.SeedInfo.seed([344D7521C48CA104:EAC71B5CFF2EC3F7]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:170)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:131)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:126)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:830)
at org.apache.solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR(LeaderInitiatedRecoveryOnShardRestartTest.java:109)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:963)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:938)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test
Error Message:
Captured an uncaught exception in thread: Thread[id=195371, name=collection2, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=195371, name=collection2, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:51590/np: collection already exists: awholynewstresscollection_collection2_0
at __randomizedtesting.SeedInfo.seed([344D7521C48CA104]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1573)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1594)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:876)
Build Log:
[...truncated 10769 lines...]
[junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_344D7521C48CA104-001/init-core-data-001
[junit4] 2> 2147220 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[344D7521C48CA104]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true)
[junit4] 2> 2147220 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[344D7521C48CA104]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /np/
[junit4] 2> 2147225 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 2147225 INFO (Thread-188436) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 2147225 INFO (Thread-188436) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 2147325 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.ZkTestServer start zk server on port:53251
[junit4] 2> 2147326 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 2147326 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2147336 INFO (zkCallback-1163-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2ac6506a name:ZooKeeperConnection Watcher:127.0.0.1:53251 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2147336 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2147337 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 2147337 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 2147340 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 2147341 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2147347 INFO (zkCallback-1164-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@54f324ee name:ZooKeeperConnection Watcher:127.0.0.1:53251/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2147348 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2147348 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 2147348 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
[junit4] 2> 2147351 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
[junit4] 2> 2147354 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
[junit4] 2> 2147356 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
[junit4] 2> 2147357 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 2147357 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 2147361 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 2147361 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
[junit4] 2> 2147363 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 2147363 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 2147364 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 2147365 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
[junit4] 2> 2147367 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 2147367 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
[junit4] 2> 2147369 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 2147369 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
[junit4] 2> 2147372 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 2147372 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 2147374 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 2147374 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 2147377 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 2147377 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 2147379 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 2147379 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 2147381 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 2147381 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
[junit4] 2> 2147383 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 2147384 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2147384 INFO (zkCallback-1165-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@88f7e05 name:ZooKeeperConnection Watcher:127.0.0.1:53251 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2147385 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2147385 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 2147385 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 2147386 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 2147386 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2147396 INFO (zkCallback-1166-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5d707277 name:ZooKeeperConnection Watcher:127.0.0.1:53251/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2147396 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2147396 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 2147396 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf2/solrconfig.xml
[junit4] 2> 2147397 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/solrconfig.xml
[junit4] 2> 2147399 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf2/schema.xml
[junit4] 2> 2147399 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/schema.xml
[junit4] 2> 2147400 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf2/enumsConfig.xml
[junit4] 2> 2147401 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/enumsConfig.xml
[junit4] 2> 2147402 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf2/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 2147402 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 2147403 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf2/stopwords.txt
[junit4] 2> 2147404 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/stopwords.txt
[junit4] 2> 2147414 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf2/protwords.txt
[junit4] 2> 2147414 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/protwords.txt
[junit4] 2> 2147416 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf2/currency.xml
[junit4] 2> 2147417 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/currency.xml
[junit4] 2> 2147418 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf2/open-exchange-rates.json
[junit4] 2> 2147418 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/open-exchange-rates.json
[junit4] 2> 2147420 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf2/mapping-ISOLatin1Accent.txt
[junit4] 2> 2147420 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/mapping-ISOLatin1Accent.txt
[junit4] 2> 2147423 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf2/old_synonyms.txt
[junit4] 2> 2147424 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/old_synonyms.txt
[junit4] 2> 2147426 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf2/synonyms.txt
[junit4] 2> 2147426 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/synonyms.txt
[junit4] 2> 2147428 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/elevate.xml to /configs/conf2/elevate.xml
[junit4] 2> 2147428 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/elevate.xml
[junit4] 2> 2147836 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_344D7521C48CA104-001/control-001/cores/collection1
[junit4] 2> 2147838 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.e.j.s.Server jetty-9.2.13.v20150730
[junit4] 2> 2147848 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6c40d16c{/np,null,AVAILABLE}
[junit4] 2> 2147850 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.e.j.s.ServerConnector Started ServerConnector@44f7cd0{HTTP/1.1}{127.0.0.1:39783}
[junit4] 2> 2147850 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.e.j.s.Server Started @2150920ms
[junit4] 2> 2147850 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_344D7521C48CA104-001/tempDir-001/control/data, hostContext=/np, hostPort=39783, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_344D7521C48CA104-001/control-001/cores}
[junit4] 2> 2147850 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 2147850 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_344D7521C48CA104-001/control-001'
[junit4] 2> 2147850 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2147851 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 2147851 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 2147852 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2147853 INFO (zkCallback-1167-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@769be3b name:ZooKeeperConnection Watcher:127.0.0.1:53251/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2147853 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2147853 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 2147856 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 2147856 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_344D7521C48CA104-001/control-001/solr.xml
[junit4] 2> 2147861 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_344D7521C48CA104-001/control-001/cores
[junit4] 2> 2147861 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.CoreContainer New CoreContainer 1707658841
[junit4] 2> 2147861 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_344D7521C48CA104-001/control-001]
[junit4] 2> 2147861 WARN (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_344D7521C48CA104-001/control-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_344D7521C48CA104-001/control-001/lib
[junit4] 2> 2147861 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 2147863 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 2147863 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2147863 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2147864 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:53251/solr
[junit4] 2> 2147864 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 2147864 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 2147865 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2147880 INFO (zkCallback-1169-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@18fefdf7 name:ZooKeeperConnection Watcher:127.0.0.1:53251 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2147881 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2147881 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 2147888 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [n:127.0.0.1:39783_np ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2147902 INFO (zkCallback-1170-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@19aa6de4 name:ZooKeeperConnection Watcher:127.0.0.1:53251/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2147902 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [n:127.0.0.1:39783_np ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2147904 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [n:127.0.0.1:39783_np ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
[junit4] 2> 2147905 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [n:127.0.0.1:39783_np ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 2147907 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [n:127.0.0.1:39783_np ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 2147909 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [n:127.0.0.1:39783_np ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 2147912 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [n:127.0.0.1:39783_np ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 2147915 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [n:127.0.0.1:39783_np ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 2147916 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [n:127.0.0.1:39783_np ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 2147918 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [n:127.0.0.1:39783_np ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 2147919 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [n:127.0.0.1:39783_np ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 2147920 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [n:127.0.0.1:39783_np ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39783_np
[junit4] 2> 2147920 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [n:127.0.0.1:39783_np ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:39783_np
[junit4] 2> 2147922 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [n:127.0.0.1:39783_np ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 2147923 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [n:127.0.0.1:39783_np ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 2147925 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [n:127.0.0.1:39783_np ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2147926 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [n:127.0.0.1:39783_np ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94899495912603654-127.0.0.1:39783_np-n_0000000000
[junit4] 2> 2147926 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [n:127.0.0.1:39783_np ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:39783_np
[junit4] 2> 2147926 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [n:127.0.0.1:39783_np ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
[junit4] 2> 2147928 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [n:127.0.0.1:39783_np ] o.a.s.c.Overseer Overseer (id=94899495912603654-127.0.0.1:39783_np-n_0000000000) starting
[junit4] 2> 2147930 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [n:127.0.0.1:39783_np ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
[junit4] 2> 2147937 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [n:127.0.0.1:39783_np ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 2147937 INFO (OverseerCollectionConfigSetProcessor-94899495912603654-127.0.0.1:39783_np-n_0000000000) [n:127.0.0.1:39783_np ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
[junit4] 2> 2147937 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [n:127.0.0.1:39783_np ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 2147938 INFO (OverseerStateUpdate-94899495912603654-127.0.0.1:39783_np-n_0000000000) [n:127.0.0.1:39783_np ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 2147960 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [n:127.0.0.1:39783_np ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 2147960 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [n:127.0.0.1:39783_np ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 2147961 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [n:127.0.0.1:39783_np ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_344D7521C48CA104-001/control-001/cores
[junit4] 2> 2147962 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [n:127.0.0.1:39783_np ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_344D7521C48CA104-001/control-001/cores/collection1, collection=control_collection, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_344D7521C48CA104-001/control-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 2147962 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [n:127.0.0.1:39783_np ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_344D7521C48CA104-001/control-001/cores/collection1/
[junit4] 2> 2147962 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [n:127.0.0.1:39783_np ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 2147963 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [n:127.0.0.1:39783_np ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4] 2> 2147963 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [n:127.0.0.1:39783_np ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 2147964 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 2147964 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 2147965 INFO (OverseerStateUpdate-94899495912603654-127.0.0.1:39783_np-n_0000000000) [n:127.0.0.1:39783_np ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:39783/np",
[junit4] 2> "node_name":"127.0.0.1:39783_np",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 2147965 INFO (OverseerStateUpdate-94899495912603654-127.0.0.1:39783_np-n_0000000000) [n:127.0.0.1:39783_np ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:39783/np",
[junit4] 2> "node_name":"127.0.0.1:39783_np",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 2147965 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 2147966 INFO (OverseerStateUpdate-94899495912603654-127.0.0.1:39783_np-n_0000000000) [n:127.0.0.1:39783_np ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
[junit4] 2> 2147966 INFO (OverseerStateUpdate-94899495912603654-127.0.0.1:39783_np-n_0000000000) [n:127.0.0.1:39783_np ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 2147968 INFO (zkCallback-1170-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2148966 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 2148966 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
[junit4] 2> 2148966 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 2148967 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 2148967 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2148967 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_344D7521C48CA104-001/control-001/cores/collection1'
[junit4] 2> 2148968 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2148968 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 2148969 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 2148982 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 2148989 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 2149002 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2149013 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 2149136 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 2149144 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 2149145 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 2149156 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 2149158 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 2149160 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2149160 WARN (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 2149161 WARN (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 2149161 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2149161 WARN (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 2149161 WARN (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 2149163 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4] 2> 2149163 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 2149163 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 2149163 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_344D7521C48CA104-001/control-001/cores/collection1], dataDir=[null]
[junit4] 2> 2149163 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6d88ff27
[junit4] 2> 2149164 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_344D7521C48CA104-001/control-001/cores/collection1/data
[junit4] 2> 2149166 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_344D7521C48CA104-001/control-001/cores/collection1/data/index/
[junit4] 2> 2149166 WARN (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_344D7521C48CA104-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 2149166 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_344D7521C48CA104-001/control-001/cores/collection1/data/index
[junit4] 2> 2149167 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=8, maxMergeAtOnceExplicit=8, maxMergedSegmentMB=26.4736328125, floorSegmentMB=0.470703125, forceMergeDeletesPctAllowed=20.278990293294196, segmentsPerTier=47.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.3242110183618963
[junit4] 2> 2149168 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=RawDirectoryWrapper(RAMDirectory@2b7b159 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@61b7a0f4),segFN=segments_1,generation=1}
[junit4] 2> 2149168 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 2149178 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_344D7521C48CA104-001/control-001/cores/collection1/data/
[junit4] 2> 2149178 WARN (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_344D7521C48CA104-001/control-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
[junit4] 2> 2149180 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 2149180 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
[junit4] 2> 2149180 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2149180 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 2149181 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2149181 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 2149181 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2149181 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2149181 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 2149181 WARN (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,args = {defaults={a=A,b=B}}}
[junit4] 2> 2149183 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 2149184 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 2149184 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 2149185 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 2149188 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/dump,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 2149188 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 2149189 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 2149189 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 2149190 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
[junit4] 2> 2149190 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
[junit4] 2> 2149190 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@141c4edb
[junit4] 2> 2149190 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=RawDirectoryWrapper(RAMDirectory@2b7b159 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@61b7a0f4),segFN=segments_1,generation=1}
[junit4] 2> 2149190 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 2149190 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@190efaea[collection1] main
[junit4] 2> 2149190 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 2149193 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2149193 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 2149193 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 2149193 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
[junit4] 2> 2149193 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2149195 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 2149196 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2149196 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 2149196 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 2149196 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
[junit4] 2> 2149196 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
[junit4] 2> 2149196 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
[junit4] 2> 2149196 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1518391936666304512
[junit4] 2> 2149200 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 3.0ms to seed version buckets with highest version 1518391936666304512
[junit4] 2> 2149200 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
[junit4] 2> 2149200 INFO (searcherExecutor-4288-thread-1-processing-n:127.0.0.1:39783_np x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@190efaea[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2149201 INFO (coreLoadExecutor-4287-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 2149214 INFO (coreZkRegister-4281-thread-1-processing-n:127.0.0.1:39783_np x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:39783/np collection:control_collection shard:shard1
[junit4] 2> 2149216 INFO (coreZkRegister-4281-thread-1-processing-n:127.0.0.1:39783_np x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 2149219 INFO (coreZkRegister-4281-thread-1-processing-n:127.0.0.1:39783_np x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/94899495912603654-core_node1-n_0000000000
[junit4] 2> 2149219 INFO (coreZkRegister-4281-thread-1-processing-n:127.0.0.1:39783_np x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1
[junit4] 2> 2149221 INFO (OverseerStateUpdate-94899495912603654-127.0.0.1:39783_np-n_0000000000) [n:127.0.0.1:39783_np ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection"} current state version: 1
[junit4] 2> 2149222 INFO (coreZkRegister-4281-thread-1-processing-n:127.0.0.1:39783_np x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 2149222 INFO (coreZkRegister-4281-thread-1-processing-n:127.0.0.1:39783_np x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 2149222 INFO (coreZkRegister-4281-thread-1-processing-n:127.0.0.1:39783_np x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:39783/np/collection1/
[junit4] 2> 2149222 INFO (coreZkRegister-4281-thread-1-processing-n:127.0.0.1:39783_np x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 2149222 INFO (coreZkRegister-4281-thread-1-processing-n:127.0.0.1:39783_np x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:39783/np/collection1/ has no replicas
[junit4] 2> 2149223 INFO (coreZkRegister-4281-thread-1-processing-n:127.0.0.1:39783_np x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 2149225 INFO (coreZkRegister-4281-thread-1-processing-n:127.0.0.1:39783_np x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
[junit4] 2> 2149226 INFO (OverseerStateUpdate-94899495912603654-127.0.0.1:39783_np-n_0000000000) [n:127.0.0.1:39783_np ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:39783/np",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 1
[junit4] 2> 2149228 INFO (coreZkRegister-4281-thread-1-processing-n:127.0.0.1:39783_np x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:39783/np/collection1/ shard1
[junit4] 2> 2149328 INFO (zkCallback-1170-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2149378 INFO (coreZkRegister-4281-thread-1-processing-n:127.0.0.1:39783_np x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:39783/np/collection1/ and leader is http://127.0.0.1:39783/np/collection1/
[junit4] 2> 2149379 INFO (coreZkRegister-4281-thread-1-processing-n:127.0.0.1:39783_np x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:39783/np
[junit4] 2> 2149379 INFO (coreZkRegister-4281-thread-1-processing-n:127.0.0.1:39783_np x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 2149379 INFO (coreZkRegister-4281-thread-1-processing-n:127.0.0.1:39783_np x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
[junit4] 2> 2149379 INFO (coreZkRegister-4281-thread-1-processing-n:127.0.0.1:39783_np x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39783_np c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 2149380 INFO (OverseerStateUpdate-94899495912603654-127.0.0.1:39783_np-n_0000000000) [n:127.0.0.1:39783_np ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:39783/np",
[junit4] 2> "node_name":"127.0.0.1:39783_np",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 2
[junit4] 2> 2149381 INFO (OverseerStateUpdate-94899495912603654-127.0.0.1:39783_np-n_0000000000) [n:127.0.0.1:39783_np ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:39783/np",
[junit4] 2> "node_name":"127.0.0.1:39783_np",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 2149465 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 2149467 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2149482 INFO (zkCallback-1172-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4332d711 name:ZooKeeperConnection Watcher:127.0.0.1:53251/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2149483 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2149483 INFO (zkCallback-1170-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2149483 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 2149483 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 2149485 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 2149485 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with stateFormat=2
[junit4] 2> 2149485 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 2149503 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2149503 INFO (zkCallback-1173-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2e8808df name:ZooKeeperConnection Watcher:127.0.0.1:53251/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2149503 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2149503 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 2149505 INFO (OverseerStateUpdate-94899495912603654-127.0.0.1:39783_np-n_0000000000) [n:127.0.0.1:39783_np ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"create",
[junit4] 2> "name":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "stateFormat":"2"} current state version: 3
[junit4] 2> 2149505 INFO (OverseerStateUpdate-94899495912603654-127.0.0.1:39783_np-n_0000000000) [n:127.0.0.1:39783_np ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
[junit4] 2> 2149612 INFO (OverseerStateUpdate-94899495912603654-127.0.0.1:39783_np-n_0000000000) [n:127.0.0.1:39783_np ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/collection1/state.json
[junit4] 2> 2149976 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_344D7521C48CA104-001/shard-1-001/cores/collection1
[junit4] 2> 2149978 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_344D7521C48CA104-001/shard-1-001
[junit4] 2> 2149979 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.e.j.s.Server jetty-9.2.13.v20150730
[junit4] 2> 2149983 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1d21ba4b{/np,null,AVAILABLE}
[junit4] 2> 2149984 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.e.j.s.ServerConnector Started ServerConnector@7f1a95df{HTTP/1.1}{127.0.0.1:56752}
[junit4] 2> 2149984 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.e.j.s.Server Started @2153054ms
[junit4] 2> 2149984 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_344D7521C48CA104-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/np, hostPort=56752, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_344D7521C48CA104-001/shard-1-001/cores}
[junit4] 2> 2149984 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 2149984 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_344D7521C48CA104-001/shard-1-001'
[junit4] 2> 2149984 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2149984 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 2149985 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 2149986 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2149987 INFO (zkCallback-1174-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@72e4ab91 name:ZooKeeperConnection Watcher:127.0.0.1:53251/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2149987 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2149987 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 2149989 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 2149989 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_344D7521C48CA104-001/shard-1-001/solr.xml
[junit4] 2> 2149994 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_344D7521C48CA104-001/shard-1-001/cores
[junit4] 2> 2149994 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.CoreContainer New CoreContainer 910798208
[junit4] 2> 2149994 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_344D7521C48CA104-001/shard-1-001]
[junit4] 2> 2149994 WARN (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_344D7521C48CA104-001/shard-1-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_344D7521C48CA104-001/shard-1-001/lib
[junit4] 2> 2149994 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 2149995 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 2149996 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2149996 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2149996 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:53251/solr
[junit4] 2> 2149996 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 2149996 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 2149997 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2149998 INFO (zkCallback-1176-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4c13a947 name:ZooKeeperConnection Watcher:127.0.0.1:53251 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2150002 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2150002 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 2150005 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [n:127.0.0.1:56752_np ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2150014 INFO (zkCallback-1177-thread-1-processing-n:127.0.0.1:56752_np) [n:127.0.0.1:56752_np ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5ea59c5b name:ZooKeeperConnection Watcher:127.0.0.1:53251/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2150014 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [n:127.0.0.1:56752_np ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2150019 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [n:127.0.0.1:56752_np ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 2151024 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [n:127.0.0.1:56752_np ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56752_np
[junit4] 2> 2151024 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [n:127.0.0.1:56752_np ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:56752_np
[junit4] 2> 2151025 INFO (zkCallback-1170-thread-1-processing-n:127.0.0.1:39783_np) [n:127.0.0.1:39783_np ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2151025 INFO (zkCallback-1172-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2151026 INFO (zkCallback-1177-thread-1-processing-n:127.0.0.1:56752_np) [n:127.0.0.1:56752_np ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2151028 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [n:127.0.0.1:56752_np ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2151028 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [n:127.0.0.1:56752_np ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94899495912603659-127.0.0.1:56752_np-n_0000000001
[junit4] 2> 2151029 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [n:127.0.0.1:56752_np ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/94899495912603654-127.0.0.1:39783_np-n_0000000000 to know if I could be the leader
[junit4] 2> 2151052 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [n:127.0.0.1:56752_np ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 2151052 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [n:127.0.0.1:56752_np ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 2151052 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [n:127.0.0.1:56752_np ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_344D7521C48CA104-001/shard-1-001/cores
[junit4] 2> 2151053 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[344D7521C48CA104]) [n:127.0.0.1:56752_np ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml,
[...truncated too long message...]
unit4] 2> at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:255)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.rejoinLeaderElection(ElectionContext.java:620)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:426)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:197)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:157)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:58)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:388)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3$1.run(SolrZkClient.java:269)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:231)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 3995838 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[344D7521C48CA104]) [ ] o.e.j.s.ServerConnector Stopped ServerConnector@10d0e280{HTTP/1.1}{127.0.0.1:47743}
[junit4] 2> 3995840 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[344D7521C48CA104]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@5a17fa15{/mp_ua/as,null,UNAVAILABLE}
[junit4] 2> 3995850 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[344D7521C48CA104]) [n:127.0.0.1:47743_mp_ua%2Fas c:collection1 s:shard1 r:core_node3 x:collection1] o.a.s.c.ZkTestServer connecting to 127.0.0.1:33459 33459
[junit4] 2> 3995968 INFO (Thread-190345) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:33459 33459
[junit4] 2> 3995971 WARN (Thread-190345) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 11 /solr/aliases.json
[junit4] 2> 10 /solr/security.json
[junit4] 2> 10 /solr/configs/conf1
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 19 /solr/collections/all_in_lir/state.json
[junit4] 2> 17 /solr/collections/collection1/state.json
[junit4] 2> 11 /solr/clusterstate.json
[junit4] 2> 6 /solr/overseer_elect/election/94899589570166788-127.0.0.1:52318_mp_ua%2Fas-n_0000000000
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 13 /solr/live_nodes
[junit4] 2> 11 /solr/collections
[junit4] 2> 2 /solr/overseer/queue
[junit4] 2> 2 /solr/overseer/collection-queue-work
[junit4] 2>
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=LeaderInitiatedRecoveryOnShardRestartTest -Dtests.method=testRestartWithAllInLIR -Dtests.seed=344D7521C48CA104 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=ko -Dtests.timezone=Europe/Bucharest -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[junit4] FAILURE 420s J0 | LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR <<<
[junit4] > Throwable #1: java.lang.AssertionError: There are still nodes recoverying - waited for 330 seconds
[junit4] > at __randomizedtesting.SeedInfo.seed([344D7521C48CA104:EAC71B5CFF2EC3F7]:0)
[junit4] > at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:170)
[junit4] > at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:131)
[junit4] > at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:126)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:830)
[junit4] > at org.apache.solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR(LeaderInitiatedRecoveryOnShardRestartTest.java:109)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:963)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:938)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 3995980 INFO (SUITE-LeaderInitiatedRecoveryOnShardRestartTest-seed#[344D7521C48CA104]-worker) [n:127.0.0.1:47743_mp_ua%2Fas c:collection1 s:shard1 r:core_node3 x:collection1] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_344D7521C48CA104-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene60): {}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=ko, timezone=Europe/Bucharest
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_66 (64-bit)/cpus=4,threads=1,free=356625768,total=509083648
[junit4] 2> NOTE: All tests run in this JVM: [ResponseHeaderTest, ResourceLoaderTest, TestLuceneMatchVersion, TestLRUCache, TestMergePolicyConfig, TestSmileRequest, CloudExitableDirectoryReaderTest, DateRangeFieldTest, HdfsWriteToMultipleCollectionsTest, TestSha256AuthenticationProvider, HdfsDirectoryFactoryTest, AlternateDirectoryTest, TestHashQParserPlugin, DocValuesMissingTest, TestConfigSetsAPI, TestRandomRequestDistribution, FileBasedSpellCheckerTest, TestManagedResourceStorage, MigrateRouteKeyTest, TestPerFieldSimilarityClassic, EchoParamsTest, TestCSVLoader, TestFaceting, TestMiniSolrCloudCluster, QueryEqualityTest, TestDistribIDF, CursorMarkTest, SolrTestCaseJ4Test, TestManagedStopFilterFactory, DistributedQueryElevationComponentTest, TestBulkSchemaAPI, TestFunctionQuery, TestDistributedStatsComponentCardinality, TestDocBasedVersionConstraints, TestConfig, StandardRequestHandlerTest, AnalysisAfterCoreReloadTest, ZkStateReaderTest, GraphQueryTest, TestLazyCores, AssignTest, TestLMDirichletSimilarityFactory, HdfsDirectoryTest, HdfsSyncSliceTest, DistributedFacetPivotSmallAdvancedTest, HdfsBasicDistributedZkTest, PingRequestHandlerTest, TestBinaryField, TestRangeQuery, PeerSyncTest, TestIBSimilarityFactory, TestRemoteStreaming, CdcrVersionReplicationTest, TestConfigReload, OutputWriterTest, TestConfigSetProperties, TestOverriddenPrefixQueryForCustomFieldType, MultiThreadedOCPTest, TestSolrCLIRunExample, TestArbitraryIndexDir, TestRandomFaceting, DistribCursorPagingTest, PolyFieldTest, SolrRequestParserTest, QueryResultKeyTest, RequiredFieldsTest, DeleteShardTest, JsonLoaderTest, DisMaxRequestHandlerTest, TestReRankQParserPlugin, TestScoreJoinQPNoScore, ConcurrentDeleteAndCreateCollectionTest, TestRandomCollapseQParserPlugin, SuggestComponentContextFilterQueryTest, BasicAuthIntegrationTest, TestMinMaxOnMultiValuedField, TestValueSourceCache, TestExactSharedStatsCache, URLClassifyProcessorTest, TestAnalyzedSuggestions, TestFastOutputStream, AddBlockUpdateTest, OverriddenZkACLAndCredentialsProvidersTest, TestSerializedLuceneMatchVersion, PKIAuthenticationIntegrationTest, RestartWhileUpdatingTest, DistributedSpellCheckComponentTest, TestLeaderInitiatedRecoveryThread, TestDocSet, TestBulkSchemaConcurrent, OverseerCollectionConfigSetProcessorTest, BasicDistributedZkTest, ChaosMonkeySafeLeaderTest, CollectionsAPIDistributedZkTest, BasicZkTest, TestReplicationHandler, CollectionReloadTest, CollectionsAPIAsyncDistributedZkTest, ConnectionManagerTest, DeleteLastCustomShardedReplicaTest, DeleteReplicaTest, DistributedQueueTest, DistributedVersionInfoTest, LeaderInitiatedRecoveryOnShardRestartTest]
[junit4] Completed [452/559] on J0 in 419.70s, 1 test, 1 failure <<< FAILURES!
[...truncated 337 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987: There were test failures: 559 suites (8 ignored), 2216 tests, 1 error, 1 failure, 32 ignored (18 assumptions) [seed: 344D7521C48CA104]
Total time: 207 minutes 21 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 857 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/857/
2 tests failed.
FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test
Error Message:
Captured an uncaught exception in thread: Thread[id=19620, name=collection2, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=19620, name=collection2, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:45476: Could not find collection : awholynewstresscollection_collection2_2
at __randomizedtesting.SeedInfo.seed([D28A4B3639CED460]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:883)
FAILED: org.apache.solr.cloud.SharedFSAutoReplicaFailoverTest.test
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([D28A4B3639CED460:5ADE74EC9732B998]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertTrue(Assert.java:54)
at org.apache.solr.cloud.SharedFSAutoReplicaFailoverTest.testBasics(SharedFSAutoReplicaFailoverTest.java:227)
at org.apache.solr.cloud.SharedFSAutoReplicaFailoverTest.test(SharedFSAutoReplicaFailoverTest.java:108)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:963)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:938)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 10006 lines...]
[junit4] Suite: org.apache.solr.cloud.SharedFSAutoReplicaFailoverTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_D28A4B3639CED460-001/init-core-data-001
[junit4] 2> 424566 INFO (SUITE-SharedFSAutoReplicaFailoverTest-seed#[D28A4B3639CED460]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
[junit4] 1> Formatting using clusterid: testClusterID
[junit4] 2> 424686 WARN (SUITE-SharedFSAutoReplicaFailoverTest-seed#[D28A4B3639CED460]-worker) [ ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
[junit4] 2> 424716 WARN (SUITE-SharedFSAutoReplicaFailoverTest-seed#[D28A4B3639CED460]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 424721 INFO (SUITE-SharedFSAutoReplicaFailoverTest-seed#[D28A4B3639CED460]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 424752 INFO (SUITE-SharedFSAutoReplicaFailoverTest-seed#[D28A4B3639CED460]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_54203_hdfs____.tu99cw/webapp
[junit4] 2> 424906 INFO (SUITE-SharedFSAutoReplicaFailoverTest-seed#[D28A4B3639CED460]-worker) [ ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
[junit4] 2> 425220 INFO (SUITE-SharedFSAutoReplicaFailoverTest-seed#[D28A4B3639CED460]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:54203
[junit4] 2> 425685 WARN (SUITE-SharedFSAutoReplicaFailoverTest-seed#[D28A4B3639CED460]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 425688 INFO (SUITE-SharedFSAutoReplicaFailoverTest-seed#[D28A4B3639CED460]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 425715 INFO (SUITE-SharedFSAutoReplicaFailoverTest-seed#[D28A4B3639CED460]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_56098_datanode____cus16d/webapp
[junit4] 2> 425930 INFO (SUITE-SharedFSAutoReplicaFailoverTest-seed#[D28A4B3639CED460]-worker) [ ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
[junit4] 2> 426236 INFO (SUITE-SharedFSAutoReplicaFailoverTest-seed#[D28A4B3639CED460]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:56098
[junit4] 2> 426422 WARN (SUITE-SharedFSAutoReplicaFailoverTest-seed#[D28A4B3639CED460]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 426429 INFO (SUITE-SharedFSAutoReplicaFailoverTest-seed#[D28A4B3639CED460]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 426614 INFO (SUITE-SharedFSAutoReplicaFailoverTest-seed#[D28A4B3639CED460]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_35288_datanode____yrebcn/webapp
[junit4] 2> 426650 INFO (IPC Server handler 2 on 47547) [ ] BlockStateChange BLOCK* processReport: from storage DS-ae0348d9-273f-4181-abd2-a329b92ab18a node DatanodeRegistration(127.0.0.1, datanodeUuid=ae7e7a63-dbf4-4ce2-baa4-e104d74c8fd5, infoPort=56098, ipcPort=45544, storageInfo=lv=-56;cid=testClusterID;nsid=1564091646;c=0), blocks: 0, hasStaleStorages: true, processing time: 3 msecs
[junit4] 2> 426650 INFO (IPC Server handler 2 on 47547) [ ] BlockStateChange BLOCK* processReport: from storage DS-4cc3b97c-864e-479e-8d7c-cd5bebcacdb7 node DatanodeRegistration(127.0.0.1, datanodeUuid=ae7e7a63-dbf4-4ce2-baa4-e104d74c8fd5, infoPort=56098, ipcPort=45544, storageInfo=lv=-56;cid=testClusterID;nsid=1564091646;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
[junit4] 2> 426741 INFO (SUITE-SharedFSAutoReplicaFailoverTest-seed#[D28A4B3639CED460]-worker) [ ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
[junit4] 2> 427058 INFO (SUITE-SharedFSAutoReplicaFailoverTest-seed#[D28A4B3639CED460]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35288
[junit4] 2> 427369 INFO (IPC Server handler 9 on 47547) [ ] BlockStateChange BLOCK* processReport: from storage DS-52904d66-9436-442b-8289-db4e7ae740b7 node DatanodeRegistration(127.0.0.1, datanodeUuid=4ef43a94-9e72-446f-bed9-fa58c3ac12dc, infoPort=35288, ipcPort=52292, storageInfo=lv=-56;cid=testClusterID;nsid=1564091646;c=0), blocks: 0, hasStaleStorages: true, processing time: 1 msecs
[junit4] 2> 427370 INFO (IPC Server handler 9 on 47547) [ ] BlockStateChange BLOCK* processReport: from storage DS-cb4f3196-0c7a-4b4a-b123-3a598443bc9c node DatanodeRegistration(127.0.0.1, datanodeUuid=4ef43a94-9e72-446f-bed9-fa58c3ac12dc, infoPort=35288, ipcPort=52292, storageInfo=lv=-56;cid=testClusterID;nsid=1564091646;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
[junit4] 2> 427579 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 427616 INFO (Thread-2399) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 427616 INFO (Thread-2399) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 427716 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.ZkTestServer start zk server on port:57084
[junit4] 2> 427716 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 427743 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 427750 INFO (zkCallback-248-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5b8e7b69 name:ZooKeeperConnection Watcher:127.0.0.1:57084 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 427750 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 427750 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 427750 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 427753 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 427755 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 427782 INFO (zkCallback-249-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@246c31a7 name:ZooKeeperConnection Watcher:127.0.0.1:57084/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 427783 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 427783 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 427783 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
[junit4] 2> 427784 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
[junit4] 2> 427785 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
[junit4] 2> 427786 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
[junit4] 2> 427788 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 427788 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 427790 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 427790 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
[junit4] 2> 427792 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 427792 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 427798 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 427798 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
[junit4] 2> 427799 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 427799 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
[junit4] 2> 427800 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 427801 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
[junit4] 2> 427853 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 427853 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 427855 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 427855 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 427857 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 427857 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 427859 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 427859 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 427865 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 427865 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
[junit4] 2> 428537 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_D28A4B3639CED460-001/control-001/cores/collection1
[junit4] 2> 428538 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.e.j.s.Server jetty-9.2.13.v20150730
[junit4] 2> 428540 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@38e83b78{/,null,AVAILABLE}
[junit4] 2> 428540 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.e.j.s.ServerConnector Started ServerConnector@234523aa{HTTP/1.1}{127.0.0.1:47835}
[junit4] 2> 428541 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.e.j.s.Server Started @431487ms
[junit4] 2> 428541 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, hostPort=47835, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_D28A4B3639CED460-001/control-001/cores}
[junit4] 2> 428541 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 428541 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_D28A4B3639CED460-001/control-001/'
[junit4] 2> 428541 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 428541 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 428581 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 428585 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 428602 INFO (zkCallback-250-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7d970705 name:ZooKeeperConnection Watcher:127.0.0.1:57084/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 428602 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 428603 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 428604 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 428604 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_D28A4B3639CED460-001/control-001/solr.xml
[junit4] 2> 428609 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_D28A4B3639CED460-001/control-001/cores
[junit4] 2> 428609 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.CoreContainer New CoreContainer 1339478905
[junit4] 2> 428609 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_D28A4B3639CED460-001/control-001/]
[junit4] 2> 428610 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_D28A4B3639CED460-001/control-001/lib
[junit4] 2> 428610 WARN (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_D28A4B3639CED460-001/control-001/lib).
[junit4] 2> 428616 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 428617 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 428618 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 428618 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 428618 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:57084/solr
[junit4] 2> 428618 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 428618 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 428690 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 428691 INFO (zkCallback-252-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2a613ca3 name:ZooKeeperConnection Watcher:127.0.0.1:57084 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 428692 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 428692 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 428703 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [n:127.0.0.1:47835_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 428709 INFO (zkCallback-253-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1814314b name:ZooKeeperConnection Watcher:127.0.0.1:57084/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 428709 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [n:127.0.0.1:47835_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 428710 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [n:127.0.0.1:47835_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
[junit4] 2> 428724 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [n:127.0.0.1:47835_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 428726 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [n:127.0.0.1:47835_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 428728 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [n:127.0.0.1:47835_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 428729 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [n:127.0.0.1:47835_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 428731 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [n:127.0.0.1:47835_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 428732 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [n:127.0.0.1:47835_ ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 428733 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [n:127.0.0.1:47835_ ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 428734 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [n:127.0.0.1:47835_ ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 428735 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [n:127.0.0.1:47835_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47835_
[junit4] 2> 428735 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [n:127.0.0.1:47835_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:47835_
[junit4] 2> 428736 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [n:127.0.0.1:47835_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 428737 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [n:127.0.0.1:47835_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 428738 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [n:127.0.0.1:47835_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 428738 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [n:127.0.0.1:47835_ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94892888616009732-127.0.0.1:47835_-n_0000000000
[junit4] 2> 428739 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [n:127.0.0.1:47835_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:47835_
[junit4] 2> 428739 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [n:127.0.0.1:47835_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
[junit4] 2> 428739 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [n:127.0.0.1:47835_ ] o.a.s.c.Overseer Overseer (id=94892888616009732-127.0.0.1:47835_-n_0000000000) starting
[junit4] 2> 428763 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [n:127.0.0.1:47835_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
[junit4] 2> 428767 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [n:127.0.0.1:47835_ ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 428767 INFO (OverseerCollectionConfigSetProcessor-94892888616009732-127.0.0.1:47835_-n_0000000000) [n:127.0.0.1:47835_ ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
[junit4] 2> 428770 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [n:127.0.0.1:47835_ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 428792 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [n:127.0.0.1:47835_ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 428792 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [n:127.0.0.1:47835_ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 428795 INFO (OverseerStateUpdate-94892888616009732-127.0.0.1:47835_-n_0000000000) [n:127.0.0.1:47835_ ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 428830 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [n:127.0.0.1:47835_ ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_D28A4B3639CED460-001/control-001/cores
[junit4] 2> 428839 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [n:127.0.0.1:47835_ ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_D28A4B3639CED460-001/control-001/cores/collection1, collection=control_collection, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_D28A4B3639CED460-001/control-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 428840 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [n:127.0.0.1:47835_ ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_D28A4B3639CED460-001/control-001/cores/collection1/
[junit4] 2> 428840 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [n:127.0.0.1:47835_ ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 428854 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 428855 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 428855 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [n:127.0.0.1:47835_ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2
[junit4] 2> 428855 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [n:127.0.0.1:47835_ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 428857 INFO (OverseerStateUpdate-94892888616009732-127.0.0.1:47835_-n_0000000000) [n:127.0.0.1:47835_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:47835",
[junit4] 2> "node_name":"127.0.0.1:47835_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 428857 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 428857 INFO (OverseerStateUpdate-94892888616009732-127.0.0.1:47835_-n_0000000000) [n:127.0.0.1:47835_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:47835",
[junit4] 2> "node_name":"127.0.0.1:47835_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 428858 INFO (OverseerStateUpdate-94892888616009732-127.0.0.1:47835_-n_0000000000) [n:127.0.0.1:47835_ ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
[junit4] 2> 428858 INFO (OverseerStateUpdate-94892888616009732-127.0.0.1:47835_-n_0000000000) [n:127.0.0.1:47835_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 428859 INFO (zkCallback-253-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 429858 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 429858 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
[junit4] 2> 429858 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 429858 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 429859 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 429859 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_D28A4B3639CED460-001/control-001/cores/collection1/'
[junit4] 2> 429859 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 429859 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 429873 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 429878 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 429886 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 429921 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
[junit4] 2> 429924 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 429928 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 430236 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 430242 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 430243 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 430282 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 430284 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 430298 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 430307 WARN (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 430308 WARN (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 430308 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 430308 WARN (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 430308 WARN (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 430309 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2
[junit4] 2> 430309 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 430309 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.HdfsDirectoryFactory
[junit4] 2> 430310 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:47547/solr_hdfs_home
[junit4] 2> 430310 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 430310 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_D28A4B3639CED460-001/control-001/cores/collection1/], dataDir=[null]
[junit4] 2> 430310 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2f1d1aa5
[junit4] 2> 430310 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:47547/solr_hdfs_home/control_collection/core_node1/data
[junit4] 2> 430374 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for hdfs://localhost:47547/solr_hdfs_home/control_collection/core_node1/data
[junit4] 2> 430375 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=hdfs://localhost:47547/solr_hdfs_home/control_collection/core_node1/data/index/
[junit4] 2> 430409 WARN (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory 'hdfs:/localhost:47547/solr_hdfs_home/control_collection/core_node1/data/index' doesn't exist. Creating new index...
[junit4] 2> 430409 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:47547/solr_hdfs_home/control_collection/core_node1/data/index
[junit4] 2> 430429 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 430429 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
[junit4] 2> 430478 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 430478 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for hdfs://localhost:47547/solr_hdfs_home/control_collection/core_node1/data/index
[junit4] 2> 430478 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@34cb5e58
[junit4] 2> 430594 INFO (IPC Server handler 4 on 47547) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:58274 is added to blk_1073741825_1001{blockUCState=COMMITTED, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-cb4f3196-0c7a-4b4a-b123-3a598443bc9c:NORMAL:127.0.0.1:58274|RBW], ReplicaUnderConstruction[[DISK]DS-4cc3b97c-864e-479e-8d7c-cd5bebcacdb7:NORMAL:127.0.0.1:36658|RBW]]} size 71
[junit4] 2> 430595 INFO (IPC Server handler 1 on 47547) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:36658 is added to blk_1073741825_1001 size 71
[junit4] 2> 431092 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=NRTCachingDirectory(BlockDirectory(HdfsDirectory@b7af5525 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2bfb68d7); maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
[junit4] 2> 431092 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 431099 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in hdfs://localhost:47547/solr_hdfs_home/control_collection/core_node1/data/
[junit4] 2> 431101 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 431102 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
[junit4] 2> 431102 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 431102 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 431102 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 431102 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 431102 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 431102 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 431102 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 431102 WARN (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,args = {defaults={a=A,b=B}}}
[junit4] 2> 431104 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 431105 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 431106 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 431107 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 431110 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/dump,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 431122 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 431123 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
[junit4] 2> 431123 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing HdfsUpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 tlogDfsReplication=2
[junit4] 2> 431156 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
[junit4] 2> 431156 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
[junit4] 2> 431161 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@1393c413
[junit4] 2> 431178 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=NRTCachingDirectory(BlockDirectory(HdfsDirectory@b7af5525 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2bfb68d7); maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
[junit4] 2> 431178 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 431178 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@5658e693[collection1] main
[junit4] 2> 431178 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 431179 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 431180 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 431180 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 431180 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
[junit4] 2> 431180 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 431181 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 431181 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 431181 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 431181 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 431182 INFO (searcherExecutor-1167-thread-1-processing-n:127.0.0.1:47835_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@5658e693[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 431182 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
[junit4] 2> 431182 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 256 version buckets from index
[junit4] 2> 431182 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
[junit4] 2> 431182 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1518286221583843328
[junit4] 2> 431182 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 0.0ms to seed version buckets with highest version 1518286221583843328
[junit4] 2> 431182 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
[junit4] 2> 431182 INFO (coreLoadExecutor-1166-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 431186 INFO (coreZkRegister-1160-thread-1-processing-n:127.0.0.1:47835_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:47835 collection:control_collection shard:shard1
[junit4] 2> 431187 INFO (coreZkRegister-1160-thread-1-processing-n:127.0.0.1:47835_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 431190 INFO (coreZkRegister-1160-thread-1-processing-n:127.0.0.1:47835_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/94892888616009732-core_node1-n_0000000000
[junit4] 2> 431191 INFO (coreZkRegister-1160-thread-1-processing-n:127.0.0.1:47835_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1
[junit4] 2> 431192 INFO (coreZkRegister-1160-thread-1-processing-n:127.0.0.1:47835_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 431193 INFO (coreZkRegister-1160-thread-1-processing-n:127.0.0.1:47835_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 431192 INFO (OverseerStateUpdate-94892888616009732-127.0.0.1:47835_-n_0000000000) [n:127.0.0.1:47835_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection"} current state version: 1
[junit4] 2> 431193 INFO (coreZkRegister-1160-thread-1-processing-n:127.0.0.1:47835_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:47835/collection1/
[junit4] 2> 431194 INFO (coreZkRegister-1160-thread-1-processing-n:127.0.0.1:47835_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 431194 INFO (coreZkRegister-1160-thread-1-processing-n:127.0.0.1:47835_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:47835/collection1/ has no replicas
[junit4] 2> 431201 INFO (coreZkRegister-1160-thread-1-processing-n:127.0.0.1:47835_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 431202 INFO (zkCallback-253-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 431205 INFO (coreZkRegister-1160-thread-1-processing-n:127.0.0.1:47835_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
[junit4] 2> 431207 INFO (coreZkRegister-1160-thread-1-processing-n:127.0.0.1:47835_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:47835/collection1/ shard1
[junit4] 2> 431207 INFO (OverseerStateUpdate-94892888616009732-127.0.0.1:47835_-n_0000000000) [n:127.0.0.1:47835_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:47835",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 2
[junit4] 2> 431309 INFO (zkCallback-253-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 431337 INFO (coreZkRegister-1160-thread-1-processing-n:127.0.0.1:47835_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:47835/collection1/ and leader is http://127.0.0.1:47835/collection1/
[junit4] 2> 431337 INFO (coreZkRegister-1160-thread-1-processing-n:127.0.0.1:47835_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:47835
[junit4] 2> 431337 INFO (coreZkRegister-1160-thread-1-processing-n:127.0.0.1:47835_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 431337 INFO (coreZkRegister-1160-thread-1-processing-n:127.0.0.1:47835_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
[junit4] 2> 431337 INFO (coreZkRegister-1160-thread-1-processing-n:127.0.0.1:47835_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47835_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 431339 INFO (OverseerStateUpdate-94892888616009732-127.0.0.1:47835_-n_0000000000) [n:127.0.0.1:47835_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:47835",
[junit4] 2> "node_name":"127.0.0.1:47835_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 3
[junit4] 2> 431339 INFO (OverseerStateUpdate-94892888616009732-127.0.0.1:47835_-n_0000000000) [n:127.0.0.1:47835_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:47835",
[junit4] 2> "node_name":"127.0.0.1:47835_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 431365 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 431367 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 431376 INFO (zkCallback-255-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@41056a78 name:ZooKeeperConnection Watcher:127.0.0.1:57084/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 431379 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 431379 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 431379 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 431381 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 431442 INFO (zkCallback-255-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 431442 INFO (zkCallback-253-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 432460 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_D28A4B3639CED460-001/shard-1-001/cores/collection1
[junit4] 2> 432461 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_D28A4B3639CED460-001/shard-1-001
[junit4] 2> 432463 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.e.j.s.Server jetty-9.2.13.v20150730
[junit4] 2> 432515 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@78654c98{/,null,AVAILABLE}
[junit4] 2> 432515 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.e.j.s.ServerConnector Started ServerConnector@53358028{HTTP/1.1}{127.0.0.1:44954}
[junit4] 2> 432515 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.e.j.s.Server Started @435461ms
[junit4] 2> 432515 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solrconfig=solrconfig.xml, hostContext=/, hostPort=44954, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_D28A4B3639CED460-001/shard-1-001/cores}
[junit4] 2> 432516 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 432516 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_D28A4B3639CED460-001/shard-1-001/'
[junit4] 2> 432516 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 432516 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 432570 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 432571 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 432576 INFO (zkCallback-256-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@42477658 name:ZooKeeperConnection Watcher:127.0.0.1:57084/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 432576 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 432576 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 432591 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 432591 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_D28A4B3639CED460-001/shard-1-001/solr.xml
[junit4] 2> 432596 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_D28A4B3639CED460-001/shard-1-001/cores
[junit4] 2> 432597 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.CoreContainer New CoreContainer 1428850593
[junit4] 2> 432597 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_D28A4B3639CED460-001/shard-1-001/]
[junit4] 2> 432597 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_D28A4B3639CED460-001/shard-1-001/lib
[junit4] 2> 432597 WARN (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_D28A4B3639CED460-001/shard-1-001/lib).
[junit4] 2> 432610 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 432611 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 432612 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 432612 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 432612 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:57084/solr
[junit4] 2> 432612 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 432612 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 432624 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 432632 INFO (zkCallback-258-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7b59d53a name:ZooKeeperConnection Watcher:127.0.0.1:57084 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 432633 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 432633 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 432718 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [n:127.0.0.1:44954_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 432748 INFO (zkCallback-259-thread-1-processing-n:127.0.0.1:44954_) [n:127.0.0.1:44954_ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@11c5582e name:ZooKeeperConnection Watcher:127.0.0.1:57084/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 432748 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [n:127.0.0.1:44954_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 432761 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [n:127.0.0.1:44954_ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 433767 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [n:127.0.0.1:44954_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44954_
[junit4] 2> 433768 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [n:127.0.0.1:44954_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:44954_
[junit4] 2> 433769 INFO (zkCallback-253-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 433769 INFO (zkCallback-255-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 433769 INFO (zkCallback-259-thread-1-processing-n:127.0.0.1:44954_) [n:127.0.0.1:44954_ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 433771 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [n:127.0.0.1:44954_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 433771 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [n:127.0.0.1:44954_ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94892888616009736-127.0.0.1:44954_-n_0000000001
[junit4] 2> 433772 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [n:127.0.0.1:44954_ ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/94892888616009732-127.0.0.1:47835_-n_0000000000 to know if I could be the leader
[junit4] 2> 433785 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [n:127.0.0.1:44954_ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 433785 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [n:127.0.0.1:44954_ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 433785 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [n:127.0.0.1:44954_ ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_D28A4B3639CED460-001/shard-1-001/cores
[junit4] 2> 433786 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [n:127.0.0.1:44954_ ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_D28A4B3639CED460-001/shard-1-001/cores/collection1, collection=collection1, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_D28A4B3639CED460-001/shard-1-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 433786 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [n:127.0.0.1:44954_ ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_D28A4B3639CED460-001/shard-1-001/cores/collection1/
[junit4] 2> 433786 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [n:127.0.0.1:44954_ ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 433796 INFO (coreLoadExecutor-1177-thread-1-processing-n:127.0.0.1:44954_) [n:127.0.0.1:44954_ c:collection1 x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 433796 INFO (coreLoadExecutor-1177-thread-1-processing-n:127.0.0.1:44954_) [n:127.0.0.1:44954_ c:collection1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 433798 INFO (OverseerStateUpdate-94892888616009732-127.0.0.1:47835_-n_0000000000) [n:127.0.0.1:47835_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:44954",
[junit4] 2> "node_name":"127.0.0.1:44954_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"} current state version: 4
[junit4] 2> 433799 INFO (OverseerStateUpdate-94892888616009732-127.0.0.1:47835_-n_0000000000) [n:127.0.0.1:47835_ ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:44954",
[junit4] 2> "node_name":"127.0.0.1:44954_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"}
[junit4] 2> 433799 INFO (OverseerStateUpdate-94892888616009732-127.0.0.1:47835_-n_0000000000) [n:127.0.0.1:47835_ ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
[junit4] 2> 433799 INFO (OverseerStateUpdate-94892888616009732-127.0.0.1:47835_-n_0000000000) [n:127.0.0.1:47835_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2
[junit4] 2> 433800 INFO (zkCallback-255-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 433805 INFO (zkCallback-253-thread-1-processing-n:127.0.0.1:47835_) [n:127.0.0.1:47835_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 433808 INFO (zkCallback-259-thread-1-processing-n:127.0.0.1:44954_) [n:127.0.0.1:44954_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 433829 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [n:127.0.0.1:44954_ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2
[junit4] 2> 433829 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[D28A4B3639CED460]) [n:127.0.0.1:44954_ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 433834 INFO (coreLoadExecutor-1177-thread-1-processing-n:127.0.0.1:44954_) [n:127.0.0.1:44954_ c:collection1 x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 433834 INFO (coreLoadExecutor-1177-thread-1-processing-n:127.0.0.1:44954_) [n:127.0.0.1:44954_ c:collection1 x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 433834 INFO (coreLoadExecutor-1177-thread-1-processing-n:127.0.0.1:44954_) [n:127.0.0.1:44954_ c:collection1 x:collection1] o.a.s.c.ZkController Check for collection zkNode:collection1
[junit4] 2> 433835 INFO (coreLoadExecutor-1177-thread-1-processing-n:127.0.0.1:44954_) [n:127.0.0.1:44954_ c:collection1 x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 433835 INFO (coreLoadExecutor-1177-thread-1-processing-n:127.0.0.1:44954_) [n:127.0.0.1:44954_ c:collection1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/collection1
[junit4] 2> 433839 INFO (coreLoadExecutor-1177-thread-1-processing-n:127.0.0.1:44954_) [n:127.0.0.1:44954_ c:collection1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 433839 INFO (coreLoadExecutor-1177-thread-1-processing-n:127.0.0.1:44954_) [n:127.0.0.1:44954_ c:collection1 x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_D28A4B3639CED460-001/shard-1-001/cores/collection1/'
[junit4] 2> 433839 INFO (coreLoadExecutor-1177-thread-1-processing-n:127.0.0.1:44954_) [n:127.0.0.1:44954_ c:collection1 x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 433840 INFO (coreLoadExecutor-1177-thread-1-processing-n:127.0.0.1:44954_) [n:127.0.0.1:44954_ c:collection1 x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 433864 INFO
[...truncated too long message...]
nt.request(HttpSolrClient.java:230)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
[junit4] > at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1573)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1594)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:876)Throwable #4: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=19618, name=collection0, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:45476: Could not find collection : awholynewstresscollection_collection0_2
[junit4] > at __randomizedtesting.SeedInfo.seed([D28A4B3639CED460]:0)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
[junit4] > at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:883)Throwable #5: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=19622, name=collection4, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:45476: Could not find collection : awholynewstresscollection_collection4_1
[junit4] > at __randomizedtesting.SeedInfo.seed([D28A4B3639CED460]:0)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
[junit4] > at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:883)Throwable #6: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=19619, name=collection1, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:45476: Could not find collection : awholynewstresscollection_collection1_2
[junit4] > at __randomizedtesting.SeedInfo.seed([D28A4B3639CED460]:0)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
[junit4] > at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:883)
[junit4] 2> 2964238 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[D28A4B3639CED460]-worker) [n:127.0.0.1:45476_ c:addReplicaColl s:shard1 r:core_node3 x:addReplicaColl_shard1_replica1] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene60): {other_tl1=PostingsFormat(name=Direct), range_facet_l_dv=PostingsFormat(name=LuceneVarGapFixedInterval), _version_=PostingsFormat(name=Direct), multiDefault=FST50, a_t=PostingsFormat(name=Direct), intDefault=PostingsFormat(name=Direct), a_i1=PostingsFormat(name=Direct), id=PostingsFormat(name=LuceneVarGapFixedInterval), range_facet_i_dv=PostingsFormat(name=Direct), text=BlockTreeOrds(blocksize=128), range_facet_l=PostingsFormat(name=Direct), timestamp=PostingsFormat(name=Direct)}, docValues:{range_facet_l_dv=DocValuesFormat(name=Memory), range_facet_i_dv=DocValuesFormat(name=Asserting), timestamp=DocValuesFormat(name=Asserting)}, sim=ClassicSimilarity, locale=vi_VN, timezone=Europe/Riga
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_66 (64-bit)/cpus=4,threads=1,free=118020008,total=493879296
[junit4] 2> NOTE: All tests run in this JVM: [HttpPartitionTest, TestSolrConfigHandlerConcurrent, NotRequiredUniqueKeyTest, SchemaVersionSpecificBehaviorTest, DirectSolrSpellCheckerTest, TestInitQParser, TestMiniSolrCloudClusterSSL, FastVectorHighlighterTest, TestManagedResource, TestClassNameShortening, SuggesterFSTTest, DistributedSuggestComponentTest, DocValuesTest, TestSolrCoreProperties, TestSurroundQueryParser, TestReplicaProperties, RequestLoggingTest, CoreMergeIndexesAdminHandlerTest, TestCloudManagedSchemaConcurrent, TestQuerySenderNoQuery, TestInitParams, HdfsBasicDistributedZk2Test, OpenCloseCoreStressTest, TestFiltering, OverseerRolesTest, TestPKIAuthenticationPlugin, TestHighlightDedupGrouping, TestRawResponseWriter, MBeansHandlerTest, CdcrReplicationDistributedZkTest, TestPartialUpdateDeduplication, UUIDUpdateProcessorFallbackTest, SolrIndexConfigTest, InfoHandlerTest, ShardRoutingTest, TestStandardQParsers, HdfsThreadLeakTest, ActionThrottleTest, BJQParserTest, TestDistributedMissingSort, SecurityConfHandlerTest, CollectionsAPIAsyncDistributedZkTest, TestChildDocTransformer, LeaderInitiatedRecoveryOnCommitTest, TestMissingGroups, RemoteQueryErrorTest, MultiTermTest, TestOrdValues, TestReqParamsAPI, TestManagedSchemaDynamicFieldResource, BigEndianAscendingWordSerializerTest, CloneFieldUpdateProcessorFactoryTest, TestUpdate, DistributedVersionInfoTest, HdfsUnloadDistributedZkTest, TestQueryUtils, TestRecoveryHdfs, CollectionsAPIDistributedZkTest]
[junit4] Completed [388/559] on J1 in 252.15s, 1 test, 1 error <<< FAILURES!
[...truncated 553 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987: There were test failures: 559 suites (8 ignored), 2215 tests, 1 error, 1 failure, 32 ignored (18 assumptions) [seed: D28A4B3639CED460]
Total time: 200 minutes 34 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 856 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/856/
3 tests failed.
FAILED: org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.test
Error Message:
Error from server at http://127.0.0.1:46164/awholynewcollection_0: Expected mime type application/octet-stream but got text/html. <html> <head> <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/> <title>Error 500 </title> </head> <body> <h2>HTTP ERROR: 500</h2> <p>Problem accessing /awholynewcollection_0/select. Reason: <pre> {msg=Error trying to proxy request for url: http://127.0.0.1:46308/awholynewcollection_0/select,trace=org.apache.solr.common.SolrException: Error trying to proxy request for url: http://127.0.0.1:46308/awholynewcollection_0/select at org.apache.solr.servlet.HttpSolrCall.remoteQuery(HttpSolrCall.java:596) at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:444) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:220) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:179) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652) at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:109) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652) at org.eclipse.jetty.servlets.UserAgentFilter.doFilter(UserAgentFilter.java:83) at org.eclipse.jetty.servlets.GzipFilter.doFilter(GzipFilter.java:364) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:221) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97) at org.eclipse.jetty.server.Server.handle(Server.java:499) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:310) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:257) at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:540) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.http.conn.ConnectionPoolTimeoutException: Timeout waiting for connection from pool at org.apache.http.impl.conn.PoolingClientConnectionManager.leaseConnection(PoolingClientConnectionManager.java:226) at org.apache.http.impl.conn.PoolingClientConnectionManager$1.getConnection(PoolingClientConnectionManager.java:195) at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:423) at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55) at org.apache.solr.servlet.HttpSolrCall.remoteQuery(HttpSolrCall.java:563) ... 24 more ,code=500}</pre></p> <hr /><i><small>Powered by Jetty://</small></i> </body> </html>
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:46164/awholynewcollection_0: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 500 </title>
</head>
<body>
<h2>HTTP ERROR: 500</h2>
<p>Problem accessing /awholynewcollection_0/select. Reason:
<pre> {msg=Error trying to proxy request for url: http://127.0.0.1:46308/awholynewcollection_0/select,trace=org.apache.solr.common.SolrException: Error trying to proxy request for url: http://127.0.0.1:46308/awholynewcollection_0/select
at org.apache.solr.servlet.HttpSolrCall.remoteQuery(HttpSolrCall.java:596)
at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:444)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:220)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:179)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:109)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
at org.eclipse.jetty.servlets.UserAgentFilter.doFilter(UserAgentFilter.java:83)
at org.eclipse.jetty.servlets.GzipFilter.doFilter(GzipFilter.java:364)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585)
at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:221)
at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127)
at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515)
at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
at org.eclipse.jetty.server.Server.handle(Server.java:499)
at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:310)
at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:257)
at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:540)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635)
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.http.conn.ConnectionPoolTimeoutException: Timeout waiting for connection from pool
at org.apache.http.impl.conn.PoolingClientConnectionManager.leaseConnection(PoolingClientConnectionManager.java:226)
at org.apache.http.impl.conn.PoolingClientConnectionManager$1.getConnection(PoolingClientConnectionManager.java:195)
at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:423)
at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
at org.apache.solr.servlet.HttpSolrCall.remoteQuery(HttpSolrCall.java:563)
... 24 more
,code=500}</pre></p>
<hr /><i><small>Powered by Jetty://</small></i>
</body>
</html>
at __randomizedtesting.SeedInfo.seed([BA78D4A59A09DEBB:322CEB7F34F5B343]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:543)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:150)
at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:943)
at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:958)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForNon403or404or503(AbstractFullDistribZkTestBase.java:1753)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:653)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test(CollectionsAPIDistributedZkTest.java:155)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1660)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:866)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:902)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:916)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:963)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:938)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:875)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:777)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:811)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:822)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest
Error Message:
5 threads leaked from SUITE scope at org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest: 1) Thread[id=6897, name=zkCallback-880-thread-2, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 2) Thread[id=6898, name=zkCallback-880-thread-3, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 3) Thread[id=6439, name=TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]-SendThread(127.0.0.1:56190), state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:994) 4) Thread[id=6441, name=zkCallback-880-thread-1, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 5) Thread[id=6440, name=TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]-EventThread, state=WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 5 threads leaked from SUITE scope at org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest:
1) Thread[id=6897, name=zkCallback-880-thread-2, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2) Thread[id=6898, name=zkCallback-880-thread-3, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
3) Thread[id=6439, name=TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]-SendThread(127.0.0.1:56190), state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:994)
4) Thread[id=6441, name=zkCallback-880-thread-1, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
5) Thread[id=6440, name=TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]-EventThread, state=WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494)
at __randomizedtesting.SeedInfo.seed([BA78D4A59A09DEBB]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=6897, name=zkCallback-880-thread-2, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 2) Thread[id=6898, name=zkCallback-880-thread-3, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 3) Thread[id=6439, name=TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]-SendThread(127.0.0.1:56190), state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:940) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003) 4) Thread[id=6441, name=zkCallback-880-thread-1, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=6897, name=zkCallback-880-thread-2, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2) Thread[id=6898, name=zkCallback-880-thread-3, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
3) Thread[id=6439, name=TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]-SendThread(127.0.0.1:56190), state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:940)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003)
4) Thread[id=6441, name=zkCallback-880-thread-1, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
at __randomizedtesting.SeedInfo.seed([BA78D4A59A09DEBB]:0)
Build Log:
[...truncated 10342 lines...]
[junit4] Suite: org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_BA78D4A59A09DEBB-001/init-core-data-001
[junit4] 2> 909088 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[BA78D4A59A09DEBB]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
[junit4] 2> 909088 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[BA78D4A59A09DEBB]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
[junit4] 1> Formatting using clusterid: testClusterID
[junit4] 2> 909199 WARN (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[BA78D4A59A09DEBB]-worker) [ ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
[junit4] 2> 909206 WARN (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[BA78D4A59A09DEBB]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 909209 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[BA78D4A59A09DEBB]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 909227 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[BA78D4A59A09DEBB]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_41906_hdfs____q236z0/webapp
[junit4] 2> 909341 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[BA78D4A59A09DEBB]-worker) [ ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
[junit4] 2> 909583 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[BA78D4A59A09DEBB]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41906
[junit4] 2> 909851 WARN (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[BA78D4A59A09DEBB]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 909852 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[BA78D4A59A09DEBB]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 909876 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[BA78D4A59A09DEBB]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_49888_datanode____uwenlm/webapp
[junit4] 2> 909979 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[BA78D4A59A09DEBB]-worker) [ ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
[junit4] 2> 910148 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[BA78D4A59A09DEBB]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:49888
[junit4] 2> 910209 WARN (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[BA78D4A59A09DEBB]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 910210 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[BA78D4A59A09DEBB]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 910221 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[BA78D4A59A09DEBB]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_39245_datanode____.m1idn0/webapp
[junit4] 2> 910348 INFO (IPC Server handler 4 on 51199) [ ] BlockStateChange BLOCK* processReport: from storage DS-2bf31472-b579-44db-84d7-1d9938d5379e node DatanodeRegistration(127.0.0.1, datanodeUuid=d2c02272-a86e-4815-8ab7-33832405d147, infoPort=49888, ipcPort=45341, storageInfo=lv=-56;cid=testClusterID;nsid=922711261;c=0), blocks: 0, hasStaleStorages: true, processing time: 1 msecs
[junit4] 2> 910348 INFO (IPC Server handler 4 on 51199) [ ] BlockStateChange BLOCK* processReport: from storage DS-bff17d16-3f4b-4d74-8e7d-926d413e113b node DatanodeRegistration(127.0.0.1, datanodeUuid=d2c02272-a86e-4815-8ab7-33832405d147, infoPort=49888, ipcPort=45341, storageInfo=lv=-56;cid=testClusterID;nsid=922711261;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
[junit4] 2> 910368 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[BA78D4A59A09DEBB]-worker) [ ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
[junit4] 2> 911461 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[BA78D4A59A09DEBB]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39245
[junit4] 2> 911592 INFO (IPC Server handler 6 on 51199) [ ] BlockStateChange BLOCK* processReport: from storage DS-6fbb9356-30a1-44ac-9d3f-7f13177d6e14 node DatanodeRegistration(127.0.0.1, datanodeUuid=ba957c5f-9d77-4959-bddd-ac3ae1a199cf, infoPort=39245, ipcPort=53673, storageInfo=lv=-56;cid=testClusterID;nsid=922711261;c=0), blocks: 0, hasStaleStorages: true, processing time: 1 msecs
[junit4] 2> 911592 INFO (IPC Server handler 6 on 51199) [ ] BlockStateChange BLOCK* processReport: from storage DS-7d9429ba-13be-418e-8144-71fa0ece884f node DatanodeRegistration(127.0.0.1, datanodeUuid=ba957c5f-9d77-4959-bddd-ac3ae1a199cf, infoPort=39245, ipcPort=53673, storageInfo=lv=-56;cid=testClusterID;nsid=922711261;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
[junit4] 2> 911654 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 911655 INFO (Thread-2597) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 911655 INFO (Thread-2597) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 911755 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.c.ZkTestServer start zk server on port:56190
[junit4] 2> 911755 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 911755 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 911758 INFO (zkCallback-849-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5a0ac646 name:ZooKeeperConnection Watcher:127.0.0.1:56190 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 911758 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 911759 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 911759 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 911762 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 911763 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 911764 INFO (zkCallback-850-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@663c1278 name:ZooKeeperConnection Watcher:127.0.0.1:56190/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 911764 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 911764 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 911764 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
[junit4] 2> 911767 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
[junit4] 2> 911768 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
[junit4] 2> 911769 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
[junit4] 2> 911771 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 911771 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 911773 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 911774 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
[junit4] 2> 911776 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 911776 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 911778 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 911778 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
[junit4] 2> 911779 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 911780 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
[junit4] 2> 911781 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 911781 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
[junit4] 2> 911783 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 911783 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 911784 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 911785 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 911786 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 911786 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 911788 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 911788 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 911790 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 911790 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
[junit4] 2> 912088 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_BA78D4A59A09DEBB-001/control-001/cores/collection1
[junit4] 2> 912089 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.e.j.s.Server jetty-9.2.13.v20150730
[junit4] 2> 912091 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5180c56f{/,null,AVAILABLE}
[junit4] 2> 912092 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.e.j.s.ServerConnector Started ServerConnector@6d9904b7{HTTP/1.1}{127.0.0.1:47950}
[junit4] 2> 912092 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.e.j.s.Server Started @915001ms
[junit4] 2> 912092 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:51199/hdfs__localhost_51199__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-trunk_solr_build_solr-core_test_J2_temp_solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_BA78D4A59A09DEBB-001_tempDir-002_control_data, hostContext=/, hostPort=47950, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_BA78D4A59A09DEBB-001/control-001/cores}
[junit4] 2> 912092 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 912092 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_BA78D4A59A09DEBB-001/control-001/'
[junit4] 2> 912092 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 912093 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 912108 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 912108 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 912109 INFO (zkCallback-851-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6daad99a name:ZooKeeperConnection Watcher:127.0.0.1:56190/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 912109 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 912110 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 912111 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 912111 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_BA78D4A59A09DEBB-001/control-001/solr.xml
[junit4] 2> 912117 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_BA78D4A59A09DEBB-001/control-001/cores
[junit4] 2> 912117 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.c.CoreContainer New CoreContainer 1021446176
[junit4] 2> 912117 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_BA78D4A59A09DEBB-001/control-001/]
[junit4] 2> 912117 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_BA78D4A59A09DEBB-001/control-001/lib
[junit4] 2> 912117 WARN (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_BA78D4A59A09DEBB-001/control-001/lib).
[junit4] 2> 912124 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 912125 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 912126 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 912126 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 912126 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:56190/solr
[junit4] 2> 912126 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 912126 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 912127 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 912134 INFO (zkCallback-853-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5d2d500 name:ZooKeeperConnection Watcher:127.0.0.1:56190 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 912135 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 912135 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 912137 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [n:127.0.0.1:47950_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 912138 INFO (zkCallback-854-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@8c217cc name:ZooKeeperConnection Watcher:127.0.0.1:56190/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 912138 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [n:127.0.0.1:47950_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 912139 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [n:127.0.0.1:47950_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
[junit4] 2> 912140 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [n:127.0.0.1:47950_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 912142 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [n:127.0.0.1:47950_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 912144 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [n:127.0.0.1:47950_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 912145 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [n:127.0.0.1:47950_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 912147 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [n:127.0.0.1:47950_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 912148 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [n:127.0.0.1:47950_ ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 912149 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [n:127.0.0.1:47950_ ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 912150 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [n:127.0.0.1:47950_ ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 912151 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [n:127.0.0.1:47950_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47950_
[junit4] 2> 912152 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [n:127.0.0.1:47950_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:47950_
[junit4] 2> 912153 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [n:127.0.0.1:47950_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 912154 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [n:127.0.0.1:47950_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 912155 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [n:127.0.0.1:47950_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 912155 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [n:127.0.0.1:47950_ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94885719969431556-127.0.0.1:47950_-n_0000000000
[junit4] 2> 912156 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [n:127.0.0.1:47950_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:47950_
[junit4] 2> 912156 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [n:127.0.0.1:47950_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
[junit4] 2> 912157 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [n:127.0.0.1:47950_ ] o.a.s.c.Overseer Overseer (id=94885719969431556-127.0.0.1:47950_-n_0000000000) starting
[junit4] 2> 912158 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [n:127.0.0.1:47950_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
[junit4] 2> 912163 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [n:127.0.0.1:47950_ ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 912164 INFO (OverseerCollectionConfigSetProcessor-94885719969431556-127.0.0.1:47950_-n_0000000000) [n:127.0.0.1:47950_ ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
[junit4] 2> 912164 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [n:127.0.0.1:47950_ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 912164 INFO (OverseerStateUpdate-94885719969431556-127.0.0.1:47950_-n_0000000000) [n:127.0.0.1:47950_ ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 912183 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [n:127.0.0.1:47950_ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 912183 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [n:127.0.0.1:47950_ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 912183 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [n:127.0.0.1:47950_ ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_BA78D4A59A09DEBB-001/control-001/cores
[junit4] 2> 912184 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [n:127.0.0.1:47950_ ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_BA78D4A59A09DEBB-001/control-001/cores/collection1, collection=control_collection, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_BA78D4A59A09DEBB-001/control-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 912184 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [n:127.0.0.1:47950_ ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_BA78D4A59A09DEBB-001/control-001/cores/collection1/
[junit4] 2> 912184 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [n:127.0.0.1:47950_ ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 912185 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [n:127.0.0.1:47950_ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2
[junit4] 2> 912185 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [n:127.0.0.1:47950_ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 912186 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 912186 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 912187 INFO (OverseerStateUpdate-94885719969431556-127.0.0.1:47950_-n_0000000000) [n:127.0.0.1:47950_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:47950",
[junit4] 2> "node_name":"127.0.0.1:47950_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 912188 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 912188 INFO (OverseerStateUpdate-94885719969431556-127.0.0.1:47950_-n_0000000000) [n:127.0.0.1:47950_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:47950",
[junit4] 2> "node_name":"127.0.0.1:47950_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 912188 INFO (OverseerStateUpdate-94885719969431556-127.0.0.1:47950_-n_0000000000) [n:127.0.0.1:47950_ ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
[junit4] 2> 912189 INFO (OverseerStateUpdate-94885719969431556-127.0.0.1:47950_-n_0000000000) [n:127.0.0.1:47950_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 912190 INFO (zkCallback-854-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 913188 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 913188 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
[junit4] 2> 913189 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 913189 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 913189 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 913189 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_BA78D4A59A09DEBB-001/control-001/cores/collection1/'
[junit4] 2> 913189 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 913190 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 913212 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 913218 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 913222 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 913244 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
[junit4] 2> 913245 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 913276 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 913417 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 913424 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 913425 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 913438 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 913440 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 913442 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 913453 WARN (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 913453 WARN (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 913453 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 913454 WARN (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 913454 WARN (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 913455 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2
[junit4] 2> 913455 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 913455 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.HdfsDirectoryFactory
[junit4] 2> 913455 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:51199/solr_hdfs_home
[junit4] 2> 913456 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 913456 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_BA78D4A59A09DEBB-001/control-001/cores/collection1/], dataDir=[null]
[junit4] 2> 913456 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@367fe632
[junit4] 2> 913456 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:51199/solr_hdfs_home/control_collection/core_node1/data
[junit4] 2> 913472 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for hdfs://localhost:51199/solr_hdfs_home/control_collection/core_node1/data
[junit4] 2> 913473 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=hdfs://localhost:51199/solr_hdfs_home/control_collection/core_node1/data/index/
[junit4] 2> 913499 WARN (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory 'hdfs:/localhost:51199/solr_hdfs_home/control_collection/core_node1/data/index' doesn't exist. Creating new index...
[junit4] 2> 913499 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:51199/solr_hdfs_home/control_collection/core_node1/data/index
[junit4] 2> 913520 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for hdfs://localhost:51199/solr_hdfs_home/control_collection/core_node1/data/index
[junit4] 2> 913520 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=48, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=0.3271484375, noCFSRatio=0.0]
[junit4] 2> 913575 INFO (IPC Server handler 5 on 51199) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52975 is added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-6fbb9356-30a1-44ac-9d3f-7f13177d6e14:NORMAL:127.0.0.1:36932|RBW], ReplicaUnderConstruction[[DISK]DS-2bf31472-b579-44db-84d7-1d9938d5379e:NORMAL:127.0.0.1:52975|RBW]]} size 0
[junit4] 2> 913578 INFO (IPC Server handler 3 on 51199) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:36932 is added to blk_1073741825_1001 size 71
[junit4] 2> 913582 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=NRTCachingDirectory(HdfsDirectory@b81bf0d9 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@17ec927d; maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
[junit4] 2> 913582 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 913584 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in hdfs://localhost:51199/solr_hdfs_home/control_collection/core_node1/data/
[junit4] 2> 913587 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 913587 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
[junit4] 2> 913588 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 913588 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 913588 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 913588 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 913588 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 913588 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 913588 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 913588 WARN (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,args = {defaults={a=A,b=B}}}
[junit4] 2> 913590 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 913591 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 913592 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 913593 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 913596 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/dump,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 913596 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 913597 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
[junit4] 2> 913597 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing HdfsUpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 tlogDfsReplication=2
[junit4] 2> 913613 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
[junit4] 2> 913613 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
[junit4] 2> 913614 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=11, maxMergeAtOnceExplicit=48, maxMergedSegmentMB=30.908203125, floorSegmentMB=1.2041015625, forceMergeDeletesPctAllowed=5.108906690701219, segmentsPerTier=11.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 913628 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=NRTCachingDirectory(HdfsDirectory@b81bf0d9 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@17ec927d; maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
[junit4] 2> 913628 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 913628 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@275bf12[collection1] main
[junit4] 2> 913629 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 913629 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 913630 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 913630 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 913630 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
[junit4] 2> 913630 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 913630 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 913630 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 913631 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 913631 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 913632 INFO (searcherExecutor-2563-thread-1-processing-n:127.0.0.1:47950_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@275bf12[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 913632 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
[junit4] 2> 913632 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 256 version buckets from index
[junit4] 2> 913632 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
[junit4] 2> 913632 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1518171521582891008
[junit4] 2> 913632 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 0.0ms to seed version buckets with highest version 1518171521582891008
[junit4] 2> 913633 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
[junit4] 2> 913633 INFO (coreLoadExecutor-2562-thread-1-processing-n:127.0.0.1:47950_) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 913634 INFO (coreZkRegister-2556-thread-1-processing-n:127.0.0.1:47950_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:47950 collection:control_collection shard:shard1
[junit4] 2> 913635 INFO (coreZkRegister-2556-thread-1-processing-n:127.0.0.1:47950_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 913639 INFO (coreZkRegister-2556-thread-1-processing-n:127.0.0.1:47950_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/94885719969431556-core_node1-n_0000000000
[junit4] 2> 913639 INFO (coreZkRegister-2556-thread-1-processing-n:127.0.0.1:47950_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1
[junit4] 2> 913641 INFO (coreZkRegister-2556-thread-1-processing-n:127.0.0.1:47950_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 913641 INFO (coreZkRegister-2556-thread-1-processing-n:127.0.0.1:47950_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 913641 INFO (coreZkRegister-2556-thread-1-processing-n:127.0.0.1:47950_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:47950/collection1/
[junit4] 2> 913641 INFO (OverseerStateUpdate-94885719969431556-127.0.0.1:47950_-n_0000000000) [n:127.0.0.1:47950_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection"} current state version: 1
[junit4] 2> 913641 INFO (coreZkRegister-2556-thread-1-processing-n:127.0.0.1:47950_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 913641 INFO (coreZkRegister-2556-thread-1-processing-n:127.0.0.1:47950_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:47950/collection1/ has no replicas
[junit4] 2> 913642 INFO (coreZkRegister-2556-thread-1-processing-n:127.0.0.1:47950_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 913644 INFO (coreZkRegister-2556-thread-1-processing-n:127.0.0.1:47950_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
[junit4] 2> 913646 INFO (coreZkRegister-2556-thread-1-processing-n:127.0.0.1:47950_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47950_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:47950/collection1/ shard1
[junit4] 2> 913647 INFO (OverseerStateUpdate-94885719969431556-127.0.0.1:47950_-n_0000000000) [n:127.0.0.1:47950_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:47950",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 1
[junit4] 2> 913687 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 913688 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 913689 INFO (zkCallback-856-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4d49c3ae name:ZooKeeperConnection Watcher:127.0.0.1:56190/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 913689 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 913689 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 913689 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 913691 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection los
[...truncated too long message...]
ile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=es_CR -Dtests.timezone=Europe/Zurich -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[junit4] ERROR 0.00s J2 | HdfsCollectionsAPIDistributedZkTest (suite) <<<
[junit4] > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 5 threads leaked from SUITE scope at org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest:
[junit4] > 1) Thread[id=6897, name=zkCallback-880-thread-2, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > 2) Thread[id=6898, name=zkCallback-880-thread-3, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > 3) Thread[id=6439, name=TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]-SendThread(127.0.0.1:56190), state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
[junit4] > at java.lang.Thread.sleep(Native Method)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:994)
[junit4] > 4) Thread[id=6441, name=zkCallback-880-thread-1, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > 5) Thread[id=6440, name=TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]-EventThread, state=WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
[junit4] > at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494)
[junit4] > at __randomizedtesting.SeedInfo.seed([BA78D4A59A09DEBB]:0)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
[junit4] > 1) Thread[id=6897, name=zkCallback-880-thread-2, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > 2) Thread[id=6898, name=zkCallback-880-thread-3, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > 3) Thread[id=6439, name=TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BA78D4A59A09DEBB]-SendThread(127.0.0.1:56190), state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
[junit4] > at java.lang.Thread.sleep(Native Method)
[junit4] > at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:940)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003)
[junit4] > 4) Thread[id=6441, name=zkCallback-880-thread-1, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > at __randomizedtesting.SeedInfo.seed([BA78D4A59A09DEBB]:0)
[junit4] Completed [184/558] on J2 in 104.52s, 1 test, 3 errors <<< FAILURES!
[...truncated 1213 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987: There were test failures: 558 suites (8 ignored), 2215 tests, 2 suite-level errors, 1 error, 1078 ignored (9 assumptions) [seed: BA78D4A59A09DEBB]
Total time: 219 minutes 58 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 855 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/855/
2 tests failed.
FAILED: org.apache.solr.search.TestCollapseQParserPlugin.testStringCollapse
Error Message:
Exception during query
Stack Trace:
java.lang.RuntimeException: Exception during query
at __randomizedtesting.SeedInfo.seed([BEDFC86FB041F315:4B57F80E79265001]:0)
at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:766)
at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:733)
at org.apache.solr.search.TestCollapseQParserPlugin.testCollapseQueries(TestCollapseQParserPlugin.java:670)
at org.apache.solr.search.TestCollapseQParserPlugin.testStringCollapse(TestCollapseQParserPlugin.java:216)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1660)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:866)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:902)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:875)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:777)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:811)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:822)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: REQUEST FAILED: xpath=//result/doc[1]/float[@name='id'][.='1.0']
xml response was: <?xml version="1.0" encoding="UTF-8"?>
<response>
<lst name="responseHeader"><int name="status">0</int><int name="QTime">0</int></lst><result name="response" numFound="2" start="0"><doc><float name="id">2.0</float><str name="term_s">YYYY</str><str name="group_s_dv">1</str><int name="test_ti">50</int><long name="test_tl">100</long><float name="test_tf">200.0</float><long name="_version_">1518089377909047296</long></doc><doc><float name="id">5.0</float><str name="term_s">YYYY</str><str name="group_s_dv">2</str><int name="test_ti">4</int><long name="test_tl">10</long><float name="test_tf">2000.0</float><long name="_version_">1518089378011807744</long></doc></result>
</response>
request was:q=*%3A*&fq=%7B%21collapse+field%3Dgroup_s_dv+min%3Dbogus_ti+%7D&sort=id+asc
at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:759)
... 42 more
FAILED: org.apache.solr.search.TestCollapseQParserPlugin.testNumericCollapse
Error Message:
Exception during query
Stack Trace:
java.lang.RuntimeException: Exception during query
at __randomizedtesting.SeedInfo.seed([BEDFC86FB041F315:399C823C366C9B6A]:0)
at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:766)
at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:733)
at org.apache.solr.search.TestCollapseQParserPlugin.testCollapseQueries(TestCollapseQParserPlugin.java:670)
at org.apache.solr.search.TestCollapseQParserPlugin.testNumericCollapse(TestCollapseQParserPlugin.java:224)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1660)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:866)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:902)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:875)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:777)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:811)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:822)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: REQUEST FAILED: xpath=//result/doc[1]/float[@name='id'][.='1.0']
xml response was: <?xml version="1.0" encoding="UTF-8"?>
<response>
<lst name="responseHeader"><int name="status">0</int><int name="QTime">0</int></lst><result name="response" numFound="2" start="0"><doc><float name="id">2.0</float><str name="term_s">YYYY</str><int name="group_ti_dv">1</int><int name="test_ti">50</int><long name="test_tl">100</long><float name="test_tf">200.0</float><long name="_version_">1518089381338939392</long></doc><doc><float name="id">5.0</float><str name="term_s">YYYY</str><int name="group_ti_dv">2</int><int name="test_ti">4</int><long name="test_tl">10</long><float name="test_tf">2000.0</float><long name="_version_">1518089381420728320</long></doc></result>
</response>
request was:q=*%3A*&fq=%7B%21collapse+field%3Dgroup_ti_dv+min%3Dbogus_ti+%7D&sort=id+asc
at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:759)
... 42 more
Build Log:
[...truncated 11389 lines...]
[junit4] Suite: org.apache.solr.search.TestCollapseQParserPlugin
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.search.TestCollapseQParserPlugin_BEDFC86FB041F315-001/init-core-data-001
[junit4] 2> 4233927 INFO (SUITE-TestCollapseQParserPlugin-seed#[BEDFC86FB041F315]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true)
[junit4] 2> 4233928 INFO (SUITE-TestCollapseQParserPlugin-seed#[BEDFC86FB041F315]-worker) [ ] o.a.s.SolrTestCaseJ4 ####initCore
[junit4] 2> 4233928 INFO (SUITE-TestCollapseQParserPlugin-seed#[BEDFC86FB041F315]-worker) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/'
[junit4] 2> 4233928 INFO (SUITE-TestCollapseQParserPlugin-seed#[BEDFC86FB041F315]-worker) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 4233928 INFO (SUITE-TestCollapseQParserPlugin-seed#[BEDFC86FB041F315]-worker) [ ] o.a.s.c.SolrResourceLoader using system property solr.solr.home: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr
[junit4] 2> 4233928 INFO (SUITE-TestCollapseQParserPlugin-seed#[BEDFC86FB041F315]-worker) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/lib/.svn/' to classloader
[junit4] 2> 4233928 INFO (SUITE-TestCollapseQParserPlugin-seed#[BEDFC86FB041F315]-worker) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
[junit4] 2> 4233929 INFO (SUITE-TestCollapseQParserPlugin-seed#[BEDFC86FB041F315]-worker) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/lib/README' to classloader
[junit4] 2> 4233946 INFO (SUITE-TestCollapseQParserPlugin-seed#[BEDFC86FB041F315]-worker) [ ] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 4234015 INFO (SUITE-TestCollapseQParserPlugin-seed#[BEDFC86FB041F315]-worker) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 4234044 INFO (SUITE-TestCollapseQParserPlugin-seed#[BEDFC86FB041F315]-worker) [ ] o.a.s.c.Config Loaded SolrConfig: solrconfig-collapseqparser.xml
[junit4] 2> 4234045 INFO (SUITE-TestCollapseQParserPlugin-seed#[BEDFC86FB041F315]-worker) [ ] o.a.s.s.IndexSchema Reading Solr Schema from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema11.xml
[junit4] 2> 4234048 INFO (SUITE-TestCollapseQParserPlugin-seed#[BEDFC86FB041F315]-worker) [ ] o.a.s.s.IndexSchema [null] Schema name=example
[junit4] 2> 4234158 INFO (SUITE-TestCollapseQParserPlugin-seed#[BEDFC86FB041F315]-worker) [ ] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 4234159 INFO (SUITE-TestCollapseQParserPlugin-seed#[BEDFC86FB041F315]-worker) [ ] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 4234258 INFO (SUITE-TestCollapseQParserPlugin-seed#[BEDFC86FB041F315]-worker) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 4234258 INFO (SUITE-TestCollapseQParserPlugin-seed#[BEDFC86FB041F315]-worker) [ ] o.a.s.c.SolrResourceLoader using system property solr.solr.home: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr
[junit4] 2> 4234258 INFO (SUITE-TestCollapseQParserPlugin-seed#[BEDFC86FB041F315]-worker) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/'
[junit4] 2> 4234258 INFO (SUITE-TestCollapseQParserPlugin-seed#[BEDFC86FB041F315]-worker) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 4234258 INFO (SUITE-TestCollapseQParserPlugin-seed#[BEDFC86FB041F315]-worker) [ ] o.a.s.c.SolrResourceLoader using system property solr.solr.home: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr
[junit4] 2> 4234259 INFO (SUITE-TestCollapseQParserPlugin-seed#[BEDFC86FB041F315]-worker) [ ] o.a.s.c.CoreContainer New CoreContainer 808618667
[junit4] 2> 4234259 INFO (SUITE-TestCollapseQParserPlugin-seed#[BEDFC86FB041F315]-worker) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/]
[junit4] 2> 4234259 INFO (SUITE-TestCollapseQParserPlugin-seed#[BEDFC86FB041F315]-worker) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/lib
[junit4] 2> 4234259 WARN (SUITE-TestCollapseQParserPlugin-seed#[BEDFC86FB041F315]-worker) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/lib).
[junit4] 2> 4234277 INFO (SUITE-TestCollapseQParserPlugin-seed#[BEDFC86FB041F315]-worker) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 600000,connTimeout : 60000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 4234279 INFO (SUITE-TestCollapseQParserPlugin-seed#[BEDFC86FB041F315]-worker) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=30000&connTimeout=30000&retry=true
[junit4] 2> 4234279 INFO (SUITE-TestCollapseQParserPlugin-seed#[BEDFC86FB041F315]-worker) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 4234279 INFO (SUITE-TestCollapseQParserPlugin-seed#[BEDFC86FB041F315]-worker) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 4234279 INFO (SUITE-TestCollapseQParserPlugin-seed#[BEDFC86FB041F315]-worker) [ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 4234279 INFO (SUITE-TestCollapseQParserPlugin-seed#[BEDFC86FB041F315]-worker) [ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 4234280 INFO (SUITE-TestCollapseQParserPlugin-seed#[BEDFC86FB041F315]-worker) [ ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig-collapseqparser.xml, transient=false, schema=schema11.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=collection1, collection=collection1, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/, dataDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.search.TestCollapseQParserPlugin_BEDFC86FB041F315-001/init-core-data-001, shard=shard1}
[junit4] 2> 4234281 INFO (coreLoadExecutor-7716-thread-1) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/'
[junit4] 2> 4234284 INFO (coreLoadExecutor-7716-thread-1) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 4234284 INFO (coreLoadExecutor-7716-thread-1) [ ] o.a.s.c.SolrResourceLoader using system property solr.solr.home: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr
[junit4] 2> 4234284 INFO (coreLoadExecutor-7716-thread-1) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/lib/.svn/' to classloader
[junit4] 2> 4234284 INFO (coreLoadExecutor-7716-thread-1) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
[junit4] 2> 4234284 INFO (coreLoadExecutor-7716-thread-1) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/lib/README' to classloader
[junit4] 2> 4234343 INFO (coreLoadExecutor-7716-thread-1) [ ] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 4234352 INFO (coreLoadExecutor-7716-thread-1) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 4234406 INFO (coreLoadExecutor-7716-thread-1) [ ] o.a.s.c.Config Loaded SolrConfig: solrconfig-collapseqparser.xml
[junit4] 2> 4234407 INFO (coreLoadExecutor-7716-thread-1) [ ] o.a.s.s.IndexSchema Reading Solr Schema from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema11.xml
[junit4] 2> 4234410 INFO (coreLoadExecutor-7716-thread-1) [ ] o.a.s.s.IndexSchema [collection1] Schema name=example
[junit4] 2> 4234585 INFO (coreLoadExecutor-7716-thread-1) [ ] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 4234586 INFO (coreLoadExecutor-7716-thread-1) [ ] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 4234590 INFO (coreLoadExecutor-7716-thread-1) [ ] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf'
[junit4] 2> 4234590 INFO (coreLoadExecutor-7716-thread-1) [ ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1
[junit4] 2> 4234590 INFO (coreLoadExecutor-7716-thread-1) [ x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 4234590 INFO (coreLoadExecutor-7716-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/], dataDir=[null]
[junit4] 2> 4234590 INFO (coreLoadExecutor-7716-thread-1) [ x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@663ac0a1
[junit4] 2> 4234591 INFO (coreLoadExecutor-7716-thread-1) [ x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.search.TestCollapseQParserPlugin_BEDFC86FB041F315-001/init-core-data-001
[junit4] 2> 4234591 INFO (coreLoadExecutor-7716-thread-1) [ x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.search.TestCollapseQParserPlugin_BEDFC86FB041F315-001/init-core-data-001/index/
[junit4] 2> 4234591 WARN (coreLoadExecutor-7716-thread-1) [ x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.search.TestCollapseQParserPlugin_BEDFC86FB041F315-001/init-core-data-001/index' doesn't exist. Creating new index...
[junit4] 2> 4234591 INFO (coreLoadExecutor-7716-thread-1) [ x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.search.TestCollapseQParserPlugin_BEDFC86FB041F315-001/init-core-data-001/index
[junit4] 2> 4234591 INFO (coreLoadExecutor-7716-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=17, maxMergeAtOnceExplicit=39, maxMergedSegmentMB=66.5283203125, floorSegmentMB=1.548828125, forceMergeDeletesPctAllowed=15.880347473837963, segmentsPerTier=15.0, maxCFSSegmentSizeMB=1.322265625, noCFSRatio=0.0
[junit4] 2> 4234592 INFO (coreLoadExecutor-7716-thread-1) [ x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1aaf8d07 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4e715b9c),segFN=segments_1,generation=1}
[junit4] 2> 4234592 INFO (coreLoadExecutor-7716-thread-1) [ x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 4234599 INFO (coreLoadExecutor-7716-thread-1) [ x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
[junit4] 2> 4234599 INFO (coreLoadExecutor-7716-thread-1) [ x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 4234599 INFO (coreLoadExecutor-7716-thread-1) [ x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe-allfields"
[junit4] 2> 4234599 INFO (coreLoadExecutor-7716-thread-1) [ x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4] 2> 4234599 INFO (coreLoadExecutor-7716-thread-1) [ x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 4234599 INFO (coreLoadExecutor-7716-thread-1) [ x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 4234599 INFO (coreLoadExecutor-7716-thread-1) [ x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "uniq-fields"
[junit4] 2> 4234600 INFO (coreLoadExecutor-7716-thread-1) [ x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4] 2> 4234600 INFO (coreLoadExecutor-7716-thread-1) [ x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 4234600 INFO (coreLoadExecutor-7716-thread-1) [ x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 4234600 INFO (coreLoadExecutor-7716-thread-1) [ x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 4234600 INFO (coreLoadExecutor-7716-thread-1) [ x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 4234602 INFO (coreLoadExecutor-7716-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 4234603 INFO (coreLoadExecutor-7716-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 4234603 INFO (coreLoadExecutor-7716-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 4234604 INFO (coreLoadExecutor-7716-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 4234605 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [ x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.search.TestCollapseQParserPlugin_BEDFC86FB041F315-001/init-core-data-001/
[junit4] 2> 4234620 INFO (coreLoadExecutor-7716-thread-1) [ x:collection1] o.a.s.c.PluginBag requestHandler : 'lazy' created with startup=lazy
[junit4] 2> 4234621 INFO (coreLoadExecutor-7716-thread-1) [ x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,spellCheckCompRH,lazy,/update/json/docs,/admin/luke,spellCheckWithWordbreak_Direct,tvrh,/get,/admin/properties,/elevate,/update/json,mltrh,/admin/threads,/update/csv,/admin/segments,spellCheckCompRH1,/mlt,/admin/system,/replication,dismax,defaults,/config,/schema,/admin/plugins,/admin/logging,spellCheckWithWordbreak,mock,/admin/ping,/update,/admin/file,/terms,spellCheckCompRH_Direct,/debug/dump
[junit4] 2> 4234622 WARN (coreLoadExecutor-7716-thread-1) [ x:collection1] o.a.s.c.SolrCore solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4] 2> 4234622 INFO (coreLoadExecutor-7716-thread-1) [ x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 4234623 INFO (coreLoadExecutor-7716-thread-1) [ x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 4234623 INFO (coreLoadExecutor-7716-thread-1) [ x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 4234623 INFO (coreLoadExecutor-7716-thread-1) [ x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
[junit4] 2> 4234624 INFO (coreLoadExecutor-7716-thread-1) [ x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
[junit4] 2> 4234624 INFO (coreLoadExecutor-7716-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=4, maxMergeAtOnceExplicit=2, maxMergedSegmentMB=47.5068359375, floorSegmentMB=1.0244140625, forceMergeDeletesPctAllowed=8.979681502271928, segmentsPerTier=37.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 4234624 INFO (coreLoadExecutor-7716-thread-1) [ x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1aaf8d07 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4e715b9c),segFN=segments_1,generation=1}
[junit4] 2> 4234624 INFO (coreLoadExecutor-7716-thread-1) [ x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 4234625 INFO (coreLoadExecutor-7716-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@a27f101[collection1] main
[junit4] 2> 4234625 WARN (coreLoadExecutor-7716-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage Cannot write to config directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf; switching to use InMemory storage instead.
[junit4] 2> 4234625 INFO (coreLoadExecutor-7716-thread-1) [ x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
[junit4] 2> 4234625 INFO (coreLoadExecutor-7716-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using InMemoryStorage
[junit4] 2> 4234625 INFO (coreLoadExecutor-7716-thread-1) [ x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 4234625 INFO (coreLoadExecutor-7716-thread-1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
[junit4] 2> 4234650 INFO (coreLoadExecutor-7716-thread-1) [ x:collection1] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4] 2> 4234687 INFO (coreLoadExecutor-7716-thread-1) [ x:collection1] o.a.s.h.c.QueryElevationComponent Loading QueryElevation from: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/elevate.xml
[junit4] 2> 4234691 INFO (coreLoadExecutor-7716-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 4234695 INFO (searcherExecutor-7717-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
[junit4] 2> 4234695 INFO (searcherExecutor-7717-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
[junit4] 2> 4234695 INFO (searcherExecutor-7717-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
[junit4] 2> 4234695 INFO (searcherExecutor-7717-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: multipleFields
[junit4] 2> 4234696 INFO (searcherExecutor-7717-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
[junit4] 2> 4234696 INFO (searcherExecutor-7717-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
[junit4] 2> 4234696 INFO (searcherExecutor-7717-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
[junit4] 2> 4234696 INFO (searcherExecutor-7717-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
[junit4] 2> 4234697 INFO (searcherExecutor-7717-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
[junit4] 2> 4234697 INFO (searcherExecutor-7717-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@a27f101[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 4234698 INFO (coreLoadExecutor-7716-thread-1) [ x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
[junit4] 2> 4234698 INFO (coreLoadExecutor-7716-thread-1) [ x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
[junit4] 2> 4234698 INFO (coreLoadExecutor-7716-thread-1) [ x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
[junit4] 2> 4234698 INFO (coreLoadExecutor-7716-thread-1) [ x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1518089376767148032
[junit4] 2> 4234700 INFO (coreLoadExecutor-7716-thread-1) [ x:collection1] o.a.s.u.UpdateLog Took 2.0ms to seed version buckets with highest version 1518089376767148032
[junit4] 2> 4234700 INFO (coreLoadExecutor-7716-thread-1) [ x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 4234701 INFO (SUITE-TestCollapseQParserPlugin-seed#[BEDFC86FB041F315]-worker) [ ] o.a.s.SolrTestCaseJ4 ####initCore end
[junit4] 2> 4234710 INFO (TEST-TestCollapseQParserPlugin.testEmptyCollection-seed#[BEDFC86FB041F315]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testEmptyCollection
[junit4] 2> 4234712 INFO (TEST-TestCollapseQParserPlugin.testEmptyCollection-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=null path=null params={} {deleteByQuery=*:* (-1518089376779730944)} 0 2
[junit4] 2> 4234713 INFO (TEST-TestCollapseQParserPlugin.testEmptyCollection-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.UpdateHandler start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 4234713 INFO (TEST-TestCollapseQParserPlugin.testEmptyCollection-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.UpdateHandler No uncommitted changes. Skipping IW.commit.
[junit4] 2> 4234714 INFO (TEST-TestCollapseQParserPlugin.testEmptyCollection-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.SolrCore SolrIndexSearcher has not changed - not re-opening: org.apache.solr.search.SolrIndexSearcher
[junit4] 2> 4234714 INFO (TEST-TestCollapseQParserPlugin.testEmptyCollection-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.UpdateHandler end_commit_flush
[junit4] 2> 4234714 INFO (TEST-TestCollapseQParserPlugin.testEmptyCollection-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=null path=null params={} {commit=} 0 0
[junit4] 2> 4234728 INFO (TEST-TestCollapseQParserPlugin.testEmptyCollection-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=*%3A*&fq=%7B%21collapse+field%3Dgroup_s_dv+%7D} hits=0 status=0 QTime=13
[junit4] 2> 4234728 INFO (TEST-TestCollapseQParserPlugin.testEmptyCollection-seed#[BEDFC86FB041F315]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testEmptyCollection
[junit4] 2> 4234731 INFO (TEST-TestCollapseQParserPlugin.testMergeBoost-seed#[BEDFC86FB041F315]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testMergeBoost
[junit4] 2> 4234732 INFO (TEST-TestCollapseQParserPlugin.testMergeBoost-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=null path=null params={} {deleteByQuery=*:* (-1518089376801751040)} 0 0
[junit4] 2> 4234732 INFO (TEST-TestCollapseQParserPlugin.testMergeBoost-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.UpdateHandler start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 4234733 INFO (TEST-TestCollapseQParserPlugin.testMergeBoost-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.UpdateHandler No uncommitted changes. Skipping IW.commit.
[junit4] 2> 4234733 INFO (TEST-TestCollapseQParserPlugin.testMergeBoost-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.SolrCore SolrIndexSearcher has not changed - not re-opening: org.apache.solr.search.SolrIndexSearcher
[junit4] 2> 4234733 INFO (TEST-TestCollapseQParserPlugin.testMergeBoost-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.UpdateHandler end_commit_flush
[junit4] 2> 4234733 INFO (TEST-TestCollapseQParserPlugin.testMergeBoost-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=null path=null params={} {commit=} 0 0
[junit4] 2> 4234735 INFO (TEST-TestCollapseQParserPlugin.testMergeBoost-seed#[BEDFC86FB041F315]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testMergeBoost
[junit4] 2> 4234737 INFO (TEST-TestCollapseQParserPlugin.testMultiSort-seed#[BEDFC86FB041F315]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testMultiSort
[junit4] 2> 4234738 INFO (TEST-TestCollapseQParserPlugin.testMultiSort-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=null path=null params={} {deleteByQuery=*:* (-1518089376808042496)} 0 0
[junit4] 2> 4234738 INFO (TEST-TestCollapseQParserPlugin.testMultiSort-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.UpdateHandler start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 4234738 INFO (TEST-TestCollapseQParserPlugin.testMultiSort-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.UpdateHandler No uncommitted changes. Skipping IW.commit.
[junit4] 2> 4234739 INFO (TEST-TestCollapseQParserPlugin.testMultiSort-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.SolrCore SolrIndexSearcher has not changed - not re-opening: org.apache.solr.search.SolrIndexSearcher
[junit4] 2> 4234739 INFO (TEST-TestCollapseQParserPlugin.testMultiSort-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.UpdateHandler end_commit_flush
[junit4] 2> 4234739 INFO (TEST-TestCollapseQParserPlugin.testMultiSort-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=null path=null params={} {commit=} 0 0
[junit4] 2> 4234740 INFO (TEST-TestCollapseQParserPlugin.testMultiSort-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=null path=null params={} {add=[1 (1518089376810139648)]} 0 1
[junit4] 2> 4234741 INFO (TEST-TestCollapseQParserPlugin.testMultiSort-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.UpdateHandler start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 4234767 INFO (TEST-TestCollapseQParserPlugin.testMultiSort-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=2
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1aaf8d07 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4e715b9c),segFN=segments_1,generation=1}
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1aaf8d07 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4e715b9c),segFN=segments_2,generation=2}
[junit4] 2> 4234767 INFO (TEST-TestCollapseQParserPlugin.testMultiSort-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.SolrCore newest commit generation = 2
[junit4] 2> 4234768 INFO (TEST-TestCollapseQParserPlugin.testMultiSort-seed#[BEDFC86FB041F315]) [ ] o.a.s.s.SolrIndexSearcher Opening Searcher@3ab392b4[collection1] main
[junit4] 2> 4234768 INFO (TEST-TestCollapseQParserPlugin.testMultiSort-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.UpdateHandler end_commit_flush
[junit4] 2> 4234769 INFO (searcherExecutor-7717-thread-1) [ ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@3ab392b4[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.0.0):c1)))}
[junit4] 2> 4234770 INFO (TEST-TestCollapseQParserPlugin.testMultiSort-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=null path=null params={} {commit=} 0 29
[junit4] 2> 4234789 INFO (TEST-TestCollapseQParserPlugin.testMultiSort-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=null path=null params={} {add=[2 (1518089376842645504)]} 0 19
[junit4] 2> 4234790 INFO (TEST-TestCollapseQParserPlugin.testMultiSort-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=null path=null params={} {add=[3 (1518089376863617024)]} 0 0
[junit4] 2> 4234791 INFO (TEST-TestCollapseQParserPlugin.testMultiSort-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=null path=null params={} {add=[4 (1518089376863617025)]} 0 0
[junit4] 2> 4234791 INFO (TEST-TestCollapseQParserPlugin.testMultiSort-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=null path=null params={} {add=[5 (1518089376864665600)]} 0 0
[junit4] 2> 4234791 INFO (TEST-TestCollapseQParserPlugin.testMultiSort-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.UpdateHandler start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 4234800 INFO (TEST-TestCollapseQParserPlugin.testMultiSort-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=2
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1aaf8d07 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4e715b9c),segFN=segments_2,generation=2}
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1aaf8d07 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4e715b9c),segFN=segments_3,generation=3}
[junit4] 2> 4234800 INFO (TEST-TestCollapseQParserPlugin.testMultiSort-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.SolrCore newest commit generation = 3
[junit4] 2> 4234801 INFO (TEST-TestCollapseQParserPlugin.testMultiSort-seed#[BEDFC86FB041F315]) [ ] o.a.s.s.SolrIndexSearcher Opening Searcher@616a7087[collection1] main
[junit4] 2> 4234801 INFO (TEST-TestCollapseQParserPlugin.testMultiSort-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.UpdateHandler end_commit_flush
[junit4] 2> 4234802 INFO (searcherExecutor-7717-thread-1) [ ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@616a7087[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.0.0):c1) Uninverting(_1(6.0.0):c4)))}
[junit4] 2> 4234802 INFO (TEST-TestCollapseQParserPlugin.testMultiSort-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=null path=null params={} {commit=} 0 10
[junit4] 2> 4234804 INFO (TEST-TestCollapseQParserPlugin.testMultiSort-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=null path=null params={} {add=[6 (1518089376877248512)]} 0 1
[junit4] 2> 4234804 INFO (TEST-TestCollapseQParserPlugin.testMultiSort-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=null path=null params={} {add=[7 (1518089376878297088)]} 0 0
[junit4] 2> 4234805 INFO (TEST-TestCollapseQParserPlugin.testMultiSort-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=null path=null params={} {add=[8 (1518089376879345664)]} 0 0
[junit4] 2> 4234805 INFO (TEST-TestCollapseQParserPlugin.testMultiSort-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.UpdateHandler start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 4234820 INFO (TEST-TestCollapseQParserPlugin.testMultiSort-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=2
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1aaf8d07 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4e715b9c),segFN=segments_3,generation=3}
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1aaf8d07 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4e715b9c),segFN=segments_4,generation=4}
[junit4] 2> 4234820 INFO (TEST-TestCollapseQParserPlugin.testMultiSort-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.SolrCore newest commit generation = 4
[junit4] 2> 4234820 INFO (TEST-TestCollapseQParserPlugin.testMultiSort-seed#[BEDFC86FB041F315]) [ ] o.a.s.s.SolrIndexSearcher Opening Searcher@30918851[collection1] main
[junit4] 2> 4234822 INFO (searcherExecutor-7717-thread-1) [ ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@30918851[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.0.0):c1) Uninverting(_1(6.0.0):c4) Uninverting(_2(6.0.0):c3)))}
[junit4] 2> 4234822 INFO (TEST-TestCollapseQParserPlugin.testMultiSort-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.UpdateHandler end_commit_flush
[junit4] 2> 4234822 INFO (TEST-TestCollapseQParserPlugin.testMultiSort-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=null path=null params={} {commit=} 0 17
[junit4] 2> 4234832 INFO (TEST-TestCollapseQParserPlugin.testMultiSort-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=*%3A*&fq=%7B%21collapse+field%3Dgroup_s+sort%3D%24sort%7D&sort=test_ti+asc%2C+test_tl+desc%2C+id+desc} hits=2 status=0 QTime=9
[junit4] 2> 4234838 INFO (TEST-TestCollapseQParserPlugin.testMultiSort-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=*%3A*&fq=%7B%21collapse+field%3Dgroup_s+sort%3D%27test_ti+asc%2C+test_tl+desc%2C+id+desc%27%7D&sort=id+asc} hits=2 status=0 QTime=5
[junit4] 2> 4234839 INFO (TEST-TestCollapseQParserPlugin.testMultiSort-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=*%3A*&fq=%7B%21collapse+field%3Dgroup_s+sort%3D%27test_ti+desc%2C+test_tl+asc%2C+id+asc%27%7D&sort=id+desc} hits=2 status=0 QTime=0
[junit4] 2> 4234840 INFO (TEST-TestCollapseQParserPlugin.testMultiSort-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=*%3A*&fq=%7B%21collapse+field%3Dgroup_s+sort%3D%27test_tl+desc%27%7D&sort=id+desc} hits=2 status=0 QTime=0
[junit4] 2> 4234845 INFO (TEST-TestCollapseQParserPlugin.testMultiSort-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=*%3A*+term_s%3AYYYY&fq=%7B%21collapse+field%3Dgroup_s+sort%3D%27score+desc%2C+test_tl+desc%2C+test_ti+asc%2C+id+asc%27%7D&sort=score+asc} hits=2 status=0 QTime=4
[junit4] 2> 4234859 INFO (TEST-TestCollapseQParserPlugin.testMultiSort-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=*%3A*+term_s%3AYYYY&fq=%7B%21collapse+field%3Dgroup_s+sort%3D%27score+desc%2C+test_tl+desc%2C+test_ti+asc%2C+id+asc%27%7D&sort=id+desc} hits=2 status=0 QTime=12
[junit4] 2> 4234861 INFO (TEST-TestCollapseQParserPlugin.testMultiSort-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=*%3A*&fq=%7B%21collapse+field%3Dgroup_s+sort%3D%27term_s+desc%2C+test_tl+asc%27%7D&sort=id+asc} hits=2 status=0 QTime=0
[junit4] 2> 4234862 INFO (TEST-TestCollapseQParserPlugin.testMultiSort-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=*%3A*&fq=%7B%21collapse+field%3Dgroup_s+sort%3D%27term_s+asc%2C+test_tl+asc%27%7D&sort=id+asc} hits=2 status=0 QTime=0
[junit4] 2> 4234998 INFO (TEST-TestCollapseQParserPlugin.testMultiSort-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=*%3A*&fq=%7B%21collapse+field%3Dtest_ti+sort%3D%27term_s+asc%2C+group_s+asc%27%7D&sort=id+asc} hits=2 status=0 QTime=135
[junit4] 2> 4235032 INFO (TEST-TestCollapseQParserPlugin.testMultiSort-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=*%3A*&fq=%7B%21collapse+field%3Dterm_s+nullPolicy%3Dcollapse+sort%3D%27test_ti+asc%2C+test_tl+desc%2C+id+asc%27%7D&sort=test_tl+asc%2C+id+asc} hits=3 status=0 QTime=0
[junit4] 2> 4235054 INFO (TEST-TestCollapseQParserPlugin.testMultiSort-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=*%3A*&fq=%7B%21collapse+field%3Dgroup_s+sort%3D%27term_s+desc%2C+test_tl+asc%27%7D&sort=test_tl+asc&qt=%2Felevate&forceElevation=true&elevateIds=4.0} hits=2 status=0 QTime=20
[junit4] 2> 4235056 INFO (TEST-TestCollapseQParserPlugin.testMultiSort-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=*%3A*&fq=%7B%21collapse+field%3Dgroup_s+sort%3D%27term_s+desc%2C+test_tl+asc%27%7D&sort=test_tl+asc&qt=%2Felevate&forceElevation=true&elevateIds=7.0} hits=2 status=0 QTime=0
[junit4] 2> 4235081 INFO (TEST-TestCollapseQParserPlugin.testMultiSort-seed#[BEDFC86FB041F315]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testMultiSort
[junit4] 2> 4235088 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testStringCollapse
[junit4] 2> 4235090 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.s.SolrIndexSearcher Opening Searcher@566b4cba[collection1] realtime
[junit4] 2> 4235090 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=null path=null params={} {deleteByQuery=*:* (-1518089377176092672)} 0 2
[junit4] 2> 4235091 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.UpdateHandler start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 4235096 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=2
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1aaf8d07 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4e715b9c),segFN=segments_4,generation=4}
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1aaf8d07 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4e715b9c),segFN=segments_5,generation=5}
[junit4] 2> 4235097 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.SolrCore newest commit generation = 5
[junit4] 2> 4235097 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.s.SolrIndexSearcher Opening Searcher@32bfe332[collection1] main
[junit4] 2> 4235097 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.UpdateHandler end_commit_flush
[junit4] 2> 4235099 INFO (searcherExecutor-7717-thread-1) [ ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@32bfe332[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 4235102 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=null path=null params={} {commit=} 0 11
[junit4] 2> 4235114 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=null path=null params={} {add=[1 (1518089377191821312)]} 0 11
[junit4] 2> 4235114 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.UpdateHandler start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 4235127 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=2
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1aaf8d07 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4e715b9c),segFN=segments_5,generation=5}
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1aaf8d07 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4e715b9c),segFN=segments_6,generation=6}
[junit4] 2> 4235127 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.SolrCore newest commit generation = 6
[junit4] 2> 4235128 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.s.SolrIndexSearcher Opening Searcher@778d637b[collection1] main
[junit4] 2> 4235128 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.UpdateHandler end_commit_flush
[junit4] 2> 4235130 INFO (searcherExecutor-7717-thread-1) [ ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@778d637b[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_3(6.0.0):c1)))}
[junit4] 2> 4235130 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=null path=null params={} {commit=} 0 16
[junit4] 2> 4235132 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=null path=null params={} {add=[2 (1518089377221181440)]} 0 1
[junit4] 2> 4235132 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=null path=null params={} {add=[3 (1518089377222230016)]} 0 0
[junit4] 2> 4235132 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.UpdateHandler start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 4235149 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=2
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1aaf8d07 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4e715b9c),segFN=segments_6,generation=6}
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1aaf8d07 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4e715b9c),segFN=segments_7,generation=7}
[junit4] 2> 4235150 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.SolrCore newest commit generation = 7
[junit4] 2> 4235150 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.s.SolrIndexSearcher Opening Searcher@33695342[collection1] main
[junit4] 2> 4235150 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.UpdateHandler end_commit_flush
[junit4] 2> 4235152 INFO (searcherExecutor-7717-thread-1) [ ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@33695342[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_3(6.0.0):c1) Uninverting(_4(6.0.0):c2)))}
[junit4] 2> 4235175 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=null path=null params={} {commit=} 0 43
[junit4] 2> 4235219 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=null path=null params={} {add=[4 (1518089377268367360)]} 0 43
[junit4] 2> 4235220 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=null path=null params={} {add=[5 (1518089377314504704)]} 0 0
[junit4] 2> 4235220 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.UpdateHandler start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 4235256 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=2
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1aaf8d07 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4e715b9c),segFN=segments_7,generation=7}
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1aaf8d07 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4e715b9c),segFN=segments_8,generation=8}
[junit4] 2> 4235256 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.SolrCore newest commit generation = 8
[junit4] 2> 4235256 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.s.SolrIndexSearcher Opening Searcher@c51db46[collection1] main
[junit4] 2> 4235257 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.UpdateHandler end_commit_flush
[junit4] 2> 4235263 INFO (searcherExecutor-7717-thread-1) [ ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@c51db46[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_3(6.0.0):c1) Uninverting(_4(6.0.0):c2) Uninverting(_5(6.0.0):c2)))}
[junit4] 2> 4235270 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=null path=null params={} {commit=} 0 49
[junit4] 2> 4235279 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=null path=null params={} {add=[6 (1518089377366933504)]} 0 9
[junit4] 2> 4235280 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.UpdateHandler start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 4235302 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=2
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1aaf8d07 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4e715b9c),segFN=segments_8,generation=8}
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1aaf8d07 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4e715b9c),segFN=segments_9,generation=9}
[junit4] 2> 4235302 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.SolrCore newest commit generation = 9
[junit4] 2> 4235302 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.s.SolrIndexSearcher Opening Searcher@19d77d9d[collection1] main
[junit4] 2> 4235305 INFO (searcherExecutor-7717-thread-1) [ ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@19d77d9d[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_3(6.0.0):c1) Uninverting(_4(6.0.0):c2) Uninverting(_5(6.0.0):c2) Uninverting(_6(6.0.0):c1)))}
[junit4] 2> 4235305 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.UpdateHandler end_commit_flush
[junit4] 2> 4235305 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=null path=null params={} {commit=} 0 25
[junit4] 2> 4235307 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=null path=null params={} {add=[7 (1518089377404682240)]} 0 1
[junit4] 2> 4235308 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.UpdateHandler start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 4235337 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=2
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1aaf8d07 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4e715b9c),segFN=segments_9,generation=9}
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1aaf8d07 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4e715b9c),segFN=segments_a,generation=10}
[junit4] 2> 4235337 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.SolrCore newest commit generation = 10
[junit4] 2> 4235338 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.s.SolrIndexSearcher Opening Searcher@26aee84b[collection1] main
[junit4] 2> 4235338 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.UpdateHandler end_commit_flush
[junit4] 2> 4235340 INFO (searcherExecutor-7717-thread-1) [ ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@26aee84b[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_3(6.0.0):c1) Uninverting(_4(6.0.0):c2) Uninverting(_5(6.0.0):c2) Uninverting(_6(6.0.0):c1) Uninverting(_7(6.0.0):c1)))}
[junit4] 2> 4235341 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=null path=null params={} {commit=} 0 33
[junit4] 2> 4235342 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=*%3A*&fq=%7B%21collapse+field%3Dgroup_s%7D&defType=edismax&bf=field%28test_ti%29&indent=on} hits=2 status=0 QTime=0
[junit4] 2> 4235359 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=*%3A*&fq=%7B%21collapse+field%3Dgroup_s+nullPolicy%3Dexpand+min%3Dtest_tf%7D&defType=edismax&bf=field%28test_ti%29&sort=} hits=4 status=0 QTime=16
[junit4] 2> 4235367 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=*%3A*&fq=%7B%21collapse+field%3Dgroup_s+nullPolicy%3Dcollapse+min%3Dfield%28test_ti%29%7D&sort=test_ti+desc} hits=3 status=0 QTime=6
[junit4] 2> 4235370 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=*%3A*&fq=%7B%21collapse+field%3Dgroup_s+nullPolicy%3Dcollapse+min%3Dcscore%28%29%7D&defType=edismax&bf=field%28test_ti%29} hits=3 status=0 QTime=2
[junit4] 2> 4235374 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=*%3A*&fq=%7B%21collapse+field%3Dgroup_s+nullPolicy%3Dcollapse+min%3Dcscore%28%29%7D&defType=edismax&bf=field%28test_ti%29&fl=id&sort=id+desc} hits=3 status=0 QTime=2
[junit4] 2> 4235375 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=*%3A*&fq=%7B%21collapse+field%3Dgroup_s+nullPolicy%3Dcollapse+min%3Dsum%28cscore%28%29%2Cfield%28test_ti%29%29%7D&defType=edismax&bf=field%28test_ti%29} hits=3 status=0 QTime=0
[junit4] 2> 4235378 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=YYYY&fq=%7B%21collapse+field%3Dgroup_s+nullPolicy%3Dcollapse%7D&defType=edismax&bf=field%28test_ti%29&qf=term_s&qt=%2Felevate} hits=4 status=0 QTime=1
[junit4] 2> 4235384 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=YYYY&fq=%7B%21collapse+field%3Dgroup_s+++nullPolicy%3Dcollapse%7D&defType=edismax&bf=field%28test_ti%29&qf=term_s&qt=%2Felevate&elevateIds=1%2C5} hits=3 status=0 QTime=4
[junit4] 2> 4235388 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=YYYY&fq=%7B%21collapse+field%3Dgroup_s+sort%3D%27score+desc%27++nullPolicy%3Dcollapse%7D&defType=edismax&bf=field%28test_ti%29&qf=term_s&qt=%2Felevate&elevateIds=1%2C5} hits=3 status=0 QTime=3
[junit4] 2> 4235438 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=YYYY&fq=%7B%21collapse+field%3Dgroup_s+max%3Dtest_ti+nullPolicy%3Dcollapse%7D&defType=edismax&bf=field%28test_ti%29&qf=term_s&qt=%2Felevate&elevateIds=1%2C5} hits=3 status=0 QTime=32
[junit4] 2> 4235444 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=YYYY&fq=%7B%21collapse+field%3Dgroup_s+sort%3D%27test_ti+desc%27+nullPolicy%3Dcollapse%7D&defType=edismax&bf=field%28test_ti%29&qf=term_s&qt=%2Felevate&elevateIds=1%2C5} hits=3 status=0 QTime=5
[junit4] 2> 4235448 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=YYYY&fq=%7B%21collapse+field%3Dgroup_s+min%3Dtest_ti+nullPolicy%3Dcollapse%7D&defType=edismax&bf=field%28test_ti%29&qf=term_s&qt=%2Felevate&elevateIds=1%2C5} hits=3 status=0 QTime=3
[junit4] 2> 4235451 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=YYYY&fq=%7B%21collapse+field%3Dgroup_s+sort%3D%27test_ti+asc%27+nullPolicy%3Dcollapse%7D&defType=edismax&bf=field%28test_ti%29&qf=term_s&qt=%2Felevate&elevateIds=1%2C5} hits=3 status=0 QTime=1
[junit4] 2> 4235456 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=YYYY&fq=%7B%21collapse+field%3Dgroup_s%7D&defType=edismax&bf=field%28test_ti%29&qf=term_s&qt=%2Felevate&elevateIds=3%2C4} hits=4 status=0 QTime=4
[junit4] 2> 4235458 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=*%3A*&fq=%7B%21collapse+field%3Dgroup_s+nullPolicy%3Dcollapse+sort%3D%27term_s+asc%2C+test_ti+asc%27+%7D&sort=id+desc} hits=3 status=0 QTime=1
[junit4] 2> 4235459 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=*%3A*&fq=%7B%21collapse+field%3Dgroup_s+nullPolicy%3Dcollapse+sort%3D%27term_s+asc%2C+test_ti+desc%27+%7D&sort=id+desc} hits=3 status=0 QTime=0
[junit4] 2> 4235460 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=*%3A*&fq=%7B%21collapse+field%3Dgroup_s+min%3Dtest_ti+%7D&sort=id+desc} hits=2 status=0 QTime=0
[junit4] 2> 4235461 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=*%3A*&fq=%7B%21collapse+field%3Dgroup_s+min%3Dtest_ti+%7D&sort=id+asc} hits=2 status=0 QTime=0
[junit4] 2> 4235461 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=*%3A*&fq=%7B%21collapse+field%3Dgroup_s+min%3Dtest_ti+%7D&sort=test_tl+asc%2Cid+desc} hits=2 status=0 QTime=0
[junit4] 2> 4235462 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=*%3A*&fq=%7B%21collapse+field%3Dgroup_s+min%3Dtest_ti+%7D&sort=score+desc%2Cid+asc&defType=edismax&bf=field%28id%29} hits=2 status=0 QTime=0
[junit4] 2> 4235463 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=*%3A*&fq=%7B%21collapse+field%3Dgroup_s+sort%3D%27test_ti+asc%27+%7D&sort=id+desc} hits=2 status=0 QTime=0
[junit4] 2> 4235465 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=*%3A*&fq=%7B%21collapse+field%3Dgroup_s+sort%3D%27test_ti+asc%27+%7D&sort=id+asc} hits=2 status=0 QTime=1
[junit4] 2> 4235466 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=*%3A*&fq=%7B%21collapse+field%3Dgroup_s+sort%3D%27test_ti+asc%27+%7D&sort=test_tl+asc%2Cid+desc} hits=2 status=0 QTime=0
[junit4] 2> 4235467 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=*%3A*&fq=%7B%21collapse+field%3Dgroup_s+sort%3D%27test_ti+asc%27+%7D&sort=score+desc%2Cid+asc&defType=edismax&bf=field%28id%29} hits=2 status=0 QTime=0
[junit4] 2> 4235468 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=*%3A*&fq=%7B%21collapse+field%3Dgroup_s+max%3Dtest_ti%7D&sort=test_ti+asc} hits=2 status=0 QTime=0
[junit4] 2> 4235535 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=*%3A*&fq=%7B%21collapse+field%3Dgroup_s+min%3Dtest_tl%7D&sort=test_ti+desc} hits=2 status=0 QTime=67
[junit4] 2> 4235537 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=*%3A*&fq=%7B%21collapse+field%3Dgroup_s+max%3Dtest_tl%7D&sort=test_ti+desc} hits=2 status=0 QTime=1
[junit4] 2> 4235558 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=*%3A*&fq=%7B%21collapse+field%3Dgroup_s+min%3Dtest_tf%7D&sort=test_ti+desc} hits=2 status=0 QTime=0
[junit4] 2> 4235565 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=*%3A*&fq=%7B%21collapse+field%3Dgroup_s+max%3Dtest_tf%7D&sort=test_ti+asc} hits=2 status=0 QTime=6
[junit4] 2> 4235574 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=*%3A*&fq=%7B%21collapse+field%3Dgroup_s+max%3Dtest_tf%7D&fq=%7B%21tag%3Dtest%7Dterm_s%3AYYYY&defType=edismax&bf=field%28id%29&fl=score%2C+id&facet=true&facet.field=%7B%21ex%3Dtest%7Dterm_s} hits=2 status=0 QTime=7
[junit4] 2> 4235575 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=*%3A*&fq=%7B%21collapse+field%3Dgroup_s+min%3Dbogus_ti+%7D&sort=id+asc} hits=2 status=0 QTime=0
[junit4] 2> 4235576 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=*%3A*&fq=%7B%21collapse+field%3Dgroup_s+sort%3D%27bogus_ti+asc%27+%7D&sort=id+asc} hits=2 status=0 QTime=0
[junit4] 2> 4235577 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=*%3A*&fq=%7B%21collapse+field%3Dgroup_s+max%3Dbogus_ti+%7D&sort=id+asc} hits=2 status=0 QTime=0
[junit4] 2> 4235580 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=*%3A*&fq=%7B%21collapse+field%3Dgroup_s+sort%3D%27bogus_ti+desc%27+%7D&sort=id+asc} hits=2 status=0 QTime=0
[junit4] 2> 4235584 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=*%3A*&fq=%7B%21collapse+field%3Dgroup_s+min%3Dbogus_tf+%7D&sort=id+asc} hits=2 status=0 QTime=1
[junit4] 2> 4235586 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=*%3A*&fq=%7B%21collapse+field%3Dgroup_s+sort%3D%27bogus_tf+asc%27+%7D&sort=id+asc} hits=2 status=0 QTime=0
[junit4] 2> 4235586 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=*%3A*&fq=%7B%21collapse+field%3Dgroup_s+max%3Dbogus_tf+%7D&sort=id+asc} hits=2 status=0 QTime=0
[junit4] 2> 4235587 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=*%3A*&fq=%7B%21collapse+field%3Dgroup_s+sort%3D%27bogus_tf+desc%27+%7D&sort=id+asc} hits=2 status=0 QTime=0
[junit4] 2> 4235588 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=*%3A*&fq=%7B%21collapse+field%3Dgroup_s+sort%3D%27bogus_td+asc%27+%7D&sort=id+asc} hits=2 status=0 QTime=0
[junit4] 2> 4235591 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=*%3A*&fq=%7B%21collapse+field%3Dgroup_s+sort%3D%27bogus_td+desc%27+%7D&sort=id+asc} hits=2 status=0 QTime=0
[junit4] 2> 4235591 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=*%3A*&fq=%7B%21collapse+field%3Dgroup_s+sort%3D%27bogus_s+asc%27+%7D&sort=id+asc} hits=2 status=0 QTime=0
[junit4] 2> 4235595 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=*%3A*&fq=%7B%21collapse+field%3Dgroup_s+sort%3D%27bogus_s+desc%27+%7D&sort=id+asc} hits=2 status=0 QTime=2
[junit4] 2> 4235598 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.SolrCore Ignoring exception matching .
[junit4] 2> 4235598 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=%7B%21func%7Dsub%28sub%28test_tl%2C1000%29%2Cid%29&fq=%7B%21collapse+field%3Dgroup_s+sort%3D%27abs%28cscore%28%29%29+asc%2C+id+asc%27%7D&sort=score+asc} status=400 QTime=3
[junit4] 2> 4235603 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.SolrCore Ignoring exception matching .
[junit4] 2> 4235604 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=*%3A*&fq=%7B%21collapse+field%3Dgroup_s+min%3Dtest_tf+max%3Dtest_tf%7D} status=400 QTime=5
[junit4] 2> 4235604 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.SolrCore Ignoring exception matching .
[junit4] 2> 4235604 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=*%3A*&fq=%7B%21collapse+field%3Dgroup_s+min%3Dtest_tf+sort%3D%27test_tf+asc%27%7D} status=400 QTime=0
[junit4] 2> 4235605 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.SolrCore Ignoring exception matching .
[junit4] 2> 4235605 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=*%3A*&fq=%7B%21collapse+field%3Dgroup_s+max%3Dtest_tf+sort%3D%27test_tf+asc%27%7D} status=400 QTime=0
[junit4] 2> 4235638 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={fq=%7B%21collapse+field%3Dgroup_s+nullPolicy%3Dcollapse+sort%3D%27test_ti+asc%27%7D&q=*%3A*&sort=test_ti+desc} hits=3 status=0 QTime=32
[junit4] 2> 4235639 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={fq=%7B%21collapse+field%3Dgroup_s+nullPolicy%3Dcollapse+min%3D%27%27+sort%3D%27test_ti+asc%27%7D&q=*%3A*&sort=test_ti+desc} hits=3 status=0 QTime=0
[junit4] 2> 4235640 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={fq=%7B%21collapse+field%3Dgroup_s+nullPolicy%3Dcollapse+max%3D%27%27+sort%3D%27test_ti+asc%27%7D&q=*%3A*&sort=test_ti+desc} hits=3 status=0 QTime=0
[junit4] 2> 4235640 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={fq=%7B%21collapse+field%3Dgroup_s+nullPolicy%3Dcollapse+min%3D%24x+sort%3D%27test_ti+asc%27%7D&q=*%3A*&sort=test_ti+desc} hits=3 status=0 QTime=0
[junit4] 2> 4235661 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={fq=%7B%21collapse+field%3Dgroup_s+nullPolicy%3Dcollapse+min%3D%24x+sort%3D%27test_ti+asc%27%7D&x=&q=*%3A*&sort=test_ti+desc} hits=3 status=0 QTime=20
[junit4] 2> 4235663 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=*%3A*&fq=%7B%21collapse+field%3Dgroup_s+max%3Dtest_tf+nullPolicy%3Dexpand%7D&sort=id+desc} hits=4 status=0 QTime=0
[junit4] 2> 4235664 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=*%3A*&fq=%7B%21collapse+field%3Dgroup_s+max%3Dtest_tf+nullPolicy%3Dcollapse%7D&sort=id+desc} hits=3 status=0 QTime=0
[junit4] 2> 4235678 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=*%3A*&fq=%7B%21collapse+field%3Dgroup_s%7D&fq=%7B%21tag%3Dtest_ti%7Did%3A5&defType=edismax&bf=field%28test_ti%29&facet=true&facet.field=%7B%21ex%3Dtest_ti%7Dtest_ti&facet.mincount=1} hits=1 status=0 QTime=13
[junit4] 2> 4235691 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=*%3A*&fq=%7B%21collapse+field%3Dgroup_s%7D&group=true&group.field=id} hits=2 status=0 QTime=0
[junit4] 2> 4235692 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=null path=null params={} {delete=[1 (-1518089377809432576)]} 0 0
[junit4] 2> 4235693 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=null path=null params={} {delete=[2 (-1518089377810481152)]} 0 0
[junit4] 2> 4235693 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.UpdateHandler start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 4235720 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=2
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1aaf8d07 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4e715b9c),segFN=segments_a,generation=10}
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1aaf8d07 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4e715b9c),segFN=segments_b,generation=11}
[junit4] 2> 4235720 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.SolrCore newest commit generation = 11
[junit4] 2> 4235720 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.s.SolrIndexSearcher Opening Searcher@442d845d[collection1] main
[junit4] 2> 4235721 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.UpdateHandler end_commit_flush
[junit4] 2> 4235723 INFO (searcherExecutor-7717-thread-1) [ ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@442d845d[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_8(6.0.0):c6/2:delGen=1) Uninverting(_7(6.0.0):c1)))}
[junit4] 2> 4235761 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=null path=null params={} {commit=} 0 68
[junit4] 2> 4235763 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=YYYY&fq=%7B%21collapse+field%3Dgroup_s+nullPolicy%3Dcollapse%7D&defType=edismax&bf=field%28test_ti%29&qf=term_s&qt=%2Felevate} hits=3 status=0 QTime=1
[junit4] 2> 4235774 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=null path=null params={} {add=[1 (1518089377893318656)]} 0 2
[junit4] 2> 4235774 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.UpdateHandler start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 4235779 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=2
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1aaf8d07 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4e715b9c),segFN=segments_b,generation=11}
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1aaf8d07 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4e715b9c),segFN=segments_c,generation=12}
[junit4] 2> 4235779 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.SolrCore newest commit generation = 12
[junit4] 2> 4235779 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.s.SolrIndexSearcher Opening Searcher@5f59d709[collection1] main
[junit4] 2> 4235782 INFO (searcherExecutor-7717-thread-1) [ ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@5f59d709[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_8(6.0.0):c6/2:delGen=1) Uninverting(_7(6.0.0):c1) Uninverting(_9(6.0.0):c1)))}
[junit4] 2> 4235784 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.UpdateHandler end_commit_flush
[junit4] 2> 4235787 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=null path=null params={} {commit=} 0 12
[junit4] 2> 4235812 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=null path=null params={} {add=[2 (1518089377909047296)]} 0 25
[junit4] 2> 4235813 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=null path=null params={} {add=[3 (1518089377936310272)]} 0 0
[junit4] 2> 4235813 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.UpdateHandler start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 4235880 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=2
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1aaf8d07 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4e715b9c),segFN=segments_c,generation=12}
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1aaf8d07 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4e715b9c),segFN=segments_d,generation=13}
[junit4] 2> 4235880 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.SolrCore newest commit generation = 13
[junit4] 2> 4235880 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.s.SolrIndexSearcher Opening Searcher@470c1c22[collection1] main
[junit4] 2> 4235881 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.UpdateHandler end_commit_flush
[junit4] 2> 4235883 INFO (searcherExecutor-7717-thread-1) [ ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@470c1c22[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_8(6.0.0):c6/3:delGen=2) Uninverting(_7(6.0.0):c1) Uninverting(_9(6.0.0):c1) Uninverting(_a(6.0.0):c2)))}
[junit4] 2> 4235883 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=null path=null params={} {commit=} 0 69
[junit4] 2> 4235884 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=null path=null params={} {add=[4 (1518089378009710592)]} 0 0
[junit4] 2> 4235885 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=null path=null params={} {add=[5 (1518089378011807744)]} 0 0
[junit4] 2> 4235885 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.UpdateHandler start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 4236065 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=2
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1aaf8d07 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4e715b9c),segFN=segments_d,generation=13}
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1aaf8d07 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4e715b9c),segFN=segments_e,generation=14}
[junit4] 2> 4236065 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.SolrCore newest commit generation = 14
[junit4] 2> 4236065 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.s.SolrIndexSearcher Opening Searcher@72c4651b[collection1] main
[junit4] 2> 4236068 INFO (searcherExecutor-7717-thread-1) [ ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@72c4651b[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_8(6.0.0):c6/5:delGen=3) Uninverting(_7(6.0.0):c1) Uninverting(_9(6.0.0):c1) Uninverting(_a(6.0.0):c2) Uninverting(_c(6.0.0):c2)))}
[junit4] 2> 4236070 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.UpdateHandler end_commit_flush
[junit4] 2> 4236070 INFO (TEST-TestCollapseQParserPlugin.testStringCollapse-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.p.LogUpdateProcessor [coll
[...truncated too long message...]
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1aaf8d07 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4e715b9c),segFN=segments_14,generation=40}
[junit4] 2> 4239417 INFO (TEST-TestCollapseQParserPlugin.testGroupHeadSelector-seed#[BEDFC86FB041F315]) [ ] o.a.s.c.SolrCore newest commit generation = 40
[junit4] 2> 4239417 INFO (TEST-TestCollapseQParserPlugin.testGroupHeadSelector-seed#[BEDFC86FB041F315]) [ ] o.a.s.s.SolrIndexSearcher Opening Searcher@745757c8[collection1] main
[junit4] 2> 4239419 INFO (searcherExecutor-7717-thread-1) [ ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@745757c8[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 4239420 INFO (TEST-TestCollapseQParserPlugin.testGroupHeadSelector-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.UpdateHandler end_commit_flush
[junit4] 2> 4239420 INFO (TEST-TestCollapseQParserPlugin.testGroupHeadSelector-seed#[BEDFC86FB041F315]) [ ] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=null path=null params={} {commit=} 0 3
[junit4] 2> 4239421 INFO (TEST-TestCollapseQParserPlugin.testGroupHeadSelector-seed#[BEDFC86FB041F315]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testGroupHeadSelector
[junit4] 2> 4239421 INFO (SUITE-TestCollapseQParserPlugin-seed#[BEDFC86FB041F315]-worker) [ ] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> 4239421 INFO (SUITE-TestCollapseQParserPlugin-seed#[BEDFC86FB041F315]-worker) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=808618667
[junit4] 2> 4239425 INFO (SUITE-TestCollapseQParserPlugin-seed#[BEDFC86FB041F315]-worker) [ x:collection1] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@540e2b5f
[junit4] 2> 4239426 INFO (SUITE-TestCollapseQParserPlugin-seed#[BEDFC86FB041F315]-worker) [ x:collection1] o.a.s.u.UpdateHandler closing DirectUpdateHandler2{commits=42,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=51,cumulative_deletesById=4,cumulative_deletesByQuery=9,cumulative_errors=0,transaction_logs_total_size=1609,transaction_logs_total_number=10}
[junit4] 2> 4239426 INFO (SUITE-TestCollapseQParserPlugin-seed#[BEDFC86FB041F315]-worker) [ x:collection1] o.a.s.u.SolrCoreState Closing SolrCoreState
[junit4] 2> 4239426 INFO (SUITE-TestCollapseQParserPlugin-seed#[BEDFC86FB041F315]-worker) [ x:collection1] o.a.s.u.DefaultSolrCoreState SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 4239426 INFO (SUITE-TestCollapseQParserPlugin-seed#[BEDFC86FB041F315]-worker) [ x:collection1] o.a.s.u.DefaultSolrCoreState closing IndexWriter with IndexWriterCloser
[junit4] 2> 4239426 INFO (SUITE-TestCollapseQParserPlugin-seed#[BEDFC86FB041F315]-worker) [ x:collection1] o.a.s.c.SolrCore [collection1] Closing main searcher on request.
[junit4] 2> 4239544 INFO (SUITE-TestCollapseQParserPlugin-seed#[BEDFC86FB041F315]-worker) [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 4239544 INFO (SUITE-TestCollapseQParserPlugin-seed#[BEDFC86FB041F315]-worker) [ x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.search.TestCollapseQParserPlugin_BEDFC86FB041F315-001/init-core-data-001 [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.search.TestCollapseQParserPlugin_BEDFC86FB041F315-001/init-core-data-001;done=false>>]
[junit4] 2> 4239544 INFO (SUITE-TestCollapseQParserPlugin-seed#[BEDFC86FB041F315]-worker) [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.search.TestCollapseQParserPlugin_BEDFC86FB041F315-001/init-core-data-001
[junit4] 2> 4239544 INFO (SUITE-TestCollapseQParserPlugin-seed#[BEDFC86FB041F315]-worker) [ x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.search.TestCollapseQParserPlugin_BEDFC86FB041F315-001/init-core-data-001/index [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.search.TestCollapseQParserPlugin_BEDFC86FB041F315-001/init-core-data-001/index;done=false>>]
[junit4] 2> 4239544 INFO (SUITE-TestCollapseQParserPlugin-seed#[BEDFC86FB041F315]-worker) [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.search.TestCollapseQParserPlugin_BEDFC86FB041F315-001/init-core-data-001/index
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.search.TestCollapseQParserPlugin_BEDFC86FB041F315-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene60): {test_tl=FST50, group_i=PostingsFormat(name=Asserting), group_ti_dv=PostingsFormat(name=MockRandom), _version_=PostingsFormat(name=Memory doPackFST= true), test_ti=PostingsFormat(name=Memory doPackFST= true), term_s=PostingsFormat(name=MockRandom), test_tf=PostingsFormat(name=Asserting), id=FST50, group_s=FST50, group_s_dv=PostingsFormat(name=Memory doPackFST= true)}, docValues:{group_ti_dv=DocValuesFormat(name=Lucene54), group_s_dv=DocValuesFormat(name=Lucene54)}, sim=RandomSimilarityProvider(queryNorm=false,coord=crazy): {}, locale=ar_SY, timezone=America/Aruba
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_66 (64-bit)/cpus=4,threads=1,free=141165440,total=519045120
[junit4] 2> NOTE: All tests run in this JVM: [TestSimpleTrackingShardHandler, BigEndianAscendingWordSerializerTest, ForceLeaderTest, OverseerRolesTest, BJQParserTest, SolrCmdDistributorTest, DeleteInactiveReplicaTest, DistributedTermsComponentTest, TestCoreContainer, CdcrReplicationHandlerTest, TestMissingGroups, DistributedFacetPivotLargeTest, DistributedQueryComponentOptimizationTest, SpellCheckCollatorTest, LeaderInitiatedRecoveryOnCommitTest, BadCopyFieldTest, HttpPartitionTest, DistributedVersionInfoTest, ZkStateWriterTest, TestUpdate, MBeansHandlerTest, CoreMergeIndexesAdminHandlerTest, TestChildDocTransformer, TestQuerySenderNoQuery, RequestLoggingTest, DOMUtilTest, TestRawResponseWriter, TestSolrDynamicMBean, OverseerTaskQueueTest, TestStressVersions, OpenExchangeRatesOrgProviderTest, TestExactStatsCache, RemoteQueryErrorTest, TestHighlightDedupGrouping, TestLFUCache, CollectionStateFormat2Test, TestBM25SimilarityFactory, FastVectorHighlighterTest, TestHashPartitioner, SchemaVersionSpecificBehaviorTest, SolrIndexSplitterTest, TestDistributedMissingSort, SmileWriterTest, TestPartialUpdateDeduplication, TestManagedResource, TestPKIAuthenticationPlugin, HdfsChaosMonkeyNothingIsSafeTest, TestRestManager, SpellPossibilityIteratorTest, DistributedMLTComponentTest, ActionThrottleTest, SuggesterFSTTest, UpdateRequestProcessorFactoryTest, ChaosMonkeySafeLeaderTest, DirectSolrSpellCheckerTest, UUIDUpdateProcessorFallbackTest, ShardRoutingCustomTest, ChaosMonkeyNothingIsSafeTest, SolrXmlInZkTest, TestInitParams, VersionInfoTest, OutOfBoxZkACLAndCredentialsProvidersTest, BasicFunctionalityTest, SecurityConfHandlerTest, EnumFieldTest, ZkCLITest, TestConfigSetImmutable, HLLUtilTest, TestSolrConfigHandlerCloud, InfoHandlerTest, SoftAutoCommitTest, DistribJoinFromCollectionTest, SolrIndexConfigTest, TestTrie, TestSolrCoreProperties, SpatialFilterTest, TestMiniSolrCloudClusterSSL, TestBinaryResponseWriter, TestConfigSetsAPIZkFailure, TestRecoveryHdfs, TestInitQParser, TestInfoStreamLogging, DocumentBuilderTest, NumericFieldsTest, OpenCloseCoreStressTest, UniqFieldsUpdateProcessorFactoryTest, TestReplicaProperties, TestDocumentBuilder, LeaderElectionIntegrationTest, TestReplicationHandler, MigrateRouteKeyTest, ReplicationFactorTest, RollingRestartTest, TestCollationFieldDocValues, TestSchemaManager, AnalyticsMergeStrategyTest, AnalyticsQueryTest, MergeStrategyTest, RankQueryTest, TestAddFieldRealTimeGet, TestCollapseQParserPlugin]
[junit4] Completed [504/558] on J1 in 5.64s, 9 tests, 2 errors <<< FAILURES!
[...truncated 191 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987: There were test failures: 558 suites (8 ignored), 2215 tests, 2 errors, 32 ignored (18 assumptions) [seed: BEDFC86FB041F315]
Total time: 212 minutes 59 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 854 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/854/
2 tests failed.
FAILED: org.apache.solr.cloud.BasicDistributedZkTest.test
Error Message:
commitWithin did not work on node: http://127.0.0.1:33340/collection1 expected:<68> but was:<67>
Stack Trace:
java.lang.AssertionError: commitWithin did not work on node: http://127.0.0.1:33340/collection1 expected:<68> but was:<67>
at __randomizedtesting.SeedInfo.seed([5BDA0A180335E023:D38E35C2ADC98DDB]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.apache.solr.cloud.BasicDistributedZkTest.test(BasicDistributedZkTest.java:333)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1660)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:866)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:902)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:916)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:963)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:938)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:875)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:777)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:811)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:822)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test
Error Message:
Captured an uncaught exception in thread: Thread[id=9457, name=collection2, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=9457, name=collection2, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:51613/rt/g: collection already exists: awholynewstresscollection_collection2_0
at __randomizedtesting.SeedInfo.seed([5BDA0A180335E023]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1573)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1594)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:876)
Build Log:
[...truncated 9989 lines...]
[junit4] Suite: org.apache.solr.cloud.BasicDistributedZkTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5BDA0A180335E023-001/init-core-data-001
[junit4] 2> 460518 INFO (SUITE-BasicDistributedZkTest-seed#[5BDA0A180335E023]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
[junit4] 2> 460527 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 460533 INFO (Thread-12841) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 460534 INFO (Thread-12841) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 460633 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.ZkTestServer start zk server on port:54364
[junit4] 2> 460634 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 460657 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 460665 INFO (zkCallback-256-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6c1f3770 name:ZooKeeperConnection Watcher:127.0.0.1:54364 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 460666 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 460666 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 460666 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 460669 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 460677 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 460688 INFO (zkCallback-257-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@c530e8 name:ZooKeeperConnection Watcher:127.0.0.1:54364/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 460688 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 460689 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 460689 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
[junit4] 2> 460692 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
[junit4] 2> 460693 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
[junit4] 2> 460694 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
[junit4] 2> 460696 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 460696 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 460698 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 460698 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
[junit4] 2> 460699 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 460699 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 460700 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 460700 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
[junit4] 2> 460701 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 460702 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
[junit4] 2> 460703 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 460703 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
[junit4] 2> 460704 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 460705 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 460706 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 460706 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 460708 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 460708 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 460709 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 460709 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 460711 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 460711 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
[junit4] 2> 461214 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5BDA0A180335E023-001/control-001/cores/collection1
[junit4] 2> 461219 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.e.j.s.Server jetty-9.2.13.v20150730
[junit4] 2> 461238 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@35ff7283{/,null,AVAILABLE}
[junit4] 2> 461238 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.e.j.s.ServerConnector Started ServerConnector@41837789{HTTP/1.1}{127.0.0.1:46417}
[junit4] 2> 461238 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.e.j.s.Server Started @464124ms
[junit4] 2> 461238 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5BDA0A180335E023-001/tempDir-001/control/data, hostContext=/, hostPort=46417, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5BDA0A180335E023-001/control-001/cores}
[junit4] 2> 461239 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 461239 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5BDA0A180335E023-001/control-001/'
[junit4] 2> 461239 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 461239 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 461258 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 461262 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 461277 INFO (zkCallback-258-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3453b184 name:ZooKeeperConnection Watcher:127.0.0.1:54364/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 461278 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 461278 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 461279 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 461285 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5BDA0A180335E023-001/control-001/solr.xml
[junit4] 2> 461293 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5BDA0A180335E023-001/control-001/cores
[junit4] 2> 461293 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.CoreContainer New CoreContainer 148941025
[junit4] 2> 461293 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5BDA0A180335E023-001/control-001/]
[junit4] 2> 461293 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5BDA0A180335E023-001/control-001/lib
[junit4] 2> 461293 WARN (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5BDA0A180335E023-001/control-001/lib).
[junit4] 2> 461301 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 461315 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 461326 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 461326 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 461327 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:54364/solr
[junit4] 2> 461327 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 461327 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 461329 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 461341 INFO (zkCallback-260-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@30e2b862 name:ZooKeeperConnection Watcher:127.0.0.1:54364 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 461352 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 461355 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 461363 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [n:127.0.0.1:46417_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 461366 INFO (zkCallback-261-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@56a8e209 name:ZooKeeperConnection Watcher:127.0.0.1:54364/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 461366 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [n:127.0.0.1:46417_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 461367 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [n:127.0.0.1:46417_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
[junit4] 2> 461370 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [n:127.0.0.1:46417_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 461373 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [n:127.0.0.1:46417_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 461376 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [n:127.0.0.1:46417_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 461379 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [n:127.0.0.1:46417_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 461383 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [n:127.0.0.1:46417_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 461387 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [n:127.0.0.1:46417_ ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 461388 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [n:127.0.0.1:46417_ ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 461389 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [n:127.0.0.1:46417_ ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 461390 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [n:127.0.0.1:46417_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46417_
[junit4] 2> 461391 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [n:127.0.0.1:46417_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:46417_
[junit4] 2> 461392 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [n:127.0.0.1:46417_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 461393 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [n:127.0.0.1:46417_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 461394 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [n:127.0.0.1:46417_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 461395 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [n:127.0.0.1:46417_ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94874741134655492-127.0.0.1:46417_-n_0000000000
[junit4] 2> 461395 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [n:127.0.0.1:46417_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:46417_
[junit4] 2> 461395 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [n:127.0.0.1:46417_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
[junit4] 2> 461398 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [n:127.0.0.1:46417_ ] o.a.s.c.Overseer Overseer (id=94874741134655492-127.0.0.1:46417_-n_0000000000) starting
[junit4] 2> 461402 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [n:127.0.0.1:46417_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
[junit4] 2> 461422 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [n:127.0.0.1:46417_ ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 461428 INFO (OverseerCollectionConfigSetProcessor-94874741134655492-127.0.0.1:46417_-n_0000000000) [n:127.0.0.1:46417_ ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
[junit4] 2> 461428 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [n:127.0.0.1:46417_ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 461428 INFO (OverseerStateUpdate-94874741134655492-127.0.0.1:46417_-n_0000000000) [n:127.0.0.1:46417_ ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 461448 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [n:127.0.0.1:46417_ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 461448 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [n:127.0.0.1:46417_ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 461449 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [n:127.0.0.1:46417_ ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5BDA0A180335E023-001/control-001/cores
[junit4] 2> 461450 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [n:127.0.0.1:46417_ ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5BDA0A180335E023-001/control-001/cores/collection1, collection=control_collection, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5BDA0A180335E023-001/control-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 461450 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [n:127.0.0.1:46417_ ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5BDA0A180335E023-001/control-001/cores/collection1/
[junit4] 2> 461450 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [n:127.0.0.1:46417_ ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 461452 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 461452 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 461453 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [n:127.0.0.1:46417_ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4] 2> 461453 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [n:127.0.0.1:46417_ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 461454 INFO (OverseerStateUpdate-94874741134655492-127.0.0.1:46417_-n_0000000000) [n:127.0.0.1:46417_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:46417",
[junit4] 2> "node_name":"127.0.0.1:46417_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 461455 INFO (OverseerStateUpdate-94874741134655492-127.0.0.1:46417_-n_0000000000) [n:127.0.0.1:46417_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:46417",
[junit4] 2> "node_name":"127.0.0.1:46417_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 461455 INFO (OverseerStateUpdate-94874741134655492-127.0.0.1:46417_-n_0000000000) [n:127.0.0.1:46417_ ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
[junit4] 2> 461456 INFO (OverseerStateUpdate-94874741134655492-127.0.0.1:46417_-n_0000000000) [n:127.0.0.1:46417_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 461457 INFO (zkCallback-261-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 461460 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 461460 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 461460 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
[junit4] 2> 461460 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 461460 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 461461 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 461461 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5BDA0A180335E023-001/control-001/cores/collection1/'
[junit4] 2> 461462 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 461462 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 461476 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 461481 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 461485 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 461493 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
[junit4] 2> 461494 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 461499 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 461626 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 461632 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 461633 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 461642 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 461644 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 461646 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 461647 WARN (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 461647 WARN (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 461647 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 461647 WARN (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 461647 WARN (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 461648 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4] 2> 461648 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 461652 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 461652 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5BDA0A180335E023-001/control-001/cores/collection1/], dataDir=[null]
[junit4] 2> 461652 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@23c1ba3d
[junit4] 2> 461653 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5BDA0A180335E023-001/control-001/cores/collection1/data
[junit4] 2> 461653 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5BDA0A180335E023-001/control-001/cores/collection1/data/index/
[junit4] 2> 461653 WARN (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5BDA0A180335E023-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 461653 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5BDA0A180335E023-001/control-001/cores/collection1/data/index
[junit4] 2> 461654 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=19, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 461668 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(MMapDirectory@/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5BDA0A180335E023-001/index-MMapDirectory-001 lockFactory=org.apache.lucene.store.NativeFSLockFactory@82ba7d5),segFN=segments_1,generation=1}
[junit4] 2> 461668 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 461690 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 461690 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
[junit4] 2> 461690 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 461690 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 461690 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 461690 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 461690 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 461691 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 461691 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 461691 WARN (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,args = {defaults={a=A,b=B}}}
[junit4] 2> 461692 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 461694 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 461694 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 461709 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5BDA0A180335E023-001/control-001/cores/collection1/data/
[junit4] 2> 461710 WARN (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5BDA0A180335E023-001/control-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
[junit4] 2> 461710 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 461714 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/dump,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 461715 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 461730 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 461730 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 461731 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
[junit4] 2> 461731 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
[junit4] 2> 461731 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=26, maxMergeAtOnceExplicit=31, maxMergedSegmentMB=9.5048828125, floorSegmentMB=1.0068359375, forceMergeDeletesPctAllowed=17.992572174167172, segmentsPerTier=15.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 461741 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(MMapDirectory@/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5BDA0A180335E023-001/index-MMapDirectory-001 lockFactory=org.apache.lucene.store.NativeFSLockFactory@82ba7d5),segFN=segments_1,generation=1}
[junit4] 2> 461741 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 461742 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@57b5d41d[collection1] main
[junit4] 2> 461742 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 461743 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 461743 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 461743 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 461743 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
[junit4] 2> 461743 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 461744 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 461744 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 461744 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 461744 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 461745 INFO (searcherExecutor-1145-thread-1-processing-n:127.0.0.1:46417_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@57b5d41d[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 461745 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
[junit4] 2> 461745 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
[junit4] 2> 461745 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
[junit4] 2> 461745 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1517995859415924736
[junit4] 2> 461747 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 2.0ms to seed version buckets with highest version 1517995859415924736
[junit4] 2> 461747 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
[junit4] 2> 461748 INFO (coreLoadExecutor-1144-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 461757 INFO (coreZkRegister-1138-thread-1-processing-n:127.0.0.1:46417_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:46417 collection:control_collection shard:shard1
[junit4] 2> 461763 INFO (coreZkRegister-1138-thread-1-processing-n:127.0.0.1:46417_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 461769 INFO (coreZkRegister-1138-thread-1-processing-n:127.0.0.1:46417_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/94874741134655492-core_node1-n_0000000000
[junit4] 2> 461770 INFO (coreZkRegister-1138-thread-1-processing-n:127.0.0.1:46417_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1
[junit4] 2> 461771 INFO (OverseerStateUpdate-94874741134655492-127.0.0.1:46417_-n_0000000000) [n:127.0.0.1:46417_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection"} current state version: 1
[junit4] 2> 461773 INFO (coreZkRegister-1138-thread-1-processing-n:127.0.0.1:46417_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 461773 INFO (coreZkRegister-1138-thread-1-processing-n:127.0.0.1:46417_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 461773 INFO (coreZkRegister-1138-thread-1-processing-n:127.0.0.1:46417_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:46417/collection1/
[junit4] 2> 461773 INFO (coreZkRegister-1138-thread-1-processing-n:127.0.0.1:46417_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 461773 INFO (coreZkRegister-1138-thread-1-processing-n:127.0.0.1:46417_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:46417/collection1/ has no replicas
[junit4] 2> 461774 INFO (coreZkRegister-1138-thread-1-processing-n:127.0.0.1:46417_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 461775 INFO (coreZkRegister-1138-thread-1-processing-n:127.0.0.1:46417_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
[junit4] 2> 461777 INFO (OverseerStateUpdate-94874741134655492-127.0.0.1:46417_-n_0000000000) [n:127.0.0.1:46417_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:46417",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 1
[junit4] 2> 461778 INFO (coreZkRegister-1138-thread-1-processing-n:127.0.0.1:46417_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:46417/collection1/ shard1
[junit4] 2> 461879 INFO (zkCallback-261-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 461929 INFO (coreZkRegister-1138-thread-1-processing-n:127.0.0.1:46417_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:46417/collection1/ and leader is http://127.0.0.1:46417/collection1/
[junit4] 2> 461929 INFO (coreZkRegister-1138-thread-1-processing-n:127.0.0.1:46417_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:46417
[junit4] 2> 461929 INFO (coreZkRegister-1138-thread-1-processing-n:127.0.0.1:46417_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 461929 INFO (coreZkRegister-1138-thread-1-processing-n:127.0.0.1:46417_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
[junit4] 2> 461929 INFO (coreZkRegister-1138-thread-1-processing-n:127.0.0.1:46417_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46417_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 461931 INFO (OverseerStateUpdate-94874741134655492-127.0.0.1:46417_-n_0000000000) [n:127.0.0.1:46417_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:46417",
[junit4] 2> "node_name":"127.0.0.1:46417_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 2
[junit4] 2> 461931 INFO (OverseerStateUpdate-94874741134655492-127.0.0.1:46417_-n_0000000000) [n:127.0.0.1:46417_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:46417",
[junit4] 2> "node_name":"127.0.0.1:46417_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 461955 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 461955 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 461962 INFO (zkCallback-263-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@16700a0c name:ZooKeeperConnection Watcher:127.0.0.1:54364/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 461963 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 461963 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 461963 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 461967 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 461967 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with stateFormat=2
[junit4] 2> 461967 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 461968 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 461977 INFO (zkCallback-264-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@66c239af name:ZooKeeperConnection Watcher:127.0.0.1:54364/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 461977 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 461977 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 461980 INFO (OverseerStateUpdate-94874741134655492-127.0.0.1:46417_-n_0000000000) [n:127.0.0.1:46417_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"create",
[junit4] 2> "name":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "stateFormat":"2"} current state version: 2
[junit4] 2> 461980 INFO (OverseerStateUpdate-94874741134655492-127.0.0.1:46417_-n_0000000000) [n:127.0.0.1:46417_ ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
[junit4] 2> 461980 INFO (zkCallback-261-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 461983 INFO (zkCallback-263-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 462103 INFO (OverseerStateUpdate-94874741134655492-127.0.0.1:46417_-n_0000000000) [n:127.0.0.1:46417_ ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/collection1/state.json
[junit4] 2> 462508 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5BDA0A180335E023-001/shard-1-001/cores/collection1
[junit4] 2> 462520 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5BDA0A180335E023-001/shard-1-001
[junit4] 2> 462521 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.e.j.s.Server jetty-9.2.13.v20150730
[junit4] 2> 462526 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6f8aa9e{/,null,AVAILABLE}
[junit4] 2> 462526 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.e.j.s.ServerConnector Started ServerConnector@6f51d122{HTTP/1.1}{127.0.0.1:38919}
[junit4] 2> 462526 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.e.j.s.Server Started @465412ms
[junit4] 2> 462526 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5BDA0A180335E023-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/, hostPort=38919, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5BDA0A180335E023-001/shard-1-001/cores}
[junit4] 2> 462530 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 462530 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5BDA0A180335E023-001/shard-1-001/'
[junit4] 2> 462530 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 462530 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 462547 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 462548 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 462555 INFO (zkCallback-265-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@78fc4845 name:ZooKeeperConnection Watcher:127.0.0.1:54364/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 462555 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 462555 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 462561 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 462561 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5BDA0A180335E023-001/shard-1-001/solr.xml
[junit4] 2> 462569 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5BDA0A180335E023-001/shard-1-001/cores
[junit4] 2> 462569 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.CoreContainer New CoreContainer 415898173
[junit4] 2> 462569 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5BDA0A180335E023-001/shard-1-001/]
[junit4] 2> 462569 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5BDA0A180335E023-001/shard-1-001/lib
[junit4] 2> 462570 WARN (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5BDA0A180335E023-001/shard-1-001/lib).
[junit4] 2> 462587 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 462604 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 462604 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 462604 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 462605 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:54364/solr
[junit4] 2> 462605 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 462605 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 462617 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 462631 INFO (zkCallback-267-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@53318ddf name:ZooKeeperConnection Watcher:127.0.0.1:54364 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 462633 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 462634 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 462637 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [n:127.0.0.1:38919_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 462659 INFO (zkCallback-268-thread-1-processing-n:127.0.0.1:38919_) [n:127.0.0.1:38919_ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@360ee680 name:ZooKeeperConnection Watcher:127.0.0.1:54364/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 462659 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [n:127.0.0.1:38919_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 462665 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [n:127.0.0.1:38919_ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 463671 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [n:127.0.0.1:38919_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38919_
[junit4] 2> 463672 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [n:127.0.0.1:38919_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:38919_
[junit4] 2> 463672 INFO (zkCallback-263-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 463672 INFO (zkCallback-261-thread-1-processing-n:127.0.0.1:46417_) [n:127.0.0.1:46417_ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 463673 INFO (zkCallback-268-thread-1-processing-n:127.0.0.1:38919_) [n:127.0.0.1:38919_ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 463676 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [n:127.0.0.1:38919_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 463676 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [n:127.0.0.1:38919_ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94874741134655497-127.0.0.1:38919_-n_0000000001
[junit4] 2> 463677 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [n:127.0.0.1:38919_ ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/94874741134655492-127.0.0.1:46417_-n_0000000000 to know if I could be the leader
[junit4] 2> 463687 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [n:127.0.0.1:38919_ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 463687 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [n:127.0.0.1:38919_ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 463688 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [n:127.0.0.1:38919_ ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5BDA0A180335E023-001/shard-1-001/cores
[junit4] 2> 463689 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [n:127.0.0.1:38919_ ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5BDA0A180335E023-001/shard-1-001/cores/collection1, collection=collection1, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5BDA0A180335E023-001/shard-1-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 463689 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [n:127.0.0.1:38919_ ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5BDA0A180335E023-001/shard-1-001/cores/collection1/
[junit4] 2> 463689 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [n:127.0.0.1:38919_ ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 463691 INFO (coreLoadExecutor-1155-thread-1-processing-n:127.0.0.1:38919_) [n:127.0.0.1:38919_ c:collection1 x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 463691 INFO (coreLoadExecutor-1155-thread-1-processing-n:127.0.0.1:38919_) [n:127.0.0.1:38919_ c:collection1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 463693 INFO (coreLoadExecutor-1155-thread-1-processing-n:127.0.0.1:38919_) [n:127.0.0.1:38919_ c:collection1 x:collection1] o.a.s.c.ZkController Registering watch for collection collection1
[junit4] 2> 463693 INFO (coreLoadExecutor-1155-thread-1-processing-n:127.0.0.1:38919_) [n:127.0.0.1:38919_ c:collection1 x:collection1] o.a.s.c.c.ZkStateReader addZkWatch collection1
[junit4] 2> 463693 INFO (coreLoadExecutor-1155-thread-1-processing-n:127.0.0.1:38919_) [n:127.0.0.1:38919_ c:collection1 x:collection1] o.a.s.c.c.ZkStateReader Add data for collection1 ver 0
[junit4] 2> 463693 INFO (coreLoadExecutor-1155-thread-1-processing-n:127.0.0.1:38919_) [n:127.0.0.1:38919_ c:collection1 x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 463694 INFO (OverseerStateUpdate-94874741134655492-127.0.0.1:46417_-n_0000000000) [n:127.0.0.1:46417_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:38919",
[junit4] 2> "node_name":"127.0.0.1:38919_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"} current state version: 3
[junit4] 2> 463696 INFO (OverseerStateUpdate-94874741134655492-127.0.0.1:46417_-n_0000000000) [n:127.0.0.1:46417_ ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:38919",
[junit4] 2> "node_name":"127.0.0.1:38919_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"}
[junit4] 2> 463696 INFO (OverseerStateUpdate-94874741134655492-127.0.0.1:46417_-n_0000000000) [n:127.0.0.1:46417_ ] o.a.s.c.o.ReplicaMutator Collection already exists with numShards=2
[junit4] 2> 463696 INFO (OverseerStateUpdate-94874741134655492-127.0.0.1:46417_-n_0000000000) [n:127.0.0.1:46417_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2
[junit4] 2> 463698 INFO (OverseerStateUpdate-94874741134655492-127.0.0.1:46417_-n_0000000000) [n:127.0.0.1:46417_ ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/collection1/state.json version: 0
[junit4] 2> 463698 INFO (zkCallback-268-thread-1-processing-n:127.0.0.1:38919_) [n:127.0.0.1:38919_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json for collection collection1 has occurred - updating... (live nodes size: 2)
[junit4] 2> 463699 INFO (zkCallback-268-thread-1-processing-n:127.0.0.1:38919_) [n:127.0.0.1:38919_ ] o.a.s.c.c.ZkStateReader Updating data for collection1 from 0 to 1
[junit4] 2> 463711 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [n:127.0.0.1:38919_ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4] 2> 463711 INFO (TEST-BasicDistributedZkTest.test-seed#[5BDA0A180335E023]) [n:127.0.0.1:38919_ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 464693 INFO (coreLoadExecutor-1155-thread-1-processing-n:127.0.0.1:38919_) [n:127.0.0.1:38919_ c:collection1 x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 464693 INFO (coreLoadExecutor-1155-thread-1-processing-n:127.0.0.1:38919_) [n:127.0.0.1:38919_ c:collection1 x:collection1] o.a.s.c.ZkController Check for collection zkNode:collection1
[junit4] 2> 464694 INFO (coreLoadExecutor-1155-thread-1-processing-n:127.0.0.1:38919_) [n:127.0.0.1:38919_ c:collection1 x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 464694 INFO (coreLoadExecutor-1155-thread-1-processing-n:127.0.0.1:38919_) [n:127.0.0.1:38919_ c:collection1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/collection1
[junit4] 2> 464694 INFO (coreLoadExecutor-1155-thread-1-processing-n:127.0.0.1:38919_) [n:127.0.0.1:38919_ c:collection1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 464695 INFO (coreLoadExecutor-1155-thread-1-processing-n:127.0.0.1:38919_) [n:127.0.0.1:38919_ c:collection1 x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5BDA0A180335E023-001/shard-1-001/cores/collection1/'
[junit4] 2> 464695 INFO (coreLoadExecutor-1155-thread-1-processing-n:127.0.0.1:38919_) [n:127.0.0.1:38919_ c:collection1 x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 464695 INFO (coreLoadExecutor-1155-thread-1-processing-n:127.0.0.1:38919_) [n:127.0.0.1:38919_ c:collection1 x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 464723 INFO (coreLoadExecutor-1155-thread-1-processing-n:127.0.0.1:38919_) [n:127.0.0.1:38919_ c:collection1 x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 464728 INFO (coreLoadExecutor-1155-thread-1-processing-n:127.0.0.1:38919_) [n:127.0.0.1:38919_ c:collection1 x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 464731 INFO (coreLoadExecutor-1155-thread-1-processing-n:127.0.0.1:38919_) [n:127.0.0.1:38919_ c:collection1 x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 464742 INFO (coreLoadExecutor-1155-thread-1-processing-n:127.0.0.1:38919_) [n:127.0.0.1:38919_ c
[...truncated too long message...]
ollectionsAPIDistributedZkTest]
[junit4] > Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:51613/rt/g: collection already exists: awholynewstresscollection_collection5_0
[junit4] > at __randomizedtesting.SeedInfo.seed([5BDA0A180335E023]:0)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
[junit4] > at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1573)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1594)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:876)Throwable #5: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=9455, name=collection0, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:51613/rt/g: collection already exists: awholynewstresscollection_collection0_0
[junit4] > at __randomizedtesting.SeedInfo.seed([5BDA0A180335E023]:0)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
[junit4] > at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1573)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1594)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:876)Throwable #6: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=9456, name=collection1, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:51613/rt/g: Could not find collection : awholynewstresscollection_collection1_0
[junit4] > at __randomizedtesting.SeedInfo.seed([5BDA0A180335E023]:0)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
[junit4] > at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:883)
[junit4] 2> 1473001 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[5BDA0A180335E023]-worker) [n:127.0.0.1:51814_rt%2Fg c:addReplicaColl s:shard2 r:core_node6 x:addReplicaColl_shard2_replica3] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene60): {other_tl1=PostingsFormat(name=MockRandom), range_facet_l_dv=PostingsFormat(name=LuceneFixedGap), _version_=PostingsFormat(name=MockRandom), multiDefault=PostingsFormat(name=Direct), a_t=PostingsFormat(name=MockRandom), intDefault=PostingsFormat(name=MockRandom), a_i1=PostingsFormat(name=MockRandom), id=PostingsFormat(name=LuceneFixedGap), range_facet_i_dv=PostingsFormat(name=MockRandom), text=PostingsFormat(name=Asserting), range_facet_l=PostingsFormat(name=MockRandom), timestamp=PostingsFormat(name=MockRandom)}, docValues:{range_facet_l_dv=DocValuesFormat(name=Lucene54), range_facet_i_dv=DocValuesFormat(name=Direct), timestamp=DocValuesFormat(name=Direct)}, sim=RandomSimilarityProvider(queryNorm=false,coord=no): {}, locale=ro, timezone=Africa/Libreville
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_66 (64-bit)/cpus=4,threads=1,free=90138976,total=512229376
[junit4] 2> NOTE: All tests run in this JVM: [TestJmxMonitoredMap, CollectionTooManyReplicasTest, TestRemoveLastDynamicCopyField, TestSolrQueryParserResource, TestMacros, TestWriterPerf, TestSortByMinMaxFunction, SSLMigrationTest, HardAutoCommitTest, TestFileDictionaryLookup, TestStressUserVersions, TestCoreDiscovery, TestManagedSchema, LeaderElectionTest, TestObjectReleaseTracker, TestStressReorder, TestHighFrequencyDictionaryFactory, UnloadDistributedZkTest, SuggesterTSTTest, TestPostingsSolrHighlighter, TestSolrDeletionPolicy1, PreAnalyzedUpdateProcessorTest, TestUtils, TestRebalanceLeaders, TestRTimerTree, XmlUpdateRequestHandlerTest, TestFilteredDocIdSet, FieldAnalysisRequestHandlerTest, CustomCollectionTest, SuggesterWFSTTest, TestRequestStatusCollectionAPI, TermVectorComponentDistributedTest, TestReplicationHandlerBackup, TestCollapseQParserPlugin, TestCryptoKeys, HighlighterConfigTest, TestSchemaNameResource, TestJsonFacets, ScriptEngineTest, TestRecovery, CoreAdminRequestStatusTest, DirectUpdateHandlerTest, ExplicitHLLTest, TestSchemaSimilarityResource, UpdateParamsTest, TestSuggestSpellingConverter, PrimitiveFieldTypeTest, RuleEngineTest, OverseerTest, TestZkChroot, SpatialRPTFieldTypeTest, SuggesterTest, TestSolrQueryParser, BasicDistributedZk2Test, QueryParsingTest, DateMathParserTest, DirectUpdateHandlerOptimizeTest, CoreAdminHandlerTest, TestDistribDocBasedVersion, CircularListTest, HdfsNNFailoverTest, TestConfigSetsAPI, DistributedExpandComponentTest, FullSolrCloudDistribCmdsTest, TestSolrIndexConfig, TestRuleBasedAuthorizationPlugin, LukeRequestHandlerTest, FacetPivotSmallTest, NoCacheHeaderTest, BadIndexSchemaTest, TestCrossCoreJoin, CurrencyFieldXmlFileTest, SimpleFacetsTest, TestQueryWrapperFilter, TestCloudPivotFacet, ClusterStateTest, RequestHandlersTest, VMParamsZkACLAndCredentialsProvidersTest, StatsComponentTest, DocExpirationUpdateProcessorFactoryTest, TestSolr4Spatial2, TestSchemaManager, TestReloadAndDeleteDocs, TestCharFilters, DistribDocExpirationUpdateProcessorTest, HdfsRecoveryZkTest, DistributedQueueTest, TestReload, TestNoOpRegenerator, CollectionsAPIDistributedZkTest]
[junit4] Completed [263/558] on J2 in 246.61s, 1 test, 1 error <<< FAILURES!
[...truncated 986 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987: There were test failures: 558 suites (8 ignored), 2214 tests, 1 error, 1 failure, 32 ignored (18 assumptions) [seed: 5BDA0A180335E023]
Total time: 211 minutes 26 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 853 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/853/
5 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.CdcrReplicationDistributedZkTest
Error Message:
ObjectTracker found 1 object(s) that were not released!!! [SolrZkClient]
Stack Trace:
java.lang.AssertionError: ObjectTracker found 1 object(s) that were not released!!! [SolrZkClient]
at __randomizedtesting.SeedInfo.seed([31D5840E093BAE2]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNull(Assert.java:551)
at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:237)
at sun.reflect.GeneratedMethodAccessor21.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1660)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.CdcrReplicationDistributedZkTest
Error Message:
6 threads leaked from SUITE scope at org.apache.solr.cloud.CdcrReplicationDistributedZkTest: 1) Thread[id=71215, name=zkCallback-3213-thread-1, state=TIMED_WAITING, group=TGRP-CdcrReplicationDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 2) Thread[id=71213, name=zkCallback-3197-thread-3-processing-n:127.0.0.1:34793_n%2Fhk-EventThread, state=WAITING, group=TGRP-CdcrReplicationDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494) 3) Thread[id=71236, name=zkCallback-3213-thread-2, state=TIMED_WAITING, group=TGRP-CdcrReplicationDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 4) Thread[id=71238, name=zkCallback-3213-thread-4, state=TIMED_WAITING, group=TGRP-CdcrReplicationDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 5) Thread[id=71212, name=zkCallback-3197-thread-3-processing-n:127.0.0.1:34793_n%2Fhk-SendThread(127.0.0.1:38032), state=TIMED_WAITING, group=TGRP-CdcrReplicationDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:940) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003) 6) Thread[id=71237, name=zkCallback-3213-thread-3, state=TIMED_WAITING, group=TGRP-CdcrReplicationDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 6 threads leaked from SUITE scope at org.apache.solr.cloud.CdcrReplicationDistributedZkTest:
1) Thread[id=71215, name=zkCallback-3213-thread-1, state=TIMED_WAITING, group=TGRP-CdcrReplicationDistributedZkTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2) Thread[id=71213, name=zkCallback-3197-thread-3-processing-n:127.0.0.1:34793_n%2Fhk-EventThread, state=WAITING, group=TGRP-CdcrReplicationDistributedZkTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494)
3) Thread[id=71236, name=zkCallback-3213-thread-2, state=TIMED_WAITING, group=TGRP-CdcrReplicationDistributedZkTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
4) Thread[id=71238, name=zkCallback-3213-thread-4, state=TIMED_WAITING, group=TGRP-CdcrReplicationDistributedZkTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
5) Thread[id=71212, name=zkCallback-3197-thread-3-processing-n:127.0.0.1:34793_n%2Fhk-SendThread(127.0.0.1:38032), state=TIMED_WAITING, group=TGRP-CdcrReplicationDistributedZkTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:940)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003)
6) Thread[id=71237, name=zkCallback-3213-thread-3, state=TIMED_WAITING, group=TGRP-CdcrReplicationDistributedZkTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
at __randomizedtesting.SeedInfo.seed([31D5840E093BAE2]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.CdcrReplicationDistributedZkTest
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=71215, name=zkCallback-3213-thread-1, state=TIMED_WAITING, group=TGRP-CdcrReplicationDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 2) Thread[id=71236, name=zkCallback-3213-thread-2, state=TIMED_WAITING, group=TGRP-CdcrReplicationDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 3) Thread[id=71238, name=zkCallback-3213-thread-4, state=TIMED_WAITING, group=TGRP-CdcrReplicationDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 4) Thread[id=71212, name=zkCallback-3197-thread-3-processing-n:127.0.0.1:34793_n%2Fhk-SendThread(127.0.0.1:38032), state=TIMED_WAITING, group=TGRP-CdcrReplicationDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:994) 5) Thread[id=71237, name=zkCallback-3213-thread-3, state=TIMED_WAITING, group=TGRP-CdcrReplicationDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=71215, name=zkCallback-3213-thread-1, state=TIMED_WAITING, group=TGRP-CdcrReplicationDistributedZkTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2) Thread[id=71236, name=zkCallback-3213-thread-2, state=TIMED_WAITING, group=TGRP-CdcrReplicationDistributedZkTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
3) Thread[id=71238, name=zkCallback-3213-thread-4, state=TIMED_WAITING, group=TGRP-CdcrReplicationDistributedZkTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
4) Thread[id=71212, name=zkCallback-3197-thread-3-processing-n:127.0.0.1:34793_n%2Fhk-SendThread(127.0.0.1:38032), state=TIMED_WAITING, group=TGRP-CdcrReplicationDistributedZkTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:994)
5) Thread[id=71237, name=zkCallback-3213-thread-3, state=TIMED_WAITING, group=TGRP-CdcrReplicationDistributedZkTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
at __randomizedtesting.SeedInfo.seed([31D5840E093BAE2]:0)
FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test
Error Message:
Captured an uncaught exception in thread: Thread[id=3408, name=collection4, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=3408, name=collection4, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: java.lang.RuntimeException: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:42113/ns_jbn/f, http://127.0.0.1:34633/ns_jbn/f, http://127.0.0.1:50708/ns_jbn/f, http://127.0.0.1:33288/ns_jbn/f, http://127.0.0.1:59421/ns_jbn/f]
at __randomizedtesting.SeedInfo.seed([31D5840E093BAE2]:0)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:886)
Caused by: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:42113/ns_jbn/f, http://127.0.0.1:34633/ns_jbn/f, http://127.0.0.1:50708/ns_jbn/f, http://127.0.0.1:33288/ns_jbn/f, http://127.0.0.1:59421/ns_jbn/f]
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:352)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:883)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:59421/ns_jbn/f: KeeperErrorCode = Session expired for /overseer/collection-queue-work/qnr-
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
... 5 more
FAILED: org.apache.solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR
Error Message:
There are still nodes recoverying - waited for 330 seconds
Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 330 seconds
at __randomizedtesting.SeedInfo.seed([31D5840E093BAE2:DD97363DDB31D811]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:170)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:131)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:126)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:830)
at org.apache.solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR(LeaderInitiatedRecoveryOnShardRestartTest.java:109)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1660)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:866)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:902)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:916)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:963)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:938)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:875)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:777)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:811)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:822)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 9838 lines...]
[junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_31D5840E093BAE2-001/init-core-data-001
[junit4] 2> 301912 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[31D5840E093BAE2]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
[junit4] 2> 301912 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[31D5840E093BAE2]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /ns_jbn/f
[junit4] 2> 301915 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 301915 INFO (Thread-1496) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 301915 INFO (Thread-1496) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 302015 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.ZkTestServer start zk server on port:56469
[junit4] 2> 302015 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 302017 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 302019 INFO (zkCallback-182-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5629749d name:ZooKeeperConnection Watcher:127.0.0.1:56469 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 302019 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 302019 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 302019 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 302027 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 302027 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 302030 INFO (zkCallback-183-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4e560d6f name:ZooKeeperConnection Watcher:127.0.0.1:56469/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 302030 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 302031 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 302031 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
[junit4] 2> 302033 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
[junit4] 2> 302034 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
[junit4] 2> 302035 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
[junit4] 2> 302037 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 302037 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 302040 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 302040 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
[junit4] 2> 302042 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 302042 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 302043 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 302044 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
[junit4] 2> 302045 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 302045 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
[junit4] 2> 302047 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 302047 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
[junit4] 2> 302049 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 302049 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 302050 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 302051 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 302052 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 302052 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 302054 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 302054 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 302056 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 302056 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
[junit4] 2> 302058 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 302066 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 302068 INFO (zkCallback-184-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@13d77b3e name:ZooKeeperConnection Watcher:127.0.0.1:56469 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 302068 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 302068 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 302068 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 302070 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 302075 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 302079 INFO (zkCallback-185-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@681a79fc name:ZooKeeperConnection Watcher:127.0.0.1:56469/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 302079 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 302079 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 302079 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf2/solrconfig.xml
[junit4] 2> 302080 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/solrconfig.xml
[junit4] 2> 302081 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf2/schema.xml
[junit4] 2> 302082 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/schema.xml
[junit4] 2> 302083 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf2/enumsConfig.xml
[junit4] 2> 302083 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/enumsConfig.xml
[junit4] 2> 302084 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf2/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 302085 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 302086 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf2/stopwords.txt
[junit4] 2> 302086 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/stopwords.txt
[junit4] 2> 302087 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf2/protwords.txt
[junit4] 2> 302087 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/protwords.txt
[junit4] 2> 302088 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf2/currency.xml
[junit4] 2> 302089 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/currency.xml
[junit4] 2> 302090 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf2/open-exchange-rates.json
[junit4] 2> 302090 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/open-exchange-rates.json
[junit4] 2> 302091 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf2/mapping-ISOLatin1Accent.txt
[junit4] 2> 302091 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/mapping-ISOLatin1Accent.txt
[junit4] 2> 302096 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf2/old_synonyms.txt
[junit4] 2> 302096 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/old_synonyms.txt
[junit4] 2> 302098 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf2/synonyms.txt
[junit4] 2> 302098 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/synonyms.txt
[junit4] 2> 302100 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/elevate.xml to /configs/conf2/elevate.xml
[junit4] 2> 302100 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/elevate.xml
[junit4] 2> 302417 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_31D5840E093BAE2-001/control-001/cores/collection1
[junit4] 2> 302421 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.e.j.s.Server jetty-9.2.13.v20150730
[junit4] 2> 302431 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6b005df9{/ns_jbn/f,null,AVAILABLE}
[junit4] 2> 302434 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.e.j.s.ServerConnector Started ServerConnector@6c0a9645{HTTP/1.1}{127.0.0.1:33288}
[junit4] 2> 302434 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.e.j.s.Server Started @305365ms
[junit4] 2> 302435 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_31D5840E093BAE2-001/tempDir-001/control/data, hostContext=/ns_jbn/f, hostPort=33288, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_31D5840E093BAE2-001/control-001/cores}
[junit4] 2> 302435 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 302435 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_31D5840E093BAE2-001/control-001/'
[junit4] 2> 302435 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 302435 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 302452 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 302452 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 302453 INFO (zkCallback-186-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3b26bd92 name:ZooKeeperConnection Watcher:127.0.0.1:56469/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 302454 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 302454 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 302455 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 302455 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_31D5840E093BAE2-001/control-001/solr.xml
[junit4] 2> 302460 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_31D5840E093BAE2-001/control-001/cores
[junit4] 2> 302460 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.CoreContainer New CoreContainer 452005108
[junit4] 2> 302460 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_31D5840E093BAE2-001/control-001/]
[junit4] 2> 302460 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_31D5840E093BAE2-001/control-001/lib
[junit4] 2> 302461 WARN (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_31D5840E093BAE2-001/control-001/lib).
[junit4] 2> 302468 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 302469 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 302469 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 302469 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 302469 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:56469/solr
[junit4] 2> 302470 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 302470 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 302471 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 302472 INFO (zkCallback-188-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5720d069 name:ZooKeeperConnection Watcher:127.0.0.1:56469 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 302472 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 302473 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 302479 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [n:127.0.0.1:33288_ns_jbn%2Ff ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 302486 INFO (zkCallback-189-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@50a76dde name:ZooKeeperConnection Watcher:127.0.0.1:56469/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 302486 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [n:127.0.0.1:33288_ns_jbn%2Ff ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 302487 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [n:127.0.0.1:33288_ns_jbn%2Ff ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
[junit4] 2> 302489 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [n:127.0.0.1:33288_ns_jbn%2Ff ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 302492 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [n:127.0.0.1:33288_ns_jbn%2Ff ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 302495 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [n:127.0.0.1:33288_ns_jbn%2Ff ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 302497 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [n:127.0.0.1:33288_ns_jbn%2Ff ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 302499 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [n:127.0.0.1:33288_ns_jbn%2Ff ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 302500 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [n:127.0.0.1:33288_ns_jbn%2Ff ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 302501 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [n:127.0.0.1:33288_ns_jbn%2Ff ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 302503 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [n:127.0.0.1:33288_ns_jbn%2Ff ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 302503 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [n:127.0.0.1:33288_ns_jbn%2Ff ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33288_ns_jbn%2Ff
[junit4] 2> 302504 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [n:127.0.0.1:33288_ns_jbn%2Ff ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:33288_ns_jbn%2Ff
[junit4] 2> 302505 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [n:127.0.0.1:33288_ns_jbn%2Ff ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 302507 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [n:127.0.0.1:33288_ns_jbn%2Ff ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 302508 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [n:127.0.0.1:33288_ns_jbn%2Ff ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 302508 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [n:127.0.0.1:33288_ns_jbn%2Ff ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94869123122462726-127.0.0.1:33288_ns_jbn%2Ff-n_0000000000
[junit4] 2> 302509 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [n:127.0.0.1:33288_ns_jbn%2Ff ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:33288_ns_jbn%2Ff
[junit4] 2> 302509 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [n:127.0.0.1:33288_ns_jbn%2Ff ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
[junit4] 2> 302510 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [n:127.0.0.1:33288_ns_jbn%2Ff ] o.a.s.c.Overseer Overseer (id=94869123122462726-127.0.0.1:33288_ns_jbn%2Ff-n_0000000000) starting
[junit4] 2> 302512 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [n:127.0.0.1:33288_ns_jbn%2Ff ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
[junit4] 2> 302517 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [n:127.0.0.1:33288_ns_jbn%2Ff ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 302518 INFO (OverseerCollectionConfigSetProcessor-94869123122462726-127.0.0.1:33288_ns_jbn%2Ff-n_0000000000) [n:127.0.0.1:33288_ns_jbn%2Ff ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
[junit4] 2> 302518 INFO (OverseerStateUpdate-94869123122462726-127.0.0.1:33288_ns_jbn%2Ff-n_0000000000) [n:127.0.0.1:33288_ns_jbn%2Ff ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 302519 INFO (OverseerStateUpdate-94869123122462726-127.0.0.1:33288_ns_jbn%2Ff-n_0000000000) [n:127.0.0.1:33288_ns_jbn%2Ff ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 302523 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [n:127.0.0.1:33288_ns_jbn%2Ff ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 302537 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [n:127.0.0.1:33288_ns_jbn%2Ff ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 302537 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [n:127.0.0.1:33288_ns_jbn%2Ff ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 302538 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [n:127.0.0.1:33288_ns_jbn%2Ff ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_31D5840E093BAE2-001/control-001/cores
[junit4] 2> 302539 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [n:127.0.0.1:33288_ns_jbn%2Ff ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_31D5840E093BAE2-001/control-001/cores/collection1, collection=control_collection, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_31D5840E093BAE2-001/control-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 302539 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [n:127.0.0.1:33288_ns_jbn%2Ff ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_31D5840E093BAE2-001/control-001/cores/collection1/
[junit4] 2> 302539 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [n:127.0.0.1:33288_ns_jbn%2Ff ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 302540 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [n:127.0.0.1:33288_ns_jbn%2Ff ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4] 2> 302540 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[31D5840E093BAE2]) [n:127.0.0.1:33288_ns_jbn%2Ff ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 302540 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 302540 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 302542 INFO (OverseerStateUpdate-94869123122462726-127.0.0.1:33288_ns_jbn%2Ff-n_0000000000) [n:127.0.0.1:33288_ns_jbn%2Ff ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:33288/ns_jbn/f",
[junit4] 2> "node_name":"127.0.0.1:33288_ns_jbn%2Ff",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 302542 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 302542 INFO (OverseerStateUpdate-94869123122462726-127.0.0.1:33288_ns_jbn%2Ff-n_0000000000) [n:127.0.0.1:33288_ns_jbn%2Ff ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:33288/ns_jbn/f",
[junit4] 2> "node_name":"127.0.0.1:33288_ns_jbn%2Ff",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 302543 INFO (OverseerStateUpdate-94869123122462726-127.0.0.1:33288_ns_jbn%2Ff-n_0000000000) [n:127.0.0.1:33288_ns_jbn%2Ff ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
[junit4] 2> 302543 INFO (OverseerStateUpdate-94869123122462726-127.0.0.1:33288_ns_jbn%2Ff-n_0000000000) [n:127.0.0.1:33288_ns_jbn%2Ff ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 302546 INFO (zkCallback-189-thread-2-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 302547 INFO (zkCallback-189-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 303543 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 303543 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
[junit4] 2> 303543 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 303543 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 303544 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 303544 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_31D5840E093BAE2-001/control-001/cores/collection1/'
[junit4] 2> 303544 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 303544 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 303558 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 303563 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 303567 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 303585 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
[junit4] 2> 303586 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 303591 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 303675 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 303683 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 303684 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 303702 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 303704 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 303706 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 303707 WARN (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 303707 WARN (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 303707 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 303708 WARN (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 303708 WARN (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 303709 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4] 2> 303709 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 303709 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 303709 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_31D5840E093BAE2-001/control-001/cores/collection1/], dataDir=[null]
[junit4] 2> 303710 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@d21cd44
[junit4] 2> 303710 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_31D5840E093BAE2-001/control-001/cores/collection1/data
[junit4] 2> 303710 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_31D5840E093BAE2-001/control-001/cores/collection1/data/index/
[junit4] 2> 303710 WARN (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_31D5840E093BAE2-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 303711 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_31D5840E093BAE2-001/control-001/cores/collection1/data/index
[junit4] 2> 303711 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=48, maxMergeAtOnceExplicit=16, maxMergedSegmentMB=90.1142578125, floorSegmentMB=0.3701171875, forceMergeDeletesPctAllowed=27.898467809230038, segmentsPerTier=39.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.2933434028564743
[junit4] 2> 303711 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=RawDirectoryWrapper(RAMDirectory@2eb3dd7e lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@33f3c1),segFN=segments_1,generation=1}
[junit4] 2> 303711 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 303712 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_31D5840E093BAE2-001/control-001/cores/collection1/data/
[junit4] 2> 303712 WARN (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_31D5840E093BAE2-001/control-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
[junit4] 2> 303716 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 303716 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
[junit4] 2> 303716 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 303717 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 303717 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 303717 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 303717 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 303717 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 303717 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 303718 WARN (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,args = {defaults={a=A,b=B}}}
[junit4] 2> 303719 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 303720 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 303721 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 303722 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 303726 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/dump,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 303726 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 303727 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 303727 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 303728 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
[junit4] 2> 303728 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
[junit4] 2> 303729 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=28, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5839907559182581]
[junit4] 2> 303729 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=RawDirectoryWrapper(RAMDirectory@2eb3dd7e lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@33f3c1),segFN=segments_1,generation=1}
[junit4] 2> 303729 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 303729 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@4e52797c[collection1] main
[junit4] 2> 303729 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 303730 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 303730 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 303731 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 303731 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
[junit4] 2> 303731 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 303733 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 303733 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 303739 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 303740 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 303740 INFO (searcherExecutor-646-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@4e52797c[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 303740 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
[junit4] 2> 303740 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
[junit4] 2> 303740 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
[junit4] 2> 303740 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1517905971872006144
[junit4] 2> 303743 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 2.0ms to seed version buckets with highest version 1517905971872006144
[junit4] 2> 303743 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
[junit4] 2> 303743 INFO (coreLoadExecutor-645-thread-1-processing-n:127.0.0.1:33288_ns_jbn%2Ff) [n:127.0.0.1:33288_ns_jbn%2Ff c
[...truncated too long message...]
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494)
[junit4] > 3) Thread[id=71236, name=zkCallback-3213-thread-2, state=TIMED_WAITING, group=TGRP-CdcrReplicationDistributedZkTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > 4) Thread[id=71238, name=zkCallback-3213-thread-4, state=TIMED_WAITING, group=TGRP-CdcrReplicationDistributedZkTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > 5) Thread[id=71212, name=zkCallback-3197-thread-3-processing-n:127.0.0.1:34793_n%2Fhk-SendThread(127.0.0.1:38032), state=TIMED_WAITING, group=TGRP-CdcrReplicationDistributedZkTest]
[junit4] > at java.lang.Thread.sleep(Native Method)
[junit4] > at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:940)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003)
[junit4] > 6) Thread[id=71237, name=zkCallback-3213-thread-3, state=TIMED_WAITING, group=TGRP-CdcrReplicationDistributedZkTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > at __randomizedtesting.SeedInfo.seed([31D5840E093BAE2]:0)Throwable #3: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
[junit4] > 1) Thread[id=71215, name=zkCallback-3213-thread-1, state=TIMED_WAITING, group=TGRP-CdcrReplicationDistributedZkTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > 2) Thread[id=71236, name=zkCallback-3213-thread-2, state=TIMED_WAITING, group=TGRP-CdcrReplicationDistributedZkTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > 3) Thread[id=71238, name=zkCallback-3213-thread-4, state=TIMED_WAITING, group=TGRP-CdcrReplicationDistributedZkTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > 4) Thread[id=71212, name=zkCallback-3197-thread-3-processing-n:127.0.0.1:34793_n%2Fhk-SendThread(127.0.0.1:38032), state=TIMED_WAITING, group=TGRP-CdcrReplicationDistributedZkTest]
[junit4] > at java.lang.Thread.sleep(Native Method)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:994)
[junit4] > 5) Thread[id=71237, name=zkCallback-3213-thread-3, state=TIMED_WAITING, group=TGRP-CdcrReplicationDistributedZkTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > at __randomizedtesting.SeedInfo.seed([31D5840E093BAE2]:0)
[junit4] Completed [443/558] on J0 in 967.14s, 11 tests, 1 failure, 2 errors <<< FAILURES!
[...truncated 359 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987: There were test failures: 558 suites (8 ignored), 2214 tests, 3 suite-level errors, 1 error, 1 failure, 428 ignored (18 assumptions) [seed: 31D5840E093BAE2]
Total time: 215 minutes 50 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 852 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/852/
1 tests failed.
FAILED: org.apache.lucene.index.TestIndexWriterExceptions.testNoLostDeletesOrUpdates
Error Message:
Captured an uncaught exception in thread: Thread[id=1299, name=Lucene Merge Thread #36, state=RUNNABLE, group=TGRP-TestIndexWriterExceptions]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=1299, name=Lucene Merge Thread #36, state=RUNNABLE, group=TGRP-TestIndexWriterExceptions]
Caused by: org.apache.lucene.index.MergePolicy$MergeException: java.lang.IllegalStateException: this writer hit an unrecoverable error; cannot merge
at __randomizedtesting.SeedInfo.seed([AFCCA3AE689042A4]:0)
at org.apache.lucene.index.ConcurrentMergeScheduler.handleMergeException(ConcurrentMergeScheduler.java:668)
at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:648)
Caused by: java.lang.IllegalStateException: this writer hit an unrecoverable error; cannot merge
at org.apache.lucene.index.IndexWriter._mergeInit(IndexWriter.java:3799)
at org.apache.lucene.index.IndexWriter.mergeInit(IndexWriter.java:3779)
at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3633)
at org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:588)
at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:626)
Caused by: org.apache.lucene.store.MockDirectoryWrapper$FakeIOException
at org.apache.lucene.index.TestIndexWriterExceptions$11.eval(TestIndexWriterExceptions.java:1918)
at org.apache.lucene.store.MockDirectoryWrapper.maybeThrowDeterministicException(MockDirectoryWrapper.java:994)
at org.apache.lucene.store.MockDirectoryWrapper.createOutput(MockDirectoryWrapper.java:553)
at org.apache.lucene.store.TrackingDirectoryWrapper.createOutput(TrackingDirectoryWrapper.java:43)
at org.apache.lucene.store.TrackingDirectoryWrapper.createOutput(TrackingDirectoryWrapper.java:43)
at org.apache.lucene.codecs.lucene54.Lucene54DocValuesConsumer.<init>(Lucene54DocValuesConsumer.java:73)
at org.apache.lucene.codecs.lucene54.Lucene54DocValuesFormat.fieldsConsumer(Lucene54DocValuesFormat.java:108)
at org.apache.lucene.codecs.asserting.AssertingDocValuesFormat.fieldsConsumer(AssertingDocValuesFormat.java:59)
at org.apache.lucene.codecs.perfield.PerFieldDocValuesFormat$FieldsWriter.getInstance(PerFieldDocValuesFormat.java:187)
at org.apache.lucene.codecs.perfield.PerFieldDocValuesFormat$FieldsWriter.addNumericField(PerFieldDocValuesFormat.java:111)
at org.apache.lucene.index.ReadersAndUpdates.handleNumericDVUpdates(ReadersAndUpdates.java:328)
at org.apache.lucene.index.ReadersAndUpdates.writeFieldUpdates(ReadersAndUpdates.java:521)
at org.apache.lucene.index.BufferedUpdatesStream.applyDeletesAndUpdates(BufferedUpdatesStream.java:266)
at org.apache.lucene.index.IndexWriter._mergeInit(IndexWriter.java:3821)
... 4 more
Build Log:
[...truncated 1066 lines...]
[junit4] Suite: org.apache.lucene.index.TestIndexWriterExceptions
[junit4] 2> stu 14, 2015 7:54:57 AM com.carrotsearch.randomizedtesting.RandomizedRunner$QueueUncaughtExceptionsHandler uncaughtException
[junit4] 2> WARNING: Uncaught exception in thread: Thread[Lucene Merge Thread #37,5,TGRP-TestIndexWriterExceptions]
[junit4] 2> org.apache.lucene.index.MergePolicy$MergeException: java.lang.IllegalStateException: this writer hit an unrecoverable error; cannot merge
[junit4] 2> at __randomizedtesting.SeedInfo.seed([AFCCA3AE689042A4]:0)
[junit4] 2> at org.apache.lucene.index.ConcurrentMergeScheduler.handleMergeException(ConcurrentMergeScheduler.java:668)
[junit4] 2> at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:648)
[junit4] 2> Caused by: java.lang.IllegalStateException: this writer hit an unrecoverable error; cannot merge
[junit4] 2> at org.apache.lucene.index.IndexWriter._mergeInit(IndexWriter.java:3799)
[junit4] 2> at org.apache.lucene.index.IndexWriter.mergeInit(IndexWriter.java:3779)
[junit4] 2> at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3633)
[junit4] 2> at org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:588)
[junit4] 2> at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:626)
[junit4] 2> Caused by: org.apache.lucene.store.MockDirectoryWrapper$FakeIOException
[junit4] 2> at org.apache.lucene.index.TestIndexWriterExceptions$11.eval(TestIndexWriterExceptions.java:1918)
[junit4] 2> at org.apache.lucene.store.MockDirectoryWrapper.maybeThrowDeterministicException(MockDirectoryWrapper.java:994)
[junit4] 2> at org.apache.lucene.store.MockDirectoryWrapper.createOutput(MockDirectoryWrapper.java:553)
[junit4] 2> at org.apache.lucene.store.TrackingDirectoryWrapper.createOutput(TrackingDirectoryWrapper.java:43)
[junit4] 2> at org.apache.lucene.store.TrackingDirectoryWrapper.createOutput(TrackingDirectoryWrapper.java:43)
[junit4] 2> at org.apache.lucene.codecs.lucene54.Lucene54DocValuesConsumer.<init>(Lucene54DocValuesConsumer.java:73)
[junit4] 2> at org.apache.lucene.codecs.lucene54.Lucene54DocValuesFormat.fieldsConsumer(Lucene54DocValuesFormat.java:108)
[junit4] 2> at org.apache.lucene.codecs.asserting.AssertingDocValuesFormat.fieldsConsumer(AssertingDocValuesFormat.java:59)
[junit4] 2> at org.apache.lucene.codecs.perfield.PerFieldDocValuesFormat$FieldsWriter.getInstance(PerFieldDocValuesFormat.java:187)
[junit4] 2> at org.apache.lucene.codecs.perfield.PerFieldDocValuesFormat$FieldsWriter.addNumericField(PerFieldDocValuesFormat.java:111)
[junit4] 2> at org.apache.lucene.index.ReadersAndUpdates.handleNumericDVUpdates(ReadersAndUpdates.java:328)
[junit4] 2> at org.apache.lucene.index.ReadersAndUpdates.writeFieldUpdates(ReadersAndUpdates.java:521)
[junit4] 2> at org.apache.lucene.index.BufferedUpdatesStream.applyDeletesAndUpdates(BufferedUpdatesStream.java:266)
[junit4] 2> at org.apache.lucene.index.IndexWriter._mergeInit(IndexWriter.java:3821)
[junit4] 2> ... 4 more
[junit4] 2>
[junit4] 2> stu 14, 2015 7:54:57 AM com.carrotsearch.randomizedtesting.RandomizedRunner$QueueUncaughtExceptionsHandler uncaughtException
[junit4] 2> WARNING: Uncaught exception in thread: Thread[Lucene Merge Thread #34,5,TGRP-TestIndexWriterExceptions]
[junit4] 2> org.apache.lucene.index.MergePolicy$MergeException: java.lang.IllegalStateException: this writer hit an unrecoverable error; cannot complete merge
[junit4] 2> at __randomizedtesting.SeedInfo.seed([AFCCA3AE689042A4]:0)
[junit4] 2> at org.apache.lucene.index.ConcurrentMergeScheduler.handleMergeException(ConcurrentMergeScheduler.java:668)
[junit4] 2> at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:648)
[junit4] 2> Caused by: java.lang.IllegalStateException: this writer hit an unrecoverable error; cannot complete merge
[junit4] 2> at org.apache.lucene.index.IndexWriter.commitMerge(IndexWriter.java:3448)
[junit4] 2> at org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4210)
[junit4] 2> at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3642)
[junit4] 2> at org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:588)
[junit4] 2> at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:626)
[junit4] 2> Caused by: org.apache.lucene.store.MockDirectoryWrapper$FakeIOException
[junit4] 2> at org.apache.lucene.index.TestIndexWriterExceptions$11.eval(TestIndexWriterExceptions.java:1918)
[junit4] 2> at org.apache.lucene.store.MockDirectoryWrapper.maybeThrowDeterministicException(MockDirectoryWrapper.java:994)
[junit4] 2> at org.apache.lucene.store.MockDirectoryWrapper.createOutput(MockDirectoryWrapper.java:553)
[junit4] 2> at org.apache.lucene.store.TrackingDirectoryWrapper.createOutput(TrackingDirectoryWrapper.java:43)
[junit4] 2> at org.apache.lucene.store.TrackingDirectoryWrapper.createOutput(TrackingDirectoryWrapper.java:43)
[junit4] 2> at org.apache.lucene.codecs.lucene54.Lucene54DocValuesConsumer.<init>(Lucene54DocValuesConsumer.java:73)
[junit4] 2> at org.apache.lucene.codecs.lucene54.Lucene54DocValuesFormat.fieldsConsumer(Lucene54DocValuesFormat.java:108)
[junit4] 2> at org.apache.lucene.codecs.asserting.AssertingDocValuesFormat.fieldsConsumer(AssertingDocValuesFormat.java:59)
[junit4] 2> at org.apache.lucene.codecs.perfield.PerFieldDocValuesFormat$FieldsWriter.getInstance(PerFieldDocValuesFormat.java:187)
[junit4] 2> at org.apache.lucene.codecs.perfield.PerFieldDocValuesFormat$FieldsWriter.addNumericField(PerFieldDocValuesFormat.java:111)
[junit4] 2> at org.apache.lucene.index.ReadersAndUpdates.handleNumericDVUpdates(ReadersAndUpdates.java:328)
[junit4] 2> at org.apache.lucene.index.ReadersAndUpdates.writeFieldUpdates(ReadersAndUpdates.java:521)
[junit4] 2> at org.apache.lucene.index.BufferedUpdatesStream.applyDeletesAndUpdates(BufferedUpdatesStream.java:266)
[junit4] 2> at org.apache.lucene.index.IndexWriter._mergeInit(IndexWriter.java:3821)
[junit4] 2> at org.apache.lucene.index.IndexWriter.mergeInit(IndexWriter.java:3779)
[junit4] 2> at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3633)
[junit4] 2> ... 2 more
[junit4] 2>
[junit4] 2> stu 14, 2015 7:54:57 AM com.carrotsearch.randomizedtesting.RandomizedRunner$QueueUncaughtExceptionsHandler uncaughtException
[junit4] 2> WARNING: Uncaught exception in thread: Thread[Lucene Merge Thread #36,5,TGRP-TestIndexWriterExceptions]
[junit4] 2> org.apache.lucene.index.MergePolicy$MergeException: java.lang.IllegalStateException: this writer hit an unrecoverable error; cannot merge
[junit4] 2> at __randomizedtesting.SeedInfo.seed([AFCCA3AE689042A4]:0)
[junit4] 2> at org.apache.lucene.index.ConcurrentMergeScheduler.handleMergeException(ConcurrentMergeScheduler.java:668)
[junit4] 2> at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:648)
[junit4] 2> Caused by: java.lang.IllegalStateException: this writer hit an unrecoverable error; cannot merge
[junit4] 2> at org.apache.lucene.index.IndexWriter._mergeInit(IndexWriter.java:3799)
[junit4] 2> at org.apache.lucene.index.IndexWriter.mergeInit(IndexWriter.java:3779)
[junit4] 2> at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3633)
[junit4] 2> at org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:588)
[junit4] 2> at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:626)
[junit4] 2> Caused by: org.apache.lucene.store.MockDirectoryWrapper$FakeIOException
[junit4] 2> at org.apache.lucene.index.TestIndexWriterExceptions$11.eval(TestIndexWriterExceptions.java:1918)
[junit4] 2> at org.apache.lucene.store.MockDirectoryWrapper.maybeThrowDeterministicException(MockDirectoryWrapper.java:994)
[junit4] 2> at org.apache.lucene.store.MockDirectoryWrapper.createOutput(MockDirectoryWrapper.java:553)
[junit4] 2> at org.apache.lucene.store.TrackingDirectoryWrapper.createOutput(TrackingDirectoryWrapper.java:43)
[junit4] 2> at org.apache.lucene.store.TrackingDirectoryWrapper.createOutput(TrackingDirectoryWrapper.java:43)
[junit4] 2> at org.apache.lucene.codecs.lucene54.Lucene54DocValuesConsumer.<init>(Lucene54DocValuesConsumer.java:73)
[junit4] 2> at org.apache.lucene.codecs.lucene54.Lucene54DocValuesFormat.fieldsConsumer(Lucene54DocValuesFormat.java:108)
[junit4] 2> at org.apache.lucene.codecs.asserting.AssertingDocValuesFormat.fieldsConsumer(AssertingDocValuesFormat.java:59)
[junit4] 2> at org.apache.lucene.codecs.perfield.PerFieldDocValuesFormat$FieldsWriter.getInstance(PerFieldDocValuesFormat.java:187)
[junit4] 2> at org.apache.lucene.codecs.perfield.PerFieldDocValuesFormat$FieldsWriter.addNumericField(PerFieldDocValuesFormat.java:111)
[junit4] 2> at org.apache.lucene.index.ReadersAndUpdates.handleNumericDVUpdates(ReadersAndUpdates.java:328)
[junit4] 2> at org.apache.lucene.index.ReadersAndUpdates.writeFieldUpdates(ReadersAndUpdates.java:521)
[junit4] 2> at org.apache.lucene.index.BufferedUpdatesStream.applyDeletesAndUpdates(BufferedUpdatesStream.java:266)
[junit4] 2> at org.apache.lucene.index.IndexWriter._mergeInit(IndexWriter.java:3821)
[junit4] 2> ... 4 more
[junit4] 2>
[junit4] 2> stu 14, 2015 7:54:57 AM com.carrotsearch.randomizedtesting.RandomizedRunner$QueueUncaughtExceptionsHandler uncaughtException
[junit4] 2> WARNING: Uncaught exception in thread: Thread[Lucene Merge Thread #35,5,TGRP-TestIndexWriterExceptions]
[junit4] 2> org.apache.lucene.index.MergePolicy$MergeException: org.apache.lucene.store.MockDirectoryWrapper$FakeIOException
[junit4] 2> at __randomizedtesting.SeedInfo.seed([AFCCA3AE689042A4]:0)
[junit4] 2> at org.apache.lucene.index.ConcurrentMergeScheduler.handleMergeException(ConcurrentMergeScheduler.java:668)
[junit4] 2> at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:648)
[junit4] 2> Caused by: org.apache.lucene.store.MockDirectoryWrapper$FakeIOException
[junit4] 2> at org.apache.lucene.index.TestIndexWriterExceptions$11.eval(TestIndexWriterExceptions.java:1918)
[junit4] 2> at org.apache.lucene.store.MockDirectoryWrapper.maybeThrowDeterministicException(MockDirectoryWrapper.java:994)
[junit4] 2> at org.apache.lucene.store.MockDirectoryWrapper.createOutput(MockDirectoryWrapper.java:553)
[junit4] 2> at org.apache.lucene.store.TrackingDirectoryWrapper.createOutput(TrackingDirectoryWrapper.java:43)
[junit4] 2> at org.apache.lucene.store.TrackingDirectoryWrapper.createOutput(TrackingDirectoryWrapper.java:43)
[junit4] 2> at org.apache.lucene.codecs.lucene54.Lucene54DocValuesConsumer.<init>(Lucene54DocValuesConsumer.java:73)
[junit4] 2> at org.apache.lucene.codecs.lucene54.Lucene54DocValuesFormat.fieldsConsumer(Lucene54DocValuesFormat.java:108)
[junit4] 2> at org.apache.lucene.codecs.asserting.AssertingDocValuesFormat.fieldsConsumer(AssertingDocValuesFormat.java:59)
[junit4] 2> at org.apache.lucene.codecs.perfield.PerFieldDocValuesFormat$FieldsWriter.getInstance(PerFieldDocValuesFormat.java:187)
[junit4] 2> at org.apache.lucene.codecs.perfield.PerFieldDocValuesFormat$FieldsWriter.addNumericField(PerFieldDocValuesFormat.java:111)
[junit4] 2> at org.apache.lucene.index.ReadersAndUpdates.handleNumericDVUpdates(ReadersAndUpdates.java:328)
[junit4] 2> at org.apache.lucene.index.ReadersAndUpdates.writeFieldUpdates(ReadersAndUpdates.java:521)
[junit4] 2> at org.apache.lucene.index.BufferedUpdatesStream.applyDeletesAndUpdates(BufferedUpdatesStream.java:266)
[junit4] 2> at org.apache.lucene.index.IndexWriter._mergeInit(IndexWriter.java:3821)
[junit4] 2> at org.apache.lucene.index.IndexWriter.mergeInit(IndexWriter.java:3779)
[junit4] 2> at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3633)
[junit4] 2> at org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:588)
[junit4] 2> at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:626)
[junit4] 2>
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestIndexWriterExceptions -Dtests.method=testNoLostDeletesOrUpdates -Dtests.seed=AFCCA3AE689042A4 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=hr_HR -Dtests.timezone=Antarctica/Palmer -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] ERROR 8.35s J1 | TestIndexWriterExceptions.testNoLostDeletesOrUpdates <<<
[junit4] > Throwable #1: java.lang.AssertionError: expected:<8559> but was:<8084>
[junit4] > at org.apache.lucene.index.TestIndexWriterExceptions.testNoLostDeletesOrUpdates(TestIndexWriterExceptions.java:2073)
[junit4] > at java.lang.Thread.run(Thread.java:745)Throwable #2: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=1299, name=Lucene Merge Thread #36, state=RUNNABLE, group=TGRP-TestIndexWriterExceptions]
[junit4] > Caused by: org.apache.lucene.index.MergePolicy$MergeException: java.lang.IllegalStateException: this writer hit an unrecoverable error; cannot merge
[junit4] > at __randomizedtesting.SeedInfo.seed([AFCCA3AE689042A4]:0)
[junit4] > at org.apache.lucene.index.ConcurrentMergeScheduler.handleMergeException(ConcurrentMergeScheduler.java:668)
[junit4] > at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:648)
[junit4] > Caused by: java.lang.IllegalStateException: this writer hit an unrecoverable error; cannot merge
[junit4] > at org.apache.lucene.index.IndexWriter._mergeInit(IndexWriter.java:3799)
[junit4] > at org.apache.lucene.index.IndexWriter.mergeInit(IndexWriter.java:3779)
[junit4] > at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3633)
[junit4] > at org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:588)
[junit4] > at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:626)
[junit4] > Caused by: org.apache.lucene.store.MockDirectoryWrapper$FakeIOException
[junit4] > at org.apache.lucene.index.TestIndexWriterExceptions$11.eval(TestIndexWriterExceptions.java:1918)
[junit4] > at org.apache.lucene.store.MockDirectoryWrapper.maybeThrowDeterministicException(MockDirectoryWrapper.java:994)
[junit4] > at org.apache.lucene.store.MockDirectoryWrapper.createOutput(MockDirectoryWrapper.java:553)
[junit4] > at org.apache.lucene.store.TrackingDirectoryWrapper.createOutput(TrackingDirectoryWrapper.java:43)
[junit4] > at org.apache.lucene.store.TrackingDirectoryWrapper.createOutput(TrackingDirectoryWrapper.java:43)
[junit4] > at org.apache.lucene.codecs.lucene54.Lucene54DocValuesConsumer.<init>(Lucene54DocValuesConsumer.java:73)
[junit4] > at org.apache.lucene.codecs.lucene54.Lucene54DocValuesFormat.fieldsConsumer(Lucene54DocValuesFormat.java:108)
[junit4] > at org.apache.lucene.codecs.asserting.AssertingDocValuesFormat.fieldsConsumer(AssertingDocValuesFormat.java:59)
[junit4] > at org.apache.lucene.codecs.perfield.PerFieldDocValuesFormat$FieldsWriter.getInstance(PerFieldDocValuesFormat.java:187)
[junit4] > at org.apache.lucene.codecs.perfield.PerFieldDocValuesFormat$FieldsWriter.addNumericField(PerFieldDocValuesFormat.java:111)
[junit4] > at org.apache.lucene.index.ReadersAndUpdates.handleNumericDVUpdates(ReadersAndUpdates.java:328)
[junit4] > at org.apache.lucene.index.ReadersAndUpdates.writeFieldUpdates(ReadersAndUpdates.java:521)
[junit4] > at org.apache.lucene.index.BufferedUpdatesStream.applyDeletesAndUpdates(BufferedUpdatesStream.java:266)
[junit4] > at org.apache.lucene.index.IndexWriter._mergeInit(IndexWriter.java:3821)
[junit4] > ... 4 moreThrowable #3: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=1297, name=Lucene Merge Thread #34, state=RUNNABLE, group=TGRP-TestIndexWriterExceptions]
[junit4] > Caused by: org.apache.lucene.index.MergePolicy$MergeException: java.lang.IllegalStateException: this writer hit an unrecoverable error; cannot complete merge
[junit4] > at __randomizedtesting.SeedInfo.seed([AFCCA3AE689042A4]:0)
[junit4] > at org.apache.lucene.index.ConcurrentMergeScheduler.handleMergeException(ConcurrentMergeScheduler.java:668)
[junit4] > at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:648)
[junit4] > Caused by: java.lang.IllegalStateException: this writer hit an unrecoverable error; cannot complete merge
[junit4] > at org.apache.lucene.index.IndexWriter.commitMerge(IndexWriter.java:3448)
[junit4] > at org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4210)
[junit4] > at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3642)
[junit4] > at org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:588)
[junit4] > at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:626)
[junit4] > Caused by: org.apache.lucene.store.MockDirectoryWrapper$FakeIOException
[junit4] > at org.apache.lucene.index.TestIndexWriterExceptions$11.eval(TestIndexWriterExceptions.java:1918)
[junit4] > at org.apache.lucene.store.MockDirectoryWrapper.maybeThrowDeterministicException(MockDirectoryWrapper.java:994)
[junit4] > at org.apache.lucene.store.MockDirectoryWrapper.createOutput(MockDirectoryWrapper.java:553)
[junit4] > at org.apache.lucene.store.TrackingDirectoryWrapper.createOutput(TrackingDirectoryWrapper.java:43)
[junit4] > at org.apache.lucene.store.TrackingDirectoryWrapper.createOutput(TrackingDirectoryWrapper.java:43)
[junit4] > at org.apache.lucene.codecs.lucene54.Lucene54DocValuesConsumer.<init>(Lucene54DocValuesConsumer.java:73)
[junit4] > at org.apache.lucene.codecs.lucene54.Lucene54DocValuesFormat.fieldsConsumer(Lucene54DocValuesFormat.java:108)
[junit4] > at org.apache.lucene.codecs.asserting.AssertingDocValuesFormat.fieldsConsumer(AssertingDocValuesFormat.java:59)
[junit4] > at org.apache.lucene.codecs.perfield.PerFieldDocValuesFormat$FieldsWriter.getInstance(PerFieldDocValuesFormat.java:187)
[junit4] > at org.apache.lucene.codecs.perfield.PerFieldDocValuesFormat$FieldsWriter.addNumericField(PerFieldDocValuesFormat.java:111)
[junit4] > at org.apache.lucene.index.ReadersAndUpdates.handleNumericDVUpdates(ReadersAndUpdates.java:328)
[junit4] > at org.apache.lucene.index.ReadersAndUpdates.writeFieldUpdates(ReadersAndUpdates.java:521)
[junit4] > at org.apache.lucene.index.BufferedUpdatesStream.applyDeletesAndUpdates(BufferedUpdatesStream.java:266)
[junit4] > at org.apache.lucene.index.IndexWriter._mergeInit(IndexWriter.java:3821)
[junit4] > at org.apache.lucene.index.IndexWriter.mergeInit(IndexWriter.java:3779)
[junit4] > at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3633)
[junit4] > ... 2 moreThrowable #4: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=1300, name=Lucene Merge Thread #37, state=RUNNABLE, group=TGRP-TestIndexWriterExceptions]
[junit4] > Caused by: org.apache.lucene.index.MergePolicy$MergeException: java.lang.IllegalStateException: this writer hit an unrecoverable error; cannot merge
[junit4] > at __randomizedtesting.SeedInfo.seed([AFCCA3AE689042A4]:0)
[junit4] > at org.apache.lucene.index.ConcurrentMergeScheduler.handleMergeException(ConcurrentMergeScheduler.java:668)
[junit4] > at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:648)
[junit4] > Caused by: java.lang.IllegalStateException: this writer hit an unrecoverable error; cannot merge
[junit4] > at org.apache.lucene.index.IndexWriter._mergeInit(IndexWriter.java:3799)
[junit4] > at org.apache.lucene.index.IndexWriter.mergeInit(IndexWriter.java:3779)
[junit4] > at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3633)
[junit4] > at org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:588)
[junit4] > at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:626)
[junit4] > Caused by: org.apache.lucene.store.MockDirectoryWrapper$FakeIOException
[junit4] > at org.apache.lucene.index.TestIndexWriterExceptions$11.eval(TestIndexWriterExceptions.java:1918)
[junit4] > at org.apache.lucene.store.MockDirectoryWrapper.maybeThrowDeterministicException(MockDirectoryWrapper.java:994)
[junit4] > at org.apache.lucene.store.MockDirectoryWrapper.createOutput(MockDirectoryWrapper.java:553)
[junit4] > at org.apache.lucene.store.TrackingDirectoryWrapper.createOutput(TrackingDirectoryWrapper.java:43)
[junit4] > at org.apache.lucene.store.TrackingDirectoryWrapper.createOutput(TrackingDirectoryWrapper.java:43)
[junit4] > at org.apache.lucene.codecs.lucene54.Lucene54DocValuesConsumer.<init>(Lucene54DocValuesConsumer.java:73)
[junit4] > at org.apache.lucene.codecs.lucene54.Lucene54DocValuesFormat.fieldsConsumer(Lucene54DocValuesFormat.java:108)
[junit4] > at org.apache.lucene.codecs.asserting.AssertingDocValuesFormat.fieldsConsumer(AssertingDocValuesFormat.java:59)
[junit4] > at org.apache.lucene.codecs.perfield.PerFieldDocValuesFormat$FieldsWriter.getInstance(PerFieldDocValuesFormat.java:187)
[junit4] > at org.apache.lucene.codecs.perfield.PerFieldDocValuesFormat$FieldsWriter.addNumericField(PerFieldDocValuesFormat.java:111)
[junit4] > at org.apache.lucene.index.ReadersAndUpdates.handleNumericDVUpdates(ReadersAndUpdates.java:328)
[junit4] > at org.apache.lucene.index.ReadersAndUpdates.writeFieldUpdates(ReadersAndUpdates.java:521)
[junit4] > at org.apache.lucene.index.BufferedUpdatesStream.applyDeletesAndUpdates(BufferedUpdatesStream.java:266)
[junit4] > at org.apache.lucene.index.IndexWriter._mergeInit(IndexWriter.java:3821)
[junit4] > ... 4 moreThrowable #5: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=1298, name=Lucene Merge Thread #35, state=RUNNABLE, group=TGRP-TestIndexWriterExceptions]
[junit4] > Caused by: org.apache.lucene.index.MergePolicy$MergeException: org.apache.lucene.store.MockDirectoryWrapper$FakeIOException
[junit4] > at __randomizedtesting.SeedInfo.seed([AFCCA3AE689042A4]:0)
[junit4] > at org.apache.lucene.index.ConcurrentMergeScheduler.handleMergeException(ConcurrentMergeScheduler.java:668)
[junit4] > at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:648)
[junit4] > Caused by: org.apache.lucene.store.MockDirectoryWrapper$FakeIOException
[junit4] > at org.apache.lucene.index.TestIndexWriterExceptions$11.eval(TestIndexWriterExceptions.java:1918)
[junit4] > at org.apache.lucene.store.MockDirectoryWrapper.maybeThrowDeterministicException(MockDirectoryWrapper.java:994)
[junit4] > at org.apache.lucene.store.MockDirectoryWrapper.createOutput(MockDirectoryWrapper.java:553)
[junit4] > at org.apache.lucene.store.TrackingDirectoryWrapper.createOutput(TrackingDirectoryWrapper.java:43)
[junit4] > at org.apache.lucene.store.TrackingDirectoryWrapper.createOutput(TrackingDirectoryWrapper.java:43)
[junit4] > at org.apache.lucene.codecs.lucene54.Lucene54DocValuesConsumer.<init>(Lucene54DocValuesConsumer.java:73)
[junit4] > at org.apache.lucene.codecs.lucene54.Lucene54DocValuesFormat.fieldsConsumer(Lucene54DocValuesFormat.java:108)
[junit4] > at org.apache.lucene.codecs.asserting.AssertingDocValuesFormat.fieldsConsumer(AssertingDocValuesFormat.java:59)
[junit4] > at org.apache.lucene.codecs.perfield.PerFieldDocValuesFormat$FieldsWriter.getInstance(PerFieldDocValuesFormat.java:187)
[junit4] > at org.apache.lucene.codecs.perfield.PerFieldDocValuesFormat$FieldsWriter.addNumericField(PerFieldDocValuesFormat.java:111)
[junit4] > at org.apache.lucene.index.ReadersAndUpdates.handleNumericDVUpdates(ReadersAndUpdates.java:328)
[junit4] > at org.apache.lucene.index.ReadersAndUpdates.writeFieldUpdates(ReadersAndUpdates.java:521)
[junit4] > at org.apache.lucene.index.BufferedUpdatesStream.applyDeletesAndUpdates(BufferedUpdatesStream.java:266)
[junit4] > at org.apache.lucene.index.IndexWriter._mergeInit(IndexWriter.java:3821)
[junit4] > at org.apache.lucene.index.IndexWriter.mergeInit(IndexWriter.java:3779)
[junit4] > at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3633)
[junit4] > at org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:588)
[junit4] > at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:626)
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/core/test/J1/temp/lucene.index.TestIndexWriterExceptions_AFCCA3AE689042A4-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene60), sim=RandomSimilarityProvider(queryNorm=false,coord=crazy): {content6=DFR I(ne)L2, field=IB LL-D1, content4=DFR I(F)L3(800.0), contents=DFR I(ne)2, content2=IB LL-DZ(0.3), content1=DFR I(F)L2, id=DFR I(n)B3(800.0), content=DFR GB3(800.0)}, locale=hr_HR, timezone=Antarctica/Palmer
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_66 (64-bit)/cpus=4,threads=1,free=66461328,total=346030080
[junit4] 2> NOTE: All tests run in this JVM: [TestPackedInts, TestScorerPerf, TestIndexWriterDeleteByQuery, TestDuelingCodecs, TestSegmentInfos, TestDocBoost, TestLevenshteinAutomata, TestPayloads, TestDocumentsWriterStallControl, TestTrackingDirectoryWrapper, TestControlledRealTimeReopenThread, TestDocValues, TestFlushByRamOrCountsPolicy, TestSpanSearchEquivalence, TestQueryCachingPolicy, TestMultiPhraseEnum, TestFieldsReader, TestFlex, TestTopFieldCollector, TestExceedMaxTermLength, TestRAMDirectory, TestHugeRamFile, TestLogMergePolicy, TestSegmentMerger, Test2BSortedDocValuesOrds, TestRateLimiter, TestAddIndexes, TestNotDocIdSet, TestSimpleExplanationsOfNonMatches, TestAutomatonQueryUnicode, TestBasics, TestPrefixQuery, TestLucene50FieldInfoFormat, TestTerm, TestSegmentTermEnum, TestFieldMaskingSpanQuery, TestCollectionUtil, TestRecyclingByteBlockAllocator, TestSpanCollection, TestDocInverterPerFieldErrorInfo, TestGrowableByteArrayDataOutput, TestNoMergeScheduler, TestPhrasePrefixQuery, TestSimilarityProvider, TestDuelingCodecsAtNight, TestSimilarity, TestClassicSimilarity, TestFilterSpans, TestDocument, TestSpanNotQuery, TestBoostQuery, TestIntsRef, TestSpanFirstQuery, TestSnapshotDeletionPolicy, TestReusableStringReader, TestSpanTermQuery, TestStressDeletes, TestBooleanQueryVisitSubscorers, TestDocsAndPositions, TestDocumentsWriterDeleteQueue, TestOmitNorms, TestIOUtils, TestIndexWriterExceptions]
[junit4] Completed [196/401] on J1 in 504.28s, 36 tests, 1 error <<< FAILURES!
[...truncated 679 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build.xml:50: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987: There were test failures: 401 suites (1 ignored), 3291 tests, 1 error, 26 ignored (22 assumptions) [seed: AFCCA3AE689042A4]
Total time: 63 minutes 36 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 851 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/851/
1 tests failed.
FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test
Error Message:
No registered leader was found after waiting for 30000ms , collection: halfdeletedcollection2 slice: shard1
Stack Trace:
org.apache.solr.common.SolrException: No registered leader was found after waiting for 30000ms , collection: halfdeletedcollection2 slice: shard1
at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:637)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.deleteCollectionWithDownNodes(CollectionsAPIDistributedZkTest.java:259)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test(CollectionsAPIDistributedZkTest.java:163)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1660)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:866)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:902)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:916)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:963)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:938)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:875)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:777)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:811)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:822)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 10440 lines...]
[junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_8D1F5EBE10978A1F-001/init-core-data-001
[junit4] 2> 1709405 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[8D1F5EBE10978A1F]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
[junit4] 2> 1709406 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[8D1F5EBE10978A1F]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
[junit4] 2> 1709408 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1709408 INFO (Thread-4024) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1709408 INFO (Thread-4024) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1709508 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.ZkTestServer start zk server on port:36367
[junit4] 2> 1709509 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1709509 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1709512 INFO (zkCallback-1534-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7ba03227 name:ZooKeeperConnection Watcher:127.0.0.1:36367 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1709512 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1709512 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1709512 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 1709515 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1709515 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1709516 INFO (zkCallback-1535-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@31f6e84c name:ZooKeeperConnection Watcher:127.0.0.1:36367/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1709516 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1709516 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1709516 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
[junit4] 2> 1709518 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
[junit4] 2> 1709520 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
[junit4] 2> 1709521 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
[junit4] 2> 1709522 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 1709522 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 1709525 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 1709525 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
[junit4] 2> 1709526 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1709527 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1709528 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 1709528 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
[junit4] 2> 1709529 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 1709530 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
[junit4] 2> 1709531 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 1709531 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
[junit4] 2> 1709532 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 1709533 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 1709534 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1709534 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 1709535 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1709536 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1709537 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 1709537 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 1709538 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 1709539 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
[junit4] 2> 1709835 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_8D1F5EBE10978A1F-001/control-001/cores/collection1
[junit4] 2> 1709836 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.e.j.s.Server jetty-9.2.13.v20150730
[junit4] 2> 1709838 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@51d54158{/,null,AVAILABLE}
[junit4] 2> 1709840 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.e.j.s.ServerConnector Started ServerConnector@71120089{HTTP/1.1}{127.0.0.1:53653}
[junit4] 2> 1709840 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.e.j.s.Server Started @1712746ms
[junit4] 2> 1709841 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_8D1F5EBE10978A1F-001/tempDir-001/control/data, hostContext=/, hostPort=53653, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_8D1F5EBE10978A1F-001/control-001/cores}
[junit4] 2> 1709841 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 1709841 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_8D1F5EBE10978A1F-001/control-001/'
[junit4] 2> 1709841 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1709841 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 1709856 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1709856 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1709857 INFO (zkCallback-1536-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@27a3616c name:ZooKeeperConnection Watcher:127.0.0.1:36367/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1709857 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1709858 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1709858 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1709859 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_8D1F5EBE10978A1F-001/control-001/solr.xml
[junit4] 2> 1709863 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_8D1F5EBE10978A1F-001/control-001/cores
[junit4] 2> 1709863 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.CoreContainer New CoreContainer 966657209
[junit4] 2> 1709863 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_8D1F5EBE10978A1F-001/control-001/]
[junit4] 2> 1709863 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_8D1F5EBE10978A1F-001/control-001/lib
[junit4] 2> 1709863 WARN (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_8D1F5EBE10978A1F-001/control-001/lib).
[junit4] 2> 1709870 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 1709871 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1709872 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1709872 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1709872 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36367/solr
[junit4] 2> 1709872 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 1709872 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1709873 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1709874 INFO (zkCallback-1538-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@266405ab name:ZooKeeperConnection Watcher:127.0.0.1:36367 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1709874 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1709874 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1709875 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [n:127.0.0.1:53653_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1709876 INFO (zkCallback-1539-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@8e94b12 name:ZooKeeperConnection Watcher:127.0.0.1:36367/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1709876 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [n:127.0.0.1:53653_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1709877 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [n:127.0.0.1:53653_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
[junit4] 2> 1709879 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [n:127.0.0.1:53653_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 1709881 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [n:127.0.0.1:53653_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 1709883 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [n:127.0.0.1:53653_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 1709884 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [n:127.0.0.1:53653_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 1709886 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [n:127.0.0.1:53653_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 1709887 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [n:127.0.0.1:53653_ ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 1709888 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [n:127.0.0.1:53653_ ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 1709889 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [n:127.0.0.1:53653_ ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 1709890 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [n:127.0.0.1:53653_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53653_
[junit4] 2> 1709890 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [n:127.0.0.1:53653_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:53653_
[junit4] 2> 1709891 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [n:127.0.0.1:53653_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 1709892 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [n:127.0.0.1:53653_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 1709893 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [n:127.0.0.1:53653_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1709894 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [n:127.0.0.1:53653_ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94859149466402820-127.0.0.1:53653_-n_0000000000
[junit4] 2> 1709894 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [n:127.0.0.1:53653_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:53653_
[junit4] 2> 1709894 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [n:127.0.0.1:53653_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
[junit4] 2> 1709895 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [n:127.0.0.1:53653_ ] o.a.s.c.Overseer Overseer (id=94859149466402820-127.0.0.1:53653_-n_0000000000) starting
[junit4] 2> 1709896 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [n:127.0.0.1:53653_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
[junit4] 2> 1709901 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [n:127.0.0.1:53653_ ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 1709901 INFO (OverseerCollectionConfigSetProcessor-94859149466402820-127.0.0.1:53653_-n_0000000000) [n:127.0.0.1:53653_ ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
[junit4] 2> 1709901 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [n:127.0.0.1:53653_ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 1709902 INFO (OverseerStateUpdate-94859149466402820-127.0.0.1:53653_-n_0000000000) [n:127.0.0.1:53653_ ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 1709925 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [n:127.0.0.1:53653_ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 1709925 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [n:127.0.0.1:53653_ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 1709926 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [n:127.0.0.1:53653_ ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_8D1F5EBE10978A1F-001/control-001/cores
[junit4] 2> 1709926 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [n:127.0.0.1:53653_ ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_8D1F5EBE10978A1F-001/control-001/cores/collection1, collection=control_collection, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_8D1F5EBE10978A1F-001/control-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 1709926 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [n:127.0.0.1:53653_ ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_8D1F5EBE10978A1F-001/control-001/cores/collection1/
[junit4] 2> 1709927 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [n:127.0.0.1:53653_ ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 1709928 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [n:127.0.0.1:53653_ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2
[junit4] 2> 1709928 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [n:127.0.0.1:53653_ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 1709928 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 1709928 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 1709929 INFO (OverseerStateUpdate-94859149466402820-127.0.0.1:53653_-n_0000000000) [n:127.0.0.1:53653_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:53653",
[junit4] 2> "node_name":"127.0.0.1:53653_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 1709929 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 1709930 INFO (OverseerStateUpdate-94859149466402820-127.0.0.1:53653_-n_0000000000) [n:127.0.0.1:53653_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:53653",
[junit4] 2> "node_name":"127.0.0.1:53653_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 1709930 INFO (OverseerStateUpdate-94859149466402820-127.0.0.1:53653_-n_0000000000) [n:127.0.0.1:53653_ ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
[junit4] 2> 1709930 INFO (OverseerStateUpdate-94859149466402820-127.0.0.1:53653_-n_0000000000) [n:127.0.0.1:53653_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 1709931 INFO (zkCallback-1539-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1710930 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 1710930 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
[junit4] 2> 1710931 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 1710931 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 1710932 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1710932 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_8D1F5EBE10978A1F-001/control-001/cores/collection1/'
[junit4] 2> 1710932 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1710933 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 1710949 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 1710953 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 1710956 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 1710964 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1710965 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 1710969 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 1711060 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 1711066 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 1711067 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 1711074 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 1711076 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 1711077 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1711078 WARN (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 1711078 WARN (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 1711078 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1711079 WARN (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 1711079 WARN (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 1711080 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2
[junit4] 2> 1711080 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 1711080 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1711080 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_8D1F5EBE10978A1F-001/control-001/cores/collection1/], dataDir=[null]
[junit4] 2> 1711080 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@223ae7dd
[junit4] 2> 1711081 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_8D1F5EBE10978A1F-001/control-001/cores/collection1/data
[junit4] 2> 1711081 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_8D1F5EBE10978A1F-001/control-001/cores/collection1/data/index/
[junit4] 2> 1711081 WARN (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_8D1F5EBE10978A1F-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1711081 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_8D1F5EBE10978A1F-001/control-001/cores/collection1/data/index
[junit4] 2> 1711081 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=35, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7895336299700465]
[junit4] 2> 1711082 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1feaad5f lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@37b46fe2),segFN=segments_1,generation=1}
[junit4] 2> 1711082 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 1711082 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_8D1F5EBE10978A1F-001/control-001/cores/collection1/data/
[junit4] 2> 1711082 WARN (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_8D1F5EBE10978A1F-001/control-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
[junit4] 2> 1711085 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1711085 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1711085 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1711085 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1711085 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1711085 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1711086 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1711086 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1711086 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1711086 WARN (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,args = {defaults={a=A,b=B}}}
[junit4] 2> 1711087 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1711088 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1711089 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1711090 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1711093 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/dump,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 1711093 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 1711093 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1711093 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1711094 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
[junit4] 2> 1711094 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
[junit4] 2> 1711094 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=39, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=0.5556640625, noCFSRatio=0.32724945874590033]
[junit4] 2> 1711095 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1feaad5f lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@37b46fe2),segFN=segments_1,generation=1}
[junit4] 2> 1711095 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 1711095 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@781a15e4[collection1] main
[junit4] 2> 1711095 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 1711096 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1711096 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 1711096 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1711096 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
[junit4] 2> 1711096 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1711097 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 1711097 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1711097 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 1711097 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 1711097 INFO (searcherExecutor-4229-thread-1-processing-n:127.0.0.1:53653_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@781a15e4[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1711098 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
[junit4] 2> 1711098 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
[junit4] 2> 1711098 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
[junit4] 2> 1711098 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1517746393232441344
[junit4] 2> 1711100 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 2.0ms to seed version buckets with highest version 1517746393232441344
[junit4] 2> 1711100 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
[junit4] 2> 1711100 INFO (coreLoadExecutor-4228-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 1711100 INFO (coreZkRegister-4222-thread-1-processing-n:127.0.0.1:53653_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:53653 collection:control_collection shard:shard1
[junit4] 2> 1711101 INFO (coreZkRegister-4222-thread-1-processing-n:127.0.0.1:53653_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 1711104 INFO (coreZkRegister-4222-thread-1-processing-n:127.0.0.1:53653_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/94859149466402820-core_node1-n_0000000000
[junit4] 2> 1711104 INFO (coreZkRegister-4222-thread-1-processing-n:127.0.0.1:53653_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1
[junit4] 2> 1711105 INFO (coreZkRegister-4222-thread-1-processing-n:127.0.0.1:53653_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1711106 INFO (coreZkRegister-4222-thread-1-processing-n:127.0.0.1:53653_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1711106 INFO (coreZkRegister-4222-thread-1-processing-n:127.0.0.1:53653_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:53653/collection1/
[junit4] 2> 1711106 INFO (coreZkRegister-4222-thread-1-processing-n:127.0.0.1:53653_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1711106 INFO (coreZkRegister-4222-thread-1-processing-n:127.0.0.1:53653_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:53653/collection1/ has no replicas
[junit4] 2> 1711106 INFO (OverseerStateUpdate-94859149466402820-127.0.0.1:53653_-n_0000000000) [n:127.0.0.1:53653_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection"} current state version: 1
[junit4] 2> 1711106 INFO (coreZkRegister-4222-thread-1-processing-n:127.0.0.1:53653_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 1711108 INFO (coreZkRegister-4222-thread-1-processing-n:127.0.0.1:53653_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
[junit4] 2> 1711110 INFO (coreZkRegister-4222-thread-1-processing-n:127.0.0.1:53653_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:53653/collection1/ shard1
[junit4] 2> 1711110 INFO (OverseerStateUpdate-94859149466402820-127.0.0.1:53653_-n_0000000000) [n:127.0.0.1:53653_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:53653",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 1
[junit4] 2> 1711212 INFO (zkCallback-1539-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1711261 INFO (coreZkRegister-4222-thread-1-processing-n:127.0.0.1:53653_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:53653/collection1/ and leader is http://127.0.0.1:53653/collection1/
[junit4] 2> 1711261 INFO (coreZkRegister-4222-thread-1-processing-n:127.0.0.1:53653_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:53653
[junit4] 2> 1711261 INFO (coreZkRegister-4222-thread-1-processing-n:127.0.0.1:53653_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1711261 INFO (coreZkRegister-4222-thread-1-processing-n:127.0.0.1:53653_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
[junit4] 2> 1711261 INFO (coreZkRegister-4222-thread-1-processing-n:127.0.0.1:53653_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:53653_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 1711263 INFO (OverseerStateUpdate-94859149466402820-127.0.0.1:53653_-n_0000000000) [n:127.0.0.1:53653_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:53653",
[junit4] 2> "node_name":"127.0.0.1:53653_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 2
[junit4] 2> 1711263 INFO (OverseerStateUpdate-94859149466402820-127.0.0.1:53653_-n_0000000000) [n:127.0.0.1:53653_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:53653",
[junit4] 2> "node_name":"127.0.0.1:53653_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 1711365 INFO (zkCallback-1539-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1711429 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1711430 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1711431 INFO (zkCallback-1541-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5fd11fbd name:ZooKeeperConnection Watcher:127.0.0.1:36367/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1711431 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1711431 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1711431 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 1711433 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 1711741 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_8D1F5EBE10978A1F-001/shard-1-001/cores/collection1
[junit4] 2> 1711742 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_8D1F5EBE10978A1F-001/shard-1-001
[junit4] 2> 1711743 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.e.j.s.Server jetty-9.2.13.v20150730
[junit4] 2> 1711744 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7d34cdc3{/,null,AVAILABLE}
[junit4] 2> 1711745 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.e.j.s.ServerConnector Started ServerConnector@314197a0{HTTP/1.1}{127.0.0.1:44725}
[junit4] 2> 1711745 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.e.j.s.Server Started @1714650ms
[junit4] 2> 1711745 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_8D1F5EBE10978A1F-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/, hostPort=44725, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_8D1F5EBE10978A1F-001/shard-1-001/cores}
[junit4] 2> 1711745 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 1711745 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_8D1F5EBE10978A1F-001/shard-1-001/'
[junit4] 2> 1711745 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1711745 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 1711759 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1711760 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1711761 INFO (zkCallback-1542-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6297edbb name:ZooKeeperConnection Watcher:127.0.0.1:36367/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1711761 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1711761 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1711762 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1711762 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_8D1F5EBE10978A1F-001/shard-1-001/solr.xml
[junit4] 2> 1711766 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_8D1F5EBE10978A1F-001/shard-1-001/cores
[junit4] 2> 1711767 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.CoreContainer New CoreContainer 440940465
[junit4] 2> 1711767 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_8D1F5EBE10978A1F-001/shard-1-001/]
[junit4] 2> 1711767 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_8D1F5EBE10978A1F-001/shard-1-001/lib
[junit4] 2> 1711767 WARN (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_8D1F5EBE10978A1F-001/shard-1-001/lib).
[junit4] 2> 1711774 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 1711776 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1711776 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1711776 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1711776 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36367/solr
[junit4] 2> 1711777 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 1711777 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1711780 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1711780 INFO (zkCallback-1544-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3136dfc6 name:ZooKeeperConnection Watcher:127.0.0.1:36367 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1711781 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1711781 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1711783 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [n:127.0.0.1:44725_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1711783 INFO (zkCallback-1545-thread-1-processing-n:127.0.0.1:44725_) [n:127.0.0.1:44725_ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5e02d7a7 name:ZooKeeperConnection Watcher:127.0.0.1:36367/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1711783 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [n:127.0.0.1:44725_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1711788 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [n:127.0.0.1:44725_ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 1712792 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [n:127.0.0.1:44725_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44725_
[junit4] 2> 1712793 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [n:127.0.0.1:44725_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:44725_
[junit4] 2> 1712794 INFO (zkCallback-1541-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1712794 INFO (zkCallback-1539-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1712794 INFO (zkCallback-1545-thread-1-processing-n:127.0.0.1:44725_) [n:127.0.0.1:44725_ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1712795 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [n:127.0.0.1:44725_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1712796 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [n:127.0.0.1:44725_ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94859149466402824-127.0.0.1:44725_-n_0000000001
[junit4] 2> 1712796 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [n:127.0.0.1:44725_ ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/94859149466402820-127.0.0.1:53653_-n_0000000000 to know if I could be the leader
[junit4] 2> 1712807 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [n:127.0.0.1:44725_ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 1712807 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [n:127.0.0.1:44725_ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 1712808 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [n:127.0.0.1:44725_ ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_8D1F5EBE10978A1F-001/shard-1-001/cores
[junit4] 2> 1712809 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [n:127.0.0.1:44725_ ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_8D1F5EBE10978A1F-001/shard-1-001/cores/collection1, collection=collection1, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_8D1F5EBE10978A1F-001/shard-1-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 1712809 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [n:127.0.0.1:44725_ ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_8D1F5EBE10978A1F-001/shard-1-001/cores/collection1/
[junit4] 2> 1712809 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [n:127.0.0.1:44725_ ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 1712810 INFO (coreLoadExecutor-4239-thread-1-processing-n:127.0.0.1:44725_) [n:127.0.0.1:44725_ c:collection1 x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 1712810 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [n:127.0.0.1:44725_ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2
[junit4] 2> 1712810 INFO (coreLoadExecutor-4239-thread-1-processing-n:127.0.0.1:44725_) [n:127.0.0.1:44725_ c:collection1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 1712810 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[8D1F5EBE10978A1F]) [n:127.0.0.1:44725_ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 1712812 INFO (OverseerStateUpdate-94859149466402820-127.0.0.1:53653_-n_0000000000) [n:127.0.0.1:53653_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:44725",
[junit4] 2> "node_name":"127.0.0.1:44725_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"} current state version: 3
[junit4] 2> 1712812 INFO (coreLoadExecutor-4239-thread-1-processing-n:127.0.0.1:44725_) [n:127.0.0.1:44725_ c:collection1 x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 1712812 INFO (OverseerStateUpdate-94859149466402820-127.0.0.1:53653_-n_0000000000) [n:127.0.0.1:53653_ ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:44725",
[junit4] 2> "node_name":"127.0.0.1:44725_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"}
[junit4] 2> 1712812 INFO (OverseerStateUpdate-94859149466402820-127.0.0.1:53653_-n_0000000000) [n:127.0.0.1:53653_ ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
[junit4] 2> 1712812 INFO (OverseerStateUpdate-94859149466402820-127.0.0.1:53653_-n_0000000000) [n:127.0.0.1:53653_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2
[junit4] 2> 1712918 INFO (zkCallback-1541-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1712918 INFO (zkCallback-1545-thread-1-processing-n:127.0.0.1:44725_) [n:127.0.0.1:44725_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1712919 INFO (zkCallback-1539-thread-1-processing-n:127.0.0.1:53653_) [n:127.0.0.1:53653_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1713813 INFO (coreLoadExecutor-4239-thread-1-processing-n:127.0.0.1:44725_) [n:127.0.0.1:44725_ c:collection1 x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 1713813 INFO (coreLoadExecutor-4239-thread-1-processing-n:127.0.0.1:44725_) [n:127.0.0.1:44725_ c:collection1 x:collection1] o.a.s.c.ZkController Check for collection zkNode:collection1
[junit4] 2> 1713813 INFO (coreLoadExecutor-4239-thread-1-processing-n:127.0.0.1:44725_) [n:127.0.0.1:44725_ c:collection1 x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 1713813 INFO (coreLoadExecutor-4239-thread-1-processing-n:127.0.0.1:44725_) [n:127.0.0.1:44725_ c:collection1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/collection1
[junit4] 2> 1713814 INFO (coreLoadExecutor-4239-thread-1-processing-n:127.0.0.1:44725_) [n:127.0.0.1:44725_ c:collection1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1713814 INFO (coreLoadExecutor-4239-thread-1-processing-n:127.0.0.1:44725_) [n:127.0.0.1:44725_ c:collection1 x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_8D1F5EBE10978A1F-001/shard-1-001/cores/collection1/'
[junit4] 2> 1713814 INFO (coreLoadExecutor-4239-thread-1-processing-n:127.0.0.1:44725_) [n:127.0.0.1:44725_ c:collection1 x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1713814 INFO (coreLoadExecutor-4239-thread-1-processing-n:127.0.0.1:44725_) [n:127.0.0.1:44725_ c:collection1 x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 1713826 INFO (coreLoadExecutor-4239-thread-1-processing-n:127.0.0.1:44725_) [n:127.0.0.1:44725_ c:collection1 x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 1713831 INFO (coreLoadExecutor-4239-thread-1-processing-n:127.0.0.1:44725_) [n:127.0.0.1:44725_ c:collection1 x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 1713834 INFO (coreLoadExecutor-4239-thread-1-processing-n:127.0.0.1:44725_) [n:127.0.0.1:44725_ c:collection1 x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 1713854 INFO (coreLoadExecutor-4239-thread-1-processing-n:127.0.0.1:44725_) [n:127.0.0.1:44725_ c:collection1 x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1713855 INFO (coreLoadExecutor-4239-thread-1-processing-n:127.0.0.1:44725_) [n:127.0.0.1:44725_ c:collection1 x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 1713859 INFO (coreLoadExecutor-4239-thread-1-processing-n:127.0.0.1:44725_) [n:127.0.0.1:44725_ c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 1713947 INFO (coreLoadExecutor-4239-thread-1-processing-n:127.0.0.1:44725_) [n:127.0.0.1:44725_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 1713955 INFO (coreLoadExecutor-4239-thread-1-processing-n:127.0.0.1:44725_) [n:127.0.0.1:44725_ c:collection1 x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 1713957 INFO (coreLoadExecutor-4239-thread-1-processing-n:127.0.0.1:44725_) [n:127.0.0.1:44725_ c:collection1 x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 1713966 INFO (coreLoadExecutor-4239-thread-1-processing-n:127.0.0.1:44725_) [n:127.0.0.1:44725_ c:collection1 x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 1713969 INFO (coreLoadExecutor-4239-thread-1-processing-n:127.0.0.1:44725_) [n:127.0.0.1:44725_ c:collection1 x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 1713971 INFO (coreLoadExecutor-4239-thread-1-processing-n:127.0.0.1:44725_) [n:127.0.0.1:44725_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1713972 WARN (coreLoadExecutor-4239-thread-1-processing-n:127.0.0.1:44725_) [n:127.0.0.1:44725_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 1713972 WARN (coreLoadExecutor-4239-thread-1-processing-n:127.0.0.1:44725_) [n:127.0.0.1:44725_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 1713972 INFO (coreLoadExecutor-4239-thread-1-processing-n:127.0.0.1:44725_) [n:127.0.0.1:44725_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1713973 WARN (coreLoadExecutor-4239-thread-1-processing-n:127.0.0.1:44725_) [n:127.0.0.1:44725_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 1713973 WARN (coreLoadExecutor-4239-thread-1-processing-n:127.0.0.1:44725_) [n:127.0.0.1:44725_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 1713974 INFO (coreLoadExecutor-4239-thread-1-processing-n:127.0.0.1:44725_) [n:127.0.0.1:44725_ c:collection1 x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2
[junit4] 2> 1713974 INFO (coreLoadExecutor-4239-thread-1-processing-n:127.0.0.1:44725_) [n:127.0.0.1:44725_ c:collection1 x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 1713974 INFO (coreLoadExecutor-4239-thread-1-processing-n:127.0.0.1:44725_) [n:127.0.0.1:44725_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1713974 INFO (coreLoadExecutor-4239-thread-1-processing-n:127.0.0.1:44725_) [n:127.0.0.1:44725_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_8D1F5EBE10978A1F-001/shard-1-001/cores/collection1/], dataDir=[null]
[junit4] 2> 1713974 INFO (coreLoadExecutor-4239-thread-1-processing-n:127.0.0.1:44725_) [n:127.0.0.1:44725_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@223ae7dd
[junit4] 2> 1713975 INFO (coreLoadExecutor-4239-thread-1-processing-n:127.0.0.1:44725_) [n:127.0.0.1:44725_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/
[...truncated too long message...]
lrClient.java:372)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
[junit4] > at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1573)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1594)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:876)Throwable #6: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=11296, name=collection5, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:35715: collection already exists: awholynewstresscollection_collection5_0
[junit4] > at __randomizedtesting.SeedInfo.seed([8D1F5EBE10978A1F]:0)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
[junit4] > at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1573)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1594)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:876)Throwable #7: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=11294, name=collection3, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:35715: collection already exists: awholynewstresscollection_collection3_0
[junit4] > at __randomizedtesting.SeedInfo.seed([8D1F5EBE10978A1F]:0)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
[junit4] > at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1573)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1594)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:876)
[junit4] 2> 1969859 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[8D1F5EBE10978A1F]-worker) [n:127.0.0.1:39210_ c:awholynewstresscollection_collection3_0 s:shard5 r:core_node19 x:awholynewstresscollection_collection3_0_shard5_replica3] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_8D1F5EBE10978A1F-001
[junit4] 2> Nov 13, 2015 5:33:32 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene60): {other_tl1=PostingsFormat(name=Direct), range_facet_l_dv=PostingsFormat(name=Memory doPackFST= true), _version_=PostingsFormat(name=Direct), multiDefault=Lucene50(blocksize=128), a_t=Lucene50(blocksize=128), intDefault=PostingsFormat(name=Direct), a_i1=Lucene50(blocksize=128), id=PostingsFormat(name=Memory doPackFST= true), range_facet_i_dv=Lucene50(blocksize=128), text=PostingsFormat(name=LuceneFixedGap), range_facet_l=Lucene50(blocksize=128), timestamp=Lucene50(blocksize=128)}, docValues:{range_facet_l_dv=DocValuesFormat(name=Asserting), range_facet_i_dv=DocValuesFormat(name=Lucene54), timestamp=DocValuesFormat(name=Lucene54)}, sim=RandomSimilarityProvider(queryNorm=true,coord=yes): {}, locale=sl_SI, timezone=Africa/Lubumbashi
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_66 (64-bit)/cpus=4,threads=1,free=145954864,total=502267904
[junit4] 2> NOTE: All tests run in this JVM: [TestReversedWildcardFilterFactory, TestManagedSynonymFilterFactory, TestConfigSetsAPI, AutoCommitTest, FullSolrCloudDistribCmdsTest, SpatialRPTFieldTypeTest, TestPostingsSolrHighlighter, TestSearchPerf, TestNRTOpen, DocExpirationUpdateProcessorFactoryTest, FieldAnalysisRequestHandlerTest, BitVectorTest, TestRestoreCore, HdfsLockFactoryTest, CollectionReloadTest, TestCryptoKeys, BinaryUpdateRequestHandlerTest, ScriptEngineTest, TestStressRecovery, TestCrossCoreJoin, TestSolrQueryParserResource, TestPHPSerializedResponseWriter, SolrCoreCheckLockOnStartupTest, FacetPivotSmallTest, TestManagedSchema, DistributedFacetPivotWhiteBoxTest, DistanceUnitsTest, TestMiniSolrCloudCluster, SharedFSAutoReplicaFailoverTest, HighlighterConfigTest, TestReloadAndDeleteDocs, DirectSolrConnectionTest, DistribDocExpirationUpdateProcessorTest, OverseerTest, ShardSplitTest, TestJmxIntegration, CursorPagingTest, SearchHandlerTest, TestSchemaManager, SliceStateTest, TestIndexingPerformance, PreAnalyzedUpdateProcessorTest, TestObjectReleaseTracker, TestConfigSetsAPIExclusivity, RecoveryZkTest, TestSolrDeletionPolicy1, BasicDistributedZk2Test, BadIndexSchemaTest, CachingDirectoryFactoryTest, TestSchemaSimilarityResource, SampleTest, CoreAdminRequestStatusTest, TestConfigSets, TestSQLHandler, TestShortCircuitedRequests, TestScoreJoinQPScore, HdfsNNFailoverTest, TestHighFrequencyDictionaryFactory, TestRTimerTree, CircularListTest, TestRuleBasedAuthorizationPlugin, TestRecovery, ClusterStateTest, TestDefaultStatsCache, TestPerFieldSimilarity, TestQueryWrapperFilter, TestGroupingSearch, TestDistribDocBasedVersion, TestExclusionRuleCollectionAccess, TestStressReorder, IgnoreCommitOptimizeUpdateProcessorFactoryTest, TestSolrXml, TestNoOpRegenerator, CustomCollectionTest, TestFastWriter, TestConfigOverlay, TestSolr4Spatial2, TestXIncludeConfig, LukeRequestHandlerTest, PluginInfoTest, SaslZkACLProviderTest, TestSort, TestCloudSchemaless, TestCharFilters, TestFilteredDocIdSet, TestReplicationHandlerBackup, DistributedQueueTest, TestCopyFieldCollectionResource, ChaosMonkeySafeLeaderTest, UnloadDistributedZkTest, CollectionsAPIDistributedZkTest]
[junit4] Completed [266/558] on J2 in 260.74s, 1 test, 1 error <<< FAILURES!
[...truncated 940 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987: There were test failures: 558 suites (8 ignored), 2214 tests, 1 error, 32 ignored (18 assumptions) [seed: 8D1F5EBE10978A1F]
Total time: 194 minutes 23 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 850 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/850/
2 tests failed.
FAILED: org.apache.lucene.index.TestIndexWriterDelete.testDeletesOnDiskFull
Error Message:
Test abandoned because suite timeout was reached.
Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
at __randomizedtesting.SeedInfo.seed([1B924C7595D9712]:0)
FAILED: junit.framework.TestSuite.org.apache.lucene.index.TestIndexWriterDelete
Error Message:
Suite timeout exceeded (>= 7200000 msec).
Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
at __randomizedtesting.SeedInfo.seed([1B924C7595D9712]:0)
Build Log:
[...truncated 1875 lines...]
[junit4] Suite: org.apache.lucene.index.TestIndexWriterDelete
[junit4] 2> Nov 13, 2015 12:31:14 AM com.carrotsearch.randomizedtesting.ThreadLeakControl$2 evaluate
[junit4] 2> WARNING: Suite execution timed out: org.apache.lucene.index.TestIndexWriterDelete
[junit4] 2> 1) Thread[id=9, name=JUnit4-serializer-daemon, state=TIMED_WAITING, group=main]
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at com.carrotsearch.ant.tasks.junit4.events.Serializer$1.run(Serializer.java:47)
[junit4] 2> 2) Thread[id=11173, name=SUITE-TestIndexWriterDelete-seed#[1B924C7595D9712], state=RUNNABLE, group=TGRP-TestIndexWriterDelete]
[junit4] 2> at java.lang.Thread.getStackTrace(Thread.java:1552)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$4.run(ThreadLeakControl.java:688)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$4.run(ThreadLeakControl.java:685)
[junit4] 2> at java.security.AccessController.doPrivileged(Native Method)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.getStackTrace(ThreadLeakControl.java:685)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.getThreadsWithTraces(ThreadLeakControl.java:701)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.formatThreadStacksFull(ThreadLeakControl.java:681)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.access$1000(ThreadLeakControl.java:64)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$2.evaluate(ThreadLeakControl.java:414)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:678)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.access$200(RandomizedRunner.java:141)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:588)
[junit4] 2> 3) Thread[id=11174, name=TEST-TestIndexWriterDelete.testDeletesOnDiskFull-seed#[1B924C7595D9712], state=TIMED_WAITING, group=TGRP-TestIndexWriterDelete]
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at org.apache.lucene.store.SlowClosingMockIndexInputWrapper.close(SlowClosingMockIndexInputWrapper.java:40)
[junit4] 2> at org.apache.lucene.index.IndexWriter.slowFileExists(IndexWriter.java:4771)
[junit4] 2> at org.apache.lucene.index.IndexWriter.filesExist(IndexWriter.java:4312)
[junit4] 2> at org.apache.lucene.index.IndexWriter.<init>(IndexWriter.java:940)
[junit4] 2> at org.apache.lucene.index.TestIndexWriterDelete.doTestOperationsOnDiskFull(TestIndexWriterDelete.java:536)
[junit4] 2> at org.apache.lucene.index.TestIndexWriterDelete.testDeletesOnDiskFull(TestIndexWriterDelete.java:482)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:497)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1660)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:866)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:902)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:916)
[junit4] 2> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4] 2> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:875)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:777)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:811)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:822)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 4) Thread[id=1, name=main, state=WAITING, group=main]
[junit4] 2> at java.lang.Object.wait(Native Method)
[junit4] 2> at java.lang.Thread.join(Thread.java:1245)
[junit4] 2> at java.lang.Thread.join(Thread.java:1319)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:598)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.run(RandomizedRunner.java:447)
[junit4] 2> at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.execute(SlaveMain.java:244)
[junit4] 2> at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.main(SlaveMain.java:355)
[junit4] 2> at com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe.main(SlaveMainSafe.java:10)
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestIndexWriterDelete -Dtests.method=testDeletesOnDiskFull -Dtests.seed=1B924C7595D9712 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=de -Dtests.timezone=Antarctica/DumontDUrville -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[junit4] ERROR 7199s J2 | TestIndexWriterDelete.testDeletesOnDiskFull <<<
[junit4] > Throwable #1: java.lang.Exception: Test abandoned because suite timeout was reached.
[junit4] > at __randomizedtesting.SeedInfo.seed([1B924C7595D9712]:0)
[junit4] 2> Nov 13, 2015 12:31:14 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> Nov 13, 2015 12:31:34 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> SEVERE: 1 thread leaked from SUITE scope at org.apache.lucene.index.TestIndexWriterDelete:
[junit4] 2> 1) Thread[id=11174, name=TEST-TestIndexWriterDelete.testDeletesOnDiskFull-seed#[1B924C7595D9712], state=TIMED_WAITING, group=TGRP-TestIndexWriterDelete]
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at org.apache.lucene.store.SlowClosingMockIndexInputWrapper.close(SlowClosingMockIndexInputWrapper.java:40)
[junit4] 2> at org.apache.lucene.store.Directory.copyFrom(Directory.java:158)
[junit4] 2> at org.apache.lucene.util.TestUtil.ramCopyOf(TestUtil.java:1273)
[junit4] 2> at org.apache.lucene.index.TestIndexWriterDelete.doTestOperationsOnDiskFull(TestIndexWriterDelete.java:527)
[junit4] 2> at org.apache.lucene.index.TestIndexWriterDelete.testDeletesOnDiskFull(TestIndexWriterDelete.java:482)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:497)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1660)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:866)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:902)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:916)
[junit4] 2> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4] 2> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:875)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:777)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:811)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:822)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> Nov 13, 2015 12:31:34 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> INFO: Starting to interrupt leaked threads:
[junit4] 2> 1) Thread[id=11174, name=TEST-TestIndexWriterDelete.testDeletesOnDiskFull-seed#[1B924C7595D9712], state=RUNNABLE, group=TGRP-TestIndexWriterDelete]
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/core/test/J2/temp/lucene.index.TestIndexWriterDelete_1B924C7595D9712-001
[junit4] 2> Nov 12, 2015 2:31:34 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> INFO: All leaked threads terminated.
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene60): {id=FST50, content=BlockTreeOrds(blocksize=128)}, docValues:{dv=DocValuesFormat(name=Direct)}, sim=ClassicSimilarity, locale=de, timezone=Antarctica/DumontDUrville
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_66 (64-bit)/cpus=4,threads=1,free=179406824,total=281542656
[junit4] 2> NOTE: All tests run in this JVM: [TestBytesRef, TestSort, TestTotalHitCountCollector, TestCrashCausesCorruptIndex, TestFastDecompressionMode, Test2BTerms, TestReaderWrapperDVTypeCheck, TestMultiMMap, TestNumericDocValuesUpdates, TestWildcard, TestNumericTokenStream, TestCharTermAttributeImpl, TestTermsEnum2, TestArrayUtil, TestReaderClosed, TestTieredMergePolicy, TestForceMergeForever, TestLongBitSet, TestPayloadsOnVectors, TestIndexWriterOnJRECrash, TestFastCompressionMode, TestTragicIndexWriterDeadlock, TestReadOnlyIndex, TestForUtil, TestTermVectorsReader, TestSpans, TestCustomSearcherSort, TestConcurrentMergeScheduler, TestMultiTermQueryRewrites, TestNRTThreads, TestTimSorter, TestRollback, TestDateTools, TestMaxPosition, TestConjunctionDISI, TestLiveFieldValues, TestRecyclingIntBlockAllocator, TestBooleanOr, TestCheckIndex, TestDateSort, TestIndexableField, TestLRUQueryCache, TestFuzzyQuery, TestTermVectors, TestUsageTrackingFilterCachingPolicy, TestTopDocsMerge, Test2BPositions, TestFixedBitDocIdSet, TestCachingCollector, TestMultiThreadTermVectors, TestNumericRangeQuery32, TestSmallFloat, TestMultiCollector, TestOrdinalMap, TestSimpleAttributeImpl, TestMergeRateLimiter, TestCloseableThreadLocal, TestDimensionalRangeQuery, TestIndexInput, TestBinaryDocValuesUpdates, TestExternalCodecs, TestMergedIterator, TestRegexpRandom2, TestDirectoryReader, TestTransactions, TestAllFilesHaveChecksumFooter, FiniteStringsIteratorTest, TestAddIndexes, TestDeletionPolicy, TestBasics, TestFlushByRamOrCountsPolicy, TestSloppyPhraseQuery, TestIndexWriterDelete]
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestIndexWriterDelete -Dtests.seed=1B924C7595D9712 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=de -Dtests.timezone=Antarctica/DumontDUrville -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[junit4] ERROR 0.00s J2 | TestIndexWriterDelete (suite) <<<
[junit4] > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
[junit4] > at __randomizedtesting.SeedInfo.seed([1B924C7595D9712]:0)
[junit4] Completed [401/401] on J2 in 7220.21s, 3 tests, 2 errors <<< FAILURES!
[...truncated 12 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build.xml:50: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987: There were test failures: 401 suites (1 ignored), 3267 tests, 1 suite-level error, 1 error, 27 ignored (23 assumptions) [seed: 1B924C7595D9712]
Total time: 148 minutes 56 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 849 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/849/
1 tests failed.
FAILED: org.apache.solr.core.TestArbitraryIndexDir.testLoadNewIndexDir
Error Message:
Exception during query
Stack Trace:
java.lang.RuntimeException: Exception during query
at __randomizedtesting.SeedInfo.seed([3C8DF2D38AD7E76:EA926415A634EEDE]:0)
at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:766)
at org.apache.solr.core.TestArbitraryIndexDir.testLoadNewIndexDir(TestArbitraryIndexDir.java:128)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1660)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:866)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:902)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:875)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:777)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:811)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:822)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: REQUEST FAILED: xpath=*[count(//doc)=1]
xml response was: <?xml version="1.0" encoding="UTF-8"?>
<response>
<lst name="responseHeader"><int name="status">0</int><int name="QTime">0</int></lst><result name="response" numFound="0" start="0"></result>
</response>
request was:q=id:2&qt=standard&start=0&rows=20&version=2.2
at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:759)
... 40 more
Build Log:
[...truncated 10899 lines...]
[junit4] Suite: org.apache.solr.core.TestArbitraryIndexDir
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestArbitraryIndexDir_3C8DF2D38AD7E76-001/init-core-data-001
[junit4] 2> 2731542 INFO (SUITE-TestArbitraryIndexDir-seed#[3C8DF2D38AD7E76]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
[junit4] 2> 2731544 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testLoadNewIndexDir
[junit4] 2> 2731544 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/'
[junit4] 2> 2731544 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2731544 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 2731545 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/lib/.svn/' to classloader
[junit4] 2> 2731545 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
[junit4] 2> 2731545 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/lib/README' to classloader
[junit4] 2> 2731568 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ ] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 2731576 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 2731594 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ ] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2731595 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ ] o.a.s.s.IndexSchema Reading Solr Schema from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema12.xml
[junit4] 2> 2731599 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ ] o.a.s.s.IndexSchema [null] Schema name=test
[junit4] 2> 2731666 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ ] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 2731667 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ ] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 2731667 WARN (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ ] o.a.s.s.IndexSchema Field text is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 2731686 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ ] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 2731688 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ ] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 2731689 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2731689 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 2731689 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 'solr/'
[junit4] 2> 2731690 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2731690 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 2731690 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ ] o.a.s.c.CoreContainer New CoreContainer 1825860317
[junit4] 2> 2731690 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=solr/]
[junit4] 2> 2731690 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/solr/lib
[junit4] 2> 2731690 WARN (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/solr/lib).
[junit4] 2> 2731704 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 600000,connTimeout : 60000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 2731709 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=30000&connTimeout=30000&retry=true
[junit4] 2> 2731710 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2731710 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2731710 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 2731710 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 2731711 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema12.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=collection1, collection=collection1, absoluteInstDir=solr/collection1/, dataDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestArbitraryIndexDir_3C8DF2D38AD7E76-001/tempDir-001, shard=shard1}
[junit4] 2> 2731712 INFO (coreLoadExecutor-4512-thread-1) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 'solr/collection1/'
[junit4] 2> 2731713 INFO (coreLoadExecutor-4512-thread-1) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2731713 INFO (coreLoadExecutor-4512-thread-1) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 2731747 INFO (coreLoadExecutor-4512-thread-1) [ ] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 2731759 INFO (coreLoadExecutor-4512-thread-1) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 2731790 INFO (coreLoadExecutor-4512-thread-1) [ ] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2731792 INFO (coreLoadExecutor-4512-thread-1) [ ] o.a.s.s.IndexSchema Reading Solr Schema from solr/collection1/conf/schema12.xml
[junit4] 2> 2731798 INFO (coreLoadExecutor-4512-thread-1) [ ] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 2731879 INFO (coreLoadExecutor-4512-thread-1) [ ] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 2731880 INFO (coreLoadExecutor-4512-thread-1) [ ] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 2731880 WARN (coreLoadExecutor-4512-thread-1) [ ] o.a.s.s.IndexSchema Field text is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 2731893 INFO (coreLoadExecutor-4512-thread-1) [ ] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 2731897 INFO (coreLoadExecutor-4512-thread-1) [ ] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 2731901 INFO (coreLoadExecutor-4512-thread-1) [ ] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/solr/collection1/conf'
[junit4] 2> 2731902 INFO (coreLoadExecutor-4512-thread-1) [ ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir solr/collection1/
[junit4] 2> 2731902 INFO (coreLoadExecutor-4512-thread-1) [ x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockFSDirectoryFactory
[junit4] 2> 2731902 INFO (coreLoadExecutor-4512-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [solr/collection1/], dataDir=[null]
[junit4] 2> 2731902 INFO (coreLoadExecutor-4512-thread-1) [ x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@163d5552
[junit4] 2> 2731903 INFO (coreLoadExecutor-4512-thread-1) [ x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestArbitraryIndexDir_3C8DF2D38AD7E76-001/tempDir-001
[junit4] 2> 2731903 INFO (coreLoadExecutor-4512-thread-1) [ x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestArbitraryIndexDir_3C8DF2D38AD7E76-001/tempDir-001/index/
[junit4] 2> 2731903 WARN (coreLoadExecutor-4512-thread-1) [ x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestArbitraryIndexDir_3C8DF2D38AD7E76-001/tempDir-001/index' doesn't exist. Creating new index...
[junit4] 2> 2731904 INFO (coreLoadExecutor-4512-thread-1) [ x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestArbitraryIndexDir_3C8DF2D38AD7E76-001/tempDir-001/index
[junit4] 2> 2731904 INFO (coreLoadExecutor-4512-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@7fc28108
[junit4] 2> 2731908 INFO (coreLoadExecutor-4512-thread-1) [ x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(SimpleFSDirectory@/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestArbitraryIndexDir_3C8DF2D38AD7E76-001/tempDir-001/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@6b32fc9),segFN=segments_1,generation=1}
[junit4] 2> 2731908 INFO (coreLoadExecutor-4512-thread-1) [ x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 2731912 INFO (coreLoadExecutor-4512-thread-1) [ x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
[junit4] 2> 2731912 INFO (coreLoadExecutor-4512-thread-1) [ x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2731912 INFO (coreLoadExecutor-4512-thread-1) [ x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe-allfields"
[junit4] 2> 2731912 INFO (coreLoadExecutor-4512-thread-1) [ x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4] 2> 2731913 INFO (coreLoadExecutor-4512-thread-1) [ x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 2731913 INFO (coreLoadExecutor-4512-thread-1) [ x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2731913 INFO (coreLoadExecutor-4512-thread-1) [ x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "uniq-fields"
[junit4] 2> 2731913 INFO (coreLoadExecutor-4512-thread-1) [ x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4] 2> 2731913 INFO (coreLoadExecutor-4512-thread-1) [ x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 2731913 INFO (coreLoadExecutor-4512-thread-1) [ x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2731913 INFO (coreLoadExecutor-4512-thread-1) [ x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2731913 INFO (coreLoadExecutor-4512-thread-1) [ x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 2731915 INFO (coreLoadExecutor-4512-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 2731916 INFO (coreLoadExecutor-4512-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 2731917 INFO (coreLoadExecutor-4512-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 2731918 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [ x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestArbitraryIndexDir_3C8DF2D38AD7E76-001/tempDir-001/
[junit4] 2> 2731919 INFO (coreLoadExecutor-4512-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 2731929 INFO (coreLoadExecutor-4512-thread-1) [ x:collection1] o.a.s.c.PluginBag requestHandler : 'lazy' created with startup=lazy
[junit4] 2> 2731930 INFO (coreLoadExecutor-4512-thread-1) [ x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,spellCheckCompRH,lazy,/update/json/docs,/admin/luke,spellCheckWithWordbreak_Direct,tvrh,/get,/admin/properties,/update/json,mltrh,/admin/threads,/search-facet-def,/update/csv,/search-facet-invariants,/admin/segments,spellCheckCompRH1,/mlt,/admin/system,/replication,dismax,defaults,/config,/schema,/admin/plugins,/admin/logging,spellCheckWithWordbreak,mock,/admin/ping,/update,/admin/file,/terms,spellCheckCompRH_Direct,/debug/dump
[junit4] 2> 2731931 WARN (coreLoadExecutor-4512-thread-1) [ x:collection1] o.a.s.c.SolrCore solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4] 2> 2731931 INFO (coreLoadExecutor-4512-thread-1) [ x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 2731932 INFO (coreLoadExecutor-4512-thread-1) [ x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
[junit4] 2> 2731932 INFO (coreLoadExecutor-4512-thread-1) [ x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
[junit4] 2> 2731932 INFO (coreLoadExecutor-4512-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=29, maxMergeAtOnceExplicit=18, maxMergedSegmentMB=91.5087890625, floorSegmentMB=1.4267578125, forceMergeDeletesPctAllowed=6.718827229772372, segmentsPerTier=20.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 2731933 INFO (coreLoadExecutor-4512-thread-1) [ x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(SimpleFSDirectory@/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestArbitraryIndexDir_3C8DF2D38AD7E76-001/tempDir-001/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@6b32fc9),segFN=segments_1,generation=1}
[junit4] 2> 2731933 INFO (coreLoadExecutor-4512-thread-1) [ x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 2731933 INFO (coreLoadExecutor-4512-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@7c3bf7a7[collection1] main
[junit4] 2> 2731933 INFO (coreLoadExecutor-4512-thread-1) [ x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {storageIO=org.apache.solr.rest.ManagedResourceStorage$InMemoryStorageIO}
[junit4] 2> 2731934 INFO (coreLoadExecutor-4512-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using InMemoryStorage
[junit4] 2> 2731934 INFO (coreLoadExecutor-4512-thread-1) [ x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 2731934 INFO (coreLoadExecutor-4512-thread-1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
[junit4] 2> 2731940 INFO (coreLoadExecutor-4512-thread-1) [ x:collection1] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4] 2> 2731976 INFO (coreLoadExecutor-4512-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 2731976 INFO (searcherExecutor-4513-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
[junit4] 2> 2731977 INFO (searcherExecutor-4513-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
[junit4] 2> 2731977 INFO (searcherExecutor-4513-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
[junit4] 2> 2731977 INFO (searcherExecutor-4513-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: multipleFields
[junit4] 2> 2731977 INFO (coreLoadExecutor-4512-thread-1) [ x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 2731977 INFO (searcherExecutor-4513-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
[junit4] 2> 2731977 INFO (searcherExecutor-4513-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
[junit4] 2> 2731978 INFO (searcherExecutor-4513-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
[junit4] 2> 2731978 INFO (searcherExecutor-4513-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
[junit4] 2> 2731978 INFO (searcherExecutor-4513-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
[junit4] 2> 2731979 INFO (searcherExecutor-4513-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@7c3bf7a7[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2731981 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ ] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=null path=null params={} {add=[1]} 0 1
[junit4] 2> 2732007 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ ] o.a.s.u.UpdateHandler start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 2732027 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ ] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=2
[junit4] 2> commit{dir=MockDirectoryWrapper(SimpleFSDirectory@/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestArbitraryIndexDir_3C8DF2D38AD7E76-001/tempDir-001/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@6b32fc9),segFN=segments_1,generation=1}
[junit4] 2> commit{dir=MockDirectoryWrapper(SimpleFSDirectory@/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestArbitraryIndexDir_3C8DF2D38AD7E76-001/tempDir-001/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@6b32fc9),segFN=segments_2,generation=2}
[junit4] 2> 2732028 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ ] o.a.s.c.SolrCore newest commit generation = 2
[junit4] 2> 2732029 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ ] o.a.s.c.SolrCore New index directory detected: old=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestArbitraryIndexDir_3C8DF2D38AD7E76-001/tempDir-001/index/ new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestArbitraryIndexDir_3C8DF2D38AD7E76-001/tempDir-001/index_temp
[junit4] 2> 2732031 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ ] o.a.s.s.SolrIndexSearcher Opening Searcher@33628a08[collection1] main
[junit4] 2> 2732032 INFO (searcherExecutor-4513-thread-1) [ ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@33628a08[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.0.0):c1)))}
[junit4] 2> 2732032 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ ] o.a.s.u.UpdateHandler end_commit_flush
[junit4] 2> 2732032 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ ] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=null path=null params={} {commit=} 0 25
[junit4] 2> 2732033 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 'solr/collection1/'
[junit4] 2> 2732033 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2732033 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 2732083 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ ] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 2732092 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 2732113 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ ] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2732115 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ ] o.a.s.s.IndexSchema Reading Solr Schema from solr/collection1/conf/schema12.xml
[junit4] 2> 2732119 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ ] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 2732228 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ ] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 2732229 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ ] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 2732229 WARN (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ ] o.a.s.s.IndexSchema Field text is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 2732246 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ ] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 2732250 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ ] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 2732253 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ ] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/solr/collection1/conf'
[junit4] 2> 2732253 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ ] o.a.s.c.CoreContainer Reloading SolrCore 'collection1' using configuration from instancedir solr/collection1/
[junit4] 2> 2732254 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [solr/collection1/], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestArbitraryIndexDir_3C8DF2D38AD7E76-001/tempDir-001/]
[junit4] 2> 2732254 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@163d5552
[junit4] 2> 2732254 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestArbitraryIndexDir_3C8DF2D38AD7E76-001/tempDir-001/index_temp
[junit4] 2> 2732255 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [ x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestArbitraryIndexDir_3C8DF2D38AD7E76-001/tempDir-001/
[junit4] 2> 2732256 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [ x:collection1] o.a.s.c.DirectoryFactory Found 1 old index directories to clean-up under /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestArbitraryIndexDir_3C8DF2D38AD7E76-001/tempDir-001/
[junit4] 2> 2732256 WARN (OldIndexDirectoryCleanupThreadForCore-collection1) [ x:collection1] o.a.s.c.CachingDirectoryFactory Cannot delete directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestArbitraryIndexDir_3C8DF2D38AD7E76-001/tempDir-001/index as it is still being referenced in the cache!
[junit4] 2> 2732256 WARN (OldIndexDirectoryCleanupThreadForCore-collection1) [ x:collection1] o.a.s.c.DirectoryFactory Delete old index directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestArbitraryIndexDir_3C8DF2D38AD7E76-001/tempDir-001/index failed.
[junit4] 2> 2732270 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
[junit4] 2> 2732270 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2732270 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe-allfields"
[junit4] 2> 2732270 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4] 2> 2732270 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 2732270 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2732270 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "uniq-fields"
[junit4] 2> 2732270 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4] 2> 2732270 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 2732271 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2732271 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2732271 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 2732273 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 2732274 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 2732275 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 2732275 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 2732277 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestArbitraryIndexDir_3C8DF2D38AD7E76-001/tempDir-001/index_temp
[junit4] 2> 2732281 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ x:collection1] o.a.s.c.PluginBag requestHandler : 'lazy' created with startup=lazy
[junit4] 2> 2732284 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,spellCheckCompRH,lazy,/update/json/docs,/admin/luke,spellCheckWithWordbreak_Direct,tvrh,/get,/admin/properties,/update/json,mltrh,/admin/threads,/search-facet-def,/update/csv,/search-facet-invariants,/admin/segments,spellCheckCompRH1,/mlt,/admin/system,/replication,dismax,defaults,/config,/schema,/admin/plugins,/admin/logging,spellCheckWithWordbreak,mock,/admin/ping,/update,/admin/file,/terms,spellCheckCompRH_Direct,/debug/dump
[junit4] 2> 2732284 WARN (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ x:collection1] o.a.s.c.SolrCore solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4] 2> 2732285 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 2732286 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
[junit4] 2> 2732286 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
[junit4] 2> 2732287 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@2453cb51[collection1] main
[junit4] 2> 2732287 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {storageIO=org.apache.solr.rest.ManagedResourceStorage$InMemoryStorageIO}
[junit4] 2> 2732287 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using InMemoryStorage
[junit4] 2> 2732287 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 2732287 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ x:collection1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
[junit4] 2> 2732288 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ x:collection1] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4] 2> 2732291 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 2732291 INFO (searcherExecutor-4517-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
[junit4] 2> 2732292 INFO (searcherExecutor-4517-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
[junit4] 2> 2732292 INFO (searcherExecutor-4517-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
[junit4] 2> 2732292 INFO (searcherExecutor-4517-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: multipleFields
[junit4] 2> 2732292 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ x:collection1] o.a.s.u.DefaultSolrCoreState Closing old IndexWriter... core=collection1
[junit4] 2> 2732292 INFO (searcherExecutor-4517-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
[junit4] 2> 2732293 INFO (searcherExecutor-4517-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
[junit4] 2> 2732293 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=28, maxMergeAtOnceExplicit=24, maxMergedSegmentMB=1.794921875, floorSegmentMB=1.630859375, forceMergeDeletesPctAllowed=21.474280317425077, segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.2227971910672266
[junit4] 2> 2732293 INFO (searcherExecutor-4517-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
[junit4] 2> 2732294 INFO (searcherExecutor-4517-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
[junit4] 2> 2732294 INFO (searcherExecutor-4517-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
[junit4] 2> 2732294 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(NRTCachingDirectory(SimpleFSDirectory@/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestArbitraryIndexDir_3C8DF2D38AD7E76-001/tempDir-001/index_temp lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@49d705b0; maxCacheMB=0.3173828125 maxMergeSizeMB=0.5146484375)),segFN=segments_1,generation=1}
[junit4] 2> 2732294 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 2732295 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ x:collection1] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
[junit4] 2> 2732296 INFO (searcherExecutor-4517-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@2453cb51[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.0.0):c1)))}
[junit4] 2> 2732297 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@674aa2ba[collection1] main
[junit4] 2> 2732297 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ x:collection1] o.a.s.c.CoreContainer replacing core: collection1
[junit4] 2> 2732297 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ x:collection1] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@48fb3d72
[junit4] 2> 2732297 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ x:collection1] o.a.s.u.UpdateHandler closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=1,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 2732297 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ x:collection1] o.a.s.c.SolrCore [collection1] Closing main searcher on request.
[junit4] 2> 2732305 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=null path=null params={q=id:2&qt=standard&start=0&rows=20&version=2.2} hits=0 status=0 QTime=0
[junit4] 2> 2732305 ERROR (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ x:collection1] o.a.s.SolrTestCaseJ4 REQUEST FAILED: xpath=*[count(//doc)=1]
[junit4] 2> xml response was: <?xml version="1.0" encoding="UTF-8"?>
[junit4] 2> <response>
[junit4] 2> <lst name="responseHeader"><int name="status">0</int><int name="QTime">0</int></lst><result name="response" numFound="0" start="0"></result>
[junit4] 2> </response>
[junit4] 2>
[junit4] 2> request was:q=id:2&qt=standard&start=0&rows=20&version=2.2
[junit4] 2> 2732306 INFO (searcherExecutor-4517-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@674aa2ba[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.0.0):c1)))}
[junit4] 2> 2732307 ERROR (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ x:collection1] o.a.s.SolrTestCaseJ4 REQUEST FAILED: q=id:2&qt=standard&start=0&rows=20&version=2.2:java.lang.RuntimeException: REQUEST FAILED: xpath=*[count(//doc)=1]
[junit4] 2> xml response was: <?xml version="1.0" encoding="UTF-8"?>
[junit4] 2> <response>
[junit4] 2> <lst name="responseHeader"><int name="status">0</int><int name="QTime">0</int></lst><result name="response" numFound="0" start="0"></result>
[junit4] 2> </response>
[junit4] 2>
[junit4] 2> request was:q=id:2&qt=standard&start=0&rows=20&version=2.2
[junit4] 2> at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:759)
[junit4] 2> at org.apache.solr.core.TestArbitraryIndexDir.testLoadNewIndexDir(TestArbitraryIndexDir.java:128)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:497)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1660)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:866)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:902)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:916)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
[junit4] 2> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4] 2> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:875)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:777)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:811)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:822)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 2732308 INFO (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[3C8DF2D38AD7E76]) [ x:collection1] o.a.s.SolrTestCaseJ4 ###Ending testLoadNewIndexDir
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestArbitraryIndexDir -Dtests.method=testLoadNewIndexDir -Dtests.seed=3C8DF2D38AD7E76 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=th_TH_TH_#u-nu-thai -Dtests.timezone=Africa/Freetown -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[junit4] ERROR 0.77s J2 | TestArbitraryIndexDir.testLoadNewIndexDir <<<
[junit4] > Throwable #1: java.lang.RuntimeException: Exception during query
[junit4] > at __randomizedtesting.SeedInfo.seed([3C8DF2D38AD7E76:EA926415A634EEDE]:0)
[junit4] > at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:766)
[junit4] > at org.apache.solr.core.TestArbitraryIndexDir.testLoadNewIndexDir(TestArbitraryIndexDir.java:128)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > Caused by: java.lang.RuntimeException: REQUEST FAILED: xpath=*[count(//doc)=1]
[junit4] > xml response was: <?xml version="1.0" encoding="UTF-8"?>
[junit4] > <response>
[junit4] > <lst name="responseHeader"><int name="status">0</int><int name="QTime">0</int></lst><result name="response" numFound="0" start="0"></result>
[junit4] > </response>
[junit4] > request was:q=id:2&qt=standard&start=0&rows=20&version=2.2
[junit4] > at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:759)
[junit4] > ... 40 more
[junit4] 2> 2732311 INFO (SUITE-TestArbitraryIndexDir-seed#[3C8DF2D38AD7E76]-worker) [ x:collection1] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> 2732311 INFO (SUITE-TestArbitraryIndexDir-seed#[3C8DF2D38AD7E76]-worker) [ x:collection1] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1825860317
[junit4] 2> 2732311 INFO (SUITE-TestArbitraryIndexDir-seed#[3C8DF2D38AD7E76]-worker) [ x:collection1] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@6d138d10
[junit4] 2> 2732312 INFO (SUITE-TestArbitraryIndexDir-seed#[3C8DF2D38AD7E76]-worker) [ x:collection1] o.a.s.u.UpdateHandler closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 2732312 INFO (SUITE-TestArbitraryIndexDir-seed#[3C8DF2D38AD7E76]-worker) [ x:collection1] o.a.s.u.SolrCoreState Closing SolrCoreState
[junit4] 2> 2732312 INFO (SUITE-TestArbitraryIndexDir-seed#[3C8DF2D38AD7E76]-worker) [ x:collection1] o.a.s.u.DefaultSolrCoreState SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 2732312 INFO (SUITE-TestArbitraryIndexDir-seed#[3C8DF2D38AD7E76]-worker) [ x:collection1] o.a.s.u.DefaultSolrCoreState closing IndexWriter with IndexWriterCloser
[junit4] 2> 2732312 INFO (SUITE-TestArbitraryIndexDir-seed#[3C8DF2D38AD7E76]-worker) [ x:collection1] o.a.s.c.SolrCore [collection1] Closing main searcher on request.
[junit4] 2> 2732323 INFO (SUITE-TestArbitraryIndexDir-seed#[3C8DF2D38AD7E76]-worker) [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing MockFSDirectoryFactory - 3 directories currently being tracked
[junit4] 2> 2732324 INFO (SUITE-TestArbitraryIndexDir-seed#[3C8DF2D38AD7E76]-worker) [ x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestArbitraryIndexDir_3C8DF2D38AD7E76-001/tempDir-001/index_temp [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestArbitraryIndexDir_3C8DF2D38AD7E76-001/tempDir-001/index_temp;done=false>>]
[junit4] 2> 2732324 INFO (SUITE-TestArbitraryIndexDir-seed#[3C8DF2D38AD7E76]-worker) [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestArbitraryIndexDir_3C8DF2D38AD7E76-001/tempDir-001/index_temp
[junit4] 2> 2732326 INFO (SUITE-TestArbitraryIndexDir-seed#[3C8DF2D38AD7E76]-worker) [ x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestArbitraryIndexDir_3C8DF2D38AD7E76-001/tempDir-001 [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestArbitraryIndexDir_3C8DF2D38AD7E76-001/tempDir-001;done=false>>]
[junit4] 2> 2732326 INFO (SUITE-TestArbitraryIndexDir-seed#[3C8DF2D38AD7E76]-worker) [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestArbitraryIndexDir_3C8DF2D38AD7E76-001/tempDir-001
[junit4] 2> 2732326 INFO (SUITE-TestArbitraryIndexDir-seed#[3C8DF2D38AD7E76]-worker) [ x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestArbitraryIndexDir_3C8DF2D38AD7E76-001/tempDir-001/index [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestArbitraryIndexDir_3C8DF2D38AD7E76-001/tempDir-001/index;done=false>>]
[junit4] 2> 2732326 INFO (SUITE-TestArbitraryIndexDir-seed#[3C8DF2D38AD7E76]-worker) [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestArbitraryIndexDir_3C8DF2D38AD7E76-001/tempDir-001/index
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.core.TestArbitraryIndexDir_3C8DF2D38AD7E76-001
[junit4] 2> NOTE: test params are: codec=Lucene60, sim=ClassicSimilarity, locale=th_TH_TH_#u-nu-thai, timezone=Africa/Freetown
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_66 (64-bit)/cpus=4,threads=1,free=288911136,total=527958016
[junit4] 2> NOTE: All tests run in this JVM: [TestNonDefinedSimilarityFactory, ShowFileRequestHandlerTest, DocValuesMissingTest, CdcrVersionReplicationTest, TestRecovery, TestClassicSimilarityFactory, ClusterStateTest, TestSuggestSpellingConverter, TestUtils, TestDistributedStatsComponentCardinality, JavabinLoaderTest, TestMinMaxOnMultiValuedField, CleanupOldIndexTest, MigrateRouteKeyTest, TestFieldResource, DirectUpdateHandlerOptimizeTest, TestSweetSpotSimilarityFactory, TestSolrJ, SearchHandlerTest, SolrCoreCheckLockOnStartupTest, FullHLLTest, BinaryUpdateRequestHandlerTest, TestCursorMarkWithoutUniqueKey, TestDocBasedVersionConstraints, TestIndexingPerformance, TestFieldTypeCollectionResource, HdfsWriteToMultipleCollectionsTest, SuggesterTSTTest, BigEndianAscendingWordDeserializerTest, OverriddenZkACLAndCredentialsProvidersTest, UnloadDistributedZkTest, PrimitiveFieldTypeTest, TestFieldSortValues, DirectUpdateHandlerTest, FieldAnalysisRequestHandlerTest, StatsComponentTest, TestOverriddenPrefixQueryForCustomFieldType, AutoCommitTest, TestIndexSearcher, AsyncMigrateRouteKeyTest, HdfsSyncSliceTest, DocValuesMultiTest, TestReRankQParserPlugin, QueryParsingTest, BadComponentTest, TestSerializedLuceneMatchVersion, GraphQueryTest, TestCSVResponseWriter, TestPerFieldSimilarity, LukeRequestHandlerTest, TestSortingResponseWriter, AnalyticsQueryTest, TestFuzzyAnalyzedSuggestions, SuggesterTest, TestStressReorder, TestStressRecovery, TestZkChroot, TestBulkSchemaAPI, TestRandomRequestDistribution, TestLeaderInitiatedRecoveryThread, TestShardHandlerFactory, TestConfigSetProperties, ResponseHeaderTest, RecoveryZkTest, TestPostingsSolrHighlighter, TestGroupingSearch, TestSolrDeletionPolicy1, OverseerTest, TestSearcherReuse, HighlighterConfigTest, HLLUtilTest, OverseerCollectionConfigSetProcessorTest, SampleTest, ZkStateReaderTest, TestSolrCLIRunExample, FieldMutatingUpdateProcessorTest, BasicAuthIntegrationTest, DataDrivenBlockJoinTest, LeaderFailoverAfterPartitionTest, DistribCursorPagingTest, TestExtendedDismaxParser, HighlighterMaxOffsetTest, DeleteLastCustomShardedReplicaTest, LeaderElectionTest, BaseCdcrDistributedZkTest, TestManagedResource, DistributedFacetPivotSmallAdvancedTest, CloudMLTQParserTest, SpatialHeatmapFacetsTest, CloudExitableDirectoryReaderTest, ChaosMonkeySafeLeaderTest, BasicDistributedZk2Test, SyncSliceTest, OpenCloseCoreStressTest, LeaderElectionIntegrationTest, BasicZkTest, FullSolrCloudDistribCmdsTest, TestRandomFaceting, ZkSolrClientTest, TestRandomDVFaceting, ZkCLITest, TestDistributedGrouping, TestFaceting, DistributedSpellCheckComponentTest, ZkControllerTest, TestJoin, TestStressVersions, SimpleFacetsTest, SolrCmdDistributorTest, BadIndexSchemaTest, TestSort, DistributedQueryElevationComponentTest, SuggesterFSTTest, TestStressLucene, TestTrie, SpatialFilterTest, PolyFieldTest, NoCacheHeaderTest, SchemaVersionSpecificBehaviorTest, QueryEqualityTest, SortByFunctionTest, TestRemoteStreaming, DistanceFunctionTest, SolrInfoMBeanTest, DisMaxRequestHandlerTest, TestQueryUtils, DirectSolrSpellCheckerTest, TestReversedWildcardFilterFactory, TestQueryTypes, XmlUpdateRequestHandlerTest, DocumentBuilderTest, TermVectorComponentTest, RequiredFieldsTest, TestArbitraryIndexDir]
[junit4] Completed [349/556] on J2 in 0.81s, 1 test, 1 error <<< FAILURES!
[...truncated 672 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987: There were test failures: 556 suites (8 ignored), 2207 tests, 1 error, 32 ignored (18 assumptions) [seed: 3C8DF2D38AD7E76]
Total time: 193 minutes 30 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 848 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/848/
3 tests failed.
FAILED: org.apache.solr.handler.TestReplicationHandler.doTestStressReplication
Error Message:
timed out waiting for collection1 startAt time to exceed: Tue Nov 10 04:53:00 CST 2015
Stack Trace:
java.lang.AssertionError: timed out waiting for collection1 startAt time to exceed: Tue Nov 10 04:53:00 CST 2015
at __randomizedtesting.SeedInfo.seed([E4BD31AE554346D7:3F163168506B2F64]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.handler.TestReplicationHandler.watchCoreStartAt(TestReplicationHandler.java:1417)
at org.apache.solr.handler.TestReplicationHandler.doTestStressReplication(TestReplicationHandler.java:769)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1660)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:866)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:902)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:875)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:777)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:811)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:822)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.handler.TestReplicationHandler.doTestReplicateAfterCoreReload
Error Message:
expected:<[{indexVersion=1447153415414,generation=2,filelist=[_3z0.fdt, _3z0.fdx, _3z0.fnm, _3z0.nvd, _3z0.nvm, _3z0.si, _3z0_MockRandom_0.doc, _3z0_MockRandom_0.sd, _3z0_MockRandom_0.tib, _3z0_MockRandom_0.tii, _878.fdt, _878.fdx, _878.fnm, _878.nvd, _878.nvm, _878.si, _878_MockRandom_0.doc, _878_MockRandom_0.sd, _878_MockRandom_0.tib, _878_MockRandom_0.tii, _aqw.fdt, _aqw.fdx, _aqw.fnm, _aqw.nvd, _aqw.nvm, _aqw.si, _aqw_MockRandom_0.doc, _aqw_MockRandom_0.sd, _aqw_MockRandom_0.tbk, _aqw_MockRandom_0.tix, _aqx.fdt, _aqx.fdx, _aqx.fnm, _aqx.nvd, _aqx.nvm, _aqx.si, _aqx_MockRandom_0.doc, _aqx_MockRandom_0.sd, _aqx_MockRandom_0.tfp, _aqy.fdt, _aqy.fdx, _aqy.fnm, _aqy.nvd, _aqy.nvm, _aqy.si, _aqy_MockRandom_0.doc, _aqy_MockRandom_0.sd, _aqy_MockRandom_0.tim, _aqy_MockRandom_0.tip, _aqz.fdt, _aqz.fdx, _aqz.fnm, _aqz.nvd, _aqz.nvm, _aqz.si, _aqz_MockRandom_0.doc, _aqz_MockRandom_0.sd, _aqz_MockRandom_0.tim, _aqz_MockRandom_0.tip, _ar0.fdt, _ar0.fdx, _ar0.fnm, _ar0.nvd, _ar0.nvm, _ar0.si, _ar0_MockRandom_0.doc, _ar0_MockRandom_0.sd, _ar0_MockRandom_0.tim, _ar0_MockRandom_0.tip, _ar1.fdt, _ar1.fdx, _ar1.fnm, _ar1.nvd, _ar1.nvm, _ar1.si, _ar1_MockRandom_0.doc, _ar1_MockRandom_0.sd, _ar1_MockRandom_0.tfp, _ar2.fdt, _ar2.fdx, _ar2.fnm, _ar2.nvd, _ar2.nvm, _ar2.si, _ar2_MockRandom_0.doc, _ar2_MockRandom_0.sd, _ar2_MockRandom_0.tbk, _ar2_MockRandom_0.tix, _ar3.fdt, _ar3.fdx, _ar3.fnm, _ar3.nvd, _ar3.nvm, _ar3.si, _ar3_MockRandom_0.doc, _ar3_MockRandom_0.sd, _ar3_MockRandom_0.tim, _ar3_MockRandom_0.tip, _ar4.fdt, _ar4.fdx, _ar4.fnm, _ar4.nvd, _ar4.nvm, _ar4.si, _ar4_MockRandom_0.doc, _ar4_MockRandom_0.sd, _ar4_MockRandom_0.tio, _ar4_MockRandom_0.tipo, _ar5.fdt, _ar5.fdx, _ar5.fnm, _ar5.nvd, _ar5.nvm, _ar5.si, _ar5_MockRandom_0.doc, _ar5_MockRandom_0.sd, _ar5_MockRandom_0.tbk, _ar5_MockRandom_0.tix, _ar6.fdt, _ar6.fdx, _ar6.fnm, _ar6.nvd, _ar6.nvm, _ar6.si, _ar6_MockRandom_0.doc, _ar6_MockRandom_0.sd, _ar6_MockRandom_0.tib, _ar6_MockRandom_0.tiv, _ar7.fdt, _ar7.fdx, _ar7.fnm, _ar7.nvd, _ar7.nvm, _ar7.si, _ar7_MockRandom_0.doc, _ar7_MockRandom_0.sd, _ar7_MockRandom_0.tim, _ar7_MockRandom_0.tip, _ar8.fdt, _ar8.fdx, _ar8.fnm, _ar8.nvd, _ar8.nvm, _ar8.si, _ar8_MockRandom_0.doc, _ar8_MockRandom_0.sd, _ar8_MockRandom_0.tib, _ar8_MockRandom_0.tiv, _ar9.fdt, _ar9.fdx, _ar9.fnm, _ar9.nvd, _ar9.nvm, _ar9.si, _ar9_MockRandom_0.doc, _ar9_MockRandom_0.sd, _ar9_MockRandom_0.tio, _ar9_MockRandom_0.tipo, _ara.fdt, _ara.fdx, _ara.fnm, _ara.nvd, _ara.nvm, _ara.si, _ara_MockRandom_0.doc, _ara_MockRandom_0.sd, _ara_MockRandom_0.tfp, _arb.fdt, _arb.fdx, _arb.fnm, _arb.nvd, _arb.nvm, _arb.si, _arb_MockRandom_0.doc, _arb_MockRandom_0.sd, _arb_MockRandom_0.tio, _arb_MockRandom_0.tipo, _arc.fdt, _arc.fdx, _arc.fnm, _arc.nvd, _arc.nvm, _arc.si, _arc_MockRandom_0.doc, _arc_MockRandom_0.sd, _arc_MockRandom_0.tfp, _ard.fdt, _ard.fdx, _ard.fnm, _ard.nvd, _ard.nvm, _ard.si, _ard_MockRandom_0.doc, _ard_MockRandom_0.sd, _ard_MockRandom_0.tio, _ard_MockRandom_0.tipo, _are.fdt, _are.fdx, _are.fnm, _are.nvd, _are.nvm, _are.si, _are_MockRandom_0.doc, _are_MockRandom_0.sd, _are_MockRandom_0.tbk, _are_MockRandom_0.tix, _arf.fdt, _arf.fdx, _arf.fnm, _arf.nvd, _arf.nvm, _arf.si, _arf_MockRandom_0.doc, _arf_MockRandom_0.sd, _arf_MockRandom_0.tim, _arf_MockRandom_0.tip, _arg.fdt, _arg.fdx, _arg.fnm, _arg.nvd, _arg.nvm, _arg.si, _arg_MockRandom_0.doc, _arg_MockRandom_0.sd, _arg_MockRandom_0.tbk, _arg_MockRandom_0.tix, _arh.fdt, _arh.fdx, _arh.fnm, _arh.nvd, _arh.nvm, _arh.si, _arh_MockRandom_0.doc, _arh_MockRandom_0.sd, _arh_MockRandom_0.tio, _arh_MockRandom_0.tipo, _ari.fdt, _ari.fdx, _ari.fnm, _ari.nvd, _ari.nvm, _ari.si, _ari_MockRandom_0.doc, _ari_MockRandom_0.sd, _ari_MockRandom_0.tim, _ari_MockRandom_0.tip, _ark.fdt, _ark.fdx, _ark.fnm, _ark.nvd, _ark.nvm, _ark.si, _ark_MockRandom_0.doc, _ark_MockRandom_0.sd, _ark_MockRandom_0.tio, _ark_MockRandom_0.tipo, _arl.fdt, _arl.fdx, _arl.fnm, _arl.nvd, _arl.nvm, _arl.si, _arl_MockRandom_0.doc, _arl_MockRandom_0.sd, _arl_MockRandom_0.tbk, _arl_MockRandom_0.tix, _arm.fdt, _arm.fdx, _arm.fnm, _arm.nvd, _arm.nvm, _arm.si, _arm_MockRandom_0.doc, _arm_MockRandom_0.sd, _arm_MockRandom_0.tib, _arm_MockRandom_0.tii, _arn.fdt, _arn.fdx, _arn.fnm, _arn.nvd, _arn.nvm, _arn.si, _arn_MockRandom_0.doc, _arn_MockRandom_0.sd, _arn_MockRandom_0.tib, _arn_MockRandom_0.tii, _aro.fdt, _aro.fdx, _aro.fnm, _aro.nvd, _aro.nvm, _aro.si, _aro_MockRandom_0.doc, _aro_MockRandom_0.sd, _aro_MockRandom_0.tbk, _aro_MockRandom_0.tix, _arp.fdt, _arp.fdx, _arp.fnm, _arp.nvd, _arp.nvm, _arp.si, _arp_MockRandom_0.doc, _arp_MockRandom_0.sd, _arp_MockRandom_0.tio, _arp_MockRandom_0.tipo, _arq.fdt, _arq.fdx, _arq.fnm, _arq.nvd, _arq.nvm, _arq.si, _arq_MockRandom_0.doc, _arq_MockRandom_0.sd, _arq_MockRandom_0.tim, _arq_MockRandom_0.tip, _arr.fdt, _arr.fdx, _arr.fnm, _arr.nvd, _arr.nvm, _arr.si, _arr_MockRandom_0.doc, _arr_MockRandom_0.sd, _arr_MockRandom_0.tib, _arr_MockRandom_0.tiv, _ars.fdt, _ars.fdx, _ars.fnm, _ars.nvd, _ars.nvm, _ars.si, _ars_MockRandom_0.doc, _ars_MockRandom_0.sd, _ars_MockRandom_0.tim, _ars_MockRandom_0.tip, _art.fdt, _art.fdx, _art.fnm, _art.nvd, _art.nvm, _art.si, _art_MockRandom_0.doc, _art_MockRandom_0.sd, _art_MockRandom_0.tib, _art_MockRandom_0.tiv, _aru.fdt, _aru.fdx, _aru.fnm, _aru.nvd, _aru.nvm, _aru.si, _aru_MockRandom_0.doc, _aru_MockRandom_0.sd, _aru_MockRandom_0.tim, _aru_MockRandom_0.tip, _arv.fdt, _arv.fdx, _arv.fnm, _arv.nvd, _arv.nvm, _arv.si, _arv_MockRandom_0.doc, _arv_MockRandom_0.sd, _arv_MockRandom_0.tio, _arv_MockRandom_0.tipo, _arw.fdt, _arw.fdx, _arw.fnm, _arw.nvd, _arw.nvm, _arw.si, _arw_MockRandom_0.doc, _arw_MockRandom_0.sd, _arw_MockRandom_0.tfp, _arx.fdt, _arx.fdx, _arx.fnm, _arx.nvd, _arx.nvm, _arx.si, _arx_MockRandom_0.doc, _arx_MockRandom_0.sd, _arx_MockRandom_0.tim, _arx_MockRandom_0.tip, _ary.fdt, _ary.fdx, _ary.fnm, _ary.nvd, _ary.nvm, _ary.si, _ary_MockRandom_0.doc, _ary_MockRandom_0.sd, _ary_MockRandom_0.tfp, _arz.fdt, _arz.fdx, _arz.fnm, _arz.nvd, _arz.nvm, _arz.si, _arz_MockRandom_0.doc, _arz_MockRandom_0.sd, _arz_MockRandom_0.tbk, _arz_MockRandom_0.tix, segments_2]}]> but was:<[{indexVersion=1447153415414,generation=2,filelist=[_3z0.fdt, _3z0.fdx, _3z0.fnm, _3z0.nvd, _3z0.nvm, _3z0.si, _3z0_MockRandom_0.doc, _3z0_MockRandom_0.sd, _3z0_MockRandom_0.tib, _3z0_MockRandom_0.tii, _878.fdt, _878.fdx, _878.fnm, _878.nvd, _878.nvm, _878.si, _878_MockRandom_0.doc, _878_MockRandom_0.sd, _878_MockRandom_0.tib, _878_MockRandom_0.tii, _aqw.fdt, _aqw.fdx, _aqw.fnm, _aqw.nvd, _aqw.nvm, _aqw.si, _aqw_MockRandom_0.doc, _aqw_MockRandom_0.sd, _aqw_MockRandom_0.tbk, _aqw_MockRandom_0.tix, _aqx.fdt, _aqx.fdx, _aqx.fnm, _aqx.nvd, _aqx.nvm, _aqx.si, _aqx_MockRandom_0.doc, _aqx_MockRandom_0.sd, _aqx_MockRandom_0.tfp, _aqy.fdt, _aqy.fdx, _aqy.fnm, _aqy.nvd, _aqy.nvm, _aqy.si, _aqy_MockRandom_0.doc, _aqy_MockRandom_0.sd, _aqy_MockRandom_0.tim, _aqy_MockRandom_0.tip, _aqz.fdt, _aqz.fdx, _aqz.fnm, _aqz.nvd, _aqz.nvm, _aqz.si, _aqz_MockRandom_0.doc, _aqz_MockRandom_0.sd, _aqz_MockRandom_0.tim, _aqz_MockRandom_0.tip, _ar0.fdt, _ar0.fdx, _ar0.fnm, _ar0.nvd, _ar0.nvm, _ar0.si, _ar0_MockRandom_0.doc, _ar0_MockRandom_0.sd, _ar0_MockRandom_0.tim, _ar0_MockRandom_0.tip, _ar1.fdt, _ar1.fdx, _ar1.fnm, _ar1.nvd, _ar1.nvm, _ar1.si, _ar1_MockRandom_0.doc, _ar1_MockRandom_0.sd, _ar1_MockRandom_0.tfp, _ar2.fdt, _ar2.fdx, _ar2.fnm, _ar2.nvd, _ar2.nvm, _ar2.si, _ar2_MockRandom_0.doc, _ar2_MockRandom_0.sd, _ar2_MockRandom_0.tbk, _ar2_MockRandom_0.tix, _ar3.fdt, _ar3.fdx, _ar3.fnm, _ar3.nvd, _ar3.nvm, _ar3.si, _ar3_MockRandom_0.doc, _ar3_MockRandom_0.sd, _ar3_MockRandom_0.tim, _ar3_MockRandom_0.tip, _ar4.fdt, _ar4.fdx, _ar4.fnm, _ar4.nvd, _ar4.nvm, _ar4.si, _ar4_MockRandom_0.doc, _ar4_MockRandom_0.sd, _ar4_MockRandom_0.tio, _ar4_MockRandom_0.tipo, _ar5.fdt, _ar5.fdx, _ar5.fnm, _ar5.nvd, _ar5.nvm, _ar5.si, _ar5_MockRandom_0.doc, _ar5_MockRandom_0.sd, _ar5_MockRandom_0.tbk, _ar5_MockRandom_0.tix, _ar6.fdt, _ar6.fdx, _ar6.fnm, _ar6.nvd, _ar6.nvm, _ar6.si, _ar6_MockRandom_0.doc, _ar6_MockRandom_0.sd, _ar6_MockRandom_0.tib, _ar6_MockRandom_0.tiv, _ar7.fdt, _ar7.fdx, _ar7.fnm, _ar7.nvd, _ar7.nvm, _ar7.si, _ar7_MockRandom_0.doc, _ar7_MockRandom_0.sd, _ar7_MockRandom_0.tim, _ar7_MockRandom_0.tip, _ar8.fdt, _ar8.fdx, _ar8.fnm, _ar8.nvd, _ar8.nvm, _ar8.si, _ar8_MockRandom_0.doc, _ar8_MockRandom_0.sd, _ar8_MockRandom_0.tib, _ar8_MockRandom_0.tiv, _ar9.fdt, _ar9.fdx, _ar9.fnm, _ar9.nvd, _ar9.nvm, _ar9.si, _ar9_MockRandom_0.doc, _ar9_MockRandom_0.sd, _ar9_MockRandom_0.tio, _ar9_MockRandom_0.tipo, _ara.fdt, _ara.fdx, _ara.fnm, _ara.nvd, _ara.nvm, _ara.si, _ara_MockRandom_0.doc, _ara_MockRandom_0.sd, _ara_MockRandom_0.tfp, _arb.fdt, _arb.fdx, _arb.fnm, _arb.nvd, _arb.nvm, _arb.si, _arb_MockRandom_0.doc, _arb_MockRandom_0.sd, _arb_MockRandom_0.tio, _arb_MockRandom_0.tipo, _arc.fdt, _arc.fdx, _arc.fnm, _arc.nvd, _arc.nvm, _arc.si, _arc_MockRandom_0.doc, _arc_MockRandom_0.sd, _arc_MockRandom_0.tfp, _ard.fdt, _ard.fdx, _ard.fnm, _ard.nvd, _ard.nvm, _ard.si, _ard_MockRandom_0.doc, _ard_MockRandom_0.sd, _ard_MockRandom_0.tio, _ard_MockRandom_0.tipo, _are.fdt, _are.fdx, _are.fnm, _are.nvd, _are.nvm, _are.si, _are_MockRandom_0.doc, _are_MockRandom_0.sd, _are_MockRandom_0.tbk, _are_MockRandom_0.tix, _arf.fdt, _arf.fdx, _arf.fnm, _arf.nvd, _arf.nvm, _arf.si, _arf_MockRandom_0.doc, _arf_MockRandom_0.sd, _arf_MockRandom_0.tim, _arf_MockRandom_0.tip, _arg.fdt, _arg.fdx, _arg.fnm, _arg.nvd, _arg.nvm, _arg.si, _arg_MockRandom_0.doc, _arg_MockRandom_0.sd, _arg_MockRandom_0.tbk, _arg_MockRandom_0.tix, _arh.fdt, _arh.fdx, _arh.fnm, _arh.nvd, _arh.nvm, _arh.si, _arh_MockRandom_0.doc, _arh_MockRandom_0.sd, _arh_MockRandom_0.tio, _arh_MockRandom_0.tipo, _ari.fdt, _ari.fdx, _ari.fnm, _ari.nvd, _ari.nvm, _ari.si, _ari_MockRandom_0.doc, _ari_MockRandom_0.sd, _ari_MockRandom_0.tim, _ari_MockRandom_0.tip, _ark.fdt, _ark.fdx, _ark.fnm, _ark.nvd, _ark.nvm, _ark.si, _ark_MockRandom_0.doc, _ark_MockRandom_0.sd, _ark_MockRandom_0.tio, _ark_MockRandom_0.tipo, _arl.fdt, _arl.fdx, _arl.fnm, _arl.nvd, _arl.nvm, _arl.si, _arl_MockRandom_0.doc, _arl_MockRandom_0.sd, _arl_MockRandom_0.tbk, _arl_MockRandom_0.tix, _arm.fdt, _arm.fdx, _arm.fnm, _arm.nvd, _arm.nvm, _arm.si, _arm_MockRandom_0.doc, _arm_MockRandom_0.sd, _arm_MockRandom_0.tib, _arm_MockRandom_0.tii, _arn.fdt, _arn.fdx, _arn.fnm, _arn.nvd, _arn.nvm, _arn.si, _arn_MockRandom_0.doc, _arn_MockRandom_0.sd, _arn_MockRandom_0.tib, _arn_MockRandom_0.tii, _aro.fdt, _aro.fdx, _aro.fnm, _aro.nvd, _aro.nvm, _aro.si, _aro_MockRandom_0.doc, _aro_MockRandom_0.sd, _aro_MockRandom_0.tbk, _aro_MockRandom_0.tix, _arp.fdt, _arp.fdx, _arp.fnm, _arp.nvd, _arp.nvm, _arp.si, _arp_MockRandom_0.doc, _arp_MockRandom_0.sd, _arp_MockRandom_0.tio, _arp_MockRandom_0.tipo, _arq.fdt, _arq.fdx, _arq.fnm, _arq.nvd, _arq.nvm, _arq.si, _arq_MockRandom_0.doc, _arq_MockRandom_0.sd, _arq_MockRandom_0.tim, _arq_MockRandom_0.tip, _arr.fdt, _arr.fdx, _arr.fnm, _arr.nvd, _arr.nvm, _arr.si, _arr_MockRandom_0.doc, _arr_MockRandom_0.sd, _arr_MockRandom_0.tib, _arr_MockRandom_0.tiv, _ars.fdt, _ars.fdx, _ars.fnm, _ars.nvd, _ars.nvm, _ars.si, _ars_MockRandom_0.doc, _ars_MockRandom_0.sd, _ars_MockRandom_0.tim, _ars_MockRandom_0.tip, _art.fdt, _art.fdx, _art.fnm, _art.nvd, _art.nvm, _art.si, _art_MockRandom_0.doc, _art_MockRandom_0.sd, _art_MockRandom_0.tib, _art_MockRandom_0.tiv, _aru.fdt, _aru.fdx, _aru.fnm, _aru.nvd, _aru.nvm, _aru.si, _aru_MockRandom_0.doc, _aru_MockRandom_0.sd, _aru_MockRandom_0.tim, _aru_MockRandom_0.tip, _arv.fdt, _arv.fdx, _arv.fnm, _arv.nvd, _arv.nvm, _arv.si, _arv_MockRandom_0.doc, _arv_MockRandom_0.sd, _arv_MockRandom_0.tio, _arv_MockRandom_0.tipo, _arw.fdt, _arw.fdx, _arw.fnm, _arw.nvd, _arw.nvm, _arw.si, _arw_MockRandom_0.doc, _arw_MockRandom_0.sd, _arw_MockRandom_0.tfp, _arx.fdt, _arx.fdx, _arx.fnm, _arx.nvd, _arx.nvm, _arx.si, _arx_MockRandom_0.doc, _arx_MockRandom_0.sd, _arx_MockRandom_0.tim, _arx_MockRandom_0.tip, _ary.fdt, _ary.fdx, _ary.fnm, _ary.nvd, _ary.nvm, _ary.si, _ary_MockRandom_0.doc, _ary_MockRandom_0.sd, _ary_MockRandom_0.tfp, _arz.fdt, _arz.fdx, _arz.fnm, _arz.nvd, _arz.nvm, _arz.si, _arz_MockRandom_0.doc, _arz_MockRandom_0.sd, _arz_MockRandom_0.tbk, _arz_MockRandom_0.tix, segments_2]}, {indexVersion=1447153415414,generation=3,filelist=[_3z0.fdt, _3z0.fdx, _3z0.fnm, _3z0.nvd, _3z0.nvm, _3z0.si, _3z0_MockRandom_0.doc, _3z0_MockRandom_0.sd, _3z0_MockRandom_0.tib, _3z0_MockRandom_0.tii, _878.fdt, _878.fdx, _878.fnm, _878.nvd, _878.nvm, _878.si, _878_MockRandom_0.doc, _878_MockRandom_0.sd, _878_MockRandom_0.tib, _878_MockRandom_0.tii, _ari.fdt, _ari.fdx, _ari.fnm, _ari.nvd, _ari.nvm, _ari.si, _ari_MockRandom_0.doc, _ari_MockRandom_0.sd, _ari_MockRandom_0.tim, _ari_MockRandom_0.tip, _arj.fdt, _arj.fdx, _arj.fnm, _arj.nvd, _arj.nvm, _arj.si, _arj_MockRandom_0.doc, _arj_MockRandom_0.sd, _arj_MockRandom_0.tim, _arj_MockRandom_0.tip, _ark.fdt, _ark.fdx, _ark.fnm, _ark.nvd, _ark.nvm, _ark.si, _ark_MockRandom_0.doc, _ark_MockRandom_0.sd, _ark_MockRandom_0.tio, _ark_MockRandom_0.tipo, _arl.fdt, _arl.fdx, _arl.fnm, _arl.nvd, _arl.nvm, _arl.si, _arl_MockRandom_0.doc, _arl_MockRandom_0.sd, _arl_MockRandom_0.tbk, _arl_MockRandom_0.tix, _arm.fdt, _arm.fdx, _arm.fnm, _arm.nvd, _arm.nvm, _arm.si, _arm_MockRandom_0.doc, _arm_MockRandom_0.sd, _arm_MockRandom_0.tib, _arm_MockRandom_0.tii, _arn.fdt, _arn.fdx, _arn.fnm, _arn.nvd, _arn.nvm, _arn.si, _arn_MockRandom_0.doc, _arn_MockRandom_0.sd, _arn_MockRandom_0.tib, _arn_MockRandom_0.tii, _aro.fdt, _aro.fdx, _aro.fnm, _aro.nvd, _aro.nvm, _aro.si, _aro_MockRandom_0.doc, _aro_MockRandom_0.sd, _aro_MockRandom_0.tbk, _aro_MockRandom_0.tix, _arp.fdt, _arp.fdx, _arp.fnm, _arp.nvd, _arp.nvm, _arp.si, _arp_MockRandom_0.doc, _arp_MockRandom_0.sd, _arp_MockRandom_0.tio, _arp_MockRandom_0.tipo, _arq.fdt, _arq.fdx, _arq.fnm, _arq.nvd, _arq.nvm, _arq.si, _arq_MockRandom_0.doc, _arq_MockRandom_0.sd, _arq_MockRandom_0.tim, _arq_MockRandom_0.tip, _arr.fdt, _arr.fdx, _arr.fnm, _arr.nvd, _arr.nvm, _arr.si, _arr_MockRandom_0.doc, _arr_MockRandom_0.sd, _arr_MockRandom_0.tib, _arr_MockRandom_0.tiv, _ars.fdt, _ars.fdx, _ars.fnm, _ars.nvd, _ars.nvm, _ars.si, _ars_MockRandom_0.doc, _ars_MockRandom_0.sd, _ars_MockRandom_0.tim, _ars_MockRandom_0.tip, _art.fdt, _art.fdx, _art.fnm, _art.nvd, _art.nvm, _art.si, _art_MockRandom_0.doc, _art_MockRandom_0.sd, _art_MockRandom_0.tib, _art_MockRandom_0.tiv, _aru.fdt, _aru.fdx, _aru.fnm, _aru.nvd, _aru.nvm, _aru.si, _aru_MockRandom_0.doc, _aru_MockRandom_0.sd, _aru_MockRandom_0.tim, _aru_MockRandom_0.tip, _arv.fdt, _arv.fdx, _arv.fnm, _arv.nvd, _arv.nvm, _arv.si, _arv_MockRandom_0.doc, _arv_MockRandom_0.sd, _arv_MockRandom_0.tio, _arv_MockRandom_0.tipo, _arw.fdt, _arw.fdx, _arw.fnm, _arw.nvd, _arw.nvm, _arw.si, _arw_MockRandom_0.doc, _arw_MockRandom_0.sd, _arw_MockRandom_0.tfp, _arx.fdt, _arx.fdx, _arx.fnm, _arx.nvd, _arx.nvm, _arx.si, _arx_MockRandom_0.doc, _arx_MockRandom_0.sd, _arx_MockRandom_0.tim, _arx_MockRandom_0.tip, _ary.fdt, _ary.fdx, _ary.fnm, _ary.nvd, _ary.nvm, _ary.si, _ary_MockRandom_0.doc, _ary_MockRandom_0.sd, _ary_MockRandom_0.tfp, _arz.fdt, _arz.fdx, _arz.fnm, _arz.nvd, _arz.nvm, _arz.si, _arz_MockRandom_0.doc, _arz_MockRandom_0.sd, _arz_MockRandom_0.tbk, _arz_MockRandom_0.tix, segments_3]}]>
Stack Trace:
java.lang.AssertionError: expected:<[{indexVersion=1447153415414,generation=2,filelist=[_3z0.fdt, _3z0.fdx, _3z0.fnm, _3z0.nvd, _3z0.nvm, _3z0.si, _3z0_MockRandom_0.doc, _3z0_MockRandom_0.sd, _3z0_MockRandom_0.tib, _3z0_MockRandom_0.tii, _878.fdt, _878.fdx, _878.fnm, _878.nvd, _878.nvm, _878.si, _878_MockRandom_0.doc, _878_MockRandom_0.sd, _878_MockRandom_0.tib, _878_MockRandom_0.tii, _aqw.fdt, _aqw.fdx, _aqw.fnm, _aqw.nvd, _aqw.nvm, _aqw.si, _aqw_MockRandom_0.doc, _aqw_MockRandom_0.sd, _aqw_MockRandom_0.tbk, _aqw_MockRandom_0.tix, _aqx.fdt, _aqx.fdx, _aqx.fnm, _aqx.nvd, _aqx.nvm, _aqx.si, _aqx_MockRandom_0.doc, _aqx_MockRandom_0.sd, _aqx_MockRandom_0.tfp, _aqy.fdt, _aqy.fdx, _aqy.fnm, _aqy.nvd, _aqy.nvm, _aqy.si, _aqy_MockRandom_0.doc, _aqy_MockRandom_0.sd, _aqy_MockRandom_0.tim, _aqy_MockRandom_0.tip, _aqz.fdt, _aqz.fdx, _aqz.fnm, _aqz.nvd, _aqz.nvm, _aqz.si, _aqz_MockRandom_0.doc, _aqz_MockRandom_0.sd, _aqz_MockRandom_0.tim, _aqz_MockRandom_0.tip, _ar0.fdt, _ar0.fdx, _ar0.fnm, _ar0.nvd, _ar0.nvm, _ar0.si, _ar0_MockRandom_0.doc, _ar0_MockRandom_0.sd, _ar0_MockRandom_0.tim, _ar0_MockRandom_0.tip, _ar1.fdt, _ar1.fdx, _ar1.fnm, _ar1.nvd, _ar1.nvm, _ar1.si, _ar1_MockRandom_0.doc, _ar1_MockRandom_0.sd, _ar1_MockRandom_0.tfp, _ar2.fdt, _ar2.fdx, _ar2.fnm, _ar2.nvd, _ar2.nvm, _ar2.si, _ar2_MockRandom_0.doc, _ar2_MockRandom_0.sd, _ar2_MockRandom_0.tbk, _ar2_MockRandom_0.tix, _ar3.fdt, _ar3.fdx, _ar3.fnm, _ar3.nvd, _ar3.nvm, _ar3.si, _ar3_MockRandom_0.doc, _ar3_MockRandom_0.sd, _ar3_MockRandom_0.tim, _ar3_MockRandom_0.tip, _ar4.fdt, _ar4.fdx, _ar4.fnm, _ar4.nvd, _ar4.nvm, _ar4.si, _ar4_MockRandom_0.doc, _ar4_MockRandom_0.sd, _ar4_MockRandom_0.tio, _ar4_MockRandom_0.tipo, _ar5.fdt, _ar5.fdx, _ar5.fnm, _ar5.nvd, _ar5.nvm, _ar5.si, _ar5_MockRandom_0.doc, _ar5_MockRandom_0.sd, _ar5_MockRandom_0.tbk, _ar5_MockRandom_0.tix, _ar6.fdt, _ar6.fdx, _ar6.fnm, _ar6.nvd, _ar6.nvm, _ar6.si, _ar6_MockRandom_0.doc, _ar6_MockRandom_0.sd, _ar6_MockRandom_0.tib, _ar6_MockRandom_0.tiv, _ar7.fdt, _ar7.fdx, _ar7.fnm, _ar7.nvd, _ar7.nvm, _ar7.si, _ar7_MockRandom_0.doc, _ar7_MockRandom_0.sd, _ar7_MockRandom_0.tim, _ar7_MockRandom_0.tip, _ar8.fdt, _ar8.fdx, _ar8.fnm, _ar8.nvd, _ar8.nvm, _ar8.si, _ar8_MockRandom_0.doc, _ar8_MockRandom_0.sd, _ar8_MockRandom_0.tib, _ar8_MockRandom_0.tiv, _ar9.fdt, _ar9.fdx, _ar9.fnm, _ar9.nvd, _ar9.nvm, _ar9.si, _ar9_MockRandom_0.doc, _ar9_MockRandom_0.sd, _ar9_MockRandom_0.tio, _ar9_MockRandom_0.tipo, _ara.fdt, _ara.fdx, _ara.fnm, _ara.nvd, _ara.nvm, _ara.si, _ara_MockRandom_0.doc, _ara_MockRandom_0.sd, _ara_MockRandom_0.tfp, _arb.fdt, _arb.fdx, _arb.fnm, _arb.nvd, _arb.nvm, _arb.si, _arb_MockRandom_0.doc, _arb_MockRandom_0.sd, _arb_MockRandom_0.tio, _arb_MockRandom_0.tipo, _arc.fdt, _arc.fdx, _arc.fnm, _arc.nvd, _arc.nvm, _arc.si, _arc_MockRandom_0.doc, _arc_MockRandom_0.sd, _arc_MockRandom_0.tfp, _ard.fdt, _ard.fdx, _ard.fnm, _ard.nvd, _ard.nvm, _ard.si, _ard_MockRandom_0.doc, _ard_MockRandom_0.sd, _ard_MockRandom_0.tio, _ard_MockRandom_0.tipo, _are.fdt, _are.fdx, _are.fnm, _are.nvd, _are.nvm, _are.si, _are_MockRandom_0.doc, _are_MockRandom_0.sd, _are_MockRandom_0.tbk, _are_MockRandom_0.tix, _arf.fdt, _arf.fdx, _arf.fnm, _arf.nvd, _arf.nvm, _arf.si, _arf_MockRandom_0.doc, _arf_MockRandom_0.sd, _arf_MockRandom_0.tim, _arf_MockRandom_0.tip, _arg.fdt, _arg.fdx, _arg.fnm, _arg.nvd, _arg.nvm, _arg.si, _arg_MockRandom_0.doc, _arg_MockRandom_0.sd, _arg_MockRandom_0.tbk, _arg_MockRandom_0.tix, _arh.fdt, _arh.fdx, _arh.fnm, _arh.nvd, _arh.nvm, _arh.si, _arh_MockRandom_0.doc, _arh_MockRandom_0.sd, _arh_MockRandom_0.tio, _arh_MockRandom_0.tipo, _ari.fdt, _ari.fdx, _ari.fnm, _ari.nvd, _ari.nvm, _ari.si, _ari_MockRandom_0.doc, _ari_MockRandom_0.sd, _ari_MockRandom_0.tim, _ari_MockRandom_0.tip, _ark.fdt, _ark.fdx, _ark.fnm, _ark.nvd, _ark.nvm, _ark.si, _ark_MockRandom_0.doc, _ark_MockRandom_0.sd, _ark_MockRandom_0.tio, _ark_MockRandom_0.tipo, _arl.fdt, _arl.fdx, _arl.fnm, _arl.nvd, _arl.nvm, _arl.si, _arl_MockRandom_0.doc, _arl_MockRandom_0.sd, _arl_MockRandom_0.tbk, _arl_MockRandom_0.tix, _arm.fdt, _arm.fdx, _arm.fnm, _arm.nvd, _arm.nvm, _arm.si, _arm_MockRandom_0.doc, _arm_MockRandom_0.sd, _arm_MockRandom_0.tib, _arm_MockRandom_0.tii, _arn.fdt, _arn.fdx, _arn.fnm, _arn.nvd, _arn.nvm, _arn.si, _arn_MockRandom_0.doc, _arn_MockRandom_0.sd, _arn_MockRandom_0.tib, _arn_MockRandom_0.tii, _aro.fdt, _aro.fdx, _aro.fnm, _aro.nvd, _aro.nvm, _aro.si, _aro_MockRandom_0.doc, _aro_MockRandom_0.sd, _aro_MockRandom_0.tbk, _aro_MockRandom_0.tix, _arp.fdt, _arp.fdx, _arp.fnm, _arp.nvd, _arp.nvm, _arp.si, _arp_MockRandom_0.doc, _arp_MockRandom_0.sd, _arp_MockRandom_0.tio, _arp_MockRandom_0.tipo, _arq.fdt, _arq.fdx, _arq.fnm, _arq.nvd, _arq.nvm, _arq.si, _arq_MockRandom_0.doc, _arq_MockRandom_0.sd, _arq_MockRandom_0.tim, _arq_MockRandom_0.tip, _arr.fdt, _arr.fdx, _arr.fnm, _arr.nvd, _arr.nvm, _arr.si, _arr_MockRandom_0.doc, _arr_MockRandom_0.sd, _arr_MockRandom_0.tib, _arr_MockRandom_0.tiv, _ars.fdt, _ars.fdx, _ars.fnm, _ars.nvd, _ars.nvm, _ars.si, _ars_MockRandom_0.doc, _ars_MockRandom_0.sd, _ars_MockRandom_0.tim, _ars_MockRandom_0.tip, _art.fdt, _art.fdx, _art.fnm, _art.nvd, _art.nvm, _art.si, _art_MockRandom_0.doc, _art_MockRandom_0.sd, _art_MockRandom_0.tib, _art_MockRandom_0.tiv, _aru.fdt, _aru.fdx, _aru.fnm, _aru.nvd, _aru.nvm, _aru.si, _aru_MockRandom_0.doc, _aru_MockRandom_0.sd, _aru_MockRandom_0.tim, _aru_MockRandom_0.tip, _arv.fdt, _arv.fdx, _arv.fnm, _arv.nvd, _arv.nvm, _arv.si, _arv_MockRandom_0.doc, _arv_MockRandom_0.sd, _arv_MockRandom_0.tio, _arv_MockRandom_0.tipo, _arw.fdt, _arw.fdx, _arw.fnm, _arw.nvd, _arw.nvm, _arw.si, _arw_MockRandom_0.doc, _arw_MockRandom_0.sd, _arw_MockRandom_0.tfp, _arx.fdt, _arx.fdx, _arx.fnm, _arx.nvd, _arx.nvm, _arx.si, _arx_MockRandom_0.doc, _arx_MockRandom_0.sd, _arx_MockRandom_0.tim, _arx_MockRandom_0.tip, _ary.fdt, _ary.fdx, _ary.fnm, _ary.nvd, _ary.nvm, _ary.si, _ary_MockRandom_0.doc, _ary_MockRandom_0.sd, _ary_MockRandom_0.tfp, _arz.fdt, _arz.fdx, _arz.fnm, _arz.nvd, _arz.nvm, _arz.si, _arz_MockRandom_0.doc, _arz_MockRandom_0.sd, _arz_MockRandom_0.tbk, _arz_MockRandom_0.tix, segments_2]}]> but was:<[{indexVersion=1447153415414,generation=2,filelist=[_3z0.fdt, _3z0.fdx, _3z0.fnm, _3z0.nvd, _3z0.nvm, _3z0.si, _3z0_MockRandom_0.doc, _3z0_MockRandom_0.sd, _3z0_MockRandom_0.tib, _3z0_MockRandom_0.tii, _878.fdt, _878.fdx, _878.fnm, _878.nvd, _878.nvm, _878.si, _878_MockRandom_0.doc, _878_MockRandom_0.sd, _878_MockRandom_0.tib, _878_MockRandom_0.tii, _aqw.fdt, _aqw.fdx, _aqw.fnm, _aqw.nvd, _aqw.nvm, _aqw.si, _aqw_MockRandom_0.doc, _aqw_MockRandom_0.sd, _aqw_MockRandom_0.tbk, _aqw_MockRandom_0.tix, _aqx.fdt, _aqx.fdx, _aqx.fnm, _aqx.nvd, _aqx.nvm, _aqx.si, _aqx_MockRandom_0.doc, _aqx_MockRandom_0.sd, _aqx_MockRandom_0.tfp, _aqy.fdt, _aqy.fdx, _aqy.fnm, _aqy.nvd, _aqy.nvm, _aqy.si, _aqy_MockRandom_0.doc, _aqy_MockRandom_0.sd, _aqy_MockRandom_0.tim, _aqy_MockRandom_0.tip, _aqz.fdt, _aqz.fdx, _aqz.fnm, _aqz.nvd, _aqz.nvm, _aqz.si, _aqz_MockRandom_0.doc, _aqz_MockRandom_0.sd, _aqz_MockRandom_0.tim, _aqz_MockRandom_0.tip, _ar0.fdt, _ar0.fdx, _ar0.fnm, _ar0.nvd, _ar0.nvm, _ar0.si, _ar0_MockRandom_0.doc, _ar0_MockRandom_0.sd, _ar0_MockRandom_0.tim, _ar0_MockRandom_0.tip, _ar1.fdt, _ar1.fdx, _ar1.fnm, _ar1.nvd, _ar1.nvm, _ar1.si, _ar1_MockRandom_0.doc, _ar1_MockRandom_0.sd, _ar1_MockRandom_0.tfp, _ar2.fdt, _ar2.fdx, _ar2.fnm, _ar2.nvd, _ar2.nvm, _ar2.si, _ar2_MockRandom_0.doc, _ar2_MockRandom_0.sd, _ar2_MockRandom_0.tbk, _ar2_MockRandom_0.tix, _ar3.fdt, _ar3.fdx, _ar3.fnm, _ar3.nvd, _ar3.nvm, _ar3.si, _ar3_MockRandom_0.doc, _ar3_MockRandom_0.sd, _ar3_MockRandom_0.tim, _ar3_MockRandom_0.tip, _ar4.fdt, _ar4.fdx, _ar4.fnm, _ar4.nvd, _ar4.nvm, _ar4.si, _ar4_MockRandom_0.doc, _ar4_MockRandom_0.sd, _ar4_MockRandom_0.tio, _ar4_MockRandom_0.tipo, _ar5.fdt, _ar5.fdx, _ar5.fnm, _ar5.nvd, _ar5.nvm, _ar5.si, _ar5_MockRandom_0.doc, _ar5_MockRandom_0.sd, _ar5_MockRandom_0.tbk, _ar5_MockRandom_0.tix, _ar6.fdt, _ar6.fdx, _ar6.fnm, _ar6.nvd, _ar6.nvm, _ar6.si, _ar6_MockRandom_0.doc, _ar6_MockRandom_0.sd, _ar6_MockRandom_0.tib, _ar6_MockRandom_0.tiv, _ar7.fdt, _ar7.fdx, _ar7.fnm, _ar7.nvd, _ar7.nvm, _ar7.si, _ar7_MockRandom_0.doc, _ar7_MockRandom_0.sd, _ar7_MockRandom_0.tim, _ar7_MockRandom_0.tip, _ar8.fdt, _ar8.fdx, _ar8.fnm, _ar8.nvd, _ar8.nvm, _ar8.si, _ar8_MockRandom_0.doc, _ar8_MockRandom_0.sd, _ar8_MockRandom_0.tib, _ar8_MockRandom_0.tiv, _ar9.fdt, _ar9.fdx, _ar9.fnm, _ar9.nvd, _ar9.nvm, _ar9.si, _ar9_MockRandom_0.doc, _ar9_MockRandom_0.sd, _ar9_MockRandom_0.tio, _ar9_MockRandom_0.tipo, _ara.fdt, _ara.fdx, _ara.fnm, _ara.nvd, _ara.nvm, _ara.si, _ara_MockRandom_0.doc, _ara_MockRandom_0.sd, _ara_MockRandom_0.tfp, _arb.fdt, _arb.fdx, _arb.fnm, _arb.nvd, _arb.nvm, _arb.si, _arb_MockRandom_0.doc, _arb_MockRandom_0.sd, _arb_MockRandom_0.tio, _arb_MockRandom_0.tipo, _arc.fdt, _arc.fdx, _arc.fnm, _arc.nvd, _arc.nvm, _arc.si, _arc_MockRandom_0.doc, _arc_MockRandom_0.sd, _arc_MockRandom_0.tfp, _ard.fdt, _ard.fdx, _ard.fnm, _ard.nvd, _ard.nvm, _ard.si, _ard_MockRandom_0.doc, _ard_MockRandom_0.sd, _ard_MockRandom_0.tio, _ard_MockRandom_0.tipo, _are.fdt, _are.fdx, _are.fnm, _are.nvd, _are.nvm, _are.si, _are_MockRandom_0.doc, _are_MockRandom_0.sd, _are_MockRandom_0.tbk, _are_MockRandom_0.tix, _arf.fdt, _arf.fdx, _arf.fnm, _arf.nvd, _arf.nvm, _arf.si, _arf_MockRandom_0.doc, _arf_MockRandom_0.sd, _arf_MockRandom_0.tim, _arf_MockRandom_0.tip, _arg.fdt, _arg.fdx, _arg.fnm, _arg.nvd, _arg.nvm, _arg.si, _arg_MockRandom_0.doc, _arg_MockRandom_0.sd, _arg_MockRandom_0.tbk, _arg_MockRandom_0.tix, _arh.fdt, _arh.fdx, _arh.fnm, _arh.nvd, _arh.nvm, _arh.si, _arh_MockRandom_0.doc, _arh_MockRandom_0.sd, _arh_MockRandom_0.tio, _arh_MockRandom_0.tipo, _ari.fdt, _ari.fdx, _ari.fnm, _ari.nvd, _ari.nvm, _ari.si, _ari_MockRandom_0.doc, _ari_MockRandom_0.sd, _ari_MockRandom_0.tim, _ari_MockRandom_0.tip, _ark.fdt, _ark.fdx, _ark.fnm, _ark.nvd, _ark.nvm, _ark.si, _ark_MockRandom_0.doc, _ark_MockRandom_0.sd, _ark_MockRandom_0.tio, _ark_MockRandom_0.tipo, _arl.fdt, _arl.fdx, _arl.fnm, _arl.nvd, _arl.nvm, _arl.si, _arl_MockRandom_0.doc, _arl_MockRandom_0.sd, _arl_MockRandom_0.tbk, _arl_MockRandom_0.tix, _arm.fdt, _arm.fdx, _arm.fnm, _arm.nvd, _arm.nvm, _arm.si, _arm_MockRandom_0.doc, _arm_MockRandom_0.sd, _arm_MockRandom_0.tib, _arm_MockRandom_0.tii, _arn.fdt, _arn.fdx, _arn.fnm, _arn.nvd, _arn.nvm, _arn.si, _arn_MockRandom_0.doc, _arn_MockRandom_0.sd, _arn_MockRandom_0.tib, _arn_MockRandom_0.tii, _aro.fdt, _aro.fdx, _aro.fnm, _aro.nvd, _aro.nvm, _aro.si, _aro_MockRandom_0.doc, _aro_MockRandom_0.sd, _aro_MockRandom_0.tbk, _aro_MockRandom_0.tix, _arp.fdt, _arp.fdx, _arp.fnm, _arp.nvd, _arp.nvm, _arp.si, _arp_MockRandom_0.doc, _arp_MockRandom_0.sd, _arp_MockRandom_0.tio, _arp_MockRandom_0.tipo, _arq.fdt, _arq.fdx, _arq.fnm, _arq.nvd, _arq.nvm, _arq.si, _arq_MockRandom_0.doc, _arq_MockRandom_0.sd, _arq_MockRandom_0.tim, _arq_MockRandom_0.tip, _arr.fdt, _arr.fdx, _arr.fnm, _arr.nvd, _arr.nvm, _arr.si, _arr_MockRandom_0.doc, _arr_MockRandom_0.sd, _arr_MockRandom_0.tib, _arr_MockRandom_0.tiv, _ars.fdt, _ars.fdx, _ars.fnm, _ars.nvd, _ars.nvm, _ars.si, _ars_MockRandom_0.doc, _ars_MockRandom_0.sd, _ars_MockRandom_0.tim, _ars_MockRandom_0.tip, _art.fdt, _art.fdx, _art.fnm, _art.nvd, _art.nvm, _art.si, _art_MockRandom_0.doc, _art_MockRandom_0.sd, _art_MockRandom_0.tib, _art_MockRandom_0.tiv, _aru.fdt, _aru.fdx, _aru.fnm, _aru.nvd, _aru.nvm, _aru.si, _aru_MockRandom_0.doc, _aru_MockRandom_0.sd, _aru_MockRandom_0.tim, _aru_MockRandom_0.tip, _arv.fdt, _arv.fdx, _arv.fnm, _arv.nvd, _arv.nvm, _arv.si, _arv_MockRandom_0.doc, _arv_MockRandom_0.sd, _arv_MockRandom_0.tio, _arv_MockRandom_0.tipo, _arw.fdt, _arw.fdx, _arw.fnm, _arw.nvd, _arw.nvm, _arw.si, _arw_MockRandom_0.doc, _arw_MockRandom_0.sd, _arw_MockRandom_0.tfp, _arx.fdt, _arx.fdx, _arx.fnm, _arx.nvd, _arx.nvm, _arx.si, _arx_MockRandom_0.doc, _arx_MockRandom_0.sd, _arx_MockRandom_0.tim, _arx_MockRandom_0.tip, _ary.fdt, _ary.fdx, _ary.fnm, _ary.nvd, _ary.nvm, _ary.si, _ary_MockRandom_0.doc, _ary_MockRandom_0.sd, _ary_MockRandom_0.tfp, _arz.fdt, _arz.fdx, _arz.fnm, _arz.nvd, _arz.nvm, _arz.si, _arz_MockRandom_0.doc, _arz_MockRandom_0.sd, _arz_MockRandom_0.tbk, _arz_MockRandom_0.tix, segments_2]}, {indexVersion=1447153415414,generation=3,filelist=[_3z0.fdt, _3z0.fdx, _3z0.fnm, _3z0.nvd, _3z0.nvm, _3z0.si, _3z0_MockRandom_0.doc, _3z0_MockRandom_0.sd, _3z0_MockRandom_0.tib, _3z0_MockRandom_0.tii, _878.fdt, _878.fdx, _878.fnm, _878.nvd, _878.nvm, _878.si, _878_MockRandom_0.doc, _878_MockRandom_0.sd, _878_MockRandom_0.tib, _878_MockRandom_0.tii, _ari.fdt, _ari.fdx, _ari.fnm, _ari.nvd, _ari.nvm, _ari.si, _ari_MockRandom_0.doc, _ari_MockRandom_0.sd, _ari_MockRandom_0.tim, _ari_MockRandom_0.tip, _arj.fdt, _arj.fdx, _arj.fnm, _arj.nvd, _arj.nvm, _arj.si, _arj_MockRandom_0.doc, _arj_MockRandom_0.sd, _arj_MockRandom_0.tim, _arj_MockRandom_0.tip, _ark.fdt, _ark.fdx, _ark.fnm, _ark.nvd, _ark.nvm, _ark.si, _ark_MockRandom_0.doc, _ark_MockRandom_0.sd, _ark_MockRandom_0.tio, _ark_MockRandom_0.tipo, _arl.fdt, _arl.fdx, _arl.fnm, _arl.nvd, _arl.nvm, _arl.si, _arl_MockRandom_0.doc, _arl_MockRandom_0.sd, _arl_MockRandom_0.tbk, _arl_MockRandom_0.tix, _arm.fdt, _arm.fdx, _arm.fnm, _arm.nvd, _arm.nvm, _arm.si, _arm_MockRandom_0.doc, _arm_MockRandom_0.sd, _arm_MockRandom_0.tib, _arm_MockRandom_0.tii, _arn.fdt, _arn.fdx, _arn.fnm, _arn.nvd, _arn.nvm, _arn.si, _arn_MockRandom_0.doc, _arn_MockRandom_0.sd, _arn_MockRandom_0.tib, _arn_MockRandom_0.tii, _aro.fdt, _aro.fdx, _aro.fnm, _aro.nvd, _aro.nvm, _aro.si, _aro_MockRandom_0.doc, _aro_MockRandom_0.sd, _aro_MockRandom_0.tbk, _aro_MockRandom_0.tix, _arp.fdt, _arp.fdx, _arp.fnm, _arp.nvd, _arp.nvm, _arp.si, _arp_MockRandom_0.doc, _arp_MockRandom_0.sd, _arp_MockRandom_0.tio, _arp_MockRandom_0.tipo, _arq.fdt, _arq.fdx, _arq.fnm, _arq.nvd, _arq.nvm, _arq.si, _arq_MockRandom_0.doc, _arq_MockRandom_0.sd, _arq_MockRandom_0.tim, _arq_MockRandom_0.tip, _arr.fdt, _arr.fdx, _arr.fnm, _arr.nvd, _arr.nvm, _arr.si, _arr_MockRandom_0.doc, _arr_MockRandom_0.sd, _arr_MockRandom_0.tib, _arr_MockRandom_0.tiv, _ars.fdt, _ars.fdx, _ars.fnm, _ars.nvd, _ars.nvm, _ars.si, _ars_MockRandom_0.doc, _ars_MockRandom_0.sd, _ars_MockRandom_0.tim, _ars_MockRandom_0.tip, _art.fdt, _art.fdx, _art.fnm, _art.nvd, _art.nvm, _art.si, _art_MockRandom_0.doc, _art_MockRandom_0.sd, _art_MockRandom_0.tib, _art_MockRandom_0.tiv, _aru.fdt, _aru.fdx, _aru.fnm, _aru.nvd, _aru.nvm, _aru.si, _aru_MockRandom_0.doc, _aru_MockRandom_0.sd, _aru_MockRandom_0.tim, _aru_MockRandom_0.tip, _arv.fdt, _arv.fdx, _arv.fnm, _arv.nvd, _arv.nvm, _arv.si, _arv_MockRandom_0.doc, _arv_MockRandom_0.sd, _arv_MockRandom_0.tio, _arv_MockRandom_0.tipo, _arw.fdt, _arw.fdx, _arw.fnm, _arw.nvd, _arw.nvm, _arw.si, _arw_MockRandom_0.doc, _arw_MockRandom_0.sd, _arw_MockRandom_0.tfp, _arx.fdt, _arx.fdx, _arx.fnm, _arx.nvd, _arx.nvm, _arx.si, _arx_MockRandom_0.doc, _arx_MockRandom_0.sd, _arx_MockRandom_0.tim, _arx_MockRandom_0.tip, _ary.fdt, _ary.fdx, _ary.fnm, _ary.nvd, _ary.nvm, _ary.si, _ary_MockRandom_0.doc, _ary_MockRandom_0.sd, _ary_MockRandom_0.tfp, _arz.fdt, _arz.fdx, _arz.fnm, _arz.nvd, _arz.nvm, _arz.si, _arz_MockRandom_0.doc, _arz_MockRandom_0.sd, _arz_MockRandom_0.tbk, _arz_MockRandom_0.tix, segments_3]}]>
at __randomizedtesting.SeedInfo.seed([E4BD31AE554346D7:C16A2A9E250B48D4]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:147)
at org.apache.solr.handler.TestReplicationHandler.doTestReplicateAfterCoreReload(TestReplicationHandler.java:1138)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1660)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:866)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:902)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:875)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:777)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:811)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:822)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR
Error Message:
Captured an uncaught exception in thread: Thread[id=11750, name=coreZkRegister-2355-thread-2, state=RUNNABLE, group=TGRP-LeaderInitiatedRecoveryOnShardRestartTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=11750, name=coreZkRegister-2355-thread-2, state=RUNNABLE, group=TGRP-LeaderInitiatedRecoveryOnShardRestartTest]
at __randomizedtesting.SeedInfo.seed([E4BD31AE554346D7:3A375FD36EE12424]:0)
Caused by: java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([E4BD31AE554346D7]:0)
at org.apache.solr.cloud.ZkController.updateLeaderInitiatedRecoveryState(ZkController.java:2126)
at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:451)
at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:197)
at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:157)
at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:346)
at org.apache.solr.cloud.ZkController.joinElection(ZkController.java:1113)
at org.apache.solr.cloud.ZkController.register(ZkController.java:926)
at org.apache.solr.cloud.ZkController.register(ZkController.java:881)
at org.apache.solr.core.ZkContainer$2.run(ZkContainer.java:183)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:231)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 10230 lines...]
[junit4] Suite: org.apache.solr.handler.TestReplicationHandler
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E4BD31AE554346D7-001/init-core-data-001
[junit4] 2> 420419 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testRateLimitedReplication
[junit4] 2> 420420 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E4BD31AE554346D7-001/solr-instance-001/collection1
[junit4] 2> 420425 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ ] o.e.j.s.Server jetty-9.2.13.v20150730
[junit4] 2> 420444 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4b655932{/solr,null,AVAILABLE}
[junit4] 2> 420446 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ ] o.e.j.s.ServerConnector Started ServerConnector@72f313f3{HTTP/1.1}{127.0.0.1:54756}
[junit4] 2> 420446 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ ] o.e.j.s.Server Started @423882ms
[junit4] 2> 420446 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E4BD31AE554346D7-001/solr-instance-001/collection1/data, hostContext=/solr, hostPort=54756}
[junit4] 2> 420446 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 420446 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E4BD31AE554346D7-001/solr-instance-001/'
[junit4] 2> 420447 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 420447 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 420467 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E4BD31AE554346D7-001/solr-instance-001/solr.xml
[junit4] 2> 420476 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E4BD31AE554346D7-001/solr-instance-001/.
[junit4] 2> 420477 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ ] o.a.s.c.CoreContainer New CoreContainer 1460286206
[junit4] 2> 420477 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E4BD31AE554346D7-001/solr-instance-001/]
[junit4] 2> 420477 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E4BD31AE554346D7-001/solr-instance-001/lib
[junit4] 2> 420477 WARN (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E4BD31AE554346D7-001/solr-instance-001/lib).
[junit4] 2> 420486 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 420487 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 420488 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 420488 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 420488 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 420488 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 420489 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E4BD31AE554346D7-001/solr-instance-001/.
[junit4] 2> 420490 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E4BD31AE554346D7-001/solr-instance-001/./collection1, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E4BD31AE554346D7-001/solr-instance-001/./collection1/, dataDir=data/}
[junit4] 2> 420490 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E4BD31AE554346D7-001/solr-instance-001/./collection1/
[junit4] 2> 420490 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 420490 INFO (coreLoadExecutor-1551-thread-1) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E4BD31AE554346D7-001/solr-instance-001/./collection1/'
[junit4] 2> 420491 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4] 2> 420491 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 420491 INFO (coreLoadExecutor-1551-thread-1) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 420492 INFO (coreLoadExecutor-1551-thread-1) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 420517 INFO (coreLoadExecutor-1551-thread-1) [ ] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 420520 INFO (coreLoadExecutor-1551-thread-1) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 420526 INFO (coreLoadExecutor-1551-thread-1) [ ] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
[junit4] 2> 420526 INFO (coreLoadExecutor-1551-thread-1) [ ] o.a.s.s.IndexSchema Reading Solr Schema from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E4BD31AE554346D7-001/solr-instance-001/./collection1/conf/schema.xml
[junit4] 2> 420529 INFO (coreLoadExecutor-1551-thread-1) [ ] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 420531 INFO (coreLoadExecutor-1551-thread-1) [ ] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 420546 INFO (coreLoadExecutor-1551-thread-1) [ ] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E4BD31AE554346D7-001/solr-instance-001/./collection1/conf'
[junit4] 2> 420547 INFO (coreLoadExecutor-1551-thread-1) [ ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E4BD31AE554346D7-001/solr-instance-001/./collection1/
[junit4] 2> 420547 INFO (coreLoadExecutor-1551-thread-1) [ x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 420547 INFO (coreLoadExecutor-1551-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E4BD31AE554346D7-001/solr-instance-001/./collection1/], dataDir=[null]
[junit4] 2> 420547 INFO (coreLoadExecutor-1551-thread-1) [ x:collection1] o.a.s.c.SolrCore JMX monitoring not detected for core: collection1
[junit4] 2> 420548 INFO (coreLoadExecutor-1551-thread-1) [ x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E4BD31AE554346D7-001/solr-instance-001/./collection1/data
[junit4] 2> 420548 INFO (coreLoadExecutor-1551-thread-1) [ x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E4BD31AE554346D7-001/solr-instance-001/./collection1/data/index/
[junit4] 2> 420548 WARN (coreLoadExecutor-1551-thread-1) [ x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E4BD31AE554346D7-001/solr-instance-001/./collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 420548 INFO (coreLoadExecutor-1551-thread-1) [ x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E4BD31AE554346D7-001/solr-instance-001/./collection1/data/index
[junit4] 2> 420548 INFO (coreLoadExecutor-1551-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@19150d9a
[junit4] 2> 420549 INFO (coreLoadExecutor-1551-thread-1) [ x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@7a5e8545 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@51df0d47),segFN=segments_1,generation=1}
[junit4] 2> 420549 INFO (coreLoadExecutor-1551-thread-1) [ x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 420552 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [ x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E4BD31AE554346D7-001/solr-instance-001/./collection1/data/
[junit4] 2> 420553 INFO (coreLoadExecutor-1551-thread-1) [ x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 420555 INFO (coreLoadExecutor-1551-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 420555 INFO (coreLoadExecutor-1551-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 420556 INFO (coreLoadExecutor-1551-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 420557 INFO (coreLoadExecutor-1551-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 420561 INFO (coreLoadExecutor-1551-thread-1) [ x:collection1] o.a.s.c.PluginBag requestHandler : 'lazy' created with startup=lazy
[junit4] 2> 420561 INFO (coreLoadExecutor-1551-thread-1) [ x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,lazy,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,defaults,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 420562 INFO (coreLoadExecutor-1551-thread-1) [ x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 420564 INFO (coreLoadExecutor-1551-thread-1) [ x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
[junit4] 2> 420564 INFO (coreLoadExecutor-1551-thread-1) [ x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
[junit4] 2> 420564 INFO (coreLoadExecutor-1551-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=22, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 420565 INFO (coreLoadExecutor-1551-thread-1) [ x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@7a5e8545 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@51df0d47),segFN=segments_1,generation=1}
[junit4] 2> 420565 INFO (coreLoadExecutor-1551-thread-1) [ x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 420565 INFO (coreLoadExecutor-1551-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@68ab2281[collection1] main
[junit4] 2> 420566 INFO (coreLoadExecutor-1551-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E4BD31AE554346D7-001/solr-instance-001/./collection1/conf
[junit4] 2> 420566 INFO (coreLoadExecutor-1551-thread-1) [ x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {storageDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E4BD31AE554346D7-001/solr-instance-001/./collection1/conf}
[junit4] 2> 420566 INFO (coreLoadExecutor-1551-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using file:dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E4BD31AE554346D7-001/solr-instance-001/./collection1/conf
[junit4] 2> 420566 INFO (coreLoadExecutor-1551-thread-1) [ x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 420567 INFO (coreLoadExecutor-1551-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Replication enabled for following config files: schema.xml,xslt/dummy.xsl
[junit4] 2> 420567 INFO (coreLoadExecutor-1551-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 420567 INFO (searcherExecutor-1552-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@68ab2281[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 420567 INFO (coreLoadExecutor-1551-thread-1) [ x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 420993 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E4BD31AE554346D7-001/solr-instance-002/collection1
[junit4] 2> 420996 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ ] o.e.j.s.Server jetty-9.2.13.v20150730
[junit4] 2> 420998 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1452e3ef{/solr,null,AVAILABLE}
[junit4] 2> 421002 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ ] o.e.j.s.ServerConnector Started ServerConnector@5aa0e691{HTTP/1.1}{127.0.0.1:36820}
[junit4] 2> 421002 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ ] o.e.j.s.Server Started @424438ms
[junit4] 2> 421002 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E4BD31AE554346D7-001/solr-instance-002/collection1/data, hostContext=/solr, hostPort=36820}
[junit4] 2> 421002 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 421002 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E4BD31AE554346D7-001/solr-instance-002/'
[junit4] 2> 421002 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 421002 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 421019 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E4BD31AE554346D7-001/solr-instance-002/solr.xml
[junit4] 2> 421023 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E4BD31AE554346D7-001/solr-instance-002/.
[junit4] 2> 421024 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ ] o.a.s.c.CoreContainer New CoreContainer 820092076
[junit4] 2> 421024 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E4BD31AE554346D7-001/solr-instance-002/]
[junit4] 2> 421024 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E4BD31AE554346D7-001/solr-instance-002/lib
[junit4] 2> 421024 WARN (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E4BD31AE554346D7-001/solr-instance-002/lib).
[junit4] 2> 421033 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 421035 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 421035 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 421035 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 421035 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 421035 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 421036 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E4BD31AE554346D7-001/solr-instance-002/.
[junit4] 2> 421037 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E4BD31AE554346D7-001/solr-instance-002/./collection1, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E4BD31AE554346D7-001/solr-instance-002/./collection1/, dataDir=data/}
[junit4] 2> 421037 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E4BD31AE554346D7-001/solr-instance-002/./collection1/
[junit4] 2> 421037 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 421037 INFO (coreLoadExecutor-1561-thread-1) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E4BD31AE554346D7-001/solr-instance-002/./collection1/'
[junit4] 2> 421038 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4] 2> 421039 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 421039 INFO (coreLoadExecutor-1561-thread-1) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 421039 INFO (coreLoadExecutor-1561-thread-1) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 421059 INFO (coreLoadExecutor-1561-thread-1) [ ] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 421063 INFO (coreLoadExecutor-1561-thread-1) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 421071 INFO (coreLoadExecutor-1561-thread-1) [ ] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
[junit4] 2> 421071 INFO (coreLoadExecutor-1561-thread-1) [ ] o.a.s.s.IndexSchema Reading Solr Schema from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E4BD31AE554346D7-001/solr-instance-002/./collection1/conf/schema.xml
[junit4] 2> 421075 INFO (coreLoadExecutor-1561-thread-1) [ ] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 421078 INFO (coreLoadExecutor-1561-thread-1) [ ] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 421079 INFO (coreLoadExecutor-1561-thread-1) [ ] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E4BD31AE554346D7-001/solr-instance-002/./collection1/conf'
[junit4] 2> 421079 INFO (coreLoadExecutor-1561-thread-1) [ ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E4BD31AE554346D7-001/solr-instance-002/./collection1/
[junit4] 2> 421080 INFO (coreLoadExecutor-1561-thread-1) [ x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 421080 INFO (coreLoadExecutor-1561-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E4BD31AE554346D7-001/solr-instance-002/./collection1/], dataDir=[null]
[junit4] 2> 421080 INFO (coreLoadExecutor-1561-thread-1) [ x:collection1] o.a.s.c.SolrCore JMX monitoring not detected for core: collection1
[junit4] 2> 421080 INFO (coreLoadExecutor-1561-thread-1) [ x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E4BD31AE554346D7-001/solr-instance-002/./collection1/data
[junit4] 2> 421080 INFO (coreLoadExecutor-1561-thread-1) [ x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E4BD31AE554346D7-001/solr-instance-002/./collection1/data/index/
[junit4] 2> 421081 WARN (coreLoadExecutor-1561-thread-1) [ x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E4BD31AE554346D7-001/solr-instance-002/./collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 421081 INFO (coreLoadExecutor-1561-thread-1) [ x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E4BD31AE554346D7-001/solr-instance-002/./collection1/data/index
[junit4] 2> 421081 INFO (coreLoadExecutor-1561-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@19cfb3f2
[junit4] 2> 421082 INFO (coreLoadExecutor-1561-thread-1) [ x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@256ca5a2 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@209e727c),segFN=segments_1,generation=1}
[junit4] 2> 421082 INFO (coreLoadExecutor-1561-thread-1) [ x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 421082 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [ x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E4BD31AE554346D7-001/solr-instance-002/./collection1/data/
[junit4] 2> 421085 INFO (coreLoadExecutor-1561-thread-1) [ x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 421087 INFO (coreLoadExecutor-1561-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 421088 INFO (coreLoadExecutor-1561-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 421089 INFO (coreLoadExecutor-1561-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 421090 INFO (coreLoadExecutor-1561-thread-1) [ x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 421091 INFO (coreLoadExecutor-1561-thread-1) [ x:collection1] o.a.s.c.PluginBag requestHandler : 'lazy' created with startup=lazy
[junit4] 2> 421091 INFO (coreLoadExecutor-1561-thread-1) [ x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,lazy,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,defaults,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 421091 INFO (coreLoadExecutor-1561-thread-1) [ x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 421092 INFO (coreLoadExecutor-1561-thread-1) [ x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
[junit4] 2> 421092 INFO (coreLoadExecutor-1561-thread-1) [ x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
[junit4] 2> 421092 INFO (coreLoadExecutor-1561-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=22, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 421092 INFO (coreLoadExecutor-1561-thread-1) [ x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@256ca5a2 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@209e727c),segFN=segments_1,generation=1}
[junit4] 2> 421092 INFO (coreLoadExecutor-1561-thread-1) [ x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 421092 INFO (coreLoadExecutor-1561-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@2b8d3657[collection1] main
[junit4] 2> 421092 INFO (coreLoadExecutor-1561-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E4BD31AE554346D7-001/solr-instance-002/./collection1/conf
[junit4] 2> 421092 INFO (coreLoadExecutor-1561-thread-1) [ x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {storageDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E4BD31AE554346D7-001/solr-instance-002/./collection1/conf}
[junit4] 2> 421093 INFO (coreLoadExecutor-1561-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using file:dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E4BD31AE554346D7-001/solr-instance-002/./collection1/conf
[junit4] 2> 421093 INFO (coreLoadExecutor-1561-thread-1) [ x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 421095 INFO (coreLoadExecutor-1561-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 1000ms
[junit4] 2> 421095 INFO (searcherExecutor-1562-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@2b8d3657[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 421095 INFO (coreLoadExecutor-1561-thread-1) [ x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 421544 INFO (qtp1936569449-9616) [ x:collection1] o.a.s.c.SolrCore [collection1] REMOVING ALL DOCUMENTS FROM INDEX
[junit4] 2> 421544 INFO (qtp1936569449-9616) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {deleteByQuery=*:*} 0 1
[junit4] 2> 421550 INFO (qtp292579144-9634) [ x:collection1] o.a.s.c.SolrCore [collection1] REMOVING ALL DOCUMENTS FROM INDEX
[junit4] 2> 421555 INFO (qtp292579144-9634) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {deleteByQuery=*:*} 0 4
[junit4] 2> 421559 INFO (qtp1936569449-9617) [ x:collection1] o.a.s.u.UpdateHandler start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 421560 INFO (qtp1936569449-9617) [ x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=2
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@7a5e8545 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@51df0d47),segFN=segments_1,generation=1}
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@7a5e8545 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@51df0d47),segFN=segments_2,generation=2}
[junit4] 2> 421561 INFO (qtp1936569449-9617) [ x:collection1] o.a.s.c.SolrCore newest commit generation = 2
[junit4] 2> 421564 INFO (qtp1936569449-9617) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@153f2b34[collection1] main
[junit4] 2> 421564 INFO (qtp1936569449-9617) [ x:collection1] o.a.s.u.UpdateHandler end_commit_flush
[junit4] 2> 421564 INFO (searcherExecutor-1552-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@153f2b34[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 421564 INFO (qtp1936569449-9617) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2} {commit=} 0 5
[junit4] 2> 421567 INFO (qtp292579144-9635) [ x:collection1] o.a.s.u.UpdateHandler start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 421572 INFO (qtp292579144-9635) [ x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=2
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@256ca5a2 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@209e727c),segFN=segments_1,generation=1}
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@256ca5a2 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@209e727c),segFN=segments_2,generation=2}
[junit4] 2> 421573 INFO (qtp292579144-9635) [ x:collection1] o.a.s.c.SolrCore newest commit generation = 2
[junit4] 2> 421575 INFO (qtp292579144-9635) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@5639650e[collection1] main
[junit4] 2> 421575 INFO (qtp292579144-9635) [ x:collection1] o.a.s.u.UpdateHandler end_commit_flush
[junit4] 2> 421575 INFO (searcherExecutor-1562-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@5639650e[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 421576 INFO (qtp292579144-9635) [ x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=/solr path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2} {commit=} 0 8
[junit4] 2> 421579 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ ] o.e.j.s.ServerConnector Stopped ServerConnector@72f313f3{HTTP/1.1}{127.0.0.1:0}
[junit4] 2> 421579 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1460286206
[junit4] 2> 421579 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ x:collection1] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@76e604d6
[junit4] 2> 421579 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ x:collection1] o.a.s.u.UpdateHandler closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0}
[junit4] 2> 421582 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ x:collection1] o.a.s.u.SolrCoreState Closing SolrCoreState
[junit4] 2> 421582 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ x:collection1] o.a.s.u.DefaultSolrCoreState SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 421582 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ x:collection1] o.a.s.u.DefaultSolrCoreState closing IndexWriter with IndexWriterCloser
[junit4] 2> 421583 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ x:collection1] o.a.s.c.SolrCore [collection1] Closing main searcher on request.
[junit4] 2> 421583 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 421583 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E4BD31AE554346D7-001/solr-instance-001/./collection1/data/index [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E4BD31AE554346D7-001/solr-instance-001/./collection1/data/index;done=false>>]
[junit4] 2> 421584 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E4BD31AE554346D7-001/solr-instance-001/./collection1/data/index
[junit4] 2> 421584 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E4BD31AE554346D7-001/solr-instance-001/./collection1/data [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E4BD31AE554346D7-001/solr-instance-001/./collection1/data;done=false>>]
[junit4] 2> 421584 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E4BD31AE554346D7-001/solr-instance-001/./collection1/data
[junit4] 2> 421584 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ x:collection1] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@4b655932{/solr,null,UNAVAILABLE}
[junit4] 2> 421586 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ ] o.e.j.s.ServerConnector Stopped ServerConnector@5aa0e691{HTTP/1.1}{127.0.0.1:0}
[junit4] 2> 421586 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=820092076
[junit4] 2> 421587 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ x:collection1] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@3c2abaf9
[junit4] 2> 421588 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ x:collection1] o.a.s.u.UpdateHandler closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0}
[junit4] 2> 421589 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ x:collection1] o.a.s.u.SolrCoreState Closing SolrCoreState
[junit4] 2> 421589 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ x:collection1] o.a.s.u.DefaultSolrCoreState SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 421589 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ x:collection1] o.a.s.u.DefaultSolrCoreState closing IndexWriter with IndexWriterCloser
[junit4] 2> 421589 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ x:collection1] o.a.s.c.SolrCore [collection1] Closing main searcher on request.
[junit4] 2> 421590 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 421590 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E4BD31AE554346D7-001/solr-instance-002/./collection1/data/index [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E4BD31AE554346D7-001/solr-instance-002/./collection1/data/index;done=false>>]
[junit4] 2> 421590 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E4BD31AE554346D7-001/solr-instance-002/./collection1/data/index
[junit4] 2> 421590 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E4BD31AE554346D7-001/solr-instance-002/./collection1/data [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E4BD31AE554346D7-001/solr-instance-002/./collection1/data;done=false>>]
[junit4] 2> 421590 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E4BD31AE554346D7-001/solr-instance-002/./collection1/data
[junit4] 2> 421590 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ x:collection1] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@1452e3ef{/solr,null,UNAVAILABLE}
[junit4] 2> 421593 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ ] o.e.j.s.Server jetty-9.2.13.v20150730
[junit4] 2> 421594 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1835cd38{/solr,null,AVAILABLE}
[junit4] 2> 421595 INFO (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[E4BD31AE554346D7]) [ ] o
[...truncated too long message...]
2> 1270973 INFO (zkCallback-1028-thread-1-processing-n:127.0.0.1:33121_) [n:127.0.0.1:33121_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.ElectionContext Canceling election /collections/collection1/leader_elect/shard1/election/94840646684311571-core_node2-n_0000000003
[junit4] 2> 1270973 WARN (zkCallback-1028-thread-1-processing-n:127.0.0.1:33121_) [n:127.0.0.1:33121_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.LeaderElector
[junit4] 2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election/94840646684311571-core_node2-n_0000000003
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:244)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:241)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:241)
[junit4] 2> at org.apache.solr.cloud.ElectionContext.cancelElection(ElectionContext.java:86)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContextBase.cancelElection(ElectionContext.java:169)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.cancelElection(ElectionContext.java:285)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:467)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:197)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:157)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:58)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:388)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3$1.run(SolrZkClient.java:269)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:231)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 1271467 WARN (zkCallback-1028-thread-3-processing-n:127.0.0.1:33121_) [n:127.0.0.1:33121_ ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 1271468 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[E4BD31AE554346D7]) [ ] o.e.j.s.ServerConnector Stopped ServerConnector@61b70a07{HTTP/1.1}{127.0.0.1:33121}
[junit4] 2> 1271469 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[E4BD31AE554346D7]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@578fda5a{/,null,UNAVAILABLE}
[junit4] 2> 1271471 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[E4BD31AE554346D7]) [n:127.0.0.1:33121_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.ChaosMonkey monkey: stop shard! 55051
[junit4] 2> 1271472 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[E4BD31AE554346D7]) [n:127.0.0.1:33121_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.ZkTestServer connecting to 127.0.0.1:50791 50791
[junit4] 2> 1271698 INFO (Thread-8295) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:50791 50791
[junit4] 2> 1271699 WARN (Thread-8295) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 7 /solr/aliases.json
[junit4] 2> 6 /solr/security.json
[junit4] 2> 5 /solr/configs/conf1
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 13 /solr/collections/collection1/state.json
[junit4] 2> 11 /solr/clusterstate.json
[junit4] 2> 3 /solr/overseer_elect/election/94840646684311556-127.0.0.1:55051_-n_0000000000
[junit4] 2> 3 /solr/collections/all_in_lir/state.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 11 /solr/live_nodes
[junit4] 2> 8 /solr/collections
[junit4] 2> 3 /solr/overseer/queue
[junit4] 2> 3 /solr/overseer/collection-queue-work
[junit4] 2>
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=LeaderInitiatedRecoveryOnShardRestartTest -Dtests.method=testRestartWithAllInLIR -Dtests.seed=E4BD31AE554346D7 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=ar_SY -Dtests.timezone=Europe/Moscow -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[junit4] ERROR 41.4s J0 | LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR <<<
[junit4] > Throwable #1: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=11750, name=coreZkRegister-2355-thread-2, state=RUNNABLE, group=TGRP-LeaderInitiatedRecoveryOnShardRestartTest]
[junit4] > at __randomizedtesting.SeedInfo.seed([E4BD31AE554346D7:3A375FD36EE12424]:0)
[junit4] > Caused by: java.lang.AssertionError
[junit4] > at __randomizedtesting.SeedInfo.seed([E4BD31AE554346D7]:0)
[junit4] > at org.apache.solr.cloud.ZkController.updateLeaderInitiatedRecoveryState(ZkController.java:2126)
[junit4] > at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:451)
[junit4] > at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:197)
[junit4] > at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:157)
[junit4] > at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:346)
[junit4] > at org.apache.solr.cloud.ZkController.joinElection(ZkController.java:1113)
[junit4] > at org.apache.solr.cloud.ZkController.register(ZkController.java:926)
[junit4] > at org.apache.solr.cloud.ZkController.register(ZkController.java:881)
[junit4] > at org.apache.solr.core.ZkContainer$2.run(ZkContainer.java:183)
[junit4] > at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:231)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 1271701 INFO (SUITE-LeaderInitiatedRecoveryOnShardRestartTest-seed#[E4BD31AE554346D7]-worker) [n:127.0.0.1:33121_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene60): {}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=false,coord=yes): {}, locale=ar_SY, timezone=Europe/Moscow
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_66 (64-bit)/cpus=4,threads=1,free=93718608,total=421003264
[junit4] 2> NOTE: All tests run in this JVM: [SimpleCollectionCreateDeleteTest, OverseerRolesTest, TestExactStatsCache, ResponseLogComponentTest, TestHighlightDedupGrouping, TestSolrConfigHandlerCloud, CdcrReplicationHandlerTest, TestReplicaProperties, TestRTGBase, TestConfigSetsAPIExclusivity, PeerSyncTest, TestMaxScoreQueryParser, TestAtomicUpdateErrorCases, OverseerStatusTest, CloneFieldUpdateProcessorFactoryTest, TestHdfsUpdateLog, RequiredFieldsTest, TestReplicationHandler, SolrCoreTest, FacetPivotSmallTest, PreAnalyzedFieldTest, LeaderInitiatedRecoveryOnShardRestartTest]
[junit4] Completed [152/556] on J0 in 41.78s, 1 test, 1 error <<< FAILURES!
[...truncated 1295 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987: There were test failures: 556 suites (8 ignored), 2207 tests, 1 error, 2 failures, 32 ignored (18 assumptions) [seed: E4BD31AE554346D7]
Total time: 204 minutes 36 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 847 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/847/
1 tests failed.
FAILED: org.apache.solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR
Error Message:
Captured an uncaught exception in thread: Thread[id=5532, name=coreZkRegister-1177-thread-1, state=RUNNABLE, group=TGRP-LeaderInitiatedRecoveryOnShardRestartTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=5532, name=coreZkRegister-1177-thread-1, state=RUNNABLE, group=TGRP-LeaderInitiatedRecoveryOnShardRestartTest]
at __randomizedtesting.SeedInfo.seed([C18643A00F840DE6:1F0C2DDD34266F15]:0)
Caused by: java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([C18643A00F840DE6]:0)
at org.apache.solr.cloud.ZkController.updateLeaderInitiatedRecoveryState(ZkController.java:2126)
at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:451)
at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:197)
at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:157)
at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:346)
at org.apache.solr.cloud.ZkController.joinElection(ZkController.java:1113)
at org.apache.solr.cloud.ZkController.register(ZkController.java:926)
at org.apache.solr.cloud.ZkController.register(ZkController.java:881)
at org.apache.solr.core.ZkContainer$2.run(ZkContainer.java:183)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:231)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 10073 lines...]
[junit4] Suite: org.apache.solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_C18643A00F840DE6-001/init-core-data-001
[junit4] 2> 516930 INFO (SUITE-LeaderInitiatedRecoveryOnShardRestartTest-seed#[C18643A00F840DE6]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /aw_/
[junit4] 2> 516933 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 516934 INFO (Thread-3513) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 516934 INFO (Thread-3513) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 517034 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.ZkTestServer start zk server on port:38041
[junit4] 2> 517034 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 517035 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 517038 INFO (zkCallback-456-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3765e6c3 name:ZooKeeperConnection Watcher:127.0.0.1:38041 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 517038 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 517038 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 517038 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 517040 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 517041 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 517042 INFO (zkCallback-457-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@13ea22fd name:ZooKeeperConnection Watcher:127.0.0.1:38041/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 517042 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 517042 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 517042 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
[junit4] 2> 517044 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
[junit4] 2> 517046 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
[junit4] 2> 517048 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
[junit4] 2> 517049 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 517050 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 517052 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 517052 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
[junit4] 2> 517056 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 517056 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 517058 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 517059 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
[junit4] 2> 517061 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 517061 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
[junit4] 2> 517063 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 517063 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
[junit4] 2> 517066 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 517066 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 517069 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 517069 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 517071 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 517071 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 517073 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 517073 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 517075 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 517075 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
[junit4] 2> 517400 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_C18643A00F840DE6-001/control-001/cores/collection1
[junit4] 2> 517406 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.e.j.s.Server jetty-9.2.13.v20150730
[junit4] 2> 517408 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@71e8a701{/aw_,null,AVAILABLE}
[junit4] 2> 517416 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.e.j.s.ServerConnector Started ServerConnector@19bcf3d2{HTTP/1.1}{127.0.0.1:33540}
[junit4] 2> 517416 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.e.j.s.Server Started @520205ms
[junit4] 2> 517416 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_C18643A00F840DE6-001/tempDir-001/control/data, hostContext=/aw_, hostPort=33540, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_C18643A00F840DE6-001/control-001/cores}
[junit4] 2> 517417 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 517417 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_C18643A00F840DE6-001/control-001/'
[junit4] 2> 517417 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 517418 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 517438 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 517438 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 517440 INFO (zkCallback-458-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@33b2323e name:ZooKeeperConnection Watcher:127.0.0.1:38041/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 517440 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 517441 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 517443 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 517443 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_C18643A00F840DE6-001/control-001/solr.xml
[junit4] 2> 517449 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_C18643A00F840DE6-001/control-001/cores
[junit4] 2> 517449 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.CoreContainer New CoreContainer 1877902892
[junit4] 2> 517449 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_C18643A00F840DE6-001/control-001/]
[junit4] 2> 517449 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_C18643A00F840DE6-001/control-001/lib
[junit4] 2> 517449 WARN (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_C18643A00F840DE6-001/control-001/lib).
[junit4] 2> 517456 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 517457 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 517458 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 517458 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 517458 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38041/solr
[junit4] 2> 517458 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 517458 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 517460 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 517464 INFO (zkCallback-460-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@546ef8c1 name:ZooKeeperConnection Watcher:127.0.0.1:38041 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 517467 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 517468 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 517472 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [n:127.0.0.1:33540_aw_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 517473 INFO (zkCallback-461-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3b215888 name:ZooKeeperConnection Watcher:127.0.0.1:38041/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 517473 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [n:127.0.0.1:33540_aw_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 517474 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [n:127.0.0.1:33540_aw_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
[junit4] 2> 517476 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [n:127.0.0.1:33540_aw_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 517479 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [n:127.0.0.1:33540_aw_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 517481 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [n:127.0.0.1:33540_aw_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 517484 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [n:127.0.0.1:33540_aw_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 517486 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [n:127.0.0.1:33540_aw_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 517488 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [n:127.0.0.1:33540_aw_ ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 517489 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [n:127.0.0.1:33540_aw_ ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 517490 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [n:127.0.0.1:33540_aw_ ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 517491 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [n:127.0.0.1:33540_aw_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33540_aw_
[junit4] 2> 517492 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [n:127.0.0.1:33540_aw_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:33540_aw_
[junit4] 2> 517494 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [n:127.0.0.1:33540_aw_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 517498 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [n:127.0.0.1:33540_aw_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 517499 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [n:127.0.0.1:33540_aw_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 517499 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [n:127.0.0.1:33540_aw_ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94835062127853572-127.0.0.1:33540_aw_-n_0000000000
[junit4] 2> 517500 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [n:127.0.0.1:33540_aw_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:33540_aw_
[junit4] 2> 517500 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [n:127.0.0.1:33540_aw_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
[junit4] 2> 517502 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [n:127.0.0.1:33540_aw_ ] o.a.s.c.Overseer Overseer (id=94835062127853572-127.0.0.1:33540_aw_-n_0000000000) starting
[junit4] 2> 517503 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [n:127.0.0.1:33540_aw_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
[junit4] 2> 517509 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [n:127.0.0.1:33540_aw_ ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 517510 INFO (OverseerStateUpdate-94835062127853572-127.0.0.1:33540_aw_-n_0000000000) [n:127.0.0.1:33540_aw_ ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 517510 INFO (OverseerStateUpdate-94835062127853572-127.0.0.1:33540_aw_-n_0000000000) [n:127.0.0.1:33540_aw_ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 517516 INFO (OverseerCollectionConfigSetProcessor-94835062127853572-127.0.0.1:33540_aw_-n_0000000000) [n:127.0.0.1:33540_aw_ ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
[junit4] 2> 517516 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [n:127.0.0.1:33540_aw_ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 517543 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [n:127.0.0.1:33540_aw_ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 517543 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [n:127.0.0.1:33540_aw_ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 517544 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [n:127.0.0.1:33540_aw_ ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_C18643A00F840DE6-001/control-001/cores
[junit4] 2> 517545 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [n:127.0.0.1:33540_aw_ ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_C18643A00F840DE6-001/control-001/cores/collection1, collection=control_collection, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_C18643A00F840DE6-001/control-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 517545 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [n:127.0.0.1:33540_aw_ ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_C18643A00F840DE6-001/control-001/cores/collection1/
[junit4] 2> 517545 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [n:127.0.0.1:33540_aw_ ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 517546 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 517547 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 517549 INFO (OverseerStateUpdate-94835062127853572-127.0.0.1:33540_aw_-n_0000000000) [n:127.0.0.1:33540_aw_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:33540/aw_",
[junit4] 2> "node_name":"127.0.0.1:33540_aw_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 517549 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 517549 INFO (OverseerStateUpdate-94835062127853572-127.0.0.1:33540_aw_-n_0000000000) [n:127.0.0.1:33540_aw_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:33540/aw_",
[junit4] 2> "node_name":"127.0.0.1:33540_aw_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 517550 INFO (OverseerStateUpdate-94835062127853572-127.0.0.1:33540_aw_-n_0000000000) [n:127.0.0.1:33540_aw_ ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
[junit4] 2> 517550 INFO (OverseerStateUpdate-94835062127853572-127.0.0.1:33540_aw_-n_0000000000) [n:127.0.0.1:33540_aw_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 517552 INFO (zkCallback-461-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 517556 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [n:127.0.0.1:33540_aw_ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2
[junit4] 2> 517556 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [n:127.0.0.1:33540_aw_ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 517560 INFO (zkCallback-461-thread-2-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 518550 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 518550 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
[junit4] 2> 518550 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 518550 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 518551 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 518551 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_C18643A00F840DE6-001/control-001/cores/collection1/'
[junit4] 2> 518551 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 518551 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 518567 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 518571 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 518575 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 518583 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
[junit4] 2> 518584 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 518588 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 518679 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 518684 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 518685 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 518693 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 518695 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 518697 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 518698 WARN (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 518698 WARN (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 518698 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 518699 WARN (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 518699 WARN (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 518700 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2
[junit4] 2> 518700 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 518700 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 518700 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_C18643A00F840DE6-001/control-001/cores/collection1/], dataDir=[null]
[junit4] 2> 518701 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4cdc1872
[junit4] 2> 518701 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_C18643A00F840DE6-001/control-001/cores/collection1/data
[junit4] 2> 518701 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_C18643A00F840DE6-001/control-001/cores/collection1/data/index/
[junit4] 2> 518701 WARN (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_C18643A00F840DE6-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 518702 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_C18643A00F840DE6-001/control-001/cores/collection1/data/index
[junit4] 2> 518702 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=8, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7124848842333312]
[junit4] 2> 518702 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@6f3f70b4 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39f018b),segFN=segments_1,generation=1}
[junit4] 2> 518702 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 518703 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_C18643A00F840DE6-001/control-001/cores/collection1/data/
[junit4] 2> 518703 WARN (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_C18643A00F840DE6-001/control-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
[junit4] 2> 518706 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 518707 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
[junit4] 2> 518707 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 518707 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 518707 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 518707 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 518707 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 518707 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 518707 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 518707 WARN (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,args = {defaults={a=A,b=B}}}
[junit4] 2> 518709 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 518710 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 518711 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 518712 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 518715 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/dump,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 518715 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 518716 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 518716 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 518716 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
[junit4] 2> 518716 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
[junit4] 2> 518717 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=37, maxMergeAtOnceExplicit=16, maxMergedSegmentMB=71.693359375, floorSegmentMB=1.576171875, forceMergeDeletesPctAllowed=1.3312590507759703, segmentsPerTier=26.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6840759245306348
[junit4] 2> 518717 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@6f3f70b4 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39f018b),segFN=segments_1,generation=1}
[junit4] 2> 518717 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 518717 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@70e974ff[collection1] main
[junit4] 2> 518718 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 518718 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 518718 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 518719 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 518719 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
[junit4] 2> 518719 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 518719 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 518719 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 518719 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 518719 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 518720 INFO (searcherExecutor-1140-thread-1-processing-n:127.0.0.1:33540_aw_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@70e974ff[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 518720 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
[junit4] 2> 518720 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
[junit4] 2> 518720 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
[junit4] 2> 518720 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1517360995917365248
[junit4] 2> 518722 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 2.0ms to seed version buckets with highest version 1517360995917365248
[junit4] 2> 518722 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
[junit4] 2> 518722 INFO (coreLoadExecutor-1139-thread-1-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 518723 INFO (coreZkRegister-1133-thread-1-processing-n:127.0.0.1:33540_aw_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:33540/aw_ collection:control_collection shard:shard1
[junit4] 2> 518724 INFO (coreZkRegister-1133-thread-1-processing-n:127.0.0.1:33540_aw_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 518728 INFO (coreZkRegister-1133-thread-1-processing-n:127.0.0.1:33540_aw_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/94835062127853572-core_node1-n_0000000000
[junit4] 2> 518729 INFO (coreZkRegister-1133-thread-1-processing-n:127.0.0.1:33540_aw_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1
[junit4] 2> 518730 INFO (coreZkRegister-1133-thread-1-processing-n:127.0.0.1:33540_aw_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 518730 INFO (coreZkRegister-1133-thread-1-processing-n:127.0.0.1:33540_aw_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 518730 INFO (coreZkRegister-1133-thread-1-processing-n:127.0.0.1:33540_aw_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:33540/aw_/collection1/
[junit4] 2> 518730 INFO (coreZkRegister-1133-thread-1-processing-n:127.0.0.1:33540_aw_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 518730 INFO (coreZkRegister-1133-thread-1-processing-n:127.0.0.1:33540_aw_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:33540/aw_/collection1/ has no replicas
[junit4] 2> 518730 INFO (coreZkRegister-1133-thread-1-processing-n:127.0.0.1:33540_aw_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:33540/aw_/collection1/ shard1
[junit4] 2> 518731 INFO (OverseerStateUpdate-94835062127853572-127.0.0.1:33540_aw_-n_0000000000) [n:127.0.0.1:33540_aw_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection"} current state version: 1
[junit4] 2> 518731 INFO (coreZkRegister-1133-thread-1-processing-n:127.0.0.1:33540_aw_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 518734 INFO (coreZkRegister-1133-thread-1-processing-n:127.0.0.1:33540_aw_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
[junit4] 2> 518736 INFO (OverseerStateUpdate-94835062127853572-127.0.0.1:33540_aw_-n_0000000000) [n:127.0.0.1:33540_aw_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:33540/aw_",
[junit4] 2> "node_name":"127.0.0.1:33540_aw_",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "core":"collection1"} current state version: 1
[junit4] 2> 518737 INFO (OverseerStateUpdate-94835062127853572-127.0.0.1:33540_aw_-n_0000000000) [n:127.0.0.1:33540_aw_ ] o.a.s.c.o.ReplicaMutator Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:33540/aw_",
[junit4] 2> "node_name":"127.0.0.1:33540_aw_",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "core":"collection1"}
[junit4] 2> 518738 INFO (OverseerStateUpdate-94835062127853572-127.0.0.1:33540_aw_-n_0000000000) [n:127.0.0.1:33540_aw_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:33540/aw_",
[junit4] 2> "core":"collection1"} current state version: 1
[junit4] 2> 518841 INFO (zkCallback-461-thread-2-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 518841 INFO (zkCallback-461-thread-3-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 518888 INFO (coreZkRegister-1133-thread-1-processing-n:127.0.0.1:33540_aw_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:33540/aw_/collection1/ and leader is http://127.0.0.1:33540/aw_/collection1/
[junit4] 2> 518888 INFO (coreZkRegister-1133-thread-1-processing-n:127.0.0.1:33540_aw_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:33540/aw_
[junit4] 2> 518888 INFO (coreZkRegister-1133-thread-1-processing-n:127.0.0.1:33540_aw_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 518888 INFO (coreZkRegister-1133-thread-1-processing-n:127.0.0.1:33540_aw_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
[junit4] 2> 518888 INFO (coreZkRegister-1133-thread-1-processing-n:127.0.0.1:33540_aw_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:33540_aw_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 518890 INFO (OverseerStateUpdate-94835062127853572-127.0.0.1:33540_aw_-n_0000000000) [n:127.0.0.1:33540_aw_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:33540/aw_",
[junit4] 2> "node_name":"127.0.0.1:33540_aw_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 2
[junit4] 2> 518890 INFO (OverseerStateUpdate-94835062127853572-127.0.0.1:33540_aw_-n_0000000000) [n:127.0.0.1:33540_aw_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:33540/aw_",
[junit4] 2> "node_name":"127.0.0.1:33540_aw_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 518993 INFO (zkCallback-461-thread-3-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 518993 INFO (zkCallback-461-thread-2-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 519059 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 519068 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 519097 INFO (zkCallback-463-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4ad8730c name:ZooKeeperConnection Watcher:127.0.0.1:38041/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 519097 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 519097 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 519097 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 519099 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 519422 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_C18643A00F840DE6-001/shard-1-001/cores/collection1
[junit4] 2> 519423 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_C18643A00F840DE6-001/shard-1-001
[junit4] 2> 519424 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.e.j.s.Server jetty-9.2.13.v20150730
[junit4] 2> 519426 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4c561ed7{/aw_,null,AVAILABLE}
[junit4] 2> 519427 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.e.j.s.ServerConnector Started ServerConnector@c27b5d2{HTTP/1.1}{127.0.0.1:54285}
[junit4] 2> 519427 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.e.j.s.Server Started @522216ms
[junit4] 2> 519427 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_C18643A00F840DE6-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/aw_, hostPort=54285, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_C18643A00F840DE6-001/shard-1-001/cores}
[junit4] 2> 519427 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 519427 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_C18643A00F840DE6-001/shard-1-001/'
[junit4] 2> 519428 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 519428 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 519445 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 519446 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 519448 INFO (zkCallback-464-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7b1f15d5 name:ZooKeeperConnection Watcher:127.0.0.1:38041/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 519448 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 519449 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 519450 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 519450 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_C18643A00F840DE6-001/shard-1-001/solr.xml
[junit4] 2> 519455 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_C18643A00F840DE6-001/shard-1-001/cores
[junit4] 2> 519455 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.CoreContainer New CoreContainer 853014287
[junit4] 2> 519455 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_C18643A00F840DE6-001/shard-1-001/]
[junit4] 2> 519455 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_C18643A00F840DE6-001/shard-1-001/lib
[junit4] 2> 519455 WARN (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_C18643A00F840DE6-001/shard-1-001/lib).
[junit4] 2> 519466 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 519467 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 519467 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 519467 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 519468 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38041/solr
[junit4] 2> 519468 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 519468 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 519468 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 519469 INFO (zkCallback-466-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@32e9f506 name:ZooKeeperConnection Watcher:127.0.0.1:38041 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 519470 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 519471 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 519472 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [n:127.0.0.1:54285_aw_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 519473 INFO (zkCallback-467-thread-1-processing-n:127.0.0.1:54285_aw_) [n:127.0.0.1:54285_aw_ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7be8f674 name:ZooKeeperConnection Watcher:127.0.0.1:38041/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 519473 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [n:127.0.0.1:54285_aw_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 519478 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [n:127.0.0.1:54285_aw_ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 520482 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [n:127.0.0.1:54285_aw_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54285_aw_
[junit4] 2> 520483 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [n:127.0.0.1:54285_aw_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:54285_aw_
[junit4] 2> 520484 INFO (zkCallback-461-thread-2-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 520484 INFO (zkCallback-467-thread-1-processing-n:127.0.0.1:54285_aw_) [n:127.0.0.1:54285_aw_ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 520484 INFO (zkCallback-461-thread-3-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 520484 INFO (zkCallback-463-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 520488 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [n:127.0.0.1:54285_aw_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 520488 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [n:127.0.0.1:54285_aw_ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94835062127853576-127.0.0.1:54285_aw_-n_0000000001
[junit4] 2> 520489 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [n:127.0.0.1:54285_aw_ ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/94835062127853572-127.0.0.1:33540_aw_-n_0000000000 to know if I could be the leader
[junit4] 2> 520501 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [n:127.0.0.1:54285_aw_ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 520502 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [n:127.0.0.1:54285_aw_ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 520502 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [n:127.0.0.1:54285_aw_ ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_C18643A00F840DE6-001/shard-1-001/cores
[junit4] 2> 520503 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [n:127.0.0.1:54285_aw_ ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_C18643A00F840DE6-001/shard-1-001/cores/collection1, collection=collection1, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_C18643A00F840DE6-001/shard-1-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 520503 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [n:127.0.0.1:54285_aw_ ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_C18643A00F840DE6-001/shard-1-001/cores/collection1/
[junit4] 2> 520503 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [n:127.0.0.1:54285_aw_ ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 520504 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [n:127.0.0.1:54285_aw_ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2
[junit4] 2> 520504 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [n:127.0.0.1:54285_aw_ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 520504 INFO (coreLoadExecutor-1150-thread-1-processing-n:127.0.0.1:54285_aw_) [n:127.0.0.1:54285_aw_ c:collection1 x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 520504 INFO (coreLoadExecutor-1150-thread-1-processing-n:127.0.0.1:54285_aw_) [n:127.0.0.1:54285_aw_ c:collection1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 520506 INFO (OverseerStateUpdate-94835062127853572-127.0.0.1:33540_aw_-n_0000000000) [n:127.0.0.1:33540_aw_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:54285/aw_",
[junit4] 2> "node_name":"127.0.0.1:54285_aw_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"} current state version: 3
[junit4] 2> 520506 INFO (coreLoadExecutor-1150-thread-1-processing-n:127.0.0.1:54285_aw_) [n:127.0.0.1:54285_aw_ c:collection1 x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 520506 INFO (OverseerStateUpdate-94835062127853572-127.0.0.1:33540_aw_-n_0000000000) [n:127.0.0.1:33540_aw_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:54285/aw_",
[junit4] 2> "node_name":"127.0.0.1:54285_aw_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"}
[junit4] 2> 520506 INFO (OverseerStateUpdate-94835062127853572-127.0.0.1:33540_aw_-n_0000000000) [n:127.0.0.1:33540_aw_ ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
[junit4] 2> 520507 INFO (OverseerStateUpdate-94835062127853572-127.0.0.1:33540_aw_-n_0000000000) [n:127.0.0.1:33540_aw_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 520508 INFO (zkCallback-467-thread-1-processing-n:127.0.0.1:54285_aw_) [n:127.0.0.1:54285_aw_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 520508 INFO (zkCallback-463-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 520508 INFO (zkCallback-461-thread-2-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 520508 INFO (zkCallback-461-thread-3-processing-n:127.0.0.1:33540_aw_) [n:127.0.0.1:33540_aw_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 521507 INFO (coreLoadExecutor-1150-thread-1-processing-n:127.0.0.1:54285_aw_) [n:127.0.0.1:54285_aw_ c:collection1 x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 521507 INFO (coreLoadExecutor-1150-thread-1-processing-n:127.0.0.1:54285_aw_) [n:127.0.0.1:54285_aw_ c:collection1 x:collection1] o.a.s.c.ZkController Check for collection zkNode:collection1
[junit4] 2> 521507 INFO (coreLoadExecutor-1150-thread-1-processing-n:127.0.0.1:54285_aw_) [n:127.0.0.1:54285_aw_ c:collection1 x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 521507 INFO (coreLoadExecutor-1150-thread-1-processing-n:127.0.0.1:54285_aw_) [n:127.0.0.1:54285_aw_ c:collection1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/collection1
[junit4] 2> 521508 INFO (coreLoadExecutor-1150-thread-1-processing-n:127.0.0.1:54285_aw_) [n:127.0.0.1:54285_aw_ c:collection1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 521508 INFO (coreLoadExecutor-1150-thread-1-processing-n:127.0.0.1:54285_aw_) [n:127.0.0.1:54285_aw_ c:collection1 x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_C18643A00F840DE6-001/shard-1-001/cores/collection1/'
[junit4] 2> 521508 INFO (coreLoadExecutor-1150-thread-1-processing-n:127.0.0.1:54285_aw_) [n:127.0.0.1:54285_aw_ c:collection1 x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 521508 INFO (coreLoadExecutor-1150-thread-1-processing-n:127.0.0.1:54285_aw_) [n:127.0.0.1:54285_aw_ c:collection1 x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 521524 INFO (coreLoadExecutor-1150-thread-1-processing-n:127.0.0.1:54285_aw_) [n:127.0.0.1:54285_aw_ c:collection1 x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 521528 INFO (coreLoadExecutor-1150-thread-1-processing-n:127.0.0.1:54285_aw_) [n:127.0.0.1:54285_aw_ c:collection1 x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 521531 INFO (coreLoadExecutor-1150-thread-1-processing-n:127.0.0.1:54285_aw_) [n:127.0.0.1:54285_aw_ c:collection1 x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 521539 INFO (coreLoadExecutor-1150-thread-1-processing-n:127.0.0.1:54285_aw_) [n:127.0.0.1:54285_aw_ c:collection1 x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
[junit4] 2> 521540 INFO (coreLoadExecutor-1150-thread-1-processing-n:127.0.0.1:54285_aw_) [n:127.0.0.1:54285_aw_ c:collection1 x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 521555 INFO (coreLoadExecutor-1150-thread-1-processing-n:127.0.0.1:54285_aw_) [n:127.0.0.1:54285_aw_ c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 521635 INFO (coreLoadExecutor-1150-thread-1-processing-n:127.0.0.1:54285_aw_) [n:127.0.0.1:54285_aw_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 521641 INFO (coreLoadExecutor-1150-thread-1-processing-n:127.0.0.1:54285_aw_) [n:127.0.0.1:54285_aw_ c:collection1 x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 521642 INFO (coreLoadExecutor-1150-thread-1-processing-n:127.0.0.1:54285_aw_) [n:127.0.0.1:54285_aw_ c:collection1 x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 521653 INFO (coreLoadExecutor-1150-thread-1-process
[...truncated too long message...]
llections/collection1/leader_elect/shard1/election/94835062127853586-core_node2-n_0000000003
[junit4] 2> 559661 WARN (zkCallback-482-thread-1-processing-n:127.0.0.1:49855_aw_) [n:127.0.0.1:49855_aw_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.LeaderElector
[junit4] 2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election/94835062127853586-core_node2-n_0000000003
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:244)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:241)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:241)
[junit4] 2> at org.apache.solr.cloud.ElectionContext.cancelElection(ElectionContext.java:86)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContextBase.cancelElection(ElectionContext.java:169)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.cancelElection(ElectionContext.java:285)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:467)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:197)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:157)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:58)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:388)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3$1.run(SolrZkClient.java:269)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:231)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 559662 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.e.j.s.ServerConnector Stopped ServerConnector@3032383c{HTTP/1.1}{127.0.0.1:49855}
[junit4] 2> 559663 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@672189f9{/aw_,null,UNAVAILABLE}
[junit4] 2> 559665 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [n:127.0.0.1:49855_aw_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.ChaosMonkey monkey: stop shard! 33540
[junit4] 2> 559665 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[C18643A00F840DE6]) [n:127.0.0.1:49855_aw_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.ZkTestServer connecting to 127.0.0.1:38041 38041
[junit4] 2> 559834 INFO (Thread-3513) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:38041 38041
[junit4] 2> 559835 WARN (Thread-3513) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 7 /solr/aliases.json
[junit4] 2> 6 /solr/security.json
[junit4] 2> 5 /solr/configs/conf1
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 34 /solr/clusterstate.json
[junit4] 2> 3 /solr/overseer_elect/election/94835062127853572-127.0.0.1:33540_aw_-n_0000000000
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 11 /solr/live_nodes
[junit4] 2> 8 /solr/collections
[junit4] 2> 2 /solr/overseer/queue
[junit4] 2> 2 /solr/overseer/collection-queue-work
[junit4] 2>
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=LeaderInitiatedRecoveryOnShardRestartTest -Dtests.method=testRestartWithAllInLIR -Dtests.seed=C18643A00F840DE6 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=es_MX -Dtests.timezone=America/Glace_Bay -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[junit4] ERROR 42.9s J2 | LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR <<<
[junit4] > Throwable #1: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=5532, name=coreZkRegister-1177-thread-1, state=RUNNABLE, group=TGRP-LeaderInitiatedRecoveryOnShardRestartTest]
[junit4] > at __randomizedtesting.SeedInfo.seed([C18643A00F840DE6:1F0C2DDD34266F15]:0)
[junit4] > Caused by: java.lang.AssertionError
[junit4] > at __randomizedtesting.SeedInfo.seed([C18643A00F840DE6]:0)
[junit4] > at org.apache.solr.cloud.ZkController.updateLeaderInitiatedRecoveryState(ZkController.java:2126)
[junit4] > at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:451)
[junit4] > at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:197)
[junit4] > at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:157)
[junit4] > at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:346)
[junit4] > at org.apache.solr.cloud.ZkController.joinElection(ZkController.java:1113)
[junit4] > at org.apache.solr.cloud.ZkController.register(ZkController.java:926)
[junit4] > at org.apache.solr.cloud.ZkController.register(ZkController.java:881)
[junit4] > at org.apache.solr.core.ZkContainer$2.run(ZkContainer.java:183)
[junit4] > at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:231)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 559841 INFO (SUITE-LeaderInitiatedRecoveryOnShardRestartTest-seed#[C18643A00F840DE6]-worker) [n:127.0.0.1:49855_aw_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> Nov 09, 2015 11:24:11 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene60), sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=es_MX, timezone=America/Glace_Bay
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_66 (64-bit)/cpus=4,threads=1,free=256486664,total=479199232
[junit4] 2> NOTE: All tests run in this JVM: [StatelessScriptUpdateProcessorFactoryTest, LukeRequestHandlerTest, SharedFSAutoReplicaFailoverTest, TestSchemaResource, CurrencyFieldXmlFileTest, TestCursorMarkWithoutUniqueKey, BadComponentTest, OverseerTaskQueueTest, TestMiniSolrCloudClusterSSL, AutoCommitTest, SharedFSAutoReplicaFailoverUtilsTest, TestSolrConfigHandlerConcurrent, SparseHLLTest, SimpleCollectionCreateDeleteTest, RequestLoggingTest, TestWriterPerf, BadCopyFieldTest, ConnectionManagerTest, TestBulkSchemaAPI, TestIntervalFaceting, RecoveryZkTest, DistributedVersionInfoTest, OverriddenZkACLAndCredentialsProvidersTest, ShowFileRequestHandlerTest, BinaryUpdateRequestHandlerTest, TestConfigSetsAPI, TestGroupingSearch, ScriptEngineTest, RegexBoostProcessorTest, HdfsWriteToMultipleCollectionsTest, TestSolrJ, DistributedFacetPivotLongTailTest, LeaderInitiatedRecoveryOnShardRestartTest]
[junit4] Completed [86/555] on J2 in 43.53s, 1 test, 1 error <<< FAILURES!
[...truncated 1521 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987: There were test failures: 555 suites (8 ignored), 2200 tests, 1 error, 32 ignored (18 assumptions) [seed: C18643A00F840DE6]
Total time: 206 minutes 49 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 846 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/846/
3 tests failed.
FAILED: org.apache.solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR
Error Message:
Captured an uncaught exception in thread: Thread[id=72535, name=coreZkRegister-5993-thread-1, state=RUNNABLE, group=TGRP-LeaderInitiatedRecoveryOnShardRestartTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=72535, name=coreZkRegister-5993-thread-1, state=RUNNABLE, group=TGRP-LeaderInitiatedRecoveryOnShardRestartTest]
at __randomizedtesting.SeedInfo.seed([8A16F3829FAD9E6A:549C9DFFA40FFC99]:0)
Caused by: java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([8A16F3829FAD9E6A]:0)
at org.apache.solr.cloud.ZkController.updateLeaderInitiatedRecoveryState(ZkController.java:2126)
at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:451)
at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:197)
at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:157)
at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:346)
at org.apache.solr.cloud.ZkController.joinElection(ZkController.java:1113)
at org.apache.solr.cloud.ZkController.register(ZkController.java:926)
at org.apache.solr.cloud.ZkController.register(ZkController.java:881)
at org.apache.solr.core.ZkContainer$2.run(ZkContainer.java:183)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:231)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.OverseerTest.testOverseerStatsReset
Error Message:
expected:<0> but was:<1>
Stack Trace:
java.lang.AssertionError: expected:<0> but was:<1>
at __randomizedtesting.SeedInfo.seed([8A16F3829FAD9E6A:214214BE0A773D64]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at org.apache.solr.cloud.OverseerTest.testOverseerStatsReset(OverseerTest.java:732)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1660)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:866)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:902)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:875)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:777)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:811)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:822)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test
Error Message:
Captured an uncaught exception in thread: Thread[id=3936, name=collection3, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=3936, name=collection3, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: java.lang.RuntimeException: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:38909/_pal, http://127.0.0.1:41093/_pal, http://127.0.0.1:58007/_pal, http://127.0.0.1:55115/_pal, http://127.0.0.1:40088/_pal]
at __randomizedtesting.SeedInfo.seed([8A16F3829FAD9E6A]:0)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:898)
Caused by: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:38909/_pal, http://127.0.0.1:41093/_pal, http://127.0.0.1:58007/_pal, http://127.0.0.1:55115/_pal, http://127.0.0.1:40088/_pal]
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:352)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1574)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1595)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:888)
Caused by: org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:40088/_pal
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:587)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
... 7 more
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:170)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:480)
... 11 more
Build Log:
[...truncated 10321 lines...]
[junit4] Suite: org.apache.solr.cloud.OverseerTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.OverseerTest_8A16F3829FAD9E6A-001/init-core-data-001
[junit4] 2> 1433642 INFO (SUITE-OverseerTest-seed#[8A16F3829FAD9E6A]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true)
[junit4] 2> 1433642 INFO (SUITE-OverseerTest-seed#[8A16F3829FAD9E6A]-worker) [ ] o.a.s.SolrTestCaseJ4 ####initCore
[junit4] 2> 1433642 INFO (SUITE-OverseerTest-seed#[8A16F3829FAD9E6A]-worker) [ ] o.a.s.SolrTestCaseJ4 ####initCore end
[junit4] 2> 1433655 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testOverseerStatsReset
[junit4] 2> 1433655 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1433656 INFO (Thread-10971) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1433656 INFO (Thread-10971) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1433756 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.ZkTestServer start zk server on port:47509
[junit4] 2> 1433756 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1433779 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1433784 INFO (zkCallback-1030-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@46b7a253 name:ZooKeeperConnection Watcher:127.0.0.1:47509 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1433784 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1433784 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1433786 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1433791 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1433794 INFO (zkCallback-1031-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@14f36161 name:ZooKeeperConnection Watcher:127.0.0.1:47509 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1433794 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1433795 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1433795 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 1433797 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1433808 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1433811 INFO (zkCallback-1032-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@25cac5b0 name:ZooKeeperConnection Watcher:127.0.0.1:47509/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1433811 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1433812 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1433812 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 1433813 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections
[junit4] 2> 1433814 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 1433815 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 1433816 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 1433817 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 1433819 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1433823 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1433830 INFO (zkCallback-1033-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4f0bc3e8 name:ZooKeeperConnection Watcher:127.0.0.1:47509/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1433830 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1433830 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1433831 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 1433833 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/node1
[junit4] 2> 1433836 INFO (zkCallback-1033-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 0)
[junit4] 2> 1433836 INFO (zkCallback-1032-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 0)
[junit4] 2> 1433837 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=600000&connTimeout=60000&retry=true
[junit4] 2> 1433840 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 1433841 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 1433842 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1433842 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94829315767402498-127.0.0.1:47509_solr-n_0000000000
[junit4] 2> 1433843 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:47509_solr
[junit4] 2> 1433843 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
[junit4] 2> 1433844 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.Overseer Overseer (id=94829315767402498-127.0.0.1:47509_solr-n_0000000000) starting
[junit4] 2> 1433845 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
[junit4] 2> 1433846 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
[junit4] 2> 1433848 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 1433849 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 1433851 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 1433852 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 1433854 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 1433858 INFO (OverseerStateUpdate-94829315767402498-127.0.0.1:47509_solr-n_0000000000) [ ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 1433867 INFO (OverseerCollectionConfigSetProcessor-94829315767402498-127.0.0.1:47509_solr-n_0000000000) [ ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
[junit4] 2> 1433869 INFO (OverseerStateUpdate-94829315767402498-127.0.0.1:47509_solr-n_0000000000) [ ] o.a.s.c.Overseer processMessage: queueSize: 0, message = {
[junit4] 2> "operation":"state",
[junit4] 2> "state":"recovering",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"} current state version: 0
[junit4] 2> 1433870 INFO (OverseerStateUpdate-94829315767402498-127.0.0.1:47509_solr-n_0000000000) [ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"recovering",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 1433870 INFO (OverseerStateUpdate-94829315767402498-127.0.0.1:47509_solr-n_0000000000) [ ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
[junit4] 2> 1433870 INFO (OverseerStateUpdate-94829315767402498-127.0.0.1:47509_solr-n_0000000000) [ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 1433871 INFO (zkCallback-1033-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1433871 INFO (zkCallback-1032-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1434369 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 1434370 INFO (zkCallback-1033-thread-1) [ ] o.a.s.c.c.ZkStateReader A collections change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections, has occurred - updating...
[junit4] 2> 1434370 INFO (zkCallback-1032-thread-1) [ ] o.a.s.c.c.ZkStateReader A collections change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections, has occurred - updating...
[junit4] 2> 1434373 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.LeaderElector Joined leadership election with path: /collections/collection1/leader_elect/shard1/election/94829315767402499-node1_core1-n_0000000000
[junit4] 2> 1434374 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/leaders/shard1
[junit4] 2> 1434376 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
[junit4] 2> 1434381 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.Overseer Overseer (id=94829315767402498-127.0.0.1:47509_solr-n_0000000000) closing
[junit4] 2> 1434381 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.ElectionContext Canceling election /overseer_elect/election/94829315767402498-127.0.0.1:47509_solr-n_0000000000
[junit4] 2> 1434383 INFO (OverseerStateUpdate-94829315767402498-127.0.0.1:47509_solr-n_0000000000) [ ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:47509_solr
[junit4] 2> 1434389 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94829315767402498-127.0.0.1:47509_solr-n_0000000001
[junit4] 2> 1434389 INFO (OverseerExitThread) [ ] o.a.s.c.Overseer I'm exiting , but I'm still the leader
[junit4] 2> 1434389 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:47509_solr
[junit4] 2> 1434389 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
[junit4] 2> 1434391 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.Overseer Overseer (id=94829315767402498-127.0.0.1:47509_solr-n_0000000001) starting
[junit4] 2> 1434400 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 1434419 INFO (OverseerCollectionConfigSetProcessor-94829315767402498-127.0.0.1:47509_solr-n_0000000001) [ ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
[junit4] 2> 1434419 INFO (OverseerStateUpdate-94829315767402498-127.0.0.1:47509_solr-n_0000000001) [ ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 1434421 INFO (OverseerStateUpdate-94829315767402498-127.0.0.1:47509_solr-n_0000000001) [ ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "base_url":"http://node1/solr/",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "core":"core1"} current state version: 1
[junit4] 2> 1434421 INFO (OverseerStateUpdate-94829315767402498-127.0.0.1:47509_solr-n_0000000001) [ ] o.a.s.c.o.ReplicaMutator Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "base_url":"http://node1/solr/",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "core":"core1"}
[junit4] 2> 1434422 INFO (zkCallback-1033-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1434423 INFO (OverseerStateUpdate-94829315767402498-127.0.0.1:47509_solr-n_0000000001) [ ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "base_url":"http://node1/solr/",
[junit4] 2> "core":"core1"} current state version: 2
[junit4] 2> 1434434 INFO (zkCallback-1033-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1434440 INFO (zkCallback-1032-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1434447 INFO (zkCallback-1032-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1434525 INFO (zkCallback-1032-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
[junit4] 2> 1435934 WARN (zkCallback-1033-thread-1) [ ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 1435937 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:47509 47509
[junit4] 2> 1436399 INFO (Thread-10971) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:47509 47509
[junit4] 2> 1436400 WARN (Thread-10971) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 2 /solr/aliases.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 2 /solr/clusterstate.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 2 /solr/live_nodes
[junit4] 2> 2 /solr/collections
[junit4] 2> 2 /solr/overseer/queue-work
[junit4] 2> 2 /solr/overseer/collection-queue-work
[junit4] 2>
[junit4] 2> 1436400 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testOverseerStatsReset
[junit4] 2> 1436400 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.Overseer Overseer (id=94829315767402498-127.0.0.1:47509_solr-n_0000000001) closing
[junit4] 2> 1436400 INFO (OverseerStateUpdate-94829315767402498-127.0.0.1:47509_solr-n_0000000001) [ ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:47509_solr
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=OverseerTest -Dtests.method=testOverseerStatsReset -Dtests.seed=8A16F3829FAD9E6A -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=es_ES -Dtests.timezone=SystemV/PST8 -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[junit4] FAILURE 2.76s J2 | OverseerTest.testOverseerStatsReset <<<
[junit4] > Throwable #1: java.lang.AssertionError: expected:<0> but was:<1>
[junit4] > at __randomizedtesting.SeedInfo.seed([8A16F3829FAD9E6A:214214BE0A773D64]:0)
[junit4] > at org.apache.solr.cloud.OverseerTest.testOverseerStatsReset(OverseerTest.java:732)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 1436407 ERROR (OverseerExitThread) [ ] o.a.s.c.Overseer could not read the data
[junit4] 2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:353)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:350)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:350)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:304)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:87)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater$2.run(Overseer.java:265)
[junit4] 2> 1436409 INFO (TEST-OverseerTest.testReplay-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testReplay
[junit4] 2> 1436409 INFO (TEST-OverseerTest.testReplay-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1436419 INFO (Thread-10972) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1436419 INFO (Thread-10972) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1436519 INFO (TEST-OverseerTest.testReplay-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.ZkTestServer start zk server on port:55661
[junit4] 2> 1436519 INFO (TEST-OverseerTest.testReplay-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1436519 INFO (TEST-OverseerTest.testReplay-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1436551 INFO (zkCallback-1035-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@508c219 name:ZooKeeperConnection Watcher:127.0.0.1:55661/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1436551 INFO (TEST-OverseerTest.testReplay-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1436551 INFO (TEST-OverseerTest.testReplay-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1436551 INFO (TEST-OverseerTest.testReplay-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1436564 INFO (TEST-OverseerTest.testReplay-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1436574 INFO (zkCallback-1036-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@25057dfa name:ZooKeeperConnection Watcher:127.0.0.1:55661 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1436574 INFO (TEST-OverseerTest.testReplay-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1436575 INFO (TEST-OverseerTest.testReplay-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1436576 INFO (TEST-OverseerTest.testReplay-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1436599 INFO (TEST-OverseerTest.testReplay-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1436607 INFO (zkCallback-1037-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4fda80d2 name:ZooKeeperConnection Watcher:127.0.0.1:55661 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1436607 INFO (TEST-OverseerTest.testReplay-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1436607 INFO (TEST-OverseerTest.testReplay-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1436607 INFO (TEST-OverseerTest.testReplay-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 1436610 INFO (TEST-OverseerTest.testReplay-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 1436611 INFO (TEST-OverseerTest.testReplay-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections
[junit4] 2> 1436612 INFO (TEST-OverseerTest.testReplay-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 1436613 INFO (TEST-OverseerTest.testReplay-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 1436619 INFO (TEST-OverseerTest.testReplay-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 1436620 INFO (TEST-OverseerTest.testReplay-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 1436622 INFO (TEST-OverseerTest.testReplay-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
[junit4] 2> 1436625 INFO (TEST-OverseerTest.testReplay-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1436647 INFO (TEST-OverseerTest.testReplay-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1436654 INFO (zkCallback-1038-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3a8994d9 name:ZooKeeperConnection Watcher:127.0.0.1:55661/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1436654 INFO (TEST-OverseerTest.testReplay-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1436654 INFO (TEST-OverseerTest.testReplay-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1436654 INFO (TEST-OverseerTest.testReplay-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=600000&connTimeout=60000&retry=true
[junit4] 2> 1436655 INFO (TEST-OverseerTest.testReplay-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 1436657 INFO (TEST-OverseerTest.testReplay-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 1436658 INFO (TEST-OverseerTest.testReplay-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1436658 INFO (TEST-OverseerTest.testReplay-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94829315949002755-127.0.0.1:55661_solr-n_0000000000
[junit4] 2> 1436658 INFO (TEST-OverseerTest.testReplay-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:55661_solr
[junit4] 2> 1436658 INFO (TEST-OverseerTest.testReplay-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
[junit4] 2> 1436659 INFO (TEST-OverseerTest.testReplay-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.Overseer Overseer (id=94829315949002755-127.0.0.1:55661_solr-n_0000000000) starting
[junit4] 2> 1436660 INFO (TEST-OverseerTest.testReplay-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
[junit4] 2> 1436662 INFO (TEST-OverseerTest.testReplay-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 1436664 INFO (TEST-OverseerTest.testReplay-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 1436665 INFO (TEST-OverseerTest.testReplay-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 1436667 INFO (TEST-OverseerTest.testReplay-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 1436669 INFO (TEST-OverseerTest.testReplay-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 1436683 INFO (OverseerStateUpdate-94829315949002755-127.0.0.1:55661_solr-n_0000000000) [ ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 1436684 INFO (OverseerStateUpdate-94829315949002755-127.0.0.1:55661_solr-n_0000000000) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 1436685 INFO (OverseerStateUpdate-94829315949002755-127.0.0.1:55661_solr-n_0000000000) [ ] o.a.s.c.Overseer processMessage: workQueueSize: 2, message = {
[junit4] 2> "operation":"state",
[junit4] 2> "base_url":"http://127.0.0.1/solr",
[junit4] 2> "node_name":"node1",
[junit4] 2> "shard":"s1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "core":"core1",
[junit4] 2> "roles":"",
[junit4] 2> "state":"recovering"}
[junit4] 2> 1436686 INFO (OverseerStateUpdate-94829315949002755-127.0.0.1:55661_solr-n_0000000000) [ ] o.a.s.c.o.ReplicaMutator Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "base_url":"http://127.0.0.1/solr",
[junit4] 2> "node_name":"node1",
[junit4] 2> "shard":"s1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "core":"core1",
[junit4] 2> "roles":"",
[junit4] 2> "state":"recovering"}
[junit4] 2> 1436691 INFO (OverseerCollectionConfigSetProcessor-94829315949002755-127.0.0.1:55661_solr-n_0000000000) [ ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
[junit4] 2> 1436695 INFO (zkCallback-1035-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
[junit4] 2> 1436695 INFO (zkCallback-1038-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
[junit4] 2> 1436697 INFO (OverseerStateUpdate-94829315949002755-127.0.0.1:55661_solr-n_0000000000) [ ] o.a.s.c.Overseer processMessage: workQueueSize: 0, message = {
[junit4] 2> "operation":"state",
[junit4] 2> "base_url":"http://127.0.0.1/solr",
[junit4] 2> "node_name":"node1",
[junit4] 2> "shard":"s1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "core":"core2",
[junit4] 2> "roles":"",
[junit4] 2> "state":"recovering"}
[junit4] 2> 1436698 INFO (OverseerStateUpdate-94829315949002755-127.0.0.1:55661_solr-n_0000000000) [ ] o.a.s.c.o.ReplicaMutator Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "base_url":"http://127.0.0.1/solr",
[junit4] 2> "node_name":"node1",
[junit4] 2> "shard":"s1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "core":"core2",
[junit4] 2> "roles":"",
[junit4] 2> "state":"recovering"}
[junit4] 2> 1436699 INFO (zkCallback-1038-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
[junit4] 2> 1436699 INFO (zkCallback-1035-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
[junit4] 2> 1436701 INFO (OverseerStateUpdate-94829315949002755-127.0.0.1:55661_solr-n_0000000000) [ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"state",
[junit4] 2> "base_url":"http://127.0.0.1/solr",
[junit4] 2> "node_name":"node1",
[junit4] 2> "shard":"s1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "core":"core3",
[junit4] 2> "roles":"",
[junit4] 2> "state":"recovering"} current state version: 2
[junit4] 2> 1436701 INFO (OverseerStateUpdate-94829315949002755-127.0.0.1:55661_solr-n_0000000000) [ ] o.a.s.c.o.ReplicaMutator Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "base_url":"http://127.0.0.1/solr",
[junit4] 2> "node_name":"node1",
[junit4] 2> "shard":"s1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "core":"core3",
[junit4] 2> "roles":"",
[junit4] 2> "state":"recovering"}
[junit4] 2> 1436803 INFO (zkCallback-1035-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
[junit4] 2> 1436803 INFO (zkCallback-1038-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
[junit4] 2> 1436902 INFO (TEST-OverseerTest.testReplay-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:55661 55661
[junit4] 2> 1437061 INFO (Thread-10972) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:55661 55661
[junit4] 2> 1437061 WARN (Thread-10972) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 2 /solr/aliases.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 2 /solr/clusterstate.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 2 /solr/live_nodes
[junit4] 2> 2 /solr/collections
[junit4] 2>
[junit4] 2> 1437062 INFO (TEST-OverseerTest.testReplay-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testReplay
[junit4] 2> 1437062 INFO (TEST-OverseerTest.testReplay-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.Overseer Overseer (id=94829315949002755-127.0.0.1:55661_solr-n_0000000000) closing
[junit4] 2> 1437062 INFO (OverseerStateUpdate-94829315949002755-127.0.0.1:55661_solr-n_0000000000) [ ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:55661_solr
[junit4] 2> 1437080 ERROR (OverseerExitThread) [ ] o.a.s.c.Overseer could not read the data
[junit4] 2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:353)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:350)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:350)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:304)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:87)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater$2.run(Overseer.java:265)
[junit4] 2> 1437087 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testShardAssignment
[junit4] 2> 1437087 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1437097 INFO (Thread-10973) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1437097 INFO (Thread-10973) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1437197 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.ZkTestServer start zk server on port:50005
[junit4] 2> 1437198 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1437207 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1437219 INFO (zkCallback-1040-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2d43e6f name:ZooKeeperConnection Watcher:127.0.0.1:50005 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1437219 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1437219 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1437220 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1437231 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1437237 INFO (zkCallback-1041-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@921b576 name:ZooKeeperConnection Watcher:127.0.0.1:50005 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1437237 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1437238 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1437238 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 1437240 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1437254 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1437257 INFO (zkCallback-1042-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5e7c2f03 name:ZooKeeperConnection Watcher:127.0.0.1:50005/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1437257 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1437258 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1437258 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 1437259 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections
[junit4] 2> 1437261 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 1437262 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 1437264 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 1437265 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1437282 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1437282 INFO (zkCallback-1043-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3ecc1040 name:ZooKeeperConnection Watcher:127.0.0.1:50005/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1437282 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1437283 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1437283 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=600000&connTimeout=60000&retry=true
[junit4] 2> 1437284 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 1437285 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 1437286 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1437286 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94829315992977411-127.0.0.1:50005_solr-n_0000000000
[junit4] 2> 1437286 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:50005_solr
[junit4] 2> 1437287 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
[junit4] 2> 1437287 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.Overseer Overseer (id=94829315992977411-127.0.0.1:50005_solr-n_0000000000) starting
[junit4] 2> 1437288 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
[junit4] 2> 1437290 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
[junit4] 2> 1437291 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 1437293 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 1437294 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 1437295 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 1437298 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 1437305 INFO (OverseerStateUpdate-94829315992977411-127.0.0.1:50005_solr-n_0000000000) [ ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 1437305 INFO (OverseerStateUpdate-94829315992977411-127.0.0.1:50005_solr-n_0000000000) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 1437306 INFO (OverseerCollectionConfigSetProcessor-94829315992977411-127.0.0.1:50005_solr-n_0000000000) [ ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
[junit4] 2> 1437318 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 1437320 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1437325 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1437326 INFO (zkCallback-1045-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@781f7e97 name:ZooKeeperConnection Watcher:127.0.0.1:50005/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1437332 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1437332 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1437333 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 1437338 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1
[junit4] 2> 1437339 INFO (zkCallback-1042-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 0)
[junit4] 2> 1437339 INFO (zkCallback-1043-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 0)
[junit4] 2> 1437340 INFO (zkCallback-1045-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 0)
[junit4] 2> 1437344 INFO (OverseerStateUpdate-94829315992977411-127.0.0.1:50005_solr-n_0000000000) [ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"127.0.0.1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "base_url":"http://127.0.0.1/solr/"} current state version: 0
[junit4] 2> 1437344 INFO (OverseerStateUpdate-94829315992977411-127.0.0.1:50005_solr-n_0000000000) [ ] o.a.s.c.o.ReplicaMutator Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"127.0.0.1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "base_url":"http://127.0.0.1/solr/"}
[junit4] 2> 1437344 INFO (OverseerStateUpdate-94829315992977411-127.0.0.1:50005_solr-n_0000000000) [ ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
[junit4] 2> 1437345 INFO (OverseerStateUpdate-94829315992977411-127.0.0.1:50005_solr-n_0000000000) [ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2
[junit4] 2> 1437345 INFO (zkCallback-1043-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1437345 INFO (zkCallback-1045-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1437346 INFO (zkCallback-1042-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1437844 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 1437845 INFO (zkCallback-1043-thread-1) [ ] o.a.s.c.c.ZkStateReader A collections change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections, has occurred - updating...
[junit4] 2> 1437845 INFO (zkCallback-1045-thread-1) [ ] o.a.s.c.c.ZkStateReader A collections change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections, has occurred - updating...
[junit4] 2> 1437845 INFO (zkCallback-1042-thread-1) [ ] o.a.s.c.c.ZkStateReader A collections change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections, has occurred - updating...
[junit4] 2> 1437848 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.LeaderElector Joined leadership election with path: /collections/collection1/leader_elect/shard2/election/94829315992977412-127.0.0.1_core1-n_0000000000
[junit4] 2> 1437848 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/leaders/shard2
[junit4] 2> 1437850 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
[junit4] 2> 1437852 INFO (OverseerStateUpdate-94829315992977411-127.0.0.1:50005_solr-n_0000000000) [ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "base_url":"http://127.0.0.1/solr/",
[junit4] 2> "core":"core1"} current state version: 1
[junit4] 2> 1437854 INFO (OverseerStateUpdate-94829315992977411-127.0.0.1:50005_solr-n_0000000000) [ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"127.0.0.1",
[junit4] 2> "core":"core2",
[junit4] 2> "core_node_name":"node2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "base_url":"http://127.0.0.1/solr/"} current state version: 1
[junit4] 2> 1437854 INFO (OverseerStateUpdate-94829315992977411-127.0.0.1:50005_solr-n_0000000000) [ ] o.a.s.c.o.ReplicaMutator Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"127.0.0.1",
[junit4] 2> "core":"core2",
[junit4] 2> "core_node_name":"node2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "base_url":"http://127.0.0.1/solr/"}
[junit4] 2> 1437854 INFO (OverseerStateUpdate-94829315992977411-127.0.0.1:50005_solr-n_0000000000) [ ] o.a.s.c.o.ReplicaMutator Collection already exists with numShards=3
[junit4] 2> 1437854 INFO (OverseerStateUpdate-94829315992977411-127.0.0.1:50005_solr-n_0000000000) [ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard3
[junit4] 2> 1437957 INFO (zkCallback-1042-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1437957 INFO (zkCallback-1043-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1437957 INFO (zkCallback-1045-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1438353 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/leader_elect/shard3/election
[junit4] 2> 1438358 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.LeaderElector Joined leadership election with path: /collections/collection1/leader_elect/shard3/election/94829315992977412-127.0.0.1_core2-n_0000000000
[junit4] 2> 1438359 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/leaders/shard3
[junit4] 2> 1438360 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
[junit4] 2> 1438362 INFO (OverseerStateUpdate-94829315992977411-127.0.0.1:50005_solr-n_0000000000) [ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard3",
[junit4] 2> "collection":"collection1",
[junit4] 2> "base_url":"http://127.0.0.1/solr/",
[junit4] 2> "core":"core2"} current state version: 2
[junit4] 2> 1438372 INFO (OverseerStateUpdate-94829315992977411-127.0.0.1:50005_solr-n_0000000000) [ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"127.0.0.1",
[junit4] 2> "core":"core3",
[junit4] 2> "core_node_name":"node3",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "base_url":"http://127.0.0.1/solr/"} current state version: 2
[junit4] 2> 1438372 INFO (OverseerStateUpdate-94829315992977411-127.0.0.1:50005_solr-n_0000000000) [ ] o.a.s.c.o.ReplicaMutator Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"127.0.0.1",
[junit4] 2> "core":"core3",
[junit4] 2> "core_node_name":"node3",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "base_url":"http://127.0.0.1/solr/"}
[junit4] 2> 1438372 INFO (OverseerStateUpdate-94829315992977411-127.0.0.1:50005_solr-n_0000000000) [ ] o.a.s.c.o.ReplicaMutator Collection already exists with numShards=3
[junit4] 2> 1438372 INFO (OverseerStateUpdate-94829315992977411-127.0.0.1:50005_solr-n_0000000000) [ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 1438474 INFO (zkCallback-1042-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1438474 INFO (zkCallback-1045-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1438475 INFO (zkCallback-1043-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1438864 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 1438867 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.LeaderElector Joined leadership election with path: /collections/collection1/leader_elect/shard1/election/94829315992977412-127.0.0.1_core3-n_0000000000
[junit4] 2> 1438867 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/leaders/shard1
[junit4] 2> 1438869 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
[junit4] 2> 1438871 INFO (OverseerStateUpdate-94829315992977411-127.0.0.1:50005_solr-n_0000000000) [ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "base_url":"http://127.0.0.1/solr/",
[junit4] 2> "core":"core3"} current state version: 3
[junit4] 2> 1438874 INFO (OverseerStateUpdate-94829315992977411-127.0.0.1:50005_solr-n_0000000000) [ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"127.0.0.1",
[junit4] 2> "core":"core4",
[junit4] 2> "core_node_name":"node4",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "base_url":"http://127.0.0.1/solr/"} current state version: 3
[junit4] 2> 1438874 INFO (OverseerStateUpdate-94829315992977411-127.0.0.1:50005_solr-n_0000000000) [ ] o.a.s.c.o.ReplicaMutator Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"127.0.0.1",
[junit4] 2> "core":"core4",
[junit4] 2> "core_node_name":"node4",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "base_url":"http://127.0.0.1/solr/"}
[junit4] 2> 1438874 INFO (OverseerStateUpdate-94829315992977411-127.0.0.1:50005_solr-n_0000000000) [ ] o.a.s.c.o.ReplicaMutator Collection already exists with numShards=3
[junit4] 2> 1438874 INFO (OverseerStateUpdate-94829315992977411-127.0.0.1:50005_solr-n_0000000000) [ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2
[junit4] 2> 1438976 INFO (zkCallback-1045-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1438976 INFO (zkCallback-1042-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1438980 INFO (zkCallback-1043-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1439376 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 1439378 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.LeaderElector Joined leadership election with path: /collections/collection1/leader_elect/shard2/election/94829315992977412-127.0.0.1_core4-n_0000000001
[junit4] 2> 1439379 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.LeaderElector Watching path /collections/collection1/leader_elect/shard2/election/94829315992977412-127.0.0.1_core1-n_0000000000 to know if I could be the leader
[junit4] 2> 1439380 INFO (OverseerStateUpdate-94829315992977411-127.0.0.1:50005_solr-n_0000000000) [ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"127.0.0.1",
[junit4] 2> "core":"core5",
[junit4] 2> "core_node_name":"node5",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "base_url":"http://127.0.0.1/solr/"} current state version: 4
[junit4] 2> 1439381 INFO (OverseerStateUpdate-94829315992977411-127.0.0.1:50005_solr-n_0000000000) [ ] o.a.s.c.o.ReplicaMutator Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"127.0.0.1",
[junit4] 2> "core":"core5",
[junit4] 2> "core_node_name":"node5",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "base_url":"http://127.0.0.1/solr/"}
[junit4] 2> 1439381 INFO (OverseerStateUpdate-94829315992977411-127.0.0.1:50005_solr-n_0000000000) [ ] o.a.s.c.o.ReplicaMutator Collection already exists with numShards=3
[junit4] 2> 1439381 INFO (OverseerStateUpdate-94829315992977411-127.0.0.1:50005_solr-n_0000000000) [ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard3
[junit4] 2> 1439484 INFO (zkCallback-1042-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1439484 INFO (zkCallback-1045-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1439484 INFO (zkCallback-1043-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1439882 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/leader_elect/shard3/election
[junit4] 2> 1439885 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.LeaderElector Joined leadership election with path: /collections/collection1/leader_elect/shard3/election/94829315992977412-127.0.0.1_core5-n_0000000001
[junit4] 2> 1439885 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.LeaderElector Watching path /collections/collection1/leader_elect/shard3/election/94829315992977412-127.0.0.1_core2-n_0000000000 to know if I could be the leader
[junit4] 2> 1439887 INFO (OverseerStateUpdate-94829315992977411-127.0.0.1:50005_solr-n_0000000000) [ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"127.0.0.1",
[junit4] 2> "core":"core6",
[junit4] 2> "core_node_name":"node6",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "base_url":"http://127.0.0.1/solr/"} current state version: 5
[junit4] 2> 1439895 INFO (OverseerStateUpdate-94829315992977411-127.0.0.1:50005_solr-n_0000000000) [ ] o.a.s.c.o.ReplicaMutator Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"127.0.0.1",
[junit4] 2> "core":"core6",
[junit4] 2> "core_node_name":"node6",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "base_url":"http://127.0.0.1/solr/"}
[junit4] 2> 1439895 INFO (OverseerStateUpdate-94829315992977411-127.0.0.1:50005_solr-n_0000000000) [ ] o.a.s.c.o.ReplicaMutator Collection already exists with numShards=3
[junit4] 2> 1439895 INFO (OverseerStateUpdate-94829315992977411-127.0.0.1:50005_solr-n_0000000000) [ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 1440003 INFO (zkCallback-1045-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1440003 INFO (zkCallback-1042-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1440004 INFO (zkCallback-1043-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1440402 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 1440405 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.LeaderElector Joined leadership election with path: /collections/collection1/leader_elect/shard1/election/94829315992977412-127.0.0.1_core6-n_0000000001
[junit4] 2> 1440405 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.LeaderElector Watching path /collections/collection1/leader_elect/shard1/election/94829315992977412-127.0.0.1_core3-n_0000000000 to know if I could be the leader
[junit4] 2> 1440407 INFO (zkCallback-1043-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1440407 INFO (zkCallback-1045-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1440415 ERROR (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]-EventThread) [ ] o.a.z.ClientCnxn Error while calling watcher
[junit4] 2> java.util.concurrent.RejectedExecutionException: Task org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1@43863b81 rejected from org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor@684bd95[Shutting down, pool size = 2, active threads = 2, queued tasks = 0, completed tasks = 9]
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2047)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:823)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1369)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.execute(ExecutorUtil.java:214)
[junit4] 2> at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.process(SolrZkClient.java:266)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2> 1440415 ERROR (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]-EventThread) [ ] o.a.z.ClientCnxn Error while calling watcher
[junit4] 2> java.util.concurrent.RejectedExecutionException: Task org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1@37c858ad rejected from org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor@684bd95[Shutting down, pool size = 2, active threads = 2, queued tasks = 0, completed tasks = 9]
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2047)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:823)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1369)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.execute(ExecutorUtil.java:214)
[junit4] 2> at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.process(SolrZkClient.java:266)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2> 1440421 WARN (zkCallback-1045-thread-2) [ ] o.a.s.c.LeaderElector
[junit4] 2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:336)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:333)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:333)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:107)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:58)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:388)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3$1.run(SolrZkClient.java:269)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:231)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 1441907 WARN (zkCallback-1045-thread-1) [ ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 1441909 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:50005 50005
[junit4] 2> 1442063 INFO (Thread-10973) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:50005 50005
[junit4] 2> 1442064 WARN (Thread-10973) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 3 /solr/aliases.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 3 /solr/clusterstate.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 3 /solr/live_nodes
[junit4] 2> 3 /solr/collections
[junit4] 2>
[junit4] 2> 1442064 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testShardAssignment
[junit4] 2> 1442064 INFO (TEST-OverseerTest.testShardAssignment-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.Overseer Overseer (id=94829315992977411-127.0.0.1:50005_solr-n_0000000000) closing
[junit4] 2> 1442067 INFO (OverseerStateUpdate-94829315992977411-127.0.0.1:50005_solr-n_0000000000) [ ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:50005_solr
[junit4] 2> 1442080 INFO (TEST-OverseerTest.testBadQueueItem-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testBadQueueItem
[junit4] 2> 1442081 INFO (TEST-OverseerTest.testBadQueueItem-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1442081 ERROR (OverseerExitThread) [ ] o.a.s.c.Overseer could not read the data
[junit4] 2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:353)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:350)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:350)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:304)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:87)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater$2.run(Overseer.java:265)
[junit4] 2> 1442081 INFO (Thread-10974) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1442081 INFO (Thread-10974) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1442181 INFO (TEST-OverseerTest.testBadQueueItem-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.ZkTestServer start zk server on port:57274
[junit4] 2> 1442181 INFO (TEST-OverseerTest.testBadQueueItem-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1442182 INFO (TEST-OverseerTest.testBadQueueItem-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1442184 INFO (zkCallback-1046-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6ed58d48 name:ZooKeeperConnection Watcher:127.0.0.1:57274 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1442184 INFO (TEST-OverseerTest.testBadQueueItem-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1442184 INFO (TEST-OverseerTest.testBadQueueItem-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1442185 INFO (TEST-OverseerTest.testBadQueueItem-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1442186 INFO (TEST-OverseerTest.testBadQueueItem-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1442186 INFO (zkCallback-1047-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@17f1ff27 name:ZooKeeperConnection Watcher:127.0.0.1:57274 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1442186 INFO (TEST-OverseerTest.testBadQueueItem-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1442187 INFO (TEST-OverseerTest.testBadQueueItem-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1442187 INFO (TEST-OverseerTest.testBadQueueItem-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 1442188 INFO (TEST-OverseerTest.testBadQueueItem-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1442189 INFO (TEST-OverseerTest.testBadQueueItem-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1442190 INFO (zkCallback-1048-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@b426080 name:ZooKeeperConnection Watcher:127.0.0.1:57274/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1442190 INFO (TEST-OverseerTest.testBadQueueItem-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1442190 INFO (TEST-OverseerTest.testBadQueueItem-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1442190 INFO (TEST-OverseerTest.testBadQueueItem-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 1442191 INFO (TEST-OverseerTest.testBadQueueItem-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections
[junit4] 2> 1442193 INFO (TEST-OverseerTest.testBadQueueItem-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 1442194 INFO (TEST-OverseerTest.testBadQueueItem-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 1442195 INFO (TEST-OverseerTest.testBadQueueItem-seed#[8A16F3829FAD9E6A]) [ ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 1442196 INFO (TEST-OverseerTes
[...truncated too long message...]
itiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8A16F3829FAD9E6A]) [n:127.0.0.1:41702_yd_%2Fa c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.ZkTestServer connecting to 127.0.0.1:59544 59544
[junit4] 2> 3148853 INFO (Thread-61657) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:59544 59544
[junit4] 2> 3148854 WARN (Thread-61657) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 6 /solr/aliases.json
[junit4] 2> 5 /solr/security.json
[junit4] 2> 5 /solr/configs/conf1
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 6 /solr/clusterstate.json
[junit4] 2> 3 /solr/overseer_elect/election/94829425329569796-127.0.0.1:54782_yd_%2Fa-n_0000000000
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 6 /solr/collections
[junit4] 2> 4 /solr/live_nodes
[junit4] 2> 3 /solr/overseer/collection-queue-work
[junit4] 2> 2 /solr/overseer/queue
[junit4] 2>
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=LeaderInitiatedRecoveryOnShardRestartTest -Dtests.method=testRestartWithAllInLIR -Dtests.seed=8A16F3829FAD9E6A -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=th -Dtests.timezone=JST -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[junit4] ERROR 43.4s J2 | LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR <<<
[junit4] > Throwable #1: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=72535, name=coreZkRegister-5993-thread-1, state=RUNNABLE, group=TGRP-LeaderInitiatedRecoveryOnShardRestartTest]
[junit4] > at __randomizedtesting.SeedInfo.seed([8A16F3829FAD9E6A:549C9DFFA40FFC99]:0)
[junit4] > Caused by: java.lang.AssertionError
[junit4] > at __randomizedtesting.SeedInfo.seed([8A16F3829FAD9E6A]:0)
[junit4] > at org.apache.solr.cloud.ZkController.updateLeaderInitiatedRecoveryState(ZkController.java:2126)
[junit4] > at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:451)
[junit4] > at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:197)
[junit4] > at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:157)
[junit4] > at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:346)
[junit4] > at org.apache.solr.cloud.ZkController.joinElection(ZkController.java:1113)
[junit4] > at org.apache.solr.cloud.ZkController.register(ZkController.java:926)
[junit4] > at org.apache.solr.cloud.ZkController.register(ZkController.java:881)
[junit4] > at org.apache.solr.core.ZkContainer$2.run(ZkContainer.java:183)
[junit4] > at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:231)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 3148856 INFO (SUITE-LeaderInitiatedRecoveryOnShardRestartTest-seed#[8A16F3829FAD9E6A]-worker) [n:127.0.0.1:41702_yd_%2Fa c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> Nov 08, 2015 11:30:41 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=HighCompressionCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=HIGH_COMPRESSION, chunkSize=6, maxDocsPerChunk=402, blockSize=449), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=HIGH_COMPRESSION, chunkSize=6, blockSize=449)), sim=RandomSimilarityProvider(queryNorm=false,coord=yes): {}, locale=th, timezone=JST
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_66 (64-bit)/cpus=4,threads=1,free=247071752,total=526909440
[junit4] 2> NOTE: All tests run in this JVM: [UnloadDistributedZkTest, TestSolrIndexConfig, ConnectionManagerTest, ScriptEngineTest, BadIndexSchemaTest, UpdateParamsTest, DeleteReplicaTest, TestDownShardTolerantSearch, SampleTest, AutoCommitTest, TestSort, FieldMutatingUpdateProcessorTest, TestDistributedStatsComponentCardinality, SimpleCollectionCreateDeleteTest, TestDistributedMissingSort, TestRandomRequestDistribution, TestPHPSerializedResponseWriter, MultiThreadedOCPTest, BigEndianAscendingWordDeserializerTest, PluginInfoTest, TestExtendedDismaxParser, ChangedSchemaMergeTest, UUIDUpdateProcessorFallbackTest, LeaderElectionTest, TestPerFieldSimilarity, OverseerStatusTest, CdcrVersionReplicationTest, HdfsThreadLeakTest, TestSolrConfigHandlerConcurrent, TestMiniSolrCloudCluster, TestJmxMonitoredMap, TestSchemaNameResource, TestStressRecovery, TestWriterPerf, TestScoreJoinQPNoScore, InfoHandlerTest, TestExceedMaxTermLength, AliasIntegrationTest, RemoteQueryErrorTest, SearchHandlerTest, TestReloadAndDeleteDocs, ZkStateWriterTest, HdfsWriteToMultipleCollectionsTest, HdfsChaosMonkeyNothingIsSafeTest, SimpleFacetsTest, LeaderFailoverAfterPartitionTest, HdfsBasicDistributedZk2Test, DistributedFacetPivotLongTailTest, TestSuggestSpellingConverter, TestConfigSetsAPI, TestDistribIDF, TestSchemaResource, BlockDirectoryTest, TestMiniSolrCloudClusterSSL, ActionThrottleTest, HdfsUnloadDistributedZkTest, TestElisionMultitermQuery, SolrCoreCheckLockOnStartupTest, CircularListTest, OverriddenZkACLAndCredentialsProvidersTest, TestSolrDynamicMBean, TestReload, TestExpandComponent, OverseerTest, TestRestManager, DistributedVersionInfoTest, RecoveryAfterSoftCommitTest, XmlUpdateRequestHandlerTest, ResponseHeaderTest, DateMathParserTest, DirectSolrConnectionTest, PrimitiveFieldTypeTest, TestAuthorizationFramework, TestStandardQParsers, TestFieldCollectionResource, SharedFSAutoReplicaFailoverUtilsTest, StatsComponentTest, BadCopyFieldTest, OverseerTaskQueueTest, TestRecovery, OverseerCollectionConfigSetProcessorTest, TestBulkSchemaConcurrent, TestConfigSetsAPIZkFailure, CurrencyFieldXmlFileTest, TestSerializedLuceneMatchVersion, TestRandomMergePolicy, TestXIncludeConfig, OverseerRolesTest, DistribJoinFromCollectionTest, BasicDistributedZkTest, BasicDistributedZk2Test, RecoveryZkTest, FullSolrCloudDistribCmdsTest, TestRandomFaceting, ZkSolrClientTest, TestZkChroot, TestDistributedSearch, ShowFileRequestHandlerTest, SimplePostToolTest, SignatureUpdateProcessorFactoryTest, SpellCheckCollatorTest, TestFoldingMultitermQuery, DocValuesTest, SuggesterTest, TestTrie, SuggesterWFSTTest, NoCacheHeaderTest, TestPseudoReturnFields, TestWordDelimiterFilterFactory, DirectUpdateHandlerOptimizeTest, StatelessScriptUpdateProcessorFactoryTest, XsltUpdateRequestHandlerTest, DebugComponentTest, DisMaxRequestHandlerTest, TestReversedWildcardFilterFactory, DocumentAnalysisRequestHandlerTest, TestOmitPositions, TermsComponentTest, DocumentBuilderTest, PathHierarchyTokenizerFactoryTest, TestIndexingPerformance, FieldAnalysisRequestHandlerTest, TestArbitraryIndexDir, RegexBoostProcessorTest, TestJmxIntegration, UpdateRequestProcessorFactoryTest, JSONWriterTest, QueryParsingTest, UniqFieldsUpdateProcessorFactoryTest, CSVRequestHandlerTest, TestBinaryResponseWriter, BadComponentTest, TestSearchPerf, NumericFieldsTest, TestConfig, TestFuzzyAnalyzedSuggestions, TestPostingsSolrHighlighter, SynonymTokenizerTest, EchoParamsTest, TestDFRSimilarityFactory, TestFastWriter, OpenExchangeRatesOrgProviderTest, TestSystemIdResolver, SpellingQueryConverterTest, TestSolrJ, TestUtils, SolrTestCaseJ4Test, TestCursorMarkWithoutUniqueKey, TestHighlightDedupGrouping, TestTolerantSearch, TestEmbeddedSolrServerConstructors, TestJettySolrRunner, AssignTest, AsyncMigrateRouteKeyTest, CdcrReplicationHandlerTest, CloudExitableDirectoryReaderTest, ConcurrentDeleteAndCreateCollectionTest, DeleteLastCustomShardedReplicaTest, LeaderInitiatedRecoveryOnCommitTest, LeaderInitiatedRecoveryOnShardRestartTest]
[junit4] Completed [429/555] on J2 in 44.02s, 1 test, 1 error <<< FAILURES!
[...truncated 421 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987: There were test failures: 555 suites (8 ignored), 2200 tests, 2 errors, 1 failure, 32 ignored (18 assumptions) [seed: 8A16F3829FAD9E6A]
Total time: 194 minutes 40 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 845 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/845/
5 tests failed.
FAILED: org.apache.solr.cloud.BasicDistributedZkTest.test
Error Message:
commitWithin did not work on node: http://127.0.0.1:60465/_p/m/collection1 expected:<68> but was:<67>
Stack Trace:
java.lang.AssertionError: commitWithin did not work on node: http://127.0.0.1:60465/_p/m/collection1 expected:<68> but was:<67>
at __randomizedtesting.SeedInfo.seed([5DDFB81096E730DB:D58B87CA381B5D23]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.apache.solr.cloud.BasicDistributedZkTest.test(BasicDistributedZkTest.java:333)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1660)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:866)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:902)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:916)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:963)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:938)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:875)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:777)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:811)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:822)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.handler.TestReplicationHandler.doTestStressReplication
Error Message:
timed out waiting for collection1 startAt time to exceed: Sat Nov 07 15:00:19 IRST 2015
Stack Trace:
java.lang.AssertionError: timed out waiting for collection1 startAt time to exceed: Sat Nov 07 15:00:19 IRST 2015
at __randomizedtesting.SeedInfo.seed([5DDFB81096E730DB:8674B8D693CF5968]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.handler.TestReplicationHandler.watchCoreStartAt(TestReplicationHandler.java:1417)
at org.apache.solr.handler.TestReplicationHandler.doTestStressReplication(TestReplicationHandler.java:769)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1660)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:866)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:902)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:875)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:777)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:811)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:822)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR
Error Message:
Captured an uncaught exception in thread: Thread[id=68659, name=coreZkRegister-5381-thread-2, state=RUNNABLE, group=TGRP-LeaderInitiatedRecoveryOnShardRestartTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=68659, name=coreZkRegister-5381-thread-2, state=RUNNABLE, group=TGRP-LeaderInitiatedRecoveryOnShardRestartTest]
at __randomizedtesting.SeedInfo.seed([5DDFB81096E730DB:8355D66DAD455228]:0)
Caused by: java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([5DDFB81096E730DB]:0)
at org.apache.solr.cloud.ZkController.updateLeaderInitiatedRecoveryState(ZkController.java:2126)
at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:451)
at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:197)
at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:157)
at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:346)
at org.apache.solr.cloud.ZkController.joinElection(ZkController.java:1113)
at org.apache.solr.cloud.ZkController.register(ZkController.java:926)
at org.apache.solr.cloud.ZkController.register(ZkController.java:881)
at org.apache.solr.core.ZkContainer$2.run(ZkContainer.java:183)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:231)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.OverseerTest.testOverseerStatsReset
Error Message:
expected:<1> but was:<2>
Stack Trace:
java.lang.AssertionError: expected:<1> but was:<2>
at __randomizedtesting.SeedInfo.seed([5DDFB81096E730DB:F68B5F2C033D93D5]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at org.apache.solr.cloud.OverseerTest.testOverseerStatsReset(OverseerTest.java:722)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1660)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:866)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:902)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:875)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:777)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:811)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:822)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test
Error Message:
Captured an uncaught exception in thread: Thread[id=54627, name=collection5, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=54627, name=collection5, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:56622: collection already exists: awholynewstresscollection_collection5_0
at __randomizedtesting.SeedInfo.seed([5DDFB81096E730DB]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1574)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1595)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:888)
Build Log:
[...truncated 9820 lines...]
[junit4] Suite: org.apache.solr.cloud.BasicDistributedZkTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5DDFB81096E730DB-001/init-core-data-001
[junit4] 2> 26952 INFO (SUITE-BasicDistributedZkTest-seed#[5DDFB81096E730DB]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /_p/m
[junit4] 2> 26999 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 27003 INFO (Thread-29) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 27004 INFO (Thread-29) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 27103 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.ZkTestServer start zk server on port:54055
[junit4] 2> 27149 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 27294 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 27319 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Exception causing close of session 0x0 due to java.io.IOException: ZooKeeperServer not running
[junit4] 2> 29002 INFO (zkCallback-6-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1200813a name:ZooKeeperConnection Watcher:127.0.0.1:54055 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 29002 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 29003 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 29007 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 29049 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x150e18ddb360000, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 29050 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 29055 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 29067 INFO (zkCallback-7-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2209b038 name:ZooKeeperConnection Watcher:127.0.0.1:54055/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 29067 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 29067 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 29068 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
[junit4] 2> 29078 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
[junit4] 2> 29083 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
[junit4] 2> 29087 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
[junit4] 2> 29091 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 29092 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 29099 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 29099 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
[junit4] 2> 29105 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 29106 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 29114 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 29114 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
[junit4] 2> 29118 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 29118 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
[junit4] 2> 29121 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 29121 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
[junit4] 2> 29124 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 29124 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 29127 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 29128 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 29130 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 29131 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 29134 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 29134 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 29137 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 29137 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
[junit4] 2> 29469 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5DDFB81096E730DB-001/control-001/cores/collection1
[junit4] 2> 29479 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.e.j.s.Server jetty-9.2.13.v20150730
[junit4] 2> 29528 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6fb5a11f{/_p/m,null,AVAILABLE}
[junit4] 2> 29529 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.e.j.s.ServerConnector Started ServerConnector@589a1a4e{HTTP/1.1}{127.0.0.1:46199}
[junit4] 2> 29529 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.e.j.s.Server Started @32429ms
[junit4] 2> 29542 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5DDFB81096E730DB-001/tempDir-001/control/data, hostContext=/_p/m, hostPort=46199, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5DDFB81096E730DB-001/control-001/cores}
[junit4] 2> 29543 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 29546 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5DDFB81096E730DB-001/control-001/'
[junit4] 2> 29546 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 29547 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 29568 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 29584 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 29591 INFO (zkCallback-8-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@cfd51e6 name:ZooKeeperConnection Watcher:127.0.0.1:54055/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 29591 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 29591 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 29598 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 29598 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5DDFB81096E730DB-001/control-001/solr.xml
[junit4] 2> 29605 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5DDFB81096E730DB-001/control-001/cores
[junit4] 2> 29605 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.CoreContainer New CoreContainer 1661136603
[junit4] 2> 29605 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5DDFB81096E730DB-001/control-001/]
[junit4] 2> 29605 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5DDFB81096E730DB-001/control-001/lib
[junit4] 2> 29605 WARN (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5DDFB81096E730DB-001/control-001/lib).
[junit4] 2> 29647 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 29653 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 29654 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 29654 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 29654 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:54055/solr
[junit4] 2> 29675 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 29675 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 29686 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 29702 INFO (zkCallback-10-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@41049763 name:ZooKeeperConnection Watcher:127.0.0.1:54055 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 29703 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 29703 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 29716 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [n:127.0.0.1:46199__p%2Fm ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 29731 INFO (zkCallback-11-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@cd25d8d name:ZooKeeperConnection Watcher:127.0.0.1:54055/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 29731 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [n:127.0.0.1:46199__p%2Fm ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 29743 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [n:127.0.0.1:46199__p%2Fm ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
[junit4] 2> 29757 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [n:127.0.0.1:46199__p%2Fm ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 29765 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [n:127.0.0.1:46199__p%2Fm ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 29771 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [n:127.0.0.1:46199__p%2Fm ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 29774 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [n:127.0.0.1:46199__p%2Fm ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 29788 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [n:127.0.0.1:46199__p%2Fm ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 29793 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [n:127.0.0.1:46199__p%2Fm ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 29797 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [n:127.0.0.1:46199__p%2Fm ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 29799 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [n:127.0.0.1:46199__p%2Fm ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 29801 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [n:127.0.0.1:46199__p%2Fm ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46199__p%2Fm
[junit4] 2> 29804 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [n:127.0.0.1:46199__p%2Fm ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:46199__p%2Fm
[junit4] 2> 29814 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [n:127.0.0.1:46199__p%2Fm ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 29817 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [n:127.0.0.1:46199__p%2Fm ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 29822 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [n:127.0.0.1:46199__p%2Fm ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 29823 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [n:127.0.0.1:46199__p%2Fm ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94823591559168004-127.0.0.1:46199__p%2Fm-n_0000000000
[junit4] 2> 29830 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [n:127.0.0.1:46199__p%2Fm ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:46199__p%2Fm
[junit4] 2> 29830 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [n:127.0.0.1:46199__p%2Fm ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
[junit4] 2> 29833 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [n:127.0.0.1:46199__p%2Fm ] o.a.s.c.Overseer Overseer (id=94823591559168004-127.0.0.1:46199__p%2Fm-n_0000000000) starting
[junit4] 2> 29841 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [n:127.0.0.1:46199__p%2Fm ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
[junit4] 2> 30026 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [n:127.0.0.1:46199__p%2Fm ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 30039 INFO (OverseerCollectionConfigSetProcessor-94823591559168004-127.0.0.1:46199__p%2Fm-n_0000000000) [n:127.0.0.1:46199__p%2Fm ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
[junit4] 2> 30039 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [n:127.0.0.1:46199__p%2Fm ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 30036 INFO (OverseerStateUpdate-94823591559168004-127.0.0.1:46199__p%2Fm-n_0000000000) [n:127.0.0.1:46199__p%2Fm ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 30100 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [n:127.0.0.1:46199__p%2Fm ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 30100 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [n:127.0.0.1:46199__p%2Fm ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 30102 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [n:127.0.0.1:46199__p%2Fm ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5DDFB81096E730DB-001/control-001/cores
[junit4] 2> 30105 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [n:127.0.0.1:46199__p%2Fm ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5DDFB81096E730DB-001/control-001/cores/collection1, collection=control_collection, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5DDFB81096E730DB-001/control-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 30105 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [n:127.0.0.1:46199__p%2Fm ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5DDFB81096E730DB-001/control-001/cores/collection1/
[junit4] 2> 30105 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [n:127.0.0.1:46199__p%2Fm ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 30155 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [n:127.0.0.1:46199__p%2Fm ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4] 2> 30155 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [n:127.0.0.1:46199__p%2Fm ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 30152 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 30155 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 30168 INFO (OverseerStateUpdate-94823591559168004-127.0.0.1:46199__p%2Fm-n_0000000000) [n:127.0.0.1:46199__p%2Fm ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:46199/_p/m",
[junit4] 2> "node_name":"127.0.0.1:46199__p%2Fm",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 30171 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 30192 INFO (OverseerStateUpdate-94823591559168004-127.0.0.1:46199__p%2Fm-n_0000000000) [n:127.0.0.1:46199__p%2Fm ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:46199/_p/m",
[junit4] 2> "node_name":"127.0.0.1:46199__p%2Fm",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 30195 INFO (OverseerStateUpdate-94823591559168004-127.0.0.1:46199__p%2Fm-n_0000000000) [n:127.0.0.1:46199__p%2Fm ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
[junit4] 2> 30216 INFO (OverseerStateUpdate-94823591559168004-127.0.0.1:46199__p%2Fm-n_0000000000) [n:127.0.0.1:46199__p%2Fm ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 30224 INFO (zkCallback-11-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 31172 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 31172 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
[junit4] 2> 31173 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 31173 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 31174 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 31175 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5DDFB81096E730DB-001/control-001/cores/collection1/'
[junit4] 2> 31175 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 31175 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 31215 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 31243 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 31248 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 31269 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
[junit4] 2> 31281 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 31307 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 31610 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 31640 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 31641 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 31676 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 31681 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 31683 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 31685 WARN (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 31685 WARN (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 31685 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 31686 WARN (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 31686 WARN (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 31693 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4] 2> 31693 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 31693 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 31694 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5DDFB81096E730DB-001/control-001/cores/collection1/], dataDir=[null]
[junit4] 2> 31694 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@60910b9b
[junit4] 2> 31702 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5DDFB81096E730DB-001/control-001/cores/collection1/data
[junit4] 2> 31702 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5DDFB81096E730DB-001/control-001/cores/collection1/data/index/
[junit4] 2> 31702 WARN (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5DDFB81096E730DB-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 31702 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5DDFB81096E730DB-001/control-001/cores/collection1/data/index
[junit4] 2> 31703 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=22, maxMergeAtOnceExplicit=26, maxMergedSegmentMB=34.4375, floorSegmentMB=0.6533203125, forceMergeDeletesPctAllowed=2.3108198870638397, segmentsPerTier=19.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 31712 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(NRTCachingDirectory(RAMDirectory@58c298f1 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2498ce63; maxCacheMB=0.36328125 maxMergeSizeMB=0.0283203125)),segFN=segments_1,generation=1}
[junit4] 2> 31712 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 31721 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5DDFB81096E730DB-001/control-001/cores/collection1/data/
[junit4] 2> 31728 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 31736 WARN (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5DDFB81096E730DB-001/control-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
[junit4] 2> 31740 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
[junit4] 2> 31740 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 31740 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 31740 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 31740 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 31741 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 31741 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 31741 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 31742 WARN (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,args = {defaults={a=A,b=B}}}
[junit4] 2> 31744 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 31750 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 31752 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 31755 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 31786 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/dump,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 31787 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 31788 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 31788 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 31789 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
[junit4] 2> 31789 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
[junit4] 2> 31789 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=34, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7945918042205389]
[junit4] 2> 31791 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(NRTCachingDirectory(RAMDirectory@58c298f1 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2498ce63; maxCacheMB=0.36328125 maxMergeSizeMB=0.0283203125)),segFN=segments_1,generation=1}
[junit4] 2> 31791 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 31791 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@10d5b332[collection1] main
[junit4] 2> 31791 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 31793 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 31793 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 31796 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 31796 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
[junit4] 2> 31796 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 31797 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 31798 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 31798 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 31798 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 31799 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
[junit4] 2> 31799 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
[junit4] 2> 31799 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
[junit4] 2> 31799 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1517177469859266560
[junit4] 2> 31801 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 1.0ms to seed version buckets with highest version 1517177469859266560
[junit4] 2> 31802 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
[junit4] 2> 31807 INFO (searcherExecutor-70-thread-1-processing-n:127.0.0.1:46199__p%2Fm x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@10d5b332[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 31809 INFO (coreLoadExecutor-69-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 31849 INFO (coreZkRegister-63-thread-1-processing-n:127.0.0.1:46199__p%2Fm x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:46199/_p/m collection:control_collection shard:shard1
[junit4] 2> 31858 INFO (coreZkRegister-63-thread-1-processing-n:127.0.0.1:46199__p%2Fm x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 31864 INFO (coreZkRegister-63-thread-1-processing-n:127.0.0.1:46199__p%2Fm x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/94823591559168004-core_node1-n_0000000000
[junit4] 2> 31865 INFO (coreZkRegister-63-thread-1-processing-n:127.0.0.1:46199__p%2Fm x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1
[junit4] 2> 31870 INFO (coreZkRegister-63-thread-1-processing-n:127.0.0.1:46199__p%2Fm x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 31870 INFO (coreZkRegister-63-thread-1-processing-n:127.0.0.1:46199__p%2Fm x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 31871 INFO (OverseerStateUpdate-94823591559168004-127.0.0.1:46199__p%2Fm-n_0000000000) [n:127.0.0.1:46199__p%2Fm ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection"} current state version: 1
[junit4] 2> 31871 INFO (coreZkRegister-63-thread-1-processing-n:127.0.0.1:46199__p%2Fm x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:46199/_p/m/collection1/
[junit4] 2> 31871 INFO (coreZkRegister-63-thread-1-processing-n:127.0.0.1:46199__p%2Fm x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 31871 INFO (coreZkRegister-63-thread-1-processing-n:127.0.0.1:46199__p%2Fm x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:46199/_p/m/collection1/ has no replicas
[junit4] 2> 31871 INFO (coreZkRegister-63-thread-1-processing-n:127.0.0.1:46199__p%2Fm x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:46199/_p/m/collection1/ shard1
[junit4] 2> 31877 INFO (coreZkRegister-63-thread-1-processing-n:127.0.0.1:46199__p%2Fm x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 31877 INFO (zkCallback-11-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 31895 INFO (coreZkRegister-63-thread-1-processing-n:127.0.0.1:46199__p%2Fm x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
[junit4] 2> 31915 INFO (OverseerStateUpdate-94823591559168004-127.0.0.1:46199__p%2Fm-n_0000000000) [n:127.0.0.1:46199__p%2Fm ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:46199/_p/m",
[junit4] 2> "node_name":"127.0.0.1:46199__p%2Fm",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "core":"collection1"} current state version: 2
[junit4] 2> 31916 INFO (OverseerStateUpdate-94823591559168004-127.0.0.1:46199__p%2Fm-n_0000000000) [n:127.0.0.1:46199__p%2Fm ] o.a.s.c.o.ReplicaMutator Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:46199/_p/m",
[junit4] 2> "node_name":"127.0.0.1:46199__p%2Fm",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "core":"collection1"}
[junit4] 2> 31920 INFO (OverseerStateUpdate-94823591559168004-127.0.0.1:46199__p%2Fm-n_0000000000) [n:127.0.0.1:46199__p%2Fm ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:46199/_p/m",
[junit4] 2> "core":"collection1"} current state version: 2
[junit4] 2> 32025 INFO (zkCallback-11-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 32066 INFO (coreZkRegister-63-thread-1-processing-n:127.0.0.1:46199__p%2Fm x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:46199/_p/m/collection1/ and leader is http://127.0.0.1:46199/_p/m/collection1/
[junit4] 2> 32067 INFO (coreZkRegister-63-thread-1-processing-n:127.0.0.1:46199__p%2Fm x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:46199/_p/m
[junit4] 2> 32290 INFO (coreZkRegister-63-thread-1-processing-n:127.0.0.1:46199__p%2Fm x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 32291 INFO (coreZkRegister-63-thread-1-processing-n:127.0.0.1:46199__p%2Fm x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
[junit4] 2> 32291 INFO (coreZkRegister-63-thread-1-processing-n:127.0.0.1:46199__p%2Fm x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46199__p%2Fm c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 32295 INFO (OverseerStateUpdate-94823591559168004-127.0.0.1:46199__p%2Fm-n_0000000000) [n:127.0.0.1:46199__p%2Fm ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:46199/_p/m",
[junit4] 2> "node_name":"127.0.0.1:46199__p%2Fm",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 3
[junit4] 2> 32296 INFO (OverseerStateUpdate-94823591559168004-127.0.0.1:46199__p%2Fm-n_0000000000) [n:127.0.0.1:46199__p%2Fm ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:46199/_p/m",
[junit4] 2> "node_name":"127.0.0.1:46199__p%2Fm",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 32323 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 32339 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 32359 INFO (zkCallback-13-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@33244486 name:ZooKeeperConnection Watcher:127.0.0.1:54055/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 32359 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 32359 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 32359 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 32375 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 32401 INFO (zkCallback-13-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 32401 INFO (zkCallback-11-thread-1-processing-n:127.0.0.1:46199__p%2Fm) [n:127.0.0.1:46199__p%2Fm ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 33014 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5DDFB81096E730DB-001/shard-1-001/cores/collection1
[junit4] 2> 33015 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5DDFB81096E730DB-001/shard-1-001
[junit4] 2> 33018 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.e.j.s.Server jetty-9.2.13.v20150730
[junit4] 2> 33032 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@37ad95bf{/_p/m,null,AVAILABLE}
[junit4] 2> 33033 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.e.j.s.ServerConnector Started ServerConnector@1c7a657b{HTTP/1.1}{127.0.0.1:60465}
[junit4] 2> 33033 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.e.j.s.Server Started @35933ms
[junit4] 2> 33033 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5DDFB81096E730DB-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/_p/m, hostPort=60465, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5DDFB81096E730DB-001/shard-1-001/cores}
[junit4] 2> 33034 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 33034 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5DDFB81096E730DB-001/shard-1-001/'
[junit4] 2> 33034 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 33034 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 33063 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 33071 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 33090 INFO (zkCallback-14-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6bb71235 name:ZooKeeperConnection Watcher:127.0.0.1:54055/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 33155 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 33156 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 33170 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 33170 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5DDFB81096E730DB-001/shard-1-001/solr.xml
[junit4] 2> 33178 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5DDFB81096E730DB-001/shard-1-001/cores
[junit4] 2> 33178 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.CoreContainer New CoreContainer 1790460532
[junit4] 2> 33178 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5DDFB81096E730DB-001/shard-1-001/]
[junit4] 2> 33178 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5DDFB81096E730DB-001/shard-1-001/lib
[junit4] 2> 33178 WARN (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_5DDFB81096E730DB-001/shard-1-001/lib).
[junit4] 2> 33186 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 33193 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 33193 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 33193 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 33193 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:54055/solr
[junit4] 2> 33194 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 33194 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 33196 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 33215 INFO (zkCallback-16-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6f0920c0 name:ZooKeeperConnection Watcher:127.0.0.1:54055 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 33218 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 33219 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 33230 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [n:127.0.0.1:60465__p%2Fm ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 33247 INFO (zkCallback-17-thread-1-processing-n:127.0.0.1:60465__p%2Fm) [n:127.0.0.1:60465__p%2Fm ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@24a09042 name:ZooKeeperConnection Watcher:127.0.0.1:54055/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 33247 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [n:127.0.0.1:60465__p%2Fm ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 33256 INFO (TEST-BasicDistributedZkTest.test-seed#[5DDFB81096E730DB]) [n:127.0.0.1:60465__p%2Fm ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 34264 INF
[...truncated too long message...]
cancelElection(ElectionContext.java:169)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.cancelElection(ElectionContext.java:285)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:467)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:197)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:157)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:58)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:388)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3$1.run(SolrZkClient.java:269)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:231)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 2918278 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[5DDFB81096E730DB]) [ ] o.e.j.s.ServerConnector Stopped ServerConnector@1aa83ee4{HTTP/1.1}{127.0.0.1:52952}
[junit4] 2> 2918279 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[5DDFB81096E730DB]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@1703e786{/,null,UNAVAILABLE}
[junit4] 2> 2918280 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[5DDFB81096E730DB]) [n:127.0.0.1:52952_ c:all_in_lir s:shard1 r:core_node2 x:all_in_lir_shard1_replica1] o.a.s.c.ChaosMonkey monkey: stop shard! 58439
[junit4] 2> 2918282 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[5DDFB81096E730DB]) [n:127.0.0.1:52952_ c:all_in_lir s:shard1 r:core_node2 x:all_in_lir_shard1_replica1] o.a.s.c.ZkTestServer connecting to 127.0.0.1:45514 45514
[junit4] 2> 2918453 INFO (Thread-60306) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:45514 45514
[junit4] 2> 2918455 WARN (Thread-60306) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 6 /solr/aliases.json
[junit4] 2> 5 /solr/security.json
[junit4] 2> 5 /solr/configs/conf1
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 6 /solr/clusterstate.json
[junit4] 2> 3 /solr/overseer_elect/election/94823778397913092-127.0.0.1:58439_-n_0000000000
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 6 /solr/collections
[junit4] 2> 4 /solr/live_nodes
[junit4] 2> 2 /solr/overseer/queue
[junit4] 2> 2 /solr/overseer/collection-queue-work
[junit4] 2>
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=LeaderInitiatedRecoveryOnShardRestartTest -Dtests.method=testRestartWithAllInLIR -Dtests.seed=5DDFB81096E730DB -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=sv_SE -Dtests.timezone=America/Edmonton -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] ERROR 40.4s J0 | LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR <<<
[junit4] > Throwable #1: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=68659, name=coreZkRegister-5381-thread-2, state=RUNNABLE, group=TGRP-LeaderInitiatedRecoveryOnShardRestartTest]
[junit4] > at __randomizedtesting.SeedInfo.seed([5DDFB81096E730DB:8355D66DAD455228]:0)
[junit4] > Caused by: java.lang.AssertionError
[junit4] > at __randomizedtesting.SeedInfo.seed([5DDFB81096E730DB]:0)
[junit4] > at org.apache.solr.cloud.ZkController.updateLeaderInitiatedRecoveryState(ZkController.java:2126)
[junit4] > at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:451)
[junit4] > at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:197)
[junit4] > at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:157)
[junit4] > at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:346)
[junit4] > at org.apache.solr.cloud.ZkController.joinElection(ZkController.java:1113)
[junit4] > at org.apache.solr.cloud.ZkController.register(ZkController.java:926)
[junit4] > at org.apache.solr.cloud.ZkController.register(ZkController.java:881)
[junit4] > at org.apache.solr.core.ZkContainer$2.run(ZkContainer.java:183)
[junit4] > at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:231)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 2918458 INFO (SUITE-LeaderInitiatedRecoveryOnShardRestartTest-seed#[5DDFB81096E730DB]-worker) [n:127.0.0.1:52952_ c:all_in_lir s:shard1 r:core_node2 x:all_in_lir_shard1_replica1] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: test params are: codec=Lucene60, sim=ClassicSimilarity, locale=sv_SE, timezone=America/Edmonton
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_66 (64-bit)/cpus=4,threads=1,free=116374744,total=526909440
[junit4] 2> NOTE: All tests run in this JVM: [DocExpirationUpdateProcessorFactoryTest, TestImplicitCoreProperties, TestDynamicFieldResource, TestPKIAuthenticationPlugin, EnumFieldTest, AnalysisAfterCoreReloadTest, PrimUtilsTest, TestCloudInspectUtil, BasicDistributedZkTest, TestBlobHandler, ExitableDirectoryReaderTest, QueryElevationComponentTest, DefaultValueUpdateProcessorTest, TestCloudSchemaless, HdfsRecoveryZkTest, TestAnalyzedSuggestions, TestRequestStatusCollectionAPI, RollingRestartTest, TestCryptoKeys, PreAnalyzedUpdateProcessorTest, TestInfoStreamLogging, HdfsChaosMonkeySafeLeaderTest, CurrencyFieldOpenExchangeTest, IgnoreCommitOptimizeUpdateProcessorFactoryTest, DistributedSuggestComponentTest, IndexSchemaRuntimeFieldTest, TestSolrCloudWithKerberosAlt, TestSimpleTrackingShardHandler, TestRTGBase, BJQParserTest, FileBasedSpellCheckerTest, CollectionStateFormat2Test, TestRealTimeGet, DocumentAnalysisRequestHandlerTest, TestFastOutputStream, TestReplicaProperties, TestDistributedSearch, TestFieldTypeResource, SuggestComponentContextFilterQueryTest, TestReqParamsAPI, AnalysisErrorHandlingTest, TestManagedSchemaDynamicFieldResource, BufferStoreTest, CollectionReloadTest, TestRandomFaceting, StressHdfsTest, TestRawResponseWriter, TestClassNameShortening, TestCloudManagedSchema, TestBadConfig, ReturnFieldsTest, TestCSVLoader, TestCustomSort, TestTolerantSearch, ZkNodePropsTest, CoreAdminRequestStatusTest, AlternateDirectoryTest, TestLazyCores, TestCollationFieldDocValues, RuleEngineTest, TestDefaultSearchFieldResource, TestAtomicUpdateErrorCases, PeerSyncTest, PingRequestHandlerTest, TestValueSourceCache, TestTrackingShardHandlerFactory, RAMDirectoryFactoryTest, DistributedQueueTest, TestRemoteStreaming, TestDynamicLoading, LeaderElectionIntegrationTest, ParsingFieldUpdateProcessorsTest, TestMergePolicyConfig, TestLuceneMatchVersion, TestPhraseSuggestions, ExplicitHLLTest, TestCollectionAPI, TestCustomDocTransformer, PreAnalyzedFieldTest, DateRangeFieldTest, TestSolr4Spatial, TestJettySolrRunner, SaslZkACLProviderTest, SecurityConfHandlerTest, TestScoreJoinQPScore, PathHierarchyTokenizerFactoryTest, TestShortCircuitedRequests, AddSchemaFieldsUpdateProcessorFactoryTest, TestMaxScoreQueryParser, TestLRUCache, StandardRequestHandlerTest, DeleteInactiveReplicaTest, SyncSliceTest, BasicZkTest, TestReplicationHandler, ForceLeaderTest, LeaderInitiatedRecoveryOnShardRestartTest]
[junit4] Completed [425/555] on J0 in 40.83s, 1 test, 1 error <<< FAILURES!
[...truncated 434 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987: There were test failures: 555 suites (8 ignored), 2200 tests, 2 errors, 3 failures, 32 ignored (18 assumptions) [seed: 5DDFB81096E730DB]
Total time: 197 minutes 12 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 844 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/844/
3 tests failed.
FAILED: org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.test
Error Message:
Error from server at http://127.0.0.1:55033/nv_vr/r/awholynewcollection_3: Expected mime type application/octet-stream but got text/html. <html> <head> <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/> <title>Error 500 </title> </head> <body> <h2>HTTP ERROR: 500</h2> <p>Problem accessing /nv_vr/r/awholynewcollection_3/select. Reason: <pre> {trace=java.lang.NullPointerException at org.apache.solr.servlet.HttpSolrCall.getCoreByCollection(HttpSolrCall.java:786) at org.apache.solr.servlet.HttpSolrCall.init(HttpSolrCall.java:270) at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:415) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:220) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:179) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652) at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:109) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652) at org.eclipse.jetty.servlets.UserAgentFilter.doFilter(UserAgentFilter.java:83) at org.eclipse.jetty.servlets.GzipFilter.doFilter(GzipFilter.java:364) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:221) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97) at org.eclipse.jetty.server.Server.handle(Server.java:499) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:310) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:257) at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:540) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555) at java.lang.Thread.run(Thread.java:745) ,code=500}</pre></p> <hr /><i><small>Powered by Jetty://</small></i> </body> </html>
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:55033/nv_vr/r/awholynewcollection_3: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 500 </title>
</head>
<body>
<h2>HTTP ERROR: 500</h2>
<p>Problem accessing /nv_vr/r/awholynewcollection_3/select. Reason:
<pre> {trace=java.lang.NullPointerException
at org.apache.solr.servlet.HttpSolrCall.getCoreByCollection(HttpSolrCall.java:786)
at org.apache.solr.servlet.HttpSolrCall.init(HttpSolrCall.java:270)
at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:415)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:220)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:179)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:109)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
at org.eclipse.jetty.servlets.UserAgentFilter.doFilter(UserAgentFilter.java:83)
at org.eclipse.jetty.servlets.GzipFilter.doFilter(GzipFilter.java:364)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585)
at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:221)
at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127)
at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515)
at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
at org.eclipse.jetty.server.Server.handle(Server.java:499)
at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:310)
at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:257)
at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:540)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635)
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555)
at java.lang.Thread.run(Thread.java:745)
,code=500}</pre></p>
<hr /><i><small>Powered by Jetty://</small></i>
</body>
</html>
at __randomizedtesting.SeedInfo.seed([7205036CC31451AA:FA513CB66DE83C52]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:543)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:150)
at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:943)
at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:958)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForNon403or404or503(AbstractFullDistribZkTestBase.java:1754)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:665)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test(CollectionsAPIDistributedZkTest.java:167)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1660)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:866)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:902)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:916)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:963)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:938)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:875)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:777)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:811)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:822)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest
Error Message:
5 threads leaked from SUITE scope at org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest: 1) Thread[id=17425, name=zkCallback-909-thread-3, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 2) Thread[id=17424, name=zkCallback-909-thread-2, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 3) Thread[id=16989, name=TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]-SendThread(127.0.0.1:46837), state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:994) 4) Thread[id=16991, name=zkCallback-909-thread-1, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 5) Thread[id=16990, name=TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]-EventThread, state=WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 5 threads leaked from SUITE scope at org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest:
1) Thread[id=17425, name=zkCallback-909-thread-3, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2) Thread[id=17424, name=zkCallback-909-thread-2, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
3) Thread[id=16989, name=TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]-SendThread(127.0.0.1:46837), state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:994)
4) Thread[id=16991, name=zkCallback-909-thread-1, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
5) Thread[id=16990, name=TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]-EventThread, state=WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494)
at __randomizedtesting.SeedInfo.seed([7205036CC31451AA]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=17425, name=zkCallback-909-thread-3, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 2) Thread[id=17424, name=zkCallback-909-thread-2, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 3) Thread[id=16989, name=TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]-SendThread(127.0.0.1:46837), state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:994) 4) Thread[id=16991, name=zkCallback-909-thread-1, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=17425, name=zkCallback-909-thread-3, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2) Thread[id=17424, name=zkCallback-909-thread-2, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
3) Thread[id=16989, name=TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]-SendThread(127.0.0.1:46837), state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:994)
4) Thread[id=16991, name=zkCallback-909-thread-1, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
at __randomizedtesting.SeedInfo.seed([7205036CC31451AA]:0)
Build Log:
[...truncated 10517 lines...]
[junit4] Suite: org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_7205036CC31451AA-001/init-core-data-001
[junit4] 2> 1200970 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[7205036CC31451AA]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
[junit4] 2> 1200970 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[7205036CC31451AA]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /nv_vr/r
[junit4] 1> Formatting using clusterid: testClusterID
[junit4] 2> 1201017 WARN (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[7205036CC31451AA]-worker) [ ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
[junit4] 2> 1201024 WARN (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[7205036CC31451AA]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 1201026 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[7205036CC31451AA]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 1201053 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[7205036CC31451AA]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_53615_hdfs____.sfeu2/webapp
[junit4] 2> 1201157 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[7205036CC31451AA]-worker) [ ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
[junit4] 2> 1201331 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[7205036CC31451AA]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:53615
[junit4] 2> 1201420 WARN (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[7205036CC31451AA]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 1201421 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[7205036CC31451AA]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 1201434 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[7205036CC31451AA]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_41571_datanode____.51x23r/webapp
[junit4] 2> 1201540 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[7205036CC31451AA]-worker) [ ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
[junit4] 2> 1201710 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[7205036CC31451AA]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41571
[junit4] 2> 1201748 WARN (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[7205036CC31451AA]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 1201749 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[7205036CC31451AA]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 1201762 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[7205036CC31451AA]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_37905_datanode____.aa1j3z/webapp
[junit4] 2> 1201816 INFO (IPC Server handler 3 on 51218) [ ] BlockStateChange BLOCK* processReport: from storage DS-315151a4-ceb9-4f0d-ac3f-1a24b5077ba5 node DatanodeRegistration(127.0.0.1, datanodeUuid=f39b4f0c-9ddd-44fe-b3c2-f97feb8988af, infoPort=41571, ipcPort=48241, storageInfo=lv=-56;cid=testClusterID;nsid=349147342;c=0), blocks: 0, hasStaleStorages: true, processing time: 1 msecs
[junit4] 2> 1201816 INFO (IPC Server handler 3 on 51218) [ ] BlockStateChange BLOCK* processReport: from storage DS-f5d7f3d3-ffdc-4e8f-8e63-4e0a3d1f6b6c node DatanodeRegistration(127.0.0.1, datanodeUuid=f39b4f0c-9ddd-44fe-b3c2-f97feb8988af, infoPort=41571, ipcPort=48241, storageInfo=lv=-56;cid=testClusterID;nsid=349147342;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
[junit4] 2> 1201888 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[7205036CC31451AA]-worker) [ ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
[junit4] 2> 1202061 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[7205036CC31451AA]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37905
[junit4] 2> 1202146 INFO (IPC Server handler 7 on 51218) [ ] BlockStateChange BLOCK* processReport: from storage DS-7de94fe4-e400-4148-a12c-80bb6da79b6f node DatanodeRegistration(127.0.0.1, datanodeUuid=4137508e-46c3-4960-ab01-92b4de0cedb3, infoPort=37905, ipcPort=55881, storageInfo=lv=-56;cid=testClusterID;nsid=349147342;c=0), blocks: 0, hasStaleStorages: true, processing time: 1 msecs
[junit4] 2> 1202146 INFO (IPC Server handler 7 on 51218) [ ] BlockStateChange BLOCK* processReport: from storage DS-5a068994-9493-4dac-bd15-99e267052c30 node DatanodeRegistration(127.0.0.1, datanodeUuid=4137508e-46c3-4960-ab01-92b4de0cedb3, infoPort=37905, ipcPort=55881, storageInfo=lv=-56;cid=testClusterID;nsid=349147342;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
[junit4] 2> 1202259 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1202259 INFO (Thread-12460) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1202259 INFO (Thread-12460) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1202359 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.ZkTestServer start zk server on port:46837
[junit4] 2> 1202359 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1202360 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1202363 INFO (zkCallback-875-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7307f581 name:ZooKeeperConnection Watcher:127.0.0.1:46837 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1202363 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1202363 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1202363 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 1202365 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1202366 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1202368 INFO (zkCallback-876-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@67c8255d name:ZooKeeperConnection Watcher:127.0.0.1:46837/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1202368 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1202368 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1202368 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
[junit4] 2> 1202370 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
[junit4] 2> 1202372 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
[junit4] 2> 1202373 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
[junit4] 2> 1202375 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 1202376 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 1202378 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 1202378 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
[junit4] 2> 1202380 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1202381 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1202382 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 1202382 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
[junit4] 2> 1202384 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 1202384 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
[junit4] 2> 1202385 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 1202385 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
[junit4] 2> 1202387 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 1202387 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 1202389 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1202389 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 1202390 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1202390 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1202392 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 1202392 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 1202393 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 1202394 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
[junit4] 2> 1202396 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1202396 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1202399 INFO (zkCallback-877-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6eee350e name:ZooKeeperConnection Watcher:127.0.0.1:46837 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1202400 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1202400 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1202400 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 1202401 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1202402 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1202407 INFO (zkCallback-878-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3c272e37 name:ZooKeeperConnection Watcher:127.0.0.1:46837/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1202407 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1202407 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1202408 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf2/solrconfig.xml
[junit4] 2> 1202408 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/solrconfig.xml
[junit4] 2> 1202410 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf2/schema.xml
[junit4] 2> 1202410 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/schema.xml
[junit4] 2> 1202412 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf2/enumsConfig.xml
[junit4] 2> 1202412 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/enumsConfig.xml
[junit4] 2> 1202413 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf2/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1202413 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1202415 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf2/stopwords.txt
[junit4] 2> 1202415 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/stopwords.txt
[junit4] 2> 1202417 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf2/protwords.txt
[junit4] 2> 1202417 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/protwords.txt
[junit4] 2> 1202418 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf2/currency.xml
[junit4] 2> 1202418 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/currency.xml
[junit4] 2> 1202420 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf2/open-exchange-rates.json
[junit4] 2> 1202420 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/open-exchange-rates.json
[junit4] 2> 1202421 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf2/mapping-ISOLatin1Accent.txt
[junit4] 2> 1202422 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/mapping-ISOLatin1Accent.txt
[junit4] 2> 1202423 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf2/old_synonyms.txt
[junit4] 2> 1202423 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/old_synonyms.txt
[junit4] 2> 1202425 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf2/synonyms.txt
[junit4] 2> 1202425 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/synonyms.txt
[junit4] 2> 1202426 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/elevate.xml to /configs/conf2/elevate.xml
[junit4] 2> 1202426 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/elevate.xml
[junit4] 2> 1202761 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_7205036CC31451AA-001/control-001/cores/collection1
[junit4] 2> 1202762 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.e.j.s.Server jetty-9.2.13.v20150730
[junit4] 2> 1202764 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6d32653e{/nv_vr/r,null,AVAILABLE}
[junit4] 2> 1202765 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.e.j.s.ServerConnector Started ServerConnector@bdb1c2f{HTTP/1.1}{127.0.0.1:55033}
[junit4] 2> 1202765 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.e.j.s.Server Started @1205605ms
[junit4] 2> 1202765 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:51218/hdfs__localhost_51218__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-trunk_solr_build_solr-core_test_J2_temp_solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_7205036CC31451AA-001_tempDir-002_control_data, hostContext=/nv_vr/r, hostPort=55033, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_7205036CC31451AA-001/control-001/cores}
[junit4] 2> 1202765 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 1202765 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_7205036CC31451AA-001/control-001/'
[junit4] 2> 1202765 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1202765 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 1202781 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1202781 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1202783 INFO (zkCallback-879-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2fa1374c name:ZooKeeperConnection Watcher:127.0.0.1:46837/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1202783 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1202784 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1202785 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1202785 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_7205036CC31451AA-001/control-001/solr.xml
[junit4] 2> 1202789 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_7205036CC31451AA-001/control-001/cores
[junit4] 2> 1202789 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.CoreContainer New CoreContainer 262882375
[junit4] 2> 1202789 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_7205036CC31451AA-001/control-001/]
[junit4] 2> 1202790 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_7205036CC31451AA-001/control-001/lib
[junit4] 2> 1202790 WARN (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_7205036CC31451AA-001/control-001/lib).
[junit4] 2> 1202797 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 1202798 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1202799 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1202799 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1202799 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46837/solr
[junit4] 2> 1202799 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 1202799 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1202800 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1202801 INFO (zkCallback-881-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@55a5d326 name:ZooKeeperConnection Watcher:127.0.0.1:46837 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1202802 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1202802 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1202804 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [n:127.0.0.1:55033_nv_vr%2Fr ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1202805 INFO (zkCallback-882-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4ec566bd name:ZooKeeperConnection Watcher:127.0.0.1:46837/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1202806 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [n:127.0.0.1:55033_nv_vr%2Fr ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1202807 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [n:127.0.0.1:55033_nv_vr%2Fr ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
[junit4] 2> 1202808 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [n:127.0.0.1:55033_nv_vr%2Fr ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 1202811 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [n:127.0.0.1:55033_nv_vr%2Fr ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 1202812 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [n:127.0.0.1:55033_nv_vr%2Fr ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 1202814 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [n:127.0.0.1:55033_nv_vr%2Fr ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 1202816 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [n:127.0.0.1:55033_nv_vr%2Fr ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 1202817 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [n:127.0.0.1:55033_nv_vr%2Fr ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 1202818 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [n:127.0.0.1:55033_nv_vr%2Fr ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 1202819 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [n:127.0.0.1:55033_nv_vr%2Fr ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 1202820 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [n:127.0.0.1:55033_nv_vr%2Fr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55033_nv_vr%2Fr
[junit4] 2> 1202821 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [n:127.0.0.1:55033_nv_vr%2Fr ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:55033_nv_vr%2Fr
[junit4] 2> 1202822 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [n:127.0.0.1:55033_nv_vr%2Fr ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 1202823 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [n:127.0.0.1:55033_nv_vr%2Fr ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 1202824 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [n:127.0.0.1:55033_nv_vr%2Fr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1202824 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [n:127.0.0.1:55033_nv_vr%2Fr ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94819512677629958-127.0.0.1:55033_nv_vr%2Fr-n_0000000000
[junit4] 2> 1202826 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [n:127.0.0.1:55033_nv_vr%2Fr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:55033_nv_vr%2Fr
[junit4] 2> 1202826 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [n:127.0.0.1:55033_nv_vr%2Fr ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
[junit4] 2> 1202827 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [n:127.0.0.1:55033_nv_vr%2Fr ] o.a.s.c.Overseer Overseer (id=94819512677629958-127.0.0.1:55033_nv_vr%2Fr-n_0000000000) starting
[junit4] 2> 1202829 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [n:127.0.0.1:55033_nv_vr%2Fr ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
[junit4] 2> 1202834 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [n:127.0.0.1:55033_nv_vr%2Fr ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 1202834 INFO (OverseerCollectionConfigSetProcessor-94819512677629958-127.0.0.1:55033_nv_vr%2Fr-n_0000000000) [n:127.0.0.1:55033_nv_vr%2Fr ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
[junit4] 2> 1202834 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [n:127.0.0.1:55033_nv_vr%2Fr ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 1202835 INFO (OverseerStateUpdate-94819512677629958-127.0.0.1:55033_nv_vr%2Fr-n_0000000000) [n:127.0.0.1:55033_nv_vr%2Fr ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 1202849 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [n:127.0.0.1:55033_nv_vr%2Fr ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 1202849 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [n:127.0.0.1:55033_nv_vr%2Fr ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 1202849 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [n:127.0.0.1:55033_nv_vr%2Fr ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_7205036CC31451AA-001/control-001/cores
[junit4] 2> 1202850 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [n:127.0.0.1:55033_nv_vr%2Fr ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_7205036CC31451AA-001/control-001/cores/collection1, collection=control_collection, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_7205036CC31451AA-001/control-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 1202850 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [n:127.0.0.1:55033_nv_vr%2Fr ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_7205036CC31451AA-001/control-001/cores/collection1/
[junit4] 2> 1202850 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [n:127.0.0.1:55033_nv_vr%2Fr ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 1202852 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 1202852 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 1202852 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [n:127.0.0.1:55033_nv_vr%2Fr ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2
[junit4] 2> 1202852 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]) [n:127.0.0.1:55033_nv_vr%2Fr ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 1202853 INFO (OverseerStateUpdate-94819512677629958-127.0.0.1:55033_nv_vr%2Fr-n_0000000000) [n:127.0.0.1:55033_nv_vr%2Fr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:55033/nv_vr/r",
[junit4] 2> "node_name":"127.0.0.1:55033_nv_vr%2Fr",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 1202853 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 1202854 INFO (OverseerStateUpdate-94819512677629958-127.0.0.1:55033_nv_vr%2Fr-n_0000000000) [n:127.0.0.1:55033_nv_vr%2Fr ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:55033/nv_vr/r",
[junit4] 2> "node_name":"127.0.0.1:55033_nv_vr%2Fr",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 1202854 INFO (OverseerStateUpdate-94819512677629958-127.0.0.1:55033_nv_vr%2Fr-n_0000000000) [n:127.0.0.1:55033_nv_vr%2Fr ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
[junit4] 2> 1202854 INFO (OverseerStateUpdate-94819512677629958-127.0.0.1:55033_nv_vr%2Fr-n_0000000000) [n:127.0.0.1:55033_nv_vr%2Fr ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 1202856 INFO (zkCallback-882-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1203854 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 1203854 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
[junit4] 2> 1203855 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 1203855 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 1203855 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1203856 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_7205036CC31451AA-001/control-001/cores/collection1/'
[junit4] 2> 1203856 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1203856 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 1203872 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 1203878 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 1203899 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 1203912 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1203913 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 1203920 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 1204021 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 1204028 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 1204029 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 1204038 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 1204040 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 1204042 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1204044 WARN (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 1204044 WARN (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 1204044 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1204045 WARN (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 1204045 WARN (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 1204046 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2
[junit4] 2> 1204046 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 1204046 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.HdfsDirectoryFactory
[junit4] 2> 1204046 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:51218/solr_hdfs_home
[junit4] 2> 1204047 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 1204047 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_7205036CC31451AA-001/control-001/cores/collection1/], dataDir=[null]
[junit4] 2> 1204047 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@631b4b36
[junit4] 2> 1204047 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:51218/solr_hdfs_home/control_collection/core_node1/data
[junit4] 2> 1204066 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for hdfs://localhost:51218/solr_hdfs_home/control_collection/core_node1/data
[junit4] 2> 1204067 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=hdfs://localhost:51218/solr_hdfs_home/control_collection/core_node1/data/index/
[junit4] 2> 1204077 WARN (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory 'hdfs:/localhost:51218/solr_hdfs_home/control_collection/core_node1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1204077 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:51218/solr_hdfs_home/control_collection/core_node1/data/index
[junit4] 2> 1204088 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for hdfs://localhost:51218/solr_hdfs_home/control_collection/core_node1/data/index
[junit4] 2> 1204088 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=37, maxMergeAtOnceExplicit=36, maxMergedSegmentMB=87.4072265625, floorSegmentMB=2.1171875, forceMergeDeletesPctAllowed=4.299913233179417, segmentsPerTier=16.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.3022367295207219
[junit4] 2> 1204114 INFO (IPC Server handler 9 on 51218) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:38531 is added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-7de94fe4-e400-4148-a12c-80bb6da79b6f:NORMAL:127.0.0.1:35751|RBW], ReplicaUnderConstruction[[DISK]DS-315151a4-ceb9-4f0d-ac3f-1a24b5077ba5:NORMAL:127.0.0.1:38531|RBW]]} size 0
[junit4] 2> 1204116 INFO (IPC Server handler 0 on 51218) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:35751 is added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-315151a4-ceb9-4f0d-ac3f-1a24b5077ba5:NORMAL:127.0.0.1:38531|RBW], ReplicaUnderConstruction[[DISK]DS-5a068994-9493-4dac-bd15-99e267052c30:NORMAL:127.0.0.1:35751|FINALIZED]]} size 0
[junit4] 2> 1204123 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=NRTCachingDirectory(HdfsDirectory@b81c8180 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@6b3560ac; maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
[junit4] 2> 1204123 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 1204125 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in hdfs://localhost:51218/solr_hdfs_home/control_collection/core_node1/data/
[junit4] 2> 1204128 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1204128 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1204128 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1204129 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1204129 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1204129 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1204129 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1204129 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1204129 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1204129 WARN (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,args = {defaults={a=A,b=B}}}
[junit4] 2> 1204131 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1204132 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1204133 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1204134 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1204142 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/dump,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 1204142 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 1204143 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
[junit4] 2> 1204143 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing HdfsUpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 tlogDfsReplication=2
[junit4] 2> 1204155 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
[junit4] 2> 1204155 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
[junit4] 2> 1204156 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1171467545, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 1204173 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=NRTCachingDirectory(HdfsDirectory@b81c8180 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@6b3560ac; maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
[junit4] 2> 1204173 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 1204173 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@715e3165[collection1] main
[junit4] 2> 1204173 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 1204174 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1204174 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 1204174 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1204174 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
[junit4] 2> 1204174 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1204175 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 1204175 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1204175 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 1204175 INFO (coreLoadExecutor-2552-thread-1-processing-n:127.0.0.1:55033_nv_vr%2Fr) [n:127.0.0.1:55033_nv_vr%2Fr c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 120417
[...truncated too long message...]
y.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=HdfsCollectionsAPIDistributedZkTest -Dtests.seed=7205036CC31451AA -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=bg_BG -Dtests.timezone=Europe/Kaliningrad -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] ERROR 0.00s J2 | HdfsCollectionsAPIDistributedZkTest (suite) <<<
[junit4] > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 5 threads leaked from SUITE scope at org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest:
[junit4] > 1) Thread[id=17425, name=zkCallback-909-thread-3, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > 2) Thread[id=17424, name=zkCallback-909-thread-2, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > 3) Thread[id=16989, name=TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]-SendThread(127.0.0.1:46837), state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
[junit4] > at java.lang.Thread.sleep(Native Method)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:994)
[junit4] > 4) Thread[id=16991, name=zkCallback-909-thread-1, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > 5) Thread[id=16990, name=TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]-EventThread, state=WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
[junit4] > at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494)
[junit4] > at __randomizedtesting.SeedInfo.seed([7205036CC31451AA]:0)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
[junit4] > 1) Thread[id=17425, name=zkCallback-909-thread-3, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > 2) Thread[id=17424, name=zkCallback-909-thread-2, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > 3) Thread[id=16989, name=TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[7205036CC31451AA]-SendThread(127.0.0.1:46837), state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
[junit4] > at java.lang.Thread.sleep(Native Method)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:994)
[junit4] > 4) Thread[id=16991, name=zkCallback-909-thread-1, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > at __randomizedtesting.SeedInfo.seed([7205036CC31451AA]:0)
[junit4] Completed [239/555] on J2 in 86.36s, 1 test, 3 errors <<< FAILURES!
[...truncated 977 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987: There were test failures: 555 suites (8 ignored), 2185 tests, 2 suite-level errors, 1 error, 967 ignored (16 assumptions) [seed: 7205036CC31451AA]
Total time: 177 minutes 46 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 843 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/843/
1 tests failed.
FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test
Error Message:
Error from server at http://127.0.0.1:37527: Could not load collection from ZK:awholynewstresscollection_collection0_1
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:37527: Could not load collection from ZK:awholynewstresscollection_collection0_1
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.makeRequest(CollectionsAPIDistributedZkTest.java:302)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.deletePartiallyCreatedCollection(CollectionsAPIDistributedZkTest.java:224)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test(CollectionsAPIDistributedZkTest.java:171)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1660)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:866)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:902)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:916)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:963)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:938)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:875)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:777)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:811)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:822)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 10981 lines...]
[junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_1BF2BDFCDF031AD4-001/init-core-data-001
[junit4] 2> 1930033 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[1BF2BDFCDF031AD4]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
[junit4] 2> 1930033 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[1BF2BDFCDF031AD4]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
[junit4] 2> 1930036 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1930036 INFO (Thread-72068) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1930036 INFO (Thread-72068) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1930136 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.ZkTestServer start zk server on port:38955
[junit4] 2> 1930136 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1930138 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1930140 INFO (zkCallback-1163-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6f601586 name:ZooKeeperConnection Watcher:127.0.0.1:38955 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1930141 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1930141 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1930141 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 1930145 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1930145 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1930147 INFO (zkCallback-1164-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@eaecdaf name:ZooKeeperConnection Watcher:127.0.0.1:38955/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1930147 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1930147 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1930147 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
[junit4] 2> 1930150 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
[junit4] 2> 1930152 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
[junit4] 2> 1930154 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
[junit4] 2> 1930156 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 1930156 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 1930159 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 1930160 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
[junit4] 2> 1930162 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1930163 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1930165 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 1930165 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
[junit4] 2> 1930167 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 1930167 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
[junit4] 2> 1930171 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 1930172 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
[junit4] 2> 1930174 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 1930174 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 1930176 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1930177 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 1930179 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1930179 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1930181 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 1930182 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 1930184 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 1930184 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
[junit4] 2> 1930187 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1930187 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1930189 INFO (zkCallback-1165-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3cd01eb7 name:ZooKeeperConnection Watcher:127.0.0.1:38955 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1930189 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1930189 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1930189 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 1930191 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1930192 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1930193 INFO (zkCallback-1166-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3986c57c name:ZooKeeperConnection Watcher:127.0.0.1:38955/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1930193 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1930193 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1930194 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf2/solrconfig.xml
[junit4] 2> 1930194 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/solrconfig.xml
[junit4] 2> 1930197 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf2/schema.xml
[junit4] 2> 1930197 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/schema.xml
[junit4] 2> 1930204 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf2/enumsConfig.xml
[junit4] 2> 1930204 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/enumsConfig.xml
[junit4] 2> 1930206 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf2/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1930206 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1930208 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf2/stopwords.txt
[junit4] 2> 1930208 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/stopwords.txt
[junit4] 2> 1930210 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf2/protwords.txt
[junit4] 2> 1930210 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/protwords.txt
[junit4] 2> 1930213 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf2/currency.xml
[junit4] 2> 1930213 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/currency.xml
[junit4] 2> 1930215 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf2/open-exchange-rates.json
[junit4] 2> 1930215 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/open-exchange-rates.json
[junit4] 2> 1930217 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf2/mapping-ISOLatin1Accent.txt
[junit4] 2> 1930217 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/mapping-ISOLatin1Accent.txt
[junit4] 2> 1930219 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf2/old_synonyms.txt
[junit4] 2> 1930219 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/old_synonyms.txt
[junit4] 2> 1930222 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf2/synonyms.txt
[junit4] 2> 1930222 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/synonyms.txt
[junit4] 2> 1930224 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/elevate.xml to /configs/conf2/elevate.xml
[junit4] 2> 1930225 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/elevate.xml
[junit4] 2> 1930587 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_1BF2BDFCDF031AD4-001/control-001/cores/collection1
[junit4] 2> 1930588 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.e.j.s.Server jetty-9.2.13.v20150730
[junit4] 2> 1930590 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@73ea4128{/,null,AVAILABLE}
[junit4] 2> 1930591 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.e.j.s.ServerConnector Started ServerConnector@29249fbf{HTTP/1.1}{127.0.0.1:35673}
[junit4] 2> 1930591 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.e.j.s.Server Started @1933620ms
[junit4] 2> 1930591 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_1BF2BDFCDF031AD4-001/tempDir-001/control/data, hostContext=/, hostPort=35673, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_1BF2BDFCDF031AD4-001/control-001/cores}
[junit4] 2> 1930591 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 1930591 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_1BF2BDFCDF031AD4-001/control-001/'
[junit4] 2> 1930591 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1930591 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 1930608 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1930608 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1930609 INFO (zkCallback-1167-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@289dc7ca name:ZooKeeperConnection Watcher:127.0.0.1:38955/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1930610 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1930610 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1930611 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1930611 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_1BF2BDFCDF031AD4-001/control-001/solr.xml
[junit4] 2> 1930616 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_1BF2BDFCDF031AD4-001/control-001/cores
[junit4] 2> 1930616 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.CoreContainer New CoreContainer 349906879
[junit4] 2> 1930616 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_1BF2BDFCDF031AD4-001/control-001/]
[junit4] 2> 1930616 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_1BF2BDFCDF031AD4-001/control-001/lib
[junit4] 2> 1930616 WARN (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_1BF2BDFCDF031AD4-001/control-001/lib).
[junit4] 2> 1930624 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 1930625 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1930626 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1930626 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1930626 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38955/solr
[junit4] 2> 1930626 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 1930626 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1930626 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1930627 INFO (zkCallback-1169-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@8160adb name:ZooKeeperConnection Watcher:127.0.0.1:38955 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1930628 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1930629 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1930630 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [n:127.0.0.1:35673_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1930631 INFO (zkCallback-1170-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3ed1f192 name:ZooKeeperConnection Watcher:127.0.0.1:38955/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1930631 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [n:127.0.0.1:35673_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1930632 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [n:127.0.0.1:35673_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
[junit4] 2> 1930634 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [n:127.0.0.1:35673_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 1930637 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [n:127.0.0.1:35673_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 1930639 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [n:127.0.0.1:35673_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 1930641 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [n:127.0.0.1:35673_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 1930643 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [n:127.0.0.1:35673_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 1930644 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [n:127.0.0.1:35673_ ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 1930645 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [n:127.0.0.1:35673_ ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 1930646 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [n:127.0.0.1:35673_ ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 1930647 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [n:127.0.0.1:35673_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35673_
[junit4] 2> 1930648 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [n:127.0.0.1:35673_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:35673_
[junit4] 2> 1930649 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [n:127.0.0.1:35673_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 1930650 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [n:127.0.0.1:35673_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 1930651 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [n:127.0.0.1:35673_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1930652 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [n:127.0.0.1:35673_ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94812943434252294-127.0.0.1:35673_-n_0000000000
[junit4] 2> 1930652 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [n:127.0.0.1:35673_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:35673_
[junit4] 2> 1930652 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [n:127.0.0.1:35673_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
[junit4] 2> 1930653 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [n:127.0.0.1:35673_ ] o.a.s.c.Overseer Overseer (id=94812943434252294-127.0.0.1:35673_-n_0000000000) starting
[junit4] 2> 1930655 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [n:127.0.0.1:35673_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
[junit4] 2> 1930660 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [n:127.0.0.1:35673_ ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 1930661 INFO (OverseerCollectionConfigSetProcessor-94812943434252294-127.0.0.1:35673_-n_0000000000) [n:127.0.0.1:35673_ ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
[junit4] 2> 1930661 INFO (OverseerStateUpdate-94812943434252294-127.0.0.1:35673_-n_0000000000) [n:127.0.0.1:35673_ ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 1930661 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [n:127.0.0.1:35673_ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 1930678 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [n:127.0.0.1:35673_ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 1930678 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [n:127.0.0.1:35673_ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 1930679 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [n:127.0.0.1:35673_ ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_1BF2BDFCDF031AD4-001/control-001/cores
[junit4] 2> 1930679 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [n:127.0.0.1:35673_ ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_1BF2BDFCDF031AD4-001/control-001/cores/collection1, collection=control_collection, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_1BF2BDFCDF031AD4-001/control-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 1930679 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [n:127.0.0.1:35673_ ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_1BF2BDFCDF031AD4-001/control-001/cores/collection1/
[junit4] 2> 1930680 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [n:127.0.0.1:35673_ ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 1930681 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [n:127.0.0.1:35673_ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2
[junit4] 2> 1930681 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [n:127.0.0.1:35673_ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 1930681 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 1930681 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 1930683 INFO (OverseerStateUpdate-94812943434252294-127.0.0.1:35673_-n_0000000000) [n:127.0.0.1:35673_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:35673",
[junit4] 2> "node_name":"127.0.0.1:35673_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 1930683 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 1930683 INFO (OverseerStateUpdate-94812943434252294-127.0.0.1:35673_-n_0000000000) [n:127.0.0.1:35673_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:35673",
[junit4] 2> "node_name":"127.0.0.1:35673_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 1930683 INFO (OverseerStateUpdate-94812943434252294-127.0.0.1:35673_-n_0000000000) [n:127.0.0.1:35673_ ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
[junit4] 2> 1930684 INFO (OverseerStateUpdate-94812943434252294-127.0.0.1:35673_-n_0000000000) [n:127.0.0.1:35673_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 1930685 INFO (zkCallback-1170-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1931683 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 1931683 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
[junit4] 2> 1931685 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 1931685 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 1931686 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1931686 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_1BF2BDFCDF031AD4-001/control-001/cores/collection1/'
[junit4] 2> 1931686 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1931686 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 1931702 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 1931707 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 1931711 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 1931720 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1931736 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 1931742 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 1931834 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 1931841 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 1931842 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 1931854 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 1931856 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 1931858 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1931859 WARN (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 1931859 WARN (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 1931859 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1931860 WARN (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 1931860 WARN (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 1931861 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2
[junit4] 2> 1931861 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 1931861 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1931861 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_1BF2BDFCDF031AD4-001/control-001/cores/collection1/], dataDir=[null]
[junit4] 2> 1931861 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7384cbcf
[junit4] 2> 1931862 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_1BF2BDFCDF031AD4-001/control-001/cores/collection1/data
[junit4] 2> 1931862 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_1BF2BDFCDF031AD4-001/control-001/cores/collection1/data/index/
[junit4] 2> 1931862 WARN (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_1BF2BDFCDF031AD4-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1931862 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_1BF2BDFCDF031AD4-001/control-001/cores/collection1/data/index
[junit4] 2> 1931862 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@4ad5e086
[junit4] 2> 1931863 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(NRTCachingDirectory(RAMDirectory@7e83448 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1358f903; maxCacheMB=0.4296875 maxMergeSizeMB=0.9970703125)),segFN=segments_1,generation=1}
[junit4] 2> 1931863 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 1931872 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_1BF2BDFCDF031AD4-001/control-001/cores/collection1/data/
[junit4] 2> 1931873 WARN (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_1BF2BDFCDF031AD4-001/control-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
[junit4] 2> 1931876 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1931877 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1931877 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1931877 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1931877 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1931877 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1931877 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1931877 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1931877 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1931878 WARN (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,args = {defaults={a=A,b=B}}}
[junit4] 2> 1931879 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1931880 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1931881 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1931882 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1931885 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/dump,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 1931886 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 1931886 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1931886 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1931887 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
[junit4] 2> 1931887 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
[junit4] 2> 1931887 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=44, maxMergeAtOnceExplicit=33, maxMergedSegmentMB=46.5, floorSegmentMB=0.4453125, forceMergeDeletesPctAllowed=20.74294267231492, segmentsPerTier=32.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 1931888 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(NRTCachingDirectory(RAMDirectory@7e83448 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1358f903; maxCacheMB=0.4296875 maxMergeSizeMB=0.9970703125)),segFN=segments_1,generation=1}
[junit4] 2> 1931888 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 1931888 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@6bb182f9[collection1] main
[junit4] 2> 1931888 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 1931889 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1931889 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 1931890 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1931890 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
[junit4] 2> 1931890 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1931890 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 1931890 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1931890 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 1931890 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 1931891 INFO (searcherExecutor-4181-thread-1-processing-n:127.0.0.1:35673_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@6bb182f9[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1931891 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
[junit4] 2> 1931891 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
[junit4] 2> 1931891 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
[junit4] 2> 1931891 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1517007096892096512
[junit4] 2> 1931894 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 2.0ms to seed version buckets with highest version 1517007096892096512
[junit4] 2> 1931894 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
[junit4] 2> 1931894 INFO (coreLoadExecutor-4180-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 1931895 INFO (coreZkRegister-4174-thread-1-processing-n:127.0.0.1:35673_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:35673 collection:control_collection shard:shard1
[junit4] 2> 1931896 INFO (coreZkRegister-4174-thread-1-processing-n:127.0.0.1:35673_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 1931900 INFO (coreZkRegister-4174-thread-1-processing-n:127.0.0.1:35673_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/94812943434252294-core_node1-n_0000000000
[junit4] 2> 1931900 INFO (coreZkRegister-4174-thread-1-processing-n:127.0.0.1:35673_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1
[junit4] 2> 1931902 INFO (coreZkRegister-4174-thread-1-processing-n:127.0.0.1:35673_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1931902 INFO (coreZkRegister-4174-thread-1-processing-n:127.0.0.1:35673_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1931902 INFO (coreZkRegister-4174-thread-1-processing-n:127.0.0.1:35673_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:35673/collection1/
[junit4] 2> 1931902 INFO (coreZkRegister-4174-thread-1-processing-n:127.0.0.1:35673_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1931902 INFO (coreZkRegister-4174-thread-1-processing-n:127.0.0.1:35673_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:35673/collection1/ has no replicas
[junit4] 2> 1931902 INFO (OverseerStateUpdate-94812943434252294-127.0.0.1:35673_-n_0000000000) [n:127.0.0.1:35673_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection"} current state version: 1
[junit4] 2> 1931902 INFO (coreZkRegister-4174-thread-1-processing-n:127.0.0.1:35673_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:35673/collection1/ shard1
[junit4] 2> 1931903 INFO (coreZkRegister-4174-thread-1-processing-n:127.0.0.1:35673_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 1931905 INFO (coreZkRegister-4174-thread-1-processing-n:127.0.0.1:35673_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
[junit4] 2> 1931908 INFO (OverseerStateUpdate-94812943434252294-127.0.0.1:35673_-n_0000000000) [n:127.0.0.1:35673_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:35673",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 1
[junit4] 2> 1932011 INFO (zkCallback-1170-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1932059 INFO (coreZkRegister-4174-thread-1-processing-n:127.0.0.1:35673_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:35673/collection1/ and leader is http://127.0.0.1:35673/collection1/
[junit4] 2> 1932059 INFO (coreZkRegister-4174-thread-1-processing-n:127.0.0.1:35673_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:35673
[junit4] 2> 1932059 INFO (coreZkRegister-4174-thread-1-processing-n:127.0.0.1:35673_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1932059 INFO (coreZkRegister-4174-thread-1-processing-n:127.0.0.1:35673_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
[junit4] 2> 1932059 INFO (coreZkRegister-4174-thread-1-processing-n:127.0.0.1:35673_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35673_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 1932062 INFO (OverseerStateUpdate-94812943434252294-127.0.0.1:35673_-n_0000000000) [n:127.0.0.1:35673_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:35673",
[junit4] 2> "node_name":"127.0.0.1:35673_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 2
[junit4] 2> 1932063 INFO (OverseerStateUpdate-94812943434252294-127.0.0.1:35673_-n_0000000000) [n:127.0.0.1:35673_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:35673",
[junit4] 2> "node_name":"127.0.0.1:35673_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 1932166 INFO (zkCallback-1170-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1932183 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1932184 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1932185 INFO (zkCallback-1172-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6cd528d4 name:ZooKeeperConnection Watcher:127.0.0.1:38955/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1932185 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1932186 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1932186 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 1932188 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 1932189 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with stateFormat=2
[junit4] 2> 1932189 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1932189 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1932190 INFO (zkCallback-1173-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@788b0c1c name:ZooKeeperConnection Watcher:127.0.0.1:38955/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1932190 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1932191 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1932196 INFO (OverseerStateUpdate-94812943434252294-127.0.0.1:35673_-n_0000000000) [n:127.0.0.1:35673_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"create",
[junit4] 2> "name":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "stateFormat":"2"} current state version: 3
[junit4] 2> 1932196 INFO (OverseerStateUpdate-94812943434252294-127.0.0.1:35673_-n_0000000000) [n:127.0.0.1:35673_ ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
[junit4] 2> 1932299 INFO (OverseerStateUpdate-94812943434252294-127.0.0.1:35673_-n_0000000000) [n:127.0.0.1:35673_ ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/collection1/state.json
[junit4] 2> 1932549 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_1BF2BDFCDF031AD4-001/shard-1-001/cores/collection1
[junit4] 2> 1932550 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_1BF2BDFCDF031AD4-001/shard-1-001
[junit4] 2> 1932551 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.e.j.s.Server jetty-9.2.13.v20150730
[junit4] 2> 1932553 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4fab8f14{/,null,AVAILABLE}
[junit4] 2> 1932553 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.e.j.s.ServerConnector Started ServerConnector@4c18ff0{HTTP/1.1}{127.0.0.1:37527}
[junit4] 2> 1932553 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.e.j.s.Server Started @1935582ms
[junit4] 2> 1932553 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_1BF2BDFCDF031AD4-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/, hostPort=37527, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_1BF2BDFCDF031AD4-001/shard-1-001/cores}
[junit4] 2> 1932554 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 1932554 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_1BF2BDFCDF031AD4-001/shard-1-001/'
[junit4] 2> 1932554 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1932554 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 1932571 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1932571 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1932573 INFO (zkCallback-1174-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1f333eba name:ZooKeeperConnection Watcher:127.0.0.1:38955/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1932573 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1932573 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1932574 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1932574 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_1BF2BDFCDF031AD4-001/shard-1-001/solr.xml
[junit4] 2> 1932579 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_1BF2BDFCDF031AD4-001/shard-1-001/cores
[junit4] 2> 1932579 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.CoreContainer New CoreContainer 1802325905
[junit4] 2> 1932579 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_1BF2BDFCDF031AD4-001/shard-1-001/]
[junit4] 2> 1932580 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_1BF2BDFCDF031AD4-001/shard-1-001/lib
[junit4] 2> 1932580 WARN (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_1BF2BDFCDF031AD4-001/shard-1-001/lib).
[junit4] 2> 1932587 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 1932588 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1932589 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1932589 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1932589 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38955/solr
[junit4] 2> 1932589 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 1932589 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1932590 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1932591 INFO (zkCallback-1176-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6ed2fe40 name:ZooKeeperConnection Watcher:127.0.0.1:38955 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1932592 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1932592 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1932594 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [n:127.0.0.1:37527_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1932595 INFO (zkCallback-1177-thread-1-processing-n:127.0.0.1:37527_) [n:127.0.0.1:37527_ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1829b721 name:ZooKeeperConnection Watcher:127.0.0.1:38955/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1932595 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [n:127.0.0.1:37527_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1932601 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [n:127.0.0.1:37527_ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 1933609 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [n:127.0.0.1:37527_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37527_
[junit4] 2> 1933609 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [n:127.0.0.1:37527_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:37527_
[junit4] 2> 1933610 INFO (zkCallback-1177-thread-1-processing-n:127.0.0.1:37527_) [n:127.0.0.1:37527_ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1933610 INFO (zkCallback-1172-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1933610 INFO (zkCallback-1170-thread-1-processing-n:127.0.0.1:35673_) [n:127.0.0.1:35673_ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1933612 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [n:127.0.0.1:37527_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1933612 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [n:127.0.0.1:37527_ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94812943434252299-127.0.0.1:37527_-n_0000000001
[junit4] 2> 1933613 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [n:127.0.0.1:37527_ ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/94812943434252294-127.0.0.1:35673_-n_0000000000 to know if I could be the leader
[junit4] 2> 1933629 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [n:127.0.0.1:37527_ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 1933629 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [n:127.0.0.1:37527_ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 1933630 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [n:127.0.0.1:37527_ ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_1BF2BDFCDF031AD4-001/shard-1-001/cores
[junit4] 2> 1933631 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [n:127.0.0.1:37527_ ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_1BF2BDFCDF031AD4-001/shard-1-001/cores/collection1, collection=collection1, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_1BF2BDFCDF031AD4-001/shard-1-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 1933631 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [n:127.0.0.1:37527_ ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_1BF2BDFCDF031AD4-001/shard-1-001/cores/collection1/
[junit4] 2> 1933631 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [n:127.0.0.1:37527_ ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 1933632 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [n:127.0.0.1:37527_ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2
[junit4] 2> 1933632 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[1BF2BDFCDF031AD4]) [n:127.0.0.1:37527_ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 1933633 INFO (coreLoadExecutor-4191-thread-1-processing-n:127.0.0.1:37527_) [n:127.0.0.1:37527_ c:collection1 x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 1933633 INFO (coreLoadExecutor-4191-thread-1-processing-n:127.0.0.1:37527_) [n:127.0.0.1:37527_ c:collection1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 1933634 INFO (coreLoadExecutor-4191-thread-1-processing-n:127.0.0.1:37527_) [n:127.0.0.1:37527_ c:collection1 x:collection1] o.a.s.c.ZkController Registering watch for collection collection1
[j
[...truncated too long message...]
rotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=78971, name=collection4, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:35673: collection already exists: awholynewstresscollection_collection4_1
[junit4] > at __randomizedtesting.SeedInfo.seed([1BF2BDFCDF031AD4]:0)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
[junit4] > at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1574)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1595)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:888)Throwable #7: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=78967, name=collection0, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > Caused by: java.lang.RuntimeException: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:45949, http://127.0.0.1:35673, http://127.0.0.1:37527, http://127.0.0.1:50542, http://127.0.0.1:59656]
[junit4] > at __randomizedtesting.SeedInfo.seed([1BF2BDFCDF031AD4]:0)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:898)
[junit4] > Caused by: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:45949, http://127.0.0.1:35673, http://127.0.0.1:37527, http://127.0.0.1:50542, http://127.0.0.1:59656]
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:352)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
[junit4] > at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1574)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1595)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:888)
[junit4] > Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:50542: KeeperErrorCode = Session expired for /overseer/collection-queue-work/qnr-
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
[junit4] > ... 7 more
[junit4] 2> 3031618 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[1BF2BDFCDF031AD4]-worker) [n:127.0.0.1:45949_ c:awholynewstresscollection_collection5_1 s:shard4 r:core_node12 x:awholynewstresscollection_collection5_1_shard4_replica2] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_1BF2BDFCDF031AD4-001
[junit4] 2> Nov 05, 2015 1:56:45 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene60): {other_tl1=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), range_facet_l_dv=PostingsFormat(name=LuceneFixedGap), _version_=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), multiDefault=FSTOrd50, a_t=FSTOrd50, intDefault=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), a_i1=FSTOrd50, id=PostingsFormat(name=LuceneFixedGap), range_facet_i_dv=FSTOrd50, text=Lucene50(blocksize=128), range_facet_l=FSTOrd50, timestamp=FSTOrd50}, docValues:{range_facet_l_dv=DocValuesFormat(name=Memory), range_facet_i_dv=DocValuesFormat(name=Direct), timestamp=DocValuesFormat(name=Direct)}, sim=ClassicSimilarity, locale=fr, timezone=Canada/Mountain
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_45 (64-bit)/cpus=4,threads=1,free=189080824,total=501219328
[junit4] 2> NOTE: All tests run in this JVM: [SolrTestCaseJ4Test, StatsComponentTest, TestBulkSchemaConcurrent, OverseerTest, PluginInfoTest, BlockCacheTest, TestStressRecovery, DeleteLastCustomShardedReplicaTest, DeleteShardTest, TestReRankQParserPlugin, HdfsDirectoryTest, TestJmxIntegration, TestManagedStopFilterFactory, RegexBoostProcessorTest, TestStressReorder, TestPerFieldSimilarity, SimpleFacetsTest, TestFieldSortValues, AnalyticsMergeStrategyTest, DebugComponentTest, BaseCdcrDistributedZkTest, TestDynamicFieldCollectionResource, TestElisionMultitermQuery, HdfsNNFailoverTest, TestPostingsSolrHighlighter, DocValuesMultiTest, OverriddenZkACLAndCredentialsProvidersTest, TestSolrCLIRunExample, TestEmbeddedSolrServerConstructors, TestOrdValues, NoCacheHeaderTest, TestWriterPerf, AddBlockUpdateTest, TestReversedWildcardFilterFactory, TriLevelCompositeIdRoutingTest, TestExactSharedStatsCache, TestSolrDeletionPolicy1, DistributedFacetPivotSmallAdvancedTest, DirectUpdateHandlerOptimizeTest, CloudExitableDirectoryReaderTest, CursorMarkTest, TestSha256AuthenticationProvider, TestFuzzyAnalyzedSuggestions, FieldMutatingUpdateProcessorTest, JavabinLoaderTest, TestRecovery, CoreAdminHandlerTest, TestIndexingPerformance, TestSystemIdResolver, TestHashQParserPlugin, TestCustomSort, TestReplicationHandlerBackup, DeleteReplicaTest, StressHdfsTest, MultiThreadedOCPTest, BinaryUpdateRequestHandlerTest, TestMinMaxOnMultiValuedField, TestRandomRequestDistribution, DistributedQueryComponentCustomSortTest, AsyncCallRequestStatusResponseTest, SolrCoreCheckLockOnStartupTest, AddSchemaFieldsUpdateProcessorFactoryTest, TestFastLRUCache, TestSmileRequest, TestShardHandlerFactory, RAMDirectoryFactoryTest, HdfsBasicDistributedZkTest, PrimitiveFieldTypeTest, TestManagedResource, CleanupOldIndexTest, TestSearcherReuse, TestSortingResponseWriter, ShowFileRequestHandlerTest, TestScoreJoinQPScore, SuggesterWFSTTest, TestReload, ZkStateReaderTest, SimpleMLTQParserTest, FullSolrCloudDistribCmdsTest, TestFastWriter, TestRawTransformer, TestUniqueKeyFieldResource, TestFieldTypeResource, TestTrieFacet, TestJsonFacets, TestCursorMarkWithoutUniqueKey, ScriptEngineTest, TestReqParamsAPI, SpatialHeatmapFacetsTest, ClusterStateTest, ChaosMonkeySafeLeaderTest, BasicDistributedZk2Test, UnloadDistributedZkTest, CollectionsAPIDistributedZkTest]
[junit4] Completed [362/554] on J2 in 1101.88s, 1 test, 1 error <<< FAILURES!
[...truncated 610 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987: There were test failures: 554 suites (8 ignored), 2182 tests, 1 error, 31 ignored (18 assumptions) [seed: 1BF2BDFCDF031AD4]
Total time: 218 minutes 23 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 842 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/842/
1 tests failed.
FAILED: org.apache.solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR
Error Message:
Captured an uncaught exception in thread: Thread[id=37419, name=coreZkRegister-7261-thread-2, state=RUNNABLE, group=TGRP-LeaderInitiatedRecoveryOnShardRestartTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=37419, name=coreZkRegister-7261-thread-2, state=RUNNABLE, group=TGRP-LeaderInitiatedRecoveryOnShardRestartTest]
Caused by: java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([28EDAB8B0A266015]:0)
at org.apache.solr.cloud.ZkController.updateLeaderInitiatedRecoveryState(ZkController.java:2126)
at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:433)
at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:197)
at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:157)
at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:346)
at org.apache.solr.cloud.ZkController.joinElection(ZkController.java:1113)
at org.apache.solr.cloud.ZkController.register(ZkController.java:926)
at org.apache.solr.cloud.ZkController.register(ZkController.java:881)
at org.apache.solr.core.ZkContainer$2.run(ZkContainer.java:183)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:231)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 11042 lines...]
[junit4] Suite: org.apache.solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_28EDAB8B0A266015-001/init-core-data-001
[junit4] 2> 2638758 INFO (SUITE-LeaderInitiatedRecoveryOnShardRestartTest-seed#[28EDAB8B0A266015]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
[junit4] 2> 2638760 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 2638761 INFO (Thread-27187) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 2638761 INFO (Thread-27187) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 2638861 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.ZkTestServer start zk server on port:46279
[junit4] 2> 2638861 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 2638862 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2638865 INFO (zkCallback-2032-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1ed99d8a name:ZooKeeperConnection Watcher:127.0.0.1:46279 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2638865 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2638866 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 2638866 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 2638868 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 2638869 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2638869 INFO (zkCallback-2033-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6cbb5154 name:ZooKeeperConnection Watcher:127.0.0.1:46279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2638869 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2638869 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 2638869 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
[junit4] 2> 2638871 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
[junit4] 2> 2638872 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
[junit4] 2> 2638873 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
[junit4] 2> 2638874 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 2638874 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 2638876 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 2638876 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
[junit4] 2> 2638878 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 2638878 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 2638879 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 2638879 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
[junit4] 2> 2638880 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 2638880 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
[junit4] 2> 2638882 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 2638882 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
[junit4] 2> 2638883 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 2638883 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 2638884 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 2638885 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 2638886 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 2638886 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 2638887 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 2638887 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 2638888 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 2638889 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
[junit4] 2> 2639226 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_28EDAB8B0A266015-001/control-001/cores/collection1
[junit4] 2> 2639227 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.e.j.s.Server jetty-9.2.13.v20150730
[junit4] 2> 2639229 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@233dba17{/,null,AVAILABLE}
[junit4] 2> 2639230 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.e.j.s.ServerConnector Started ServerConnector@cc5a419{HTTP/1.1}{127.0.0.1:48688}
[junit4] 2> 2639230 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.e.j.s.Server Started @2642378ms
[junit4] 2> 2639230 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_28EDAB8B0A266015-001/tempDir-001/control/data, hostContext=/, hostPort=48688, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_28EDAB8B0A266015-001/control-001/cores}
[junit4] 2> 2639230 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 2639230 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_28EDAB8B0A266015-001/control-001/'
[junit4] 2> 2639231 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2639231 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 2639246 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 2639247 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2639248 INFO (zkCallback-2034-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@61fbe622 name:ZooKeeperConnection Watcher:127.0.0.1:46279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2639248 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2639249 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 2639249 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 2639249 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_28EDAB8B0A266015-001/control-001/solr.xml
[junit4] 2> 2639254 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_28EDAB8B0A266015-001/control-001/cores
[junit4] 2> 2639254 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.CoreContainer New CoreContainer 601359846
[junit4] 2> 2639254 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_28EDAB8B0A266015-001/control-001/]
[junit4] 2> 2639255 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_28EDAB8B0A266015-001/control-001/lib
[junit4] 2> 2639255 WARN (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_28EDAB8B0A266015-001/control-001/lib).
[junit4] 2> 2639262 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 2639263 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 2639264 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2639264 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2639264 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46279/solr
[junit4] 2> 2639264 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 2639264 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 2639264 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2639265 INFO (zkCallback-2036-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1831b96b name:ZooKeeperConnection Watcher:127.0.0.1:46279 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2639265 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2639266 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 2639267 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [n:127.0.0.1:48688_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2639267 INFO (zkCallback-2037-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1cf94f83 name:ZooKeeperConnection Watcher:127.0.0.1:46279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2639267 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [n:127.0.0.1:48688_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2639268 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [n:127.0.0.1:48688_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
[junit4] 2> 2639270 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [n:127.0.0.1:48688_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 2639272 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [n:127.0.0.1:48688_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 2639273 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [n:127.0.0.1:48688_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 2639275 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [n:127.0.0.1:48688_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 2639277 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [n:127.0.0.1:48688_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 2639278 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [n:127.0.0.1:48688_ ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 2639279 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [n:127.0.0.1:48688_ ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 2639280 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [n:127.0.0.1:48688_ ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 2639280 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [n:127.0.0.1:48688_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48688_
[junit4] 2> 2639281 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [n:127.0.0.1:48688_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:48688_
[junit4] 2> 2639285 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [n:127.0.0.1:48688_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 2639287 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [n:127.0.0.1:48688_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 2639288 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [n:127.0.0.1:48688_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2639288 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [n:127.0.0.1:48688_ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94806770325520388-127.0.0.1:48688_-n_0000000000
[junit4] 2> 2639288 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [n:127.0.0.1:48688_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:48688_
[junit4] 2> 2639289 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [n:127.0.0.1:48688_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
[junit4] 2> 2639290 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [n:127.0.0.1:48688_ ] o.a.s.c.Overseer Overseer (id=94806770325520388-127.0.0.1:48688_-n_0000000000) starting
[junit4] 2> 2639291 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [n:127.0.0.1:48688_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
[junit4] 2> 2639295 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [n:127.0.0.1:48688_ ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 2639296 INFO (OverseerCollectionConfigSetProcessor-94806770325520388-127.0.0.1:48688_-n_0000000000) [n:127.0.0.1:48688_ ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
[junit4] 2> 2639296 INFO (OverseerStateUpdate-94806770325520388-127.0.0.1:48688_-n_0000000000) [n:127.0.0.1:48688_ ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 2639297 INFO (OverseerStateUpdate-94806770325520388-127.0.0.1:48688_-n_0000000000) [n:127.0.0.1:48688_ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 2639301 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [n:127.0.0.1:48688_ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 2639313 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [n:127.0.0.1:48688_ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 2639313 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [n:127.0.0.1:48688_ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 2639314 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [n:127.0.0.1:48688_ ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_28EDAB8B0A266015-001/control-001/cores
[junit4] 2> 2639314 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [n:127.0.0.1:48688_ ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_28EDAB8B0A266015-001/control-001/cores/collection1, collection=control_collection, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_28EDAB8B0A266015-001/control-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 2639314 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [n:127.0.0.1:48688_ ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_28EDAB8B0A266015-001/control-001/cores/collection1/
[junit4] 2> 2639314 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [n:127.0.0.1:48688_ ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 2639316 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [n:127.0.0.1:48688_ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2
[junit4] 2> 2639316 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [n:127.0.0.1:48688_ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 2639316 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 2639316 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 2639318 INFO (OverseerStateUpdate-94806770325520388-127.0.0.1:48688_-n_0000000000) [n:127.0.0.1:48688_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:48688",
[junit4] 2> "node_name":"127.0.0.1:48688_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 2639318 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 2639318 INFO (OverseerStateUpdate-94806770325520388-127.0.0.1:48688_-n_0000000000) [n:127.0.0.1:48688_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:48688",
[junit4] 2> "node_name":"127.0.0.1:48688_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 2639318 INFO (OverseerStateUpdate-94806770325520388-127.0.0.1:48688_-n_0000000000) [n:127.0.0.1:48688_ ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
[junit4] 2> 2639319 INFO (OverseerStateUpdate-94806770325520388-127.0.0.1:48688_-n_0000000000) [n:127.0.0.1:48688_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 2639320 INFO (zkCallback-2037-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2639320 INFO (zkCallback-2037-thread-2-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2640318 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 2640318 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
[junit4] 2> 2640319 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 2640319 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 2640320 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2640320 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_28EDAB8B0A266015-001/control-001/cores/collection1/'
[junit4] 2> 2640320 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2640320 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 2640332 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 2640337 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 2640340 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 2640357 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2640358 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 2640363 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 2640453 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 2640458 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 2640459 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 2640468 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 2640470 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 2640471 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2640472 WARN (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 2640472 WARN (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 2640472 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2640473 WARN (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 2640473 WARN (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 2640474 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2
[junit4] 2> 2640474 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 2640474 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 2640475 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_28EDAB8B0A266015-001/control-001/cores/collection1/], dataDir=[null]
[junit4] 2> 2640475 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1ba862f0
[junit4] 2> 2640475 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_28EDAB8B0A266015-001/control-001/cores/collection1/data
[junit4] 2> 2640475 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_28EDAB8B0A266015-001/control-001/cores/collection1/data/index/
[junit4] 2> 2640475 WARN (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_28EDAB8B0A266015-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 2640476 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_28EDAB8B0A266015-001/control-001/cores/collection1/data/index
[junit4] 2> 2640476 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=17, maxMergeAtOnceExplicit=35, maxMergedSegmentMB=81.392578125, floorSegmentMB=2.0615234375, forceMergeDeletesPctAllowed=29.2956960078632, segmentsPerTier=36.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.13545458923845866
[junit4] 2> 2640476 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1591bda2 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2f2b28aa),segFN=segments_1,generation=1}
[junit4] 2> 2640476 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 2640477 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_28EDAB8B0A266015-001/control-001/cores/collection1/data/
[junit4] 2> 2640477 WARN (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_28EDAB8B0A266015-001/control-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
[junit4] 2> 2640479 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 2640479 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
[junit4] 2> 2640480 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2640480 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 2640480 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2640480 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 2640480 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2640480 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2640480 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 2640480 WARN (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,args = {defaults={a=A,b=B}}}
[junit4] 2> 2640482 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 2640483 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 2640484 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 2640485 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 2640487 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/dump,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 2640487 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 2640488 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 2640488 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 2640489 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
[junit4] 2> 2640489 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
[junit4] 2> 2640489 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=25, maxMergeAtOnceExplicit=28, maxMergedSegmentMB=25.2373046875, floorSegmentMB=0.9736328125, forceMergeDeletesPctAllowed=18.96166296556762, segmentsPerTier=43.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 2640489 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1591bda2 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2f2b28aa),segFN=segments_1,generation=1}
[junit4] 2> 2640490 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 2640490 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@4e110cbd[collection1] main
[junit4] 2> 2640490 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 2640491 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2640491 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 2640491 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 2640491 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
[junit4] 2> 2640491 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2640492 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 2640492 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2640492 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 2640492 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 2640492 INFO (searcherExecutor-7224-thread-1-processing-n:127.0.0.1:48688_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@4e110cbd[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2640493 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
[junit4] 2> 2640493 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
[junit4] 2> 2640493 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
[junit4] 2> 2640493 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1516908327023411200
[junit4] 2> 2640495 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 2.0ms to seed version buckets with highest version 1516908327023411200
[junit4] 2> 2640495 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
[junit4] 2> 2640495 INFO (coreLoadExecutor-7223-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 2640496 INFO (coreZkRegister-7217-thread-1-processing-n:127.0.0.1:48688_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:48688 collection:control_collection shard:shard1
[junit4] 2> 2640497 INFO (coreZkRegister-7217-thread-1-processing-n:127.0.0.1:48688_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 2640502 INFO (coreZkRegister-7217-thread-1-processing-n:127.0.0.1:48688_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/94806770325520388-core_node1-n_0000000000
[junit4] 2> 2640502 INFO (coreZkRegister-7217-thread-1-processing-n:127.0.0.1:48688_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1
[junit4] 2> 2640504 INFO (OverseerStateUpdate-94806770325520388-127.0.0.1:48688_-n_0000000000) [n:127.0.0.1:48688_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection"} current state version: 1
[junit4] 2> 2640505 INFO (coreZkRegister-7217-thread-1-processing-n:127.0.0.1:48688_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 2640505 INFO (coreZkRegister-7217-thread-1-processing-n:127.0.0.1:48688_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 2640505 INFO (coreZkRegister-7217-thread-1-processing-n:127.0.0.1:48688_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:48688/collection1/
[junit4] 2> 2640505 INFO (coreZkRegister-7217-thread-1-processing-n:127.0.0.1:48688_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 2640505 INFO (coreZkRegister-7217-thread-1-processing-n:127.0.0.1:48688_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:48688/collection1/ has no replicas
[junit4] 2> 2640505 INFO (coreZkRegister-7217-thread-1-processing-n:127.0.0.1:48688_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:48688/collection1/ shard1
[junit4] 2> 2640506 INFO (coreZkRegister-7217-thread-1-processing-n:127.0.0.1:48688_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 2640508 INFO (coreZkRegister-7217-thread-1-processing-n:127.0.0.1:48688_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
[junit4] 2> 2640511 INFO (OverseerStateUpdate-94806770325520388-127.0.0.1:48688_-n_0000000000) [n:127.0.0.1:48688_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:48688",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 1
[junit4] 2> 2640613 INFO (zkCallback-2037-thread-2-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2640613 INFO (zkCallback-2037-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2640662 INFO (coreZkRegister-7217-thread-1-processing-n:127.0.0.1:48688_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:48688/collection1/ and leader is http://127.0.0.1:48688/collection1/
[junit4] 2> 2640662 INFO (coreZkRegister-7217-thread-1-processing-n:127.0.0.1:48688_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:48688
[junit4] 2> 2640662 INFO (coreZkRegister-7217-thread-1-processing-n:127.0.0.1:48688_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 2640663 INFO (coreZkRegister-7217-thread-1-processing-n:127.0.0.1:48688_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
[junit4] 2> 2640663 INFO (coreZkRegister-7217-thread-1-processing-n:127.0.0.1:48688_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48688_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 2640669 INFO (OverseerStateUpdate-94806770325520388-127.0.0.1:48688_-n_0000000000) [n:127.0.0.1:48688_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:48688",
[junit4] 2> "node_name":"127.0.0.1:48688_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 2
[junit4] 2> 2640670 INFO (OverseerStateUpdate-94806770325520388-127.0.0.1:48688_-n_0000000000) [n:127.0.0.1:48688_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:48688",
[junit4] 2> "node_name":"127.0.0.1:48688_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 2640772 INFO (zkCallback-2037-thread-2-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2640772 INFO (zkCallback-2037-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2640817 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 2640818 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2640819 INFO (zkCallback-2039-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7d90c15b name:ZooKeeperConnection Watcher:127.0.0.1:46279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2640819 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2640819 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 2640819 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 2640821 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 2640821 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with stateFormat=2
[junit4] 2> 2640821 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 2640822 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2640823 INFO (zkCallback-2040-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@204c2203 name:ZooKeeperConnection Watcher:127.0.0.1:46279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2640823 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2640823 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 2640825 INFO (OverseerStateUpdate-94806770325520388-127.0.0.1:48688_-n_0000000000) [n:127.0.0.1:48688_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"create",
[junit4] 2> "name":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "stateFormat":"2"} current state version: 3
[junit4] 2> 2640825 INFO (OverseerStateUpdate-94806770325520388-127.0.0.1:48688_-n_0000000000) [n:127.0.0.1:48688_ ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
[junit4] 2> 2640930 INFO (OverseerStateUpdate-94806770325520388-127.0.0.1:48688_-n_0000000000) [n:127.0.0.1:48688_ ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/collection1/state.json
[junit4] 2> 2641147 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_28EDAB8B0A266015-001/shard-1-001/cores/collection1
[junit4] 2> 2641148 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_28EDAB8B0A266015-001/shard-1-001
[junit4] 2> 2641149 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.e.j.s.Server jetty-9.2.13.v20150730
[junit4] 2> 2641151 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@65089103{/,null,AVAILABLE}
[junit4] 2> 2641151 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.e.j.s.ServerConnector Started ServerConnector@342effb3{HTTP/1.1}{127.0.0.1:42846}
[junit4] 2> 2641151 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.e.j.s.Server Started @2644299ms
[junit4] 2> 2641151 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_28EDAB8B0A266015-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/, hostPort=42846, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_28EDAB8B0A266015-001/shard-1-001/cores}
[junit4] 2> 2641152 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 2641152 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_28EDAB8B0A266015-001/shard-1-001/'
[junit4] 2> 2641152 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2641152 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 2641165 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 2641165 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2641166 INFO (zkCallback-2041-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4e4c250e name:ZooKeeperConnection Watcher:127.0.0.1:46279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2641167 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2641167 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 2641168 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 2641168 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_28EDAB8B0A266015-001/shard-1-001/solr.xml
[junit4] 2> 2641172 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_28EDAB8B0A266015-001/shard-1-001/cores
[junit4] 2> 2641173 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.CoreContainer New CoreContainer 480186408
[junit4] 2> 2641173 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_28EDAB8B0A266015-001/shard-1-001/]
[junit4] 2> 2641173 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_28EDAB8B0A266015-001/shard-1-001/lib
[junit4] 2> 2641173 WARN (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_28EDAB8B0A266015-001/shard-1-001/lib).
[junit4] 2> 2641180 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 2641181 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 2641181 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2641181 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2641182 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46279/solr
[junit4] 2> 2641182 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 2641182 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 2641182 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2641183 INFO (zkCallback-2043-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@27e5d14f name:ZooKeeperConnection Watcher:127.0.0.1:46279 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2641183 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2641184 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 2641185 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [n:127.0.0.1:42846_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2641186 INFO (zkCallback-2044-thread-1-processing-n:127.0.0.1:42846_) [n:127.0.0.1:42846_ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@741158e4 name:ZooKeeperConnection Watcher:127.0.0.1:46279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2641186 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [n:127.0.0.1:42846_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2641190 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [n:127.0.0.1:42846_ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 2642197 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [n:127.0.0.1:42846_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42846_
[junit4] 2> 2642197 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [n:127.0.0.1:42846_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:42846_
[junit4] 2> 2642198 INFO (zkCallback-2039-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2642198 INFO (zkCallback-2037-thread-1-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2642198 INFO (zkCallback-2037-thread-2-processing-n:127.0.0.1:48688_) [n:127.0.0.1:48688_ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2642199 INFO (zkCallback-2044-thread-1-processing-n:127.0.0.1:42846_) [n:127.0.0.1:42846_ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2642199 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [n:127.0.0.1:42846_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2642200 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [n:127.0.0.1:42846_ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94806770325520393-127.0.0.1:42846_-n_0000000001
[junit4] 2> 2642201 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [n:127.0.0.1:42846_ ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/94806770325520388-127.0.0.1:48688_-n_0000000000 to know if I could be the leader
[junit4] 2> 2642208 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [n:127.0.0.1:42846_ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 2642208 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [n:127.0.0.1:42846_ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 2642209 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [n:127.0.0.1:42846_ ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_28EDAB8B0A266015-001/shard-1-001/cores
[junit4] 2> 2642210 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [n:127.0.0.1:42846_ ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_28EDAB8B0A266015-001/shard-1-001/cores/collection1, collection=collection1, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_28EDAB8B0A266015-001/shard-1-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 2642210 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [n:127.0.0.1:42846_ ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_28EDAB8B0A266015-001/shard-1-001/cores/collection1/
[junit4] 2> 2642210 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [n:127.0.0.1:42846_ ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 2642211 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [n:127.0.0.1:42846_ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2
[junit4] 2> 2642211 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[28EDAB8B0A266015]) [n:127.0.0.1:42846_ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 2642211 INFO (coreLoadExecutor-7234-thread-1-processing-n:127.0.0.1:42846_) [n:127.0.0.1:42846_ c:collection1 x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 2642211 INFO (coreLoadExecutor-7234-thread-1-processing-n:127.0.0.1:42846_) [n:127.0.0.1:42846_ c:collection1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 2642213 INFO (coreLoadExecutor-7234-thread-1-processing-n:127.0.0.1:42846_) [n:127.0.0.1:42846_ c:collection1 x:collection1] o.a.s.c.ZkController Registering watch for collection collection1
[junit4] 2> 2642213 INFO (coreLoadExecutor-7234-thread-1-processing-n:127.0.0.1:42846_) [n:127.0.0.1:42846_ c:collection1 x:collection1] o.a.s.c.c.ZkStateReader addZkWatch collection1
[junit4] 2> 2642213 INFO (OverseerStateUpdate-94806770325520388-127.0.0.1:48688_-n_0000000000) [n:127.0.0.1:48688_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:42846",
[junit4] 2> "node_name":"127.0.0.1:42846_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"} current state version: 3
[junit4] 2> 2642213 INFO (coreLoadExecutor-7234-thread-1-processing-n:127.0.0.1:42846_) [n:127.0.0.1:42846_ c:collection1 x:collection1] o.a.s.c.c.ZkStateReader Add data for collection1 ver 0
[junit4] 2> 2642213 INFO (coreLoadExecutor-7234-thread-1-processing-n:127.0.0.1:42846_) [n:127.0.0.1:42846_ c:collection1 x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 2642213 INFO (OverseerStateUpdate-94806770325520388-127.0.0.1:48688_-n_0000000000) [n:127.0.0.1:48688_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:42846",
[junit4] 2> "node_name":"127.0.0.1:42846_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"}
[junit4] 2> 2642214 INFO (OverseerStateUpdate-94806770325520388-127.0.0.1:48688_-n_0000000000) [n:127.0.0.1:48688_ ] o.a.s.c.o.ReplicaMutator Collection already exists with numShards=1
[junit4] 2> 2642214 INFO (OverseerStateUpdate-94806770325520388-127.0.0.1:48688_-n_0000000000) [n:127.0.0.1:48688_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 2642316 INFO (OverseerStateUpdate-94806770325520388-127.0.0.1:48688_-n_0000000000) [n:127.0.0.1:48688_ ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/collection1/state.json version: 0
[junit4] 2> 2642316 INFO (zkCallback-2044-thread-1-processing-n:127.0.0.1:42846_) [n:127.0.0.1:42846_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json for collection collection1 has occurred - updating... (live nodes size: 2)
[junit4] 2> 2642317 INFO (zkCallback-2044-thread-1-processing-n:127.0.0.1:42846_) [n:127.0.0.1:42846_ ] o.a.s.c.c.ZkStateReader Updating data for collection1 from 0 to 1
[junit4] 2> 2643213 INFO (coreLoadExecutor-7234-thread-1-processing-n:127.0.0.1:42846_) [n:127.0.0.1:42846_ c:collection1 x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 2643213 INFO (coreLoadExecutor-7234-thread-1-processing-n:127.0.0.1:42846_) [n:127.0.0.1:42846_ c:collection1 x:collection1] o.a.s.c.ZkController Check for collection zkNode:collection1
[junit4] 2> 2643214 INFO (coreLoadExecutor-7234-thread-1-processing-n:127.0.0.1:42846_) [n:127.0.0.1:42846_ c:collection1 x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 2643214 INFO (coreLoadExecutor-7234-thread-1-processing-n:127.0.0.1:42846_) [n:127.0.0.1:42846_ c:collection1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/collection1
[junit4] 2> 2643214 INFO (coreLoadExecutor-7234-thread-1-processing-n:127.0.0.1:42846_) [n:127.0.0.1:42846_ c:collection1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2643215 INFO (coreLoadExecutor-7234-thread-1-processing-n:127.0.0.1:42846_) [n:127.0.0.1:42846_ c:collection1 x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_28EDAB8B0A266015-001/shard-1-001/cores/collection1/'
[junit4] 2> 2643215 INFO (coreLoadExecutor-7234-thread-1-processing-n:127.0.0.1:42846_) [n:127.0.0.1:42846_ c:collection1 x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2643215 INFO (coreLoadExecutor-7234-thread-1-processing-n:127.0.0.1:42846_) [n:127.0.0.1:42846_ c:collection1 x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 2643234 INFO (coreLoadExecutor-7234-thread-1-processing-n:127.0.0.1:42846_) [n:127.0.0.1:42846_ c:collection1 x:collect
[...truncated too long message...]
tRestartWithAllInLIR <<<
[junit4] > Throwable #1: java.lang.AssertionError: There are still nodes recoverying - waited for 330 seconds
[junit4] > at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:172)
[junit4] > at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:133)
[junit4] > at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:128)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:830)
[junit4] > at org.apache.solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR(LeaderInitiatedRecoveryOnShardRestartTest.java:81)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:963)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:938)
[junit4] > at java.lang.Thread.run(Thread.java:745)Throwable #2: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=37419, name=coreZkRegister-7261-thread-2, state=RUNNABLE, group=TGRP-LeaderInitiatedRecoveryOnShardRestartTest]
[junit4] > Caused by: java.lang.AssertionError
[junit4] > at __randomizedtesting.SeedInfo.seed([28EDAB8B0A266015]:0)
[junit4] > at org.apache.solr.cloud.ZkController.updateLeaderInitiatedRecoveryState(ZkController.java:2126)
[junit4] > at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:433)
[junit4] > at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:197)
[junit4] > at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:157)
[junit4] > at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:346)
[junit4] > at org.apache.solr.cloud.ZkController.joinElection(ZkController.java:1113)
[junit4] > at org.apache.solr.cloud.ZkController.register(ZkController.java:926)
[junit4] > at org.apache.solr.cloud.ZkController.register(ZkController.java:881)
[junit4] > at org.apache.solr.core.ZkContainer$2.run(ZkContainer.java:183)
[junit4] > at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:231)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 3009479 INFO (SUITE-LeaderInitiatedRecoveryOnShardRestartTest-seed#[28EDAB8B0A266015]-worker) [n:127.0.0.1:60985_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_28EDAB8B0A266015-001
[junit4] 2> Nov 04, 2015 11:34:40 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=DummyCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=DUMMY, chunkSize=32730, maxDocsPerChunk=1, blockSize=5), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=DUMMY, chunkSize=32730, blockSize=5)), sim=ClassicSimilarity, locale=en_MT, timezone=America/Indiana/Vevay
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_45 (64-bit)/cpus=4,threads=1,free=276098240,total=507510784
[junit4] 2> NOTE: All tests run in this JVM: [CurrencyFieldXmlFileTest, TestSolrCLIRunExample, HighlighterConfigTest, TestRawTransformer, DistributedDebugComponentTest, BasicDistributedZk2Test, TestShortCircuitedRequests, FieldAnalysisRequestHandlerTest, AddSchemaFieldsUpdateProcessorFactoryTest, HLLSerializationTest, TestJsonFacets, TestCustomSort, ZkStateReaderTest, TestOverriddenPrefixQueryForCustomFieldType, DeleteLastCustomShardedReplicaTest, TestCursorMarkWithoutUniqueKey, CleanupOldIndexTest, DistributedQueryComponentCustomSortTest, TestCSVResponseWriter, SampleTest, OverriddenZkACLAndCredentialsProvidersTest, TestFieldTypeCollectionResource, TestSearchPerf, BJQParserTest, SecurityConfHandlerTest, ResponseHeaderTest, DeleteShardTest, DebugComponentTest, TestScoreJoinQPNoScore, TestLeaderInitiatedRecoveryThread, TestPostingsSolrHighlighter, ClusterStateTest, JavabinLoaderTest, FullHLLTest, RegexBoostProcessorTest, TestOrdValues, FullSolrCloudDistribCmdsTest, TestFastLRUCache, DistributedFacetPivotSmallAdvancedTest, TestCollationField, NoCacheHeaderTest, TestPerFieldSimilarity, TestStressReorder, LukeRequestHandlerTest, TestCharFilters, TestXIncludeConfig, SystemInfoHandlerTest, TestJmxIntegration, ZkNodePropsTest, TestReqParamsAPI, CdcrUpdateLogTest, OverseerCollectionConfigSetProcessorTest, AutoCommitTest, ConcurrentDeleteAndCreateCollectionTest, TestAuthenticationFramework, PluginInfoTest, TestManagedResource, TestFieldTypeResource, TriLevelCompositeIdRoutingTest, QueryResultKeyTest, TestElisionMultitermQuery, BadIndexSchemaTest, AnalyticsQueryTest, TestManagedStopFilterFactory, SolrCoreCheckLockOnStartupTest, ShowFileRequestHandlerTest, CoreAdminHandlerTest, DistributedFacetPivotSmallTest, HdfsDirectoryTest, TestSearcherReuse, HardAutoCommitTest, TestSort, CloudExitableDirectoryReaderTest, TestLRUCache, StressHdfsTest, RecoveryZkTest, TestIndexingPerformance, TestFieldSortValues, BinaryUpdateRequestHandlerTest, DirectUpdateHandlerTest, TestMiniSolrCloudClusterBase, UnloadDistributedZkTest, TestReversedWildcardFilterFactory, BasicAuthIntegrationTest, SuggesterTest, AsyncCallRequestStatusResponseTest, TestIndexSearcher, TestRecovery, TestTrieFacet, ChaosMonkeySafeLeaderTest, OverseerTest, LeaderElectionIntegrationTest, BasicZkTest, LeaderElectionTest, TestZkChroot, TestRandomDVFaceting, ZkCLITest, ShardRoutingCustomTest, TestFaceting, TestHashPartitioner, TermVectorComponentDistributedTest, ZkControllerTest, TestRealTimeGet, TestReload, TestStressVersions, TestRangeQuery, TestCoreContainer, SimpleFacetsTest, TestSolr4Spatial, SolrCoreTest, StatsComponentTest, SpellCheckComponentTest, TestGroupingSearch, QueryElevationComponentTest, TestLazyCores, SoftAutoCommitTest, CurrencyFieldOpenExchangeTest, SolrIndexSplitterTest, SimplePostToolTest, TestCoreDiscovery, SignatureUpdateProcessorFactoryTest, TestExtendedDismaxParser, SpellCheckCollatorTest, SuggesterFSTTest, SolrRequestParserTest, TestFoldingMultitermQuery, DocValuesTest, SuggesterTSTTest, SuggesterWFSTTest, TestCSVLoader, SchemaVersionSpecificBehaviorTest, FieldMutatingUpdateProcessorTest, TestAtomicUpdateErrorCases, TestWordDelimiterFilterFactory, DirectUpdateHandlerOptimizeTest, StatelessScriptUpdateProcessorFactoryTest, DocValuesMultiTest, DistanceFunctionTest, TestSolrDeletionPolicy1, SolrInfoMBeanTest, XsltUpdateRequestHandlerTest, CacheHeaderTest, IndexBasedSpellCheckerTest, TestSurroundQueryParser, DisMaxRequestHandlerTest, TestWriterPerf, TestQueryTypes, PrimitiveFieldTypeTest, TestOmitPositions, XmlUpdateRequestHandlerTest, RequestHandlersTest, DocumentBuilderTest, TestValueSourceCache, PathHierarchyTokenizerFactoryTest, MoreLikeThisHandlerTest, TestSolrQueryParser, TestArbitraryIndexDir, IndexSchemaRuntimeFieldTest, LoggingHandlerTest, SolrPluginUtilsTest, ReturnFieldsTest, UpdateRequestProcessorFactoryTest, JSONWriterTest, QueryParsingTest, TestAnalyzedSuggestions, JsonLoaderTest, TestPHPSerializedResponseWriter, CSVRequestHandlerTest, SearchHandlerTest, TestLFUCache, TestQuerySenderListener, UpdateParamsTest, AlternateDirectoryTest, TestSolrIndexConfig, TestQuerySenderNoQuery, CopyFieldTest, SolrIndexConfigTest, BadComponentTest, TestStressRecovery, SolrTestCaseJ4Test, TestCrossCoreJoin, TestDistributedMissingSort, TestEmbeddedSolrServerConstructors, AliasIntegrationTest, AsyncMigrateRouteKeyTest, CdcrVersionReplicationTest, CollectionsAPIAsyncDistributedZkTest, CustomCollectionTest, DistribCursorPagingTest, LeaderInitiatedRecoveryOnCommitTest, LeaderInitiatedRecoveryOnShardRestartTest]
[junit4] Completed [412/554] on J2 in 370.99s, 1 test, 1 error <<< FAILURES!
[...truncated 476 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987: There were test failures: 554 suites (8 ignored), 2182 tests, 1 error, 31 ignored (18 assumptions) [seed: 28EDAB8B0A266015]
Total time: 190 minutes 44 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 841 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/841/
1 tests failed.
FAILED: org.apache.solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR
Error Message:
Captured an uncaught exception in thread: Thread[id=63513, name=coreZkRegister-4791-thread-1, state=RUNNABLE, group=TGRP-LeaderInitiatedRecoveryOnShardRestartTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=63513, name=coreZkRegister-4791-thread-1, state=RUNNABLE, group=TGRP-LeaderInitiatedRecoveryOnShardRestartTest]
Caused by: java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([EAFA91E638D68228]:0)
at org.apache.solr.cloud.ZkController.updateLeaderInitiatedRecoveryState(ZkController.java:2126)
at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:433)
at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:197)
at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:157)
at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:346)
at org.apache.solr.cloud.ZkController.joinElection(ZkController.java:1113)
at org.apache.solr.cloud.ZkController.register(ZkController.java:926)
at org.apache.solr.cloud.ZkController.register(ZkController.java:881)
at org.apache.solr.core.ZkContainer$2.run(ZkContainer.java:183)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:231)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 11075 lines...]
[junit4] Suite: org.apache.solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_EAFA91E638D68228-001/init-core-data-001
[junit4] 2> 2564342 INFO (SUITE-LeaderInitiatedRecoveryOnShardRestartTest-seed#[EAFA91E638D68228]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /m_ovg/ey
[junit4] 2> 2564344 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 2564344 INFO (Thread-54620) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 2564344 INFO (Thread-54620) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 2564444 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.ZkTestServer start zk server on port:58570
[junit4] 2> 2564444 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 2564445 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2564447 INFO (zkCallback-2554-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3b1539b4 name:ZooKeeperConnection Watcher:127.0.0.1:58570 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2564447 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2564447 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 2564447 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 2564450 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 2564450 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2564451 INFO (zkCallback-2555-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2d4756df name:ZooKeeperConnection Watcher:127.0.0.1:58570/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2564451 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2564451 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 2564451 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
[junit4] 2> 2564453 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
[junit4] 2> 2564454 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
[junit4] 2> 2564455 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
[junit4] 2> 2564456 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 2564456 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 2564458 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 2564458 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
[junit4] 2> 2564460 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 2564460 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 2564462 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 2564462 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
[junit4] 2> 2564463 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 2564463 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
[junit4] 2> 2564464 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 2564465 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
[junit4] 2> 2564466 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 2564466 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 2564467 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 2564468 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 2564469 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 2564469 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 2564470 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 2564471 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 2564472 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 2564473 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
[junit4] 2> 2564780 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_EAFA91E638D68228-001/control-001/cores/collection1
[junit4] 2> 2564781 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.e.j.s.Server jetty-9.2.13.v20150730
[junit4] 2> 2564783 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@66e4c6c3{/m_ovg/ey,null,AVAILABLE}
[junit4] 2> 2564785 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.e.j.s.ServerConnector Started ServerConnector@3219d2e3{HTTP/1.1}{127.0.0.1:51724}
[junit4] 2> 2564785 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.e.j.s.Server Started @2567525ms
[junit4] 2> 2564785 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_EAFA91E638D68228-001/tempDir-001/control/data, hostContext=/m_ovg/ey, hostPort=51724, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_EAFA91E638D68228-001/control-001/cores}
[junit4] 2> 2564785 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 2564785 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_EAFA91E638D68228-001/control-001/'
[junit4] 2> 2564786 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2564786 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 2564801 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 2564801 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2564802 INFO (zkCallback-2556-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@fa646db name:ZooKeeperConnection Watcher:127.0.0.1:58570/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2564803 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2564803 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 2564804 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 2564804 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_EAFA91E638D68228-001/control-001/solr.xml
[junit4] 2> 2564808 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_EAFA91E638D68228-001/control-001/cores
[junit4] 2> 2564808 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.CoreContainer New CoreContainer 1048032233
[junit4] 2> 2564808 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_EAFA91E638D68228-001/control-001/]
[junit4] 2> 2564809 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_EAFA91E638D68228-001/control-001/lib
[junit4] 2> 2564809 WARN (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_EAFA91E638D68228-001/control-001/lib).
[junit4] 2> 2564816 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 2564817 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 2564817 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2564817 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2564817 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:58570/solr
[junit4] 2> 2564817 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 2564817 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 2564818 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2564819 INFO (zkCallback-2558-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6cbddf53 name:ZooKeeperConnection Watcher:127.0.0.1:58570 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2564819 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2564819 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 2564821 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [n:127.0.0.1:51724_m_ovg%2Fey ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2564821 INFO (zkCallback-2559-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@57814907 name:ZooKeeperConnection Watcher:127.0.0.1:58570/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2564821 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [n:127.0.0.1:51724_m_ovg%2Fey ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2564822 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [n:127.0.0.1:51724_m_ovg%2Fey ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
[junit4] 2> 2564824 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [n:127.0.0.1:51724_m_ovg%2Fey ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 2564826 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [n:127.0.0.1:51724_m_ovg%2Fey ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 2564828 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [n:127.0.0.1:51724_m_ovg%2Fey ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 2564829 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [n:127.0.0.1:51724_m_ovg%2Fey ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 2564831 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [n:127.0.0.1:51724_m_ovg%2Fey ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 2564832 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [n:127.0.0.1:51724_m_ovg%2Fey ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 2564833 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [n:127.0.0.1:51724_m_ovg%2Fey ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 2564834 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [n:127.0.0.1:51724_m_ovg%2Fey ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 2564835 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [n:127.0.0.1:51724_m_ovg%2Fey ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51724_m_ovg%2Fey
[junit4] 2> 2564835 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [n:127.0.0.1:51724_m_ovg%2Fey ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:51724_m_ovg%2Fey
[junit4] 2> 2564837 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [n:127.0.0.1:51724_m_ovg%2Fey ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 2564838 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [n:127.0.0.1:51724_m_ovg%2Fey ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 2564839 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [n:127.0.0.1:51724_m_ovg%2Fey ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2564839 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [n:127.0.0.1:51724_m_ovg%2Fey ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94801665086521348-127.0.0.1:51724_m_ovg%2Fey-n_0000000000
[junit4] 2> 2564839 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [n:127.0.0.1:51724_m_ovg%2Fey ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:51724_m_ovg%2Fey
[junit4] 2> 2564839 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [n:127.0.0.1:51724_m_ovg%2Fey ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
[junit4] 2> 2564840 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [n:127.0.0.1:51724_m_ovg%2Fey ] o.a.s.c.Overseer Overseer (id=94801665086521348-127.0.0.1:51724_m_ovg%2Fey-n_0000000000) starting
[junit4] 2> 2564842 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [n:127.0.0.1:51724_m_ovg%2Fey ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
[junit4] 2> 2564846 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [n:127.0.0.1:51724_m_ovg%2Fey ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 2564847 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [n:127.0.0.1:51724_m_ovg%2Fey ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 2564847 INFO (OverseerStateUpdate-94801665086521348-127.0.0.1:51724_m_ovg%2Fey-n_0000000000) [n:127.0.0.1:51724_m_ovg%2Fey ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 2564847 INFO (OverseerCollectionConfigSetProcessor-94801665086521348-127.0.0.1:51724_m_ovg%2Fey-n_0000000000) [n:127.0.0.1:51724_m_ovg%2Fey ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
[junit4] 2> 2564859 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [n:127.0.0.1:51724_m_ovg%2Fey ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 2564859 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [n:127.0.0.1:51724_m_ovg%2Fey ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 2564860 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [n:127.0.0.1:51724_m_ovg%2Fey ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_EAFA91E638D68228-001/control-001/cores
[junit4] 2> 2564861 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [n:127.0.0.1:51724_m_ovg%2Fey ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_EAFA91E638D68228-001/control-001/cores/collection1, collection=control_collection, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_EAFA91E638D68228-001/control-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 2564861 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [n:127.0.0.1:51724_m_ovg%2Fey ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_EAFA91E638D68228-001/control-001/cores/collection1/
[junit4] 2> 2564861 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [n:127.0.0.1:51724_m_ovg%2Fey ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 2564862 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [n:127.0.0.1:51724_m_ovg%2Fey ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4] 2> 2564862 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [n:127.0.0.1:51724_m_ovg%2Fey ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 2564862 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 2564862 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 2564863 INFO (OverseerStateUpdate-94801665086521348-127.0.0.1:51724_m_ovg%2Fey-n_0000000000) [n:127.0.0.1:51724_m_ovg%2Fey ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:51724/m_ovg/ey",
[junit4] 2> "node_name":"127.0.0.1:51724_m_ovg%2Fey",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 2564864 INFO (OverseerStateUpdate-94801665086521348-127.0.0.1:51724_m_ovg%2Fey-n_0000000000) [n:127.0.0.1:51724_m_ovg%2Fey ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:51724/m_ovg/ey",
[junit4] 2> "node_name":"127.0.0.1:51724_m_ovg%2Fey",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 2564864 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 2564864 INFO (OverseerStateUpdate-94801665086521348-127.0.0.1:51724_m_ovg%2Fey-n_0000000000) [n:127.0.0.1:51724_m_ovg%2Fey ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
[junit4] 2> 2564865 INFO (OverseerStateUpdate-94801665086521348-127.0.0.1:51724_m_ovg%2Fey-n_0000000000) [n:127.0.0.1:51724_m_ovg%2Fey ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 2564866 INFO (zkCallback-2559-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2565864 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 2565864 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
[junit4] 2> 2565865 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 2565865 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 2565866 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2565866 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_EAFA91E638D68228-001/control-001/cores/collection1/'
[junit4] 2> 2565866 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2565866 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 2565882 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 2565886 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 2565891 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 2565908 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2565910 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 2565914 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 2566008 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 2566015 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 2566016 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 2566024 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 2566027 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 2566029 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2566029 WARN (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 2566030 WARN (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 2566030 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2566030 WARN (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 2566030 WARN (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 2566031 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4] 2> 2566031 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 2566032 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 2566032 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_EAFA91E638D68228-001/control-001/cores/collection1/], dataDir=[null]
[junit4] 2> 2566032 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2fbf099b
[junit4] 2> 2566033 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_EAFA91E638D68228-001/control-001/cores/collection1/data
[junit4] 2> 2566033 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_EAFA91E638D68228-001/control-001/cores/collection1/data/index/
[junit4] 2> 2566033 WARN (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_EAFA91E638D68228-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 2566033 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_EAFA91E638D68228-001/control-001/cores/collection1/data/index
[junit4] 2> 2566033 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=43, maxMergeAtOnceExplicit=23, maxMergedSegmentMB=94.7294921875, floorSegmentMB=1.4091796875, forceMergeDeletesPctAllowed=29.161398557175048, segmentsPerTier=39.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.17260107164071414
[junit4] 2> 2566034 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(NRTCachingDirectory(RAMDirectory@54704b07 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4ae46c8e; maxCacheMB=0.3974609375 maxMergeSizeMB=0.712890625)),segFN=segments_1,generation=1}
[junit4] 2> 2566034 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 2566035 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_EAFA91E638D68228-001/control-001/cores/collection1/data/
[junit4] 2> 2566035 WARN (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_EAFA91E638D68228-001/control-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
[junit4] 2> 2566038 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 2566039 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
[junit4] 2> 2566039 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2566039 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 2566039 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2566039 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 2566039 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2566039 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2566040 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 2566040 WARN (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,args = {defaults={a=A,b=B}}}
[junit4] 2> 2566042 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 2566043 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 2566044 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 2566045 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 2566048 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/dump,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 2566048 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 2566049 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 2566049 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 2566050 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
[junit4] 2> 2566050 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
[junit4] 2> 2566050 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=34, maxMergeAtOnceExplicit=21, maxMergedSegmentMB=11.947265625, floorSegmentMB=0.427734375, forceMergeDeletesPctAllowed=10.790841346503457, segmentsPerTier=40.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 2566051 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(NRTCachingDirectory(RAMDirectory@54704b07 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4ae46c8e; maxCacheMB=0.3974609375 maxMergeSizeMB=0.712890625)),segFN=segments_1,generation=1}
[junit4] 2> 2566051 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 2566051 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@2a5a77cb[collection1] main
[junit4] 2> 2566051 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 2566052 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2566052 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 2566052 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 2566052 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
[junit4] 2> 2566052 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2566053 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 2566053 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2566053 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 2566053 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 2566054 INFO (searcherExecutor-4754-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@2a5a77cb[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2566054 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
[junit4] 2> 2566054 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
[junit4] 2> 2566054 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
[junit4] 2> 2566054 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1516826643176357888
[junit4] 2> 2566056 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 2.0ms to seed version buckets with highest version 1516826643176357888
[junit4] 2> 2566056 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
[junit4] 2> 2566057 INFO (coreLoadExecutor-4753-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 2566057 INFO (coreZkRegister-4747-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:51724/m_ovg/ey collection:control_collection shard:shard1
[junit4] 2> 2566058 INFO (coreZkRegister-4747-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 2566061 INFO (coreZkRegister-4747-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/94801665086521348-core_node1-n_0000000000
[junit4] 2> 2566062 INFO (coreZkRegister-4747-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1
[junit4] 2> 2566063 INFO (coreZkRegister-4747-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 2566063 INFO (coreZkRegister-4747-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 2566063 INFO (coreZkRegister-4747-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:51724/m_ovg/ey/collection1/
[junit4] 2> 2566063 INFO (coreZkRegister-4747-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 2566063 INFO (OverseerStateUpdate-94801665086521348-127.0.0.1:51724_m_ovg%2Fey-n_0000000000) [n:127.0.0.1:51724_m_ovg%2Fey ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection"} current state version: 1
[junit4] 2> 2566063 INFO (coreZkRegister-4747-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:51724/m_ovg/ey/collection1/ has no replicas
[junit4] 2> 2566064 INFO (coreZkRegister-4747-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:51724/m_ovg/ey/collection1/ shard1
[junit4] 2> 2566064 INFO (coreZkRegister-4747-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 2566066 INFO (coreZkRegister-4747-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
[junit4] 2> 2566069 INFO (OverseerStateUpdate-94801665086521348-127.0.0.1:51724_m_ovg%2Fey-n_0000000000) [n:127.0.0.1:51724_m_ovg%2Fey ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:51724/m_ovg/ey",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 1
[junit4] 2> 2566172 INFO (zkCallback-2559-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2566220 INFO (coreZkRegister-4747-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:51724/m_ovg/ey/collection1/ and leader is http://127.0.0.1:51724/m_ovg/ey/collection1/
[junit4] 2> 2566220 INFO (coreZkRegister-4747-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:51724/m_ovg/ey
[junit4] 2> 2566220 INFO (coreZkRegister-4747-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 2566220 INFO (coreZkRegister-4747-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
[junit4] 2> 2566220 INFO (coreZkRegister-4747-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51724_m_ovg%2Fey c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 2566222 INFO (OverseerStateUpdate-94801665086521348-127.0.0.1:51724_m_ovg%2Fey-n_0000000000) [n:127.0.0.1:51724_m_ovg%2Fey ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:51724/m_ovg/ey",
[junit4] 2> "node_name":"127.0.0.1:51724_m_ovg%2Fey",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 2
[junit4] 2> 2566223 INFO (OverseerStateUpdate-94801665086521348-127.0.0.1:51724_m_ovg%2Fey-n_0000000000) [n:127.0.0.1:51724_m_ovg%2Fey ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:51724/m_ovg/ey",
[junit4] 2> "node_name":"127.0.0.1:51724_m_ovg%2Fey",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 2566325 INFO (zkCallback-2559-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2566363 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 2566364 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2566365 INFO (zkCallback-2561-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7595647e name:ZooKeeperConnection Watcher:127.0.0.1:58570/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2566365 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2566366 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 2566366 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 2566368 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 2566368 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with stateFormat=2
[junit4] 2> 2566368 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 2566369 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2566369 INFO (zkCallback-2562-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5e8f4a22 name:ZooKeeperConnection Watcher:127.0.0.1:58570/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2566369 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2566370 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 2566372 INFO (OverseerStateUpdate-94801665086521348-127.0.0.1:51724_m_ovg%2Fey-n_0000000000) [n:127.0.0.1:51724_m_ovg%2Fey ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"create",
[junit4] 2> "name":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "stateFormat":"2"} current state version: 3
[junit4] 2> 2566372 INFO (OverseerStateUpdate-94801665086521348-127.0.0.1:51724_m_ovg%2Fey-n_0000000000) [n:127.0.0.1:51724_m_ovg%2Fey ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
[junit4] 2> 2566475 INFO (OverseerStateUpdate-94801665086521348-127.0.0.1:51724_m_ovg%2Fey-n_0000000000) [n:127.0.0.1:51724_m_ovg%2Fey ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/collection1/state.json
[junit4] 2> 2566735 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_EAFA91E638D68228-001/shard-1-001/cores/collection1
[junit4] 2> 2566736 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_EAFA91E638D68228-001/shard-1-001
[junit4] 2> 2566737 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.e.j.s.Server jetty-9.2.13.v20150730
[junit4] 2> 2566739 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3217a7ce{/m_ovg/ey,null,AVAILABLE}
[junit4] 2> 2566739 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.e.j.s.ServerConnector Started ServerConnector@2d7b005c{HTTP/1.1}{127.0.0.1:34427}
[junit4] 2> 2566739 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.e.j.s.Server Started @2569480ms
[junit4] 2> 2566739 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_EAFA91E638D68228-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/m_ovg/ey, hostPort=34427, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_EAFA91E638D68228-001/shard-1-001/cores}
[junit4] 2> 2566740 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 2566740 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_EAFA91E638D68228-001/shard-1-001/'
[junit4] 2> 2566740 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2566740 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 2566758 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 2566759 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2566760 INFO (zkCallback-2563-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3799738f name:ZooKeeperConnection Watcher:127.0.0.1:58570/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2566760 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2566760 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 2566761 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 2566761 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_EAFA91E638D68228-001/shard-1-001/solr.xml
[junit4] 2> 2566766 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_EAFA91E638D68228-001/shard-1-001/cores
[junit4] 2> 2566766 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.CoreContainer New CoreContainer 1457516883
[junit4] 2> 2566766 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_EAFA91E638D68228-001/shard-1-001/]
[junit4] 2> 2566766 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_EAFA91E638D68228-001/shard-1-001/lib
[junit4] 2> 2566767 WARN (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_EAFA91E638D68228-001/shard-1-001/lib).
[junit4] 2> 2566775 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 2566776 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 2566776 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2566777 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2566777 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:58570/solr
[junit4] 2> 2566777 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 2566777 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 2566777 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2566778 INFO (zkCallback-2565-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3dbfaae4 name:ZooKeeperConnection Watcher:127.0.0.1:58570 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2566779 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2566779 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 2566781 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [n:127.0.0.1:34427_m_ovg%2Fey ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2566781 INFO (zkCallback-2566-thread-1-processing-n:127.0.0.1:34427_m_ovg%2Fey) [n:127.0.0.1:34427_m_ovg%2Fey ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@778d1116 name:ZooKeeperConnection Watcher:127.0.0.1:58570/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2566781 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [n:127.0.0.1:34427_m_ovg%2Fey ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2566787 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [n:127.0.0.1:34427_m_ovg%2Fey ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 2567793 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [n:127.0.0.1:34427_m_ovg%2Fey ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34427_m_ovg%2Fey
[junit4] 2> 2567794 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [n:127.0.0.1:34427_m_ovg%2Fey ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:34427_m_ovg%2Fey
[junit4] 2> 2567796 INFO (zkCallback-2566-thread-1-processing-n:127.0.0.1:34427_m_ovg%2Fey) [n:127.0.0.1:34427_m_ovg%2Fey ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2567796 INFO (zkCallback-2559-thread-1-processing-n:127.0.0.1:51724_m_ovg%2Fey) [n:127.0.0.1:51724_m_ovg%2Fey ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2567797 INFO (zkCallback-2561-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2567799 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [n:127.0.0.1:34427_m_ovg%2Fey ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2567799 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [n:127.0.0.1:34427_m_ovg%2Fey ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94801665086521353-127.0.0.1:34427_m_ovg%2Fey-n_0000000001
[junit4] 2> 2567800 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [n:127.0.0.1:34427_m_ovg%2Fey ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/94801665086521348-127.0.0.1:51724_m_ovg%2Fey-n_0000000000 to know if I could be the leader
[junit4] 2> 2567811 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [n:127.0.0.1:34427_m_ovg%2Fey ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 2567811 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [n:127.0.0.1:34427_m_ovg%2Fey ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 2567811 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [n:127.0.0.1:34427_m_ovg%2Fey ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_EAFA91E638D68228-001/shard-1-001/cores
[junit4] 2> 2567812 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [n:127.0.0.1:34427_m_ovg%2Fey ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_EAFA91E638D68228-001/shard-1-001/cores/collection1, collection=collection1, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_EAFA91E638D68228-001/shard-1-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 2567812 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [n:127.0.0.1:34427_m_ovg%2Fey ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_EAFA91E638D68228-001/shard-1-001/cores/collection1/
[junit4] 2> 2567812 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [n:127.0.0.1:34427_m_ovg%2Fey ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 2567814 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [n:127.0.0.1:34427_m_ovg%2Fey ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4] 2> 2567814 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [n:127.0.0.1:34427_m_ovg%2Fey ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 2567814 INFO (coreLoadExecutor-4764-thread-1-processing-n:127.0.0.1:34427_m_ovg%2Fey) [n:127.0.0.1:34427_m_ovg%2Fey c:collection1 x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 2567814 INFO (coreLoadExecutor-4764-thread-1-processing-n:127.0.0.1:34427_m_ovg%2Fey) [n:127.0.0.1:34427_m_ovg%2Fey c:collection1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 2567816 INFO (coreLoadExecutor-4764-thread-1-processing-n:127.0.0.1:34427_m_ovg%2Fey) [n:127.0.0.1:34427_m_ovg%2Fey c:collection1 x:collection1] o.a.s.c.ZkController Registering watch for collection collection1
[junit4] 2> 2567816 INFO (coreLoadExecutor-4764-thread-1-processing-n:127.0.0.1:34427_m_ovg%2Fey) [n:127.0.0.1:34427_m_ovg%2Fey c:collection1 x:collection1] o.a.s.c.c.ZkStateReader addZkWatch collection1
[junit4] 2> 2567816 INFO (OverseerStateUpdate-94801665086521348-127.0.0.1:51724_m_ovg%2Fey-n_0000000000) [n:127.0.0.1:51724_m_ovg%2Fey ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:34427/m_ovg/ey",
[junit4] 2> "node_name":"127.0.0.1:34427_m_ovg%2Fey",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"} current state version: 3
[junit4] 2> 2567816 INFO (coreLoadExecutor-4764-thread-1-processing-n:127.0.0.1:34427_m_ovg%2Fey) [n:127.0.0.1:34427_m_ovg%2Fey c:collection1 x:collection1] o.a.s.c.c.ZkStateReader Add data for collection1 ver 0
[junit4] 2> 2567816 INFO (coreLoadExecutor-4764-thread-1-processing-n:127.0.0.1:34427_m_ovg%2Fey) [n:127.0.0.1:34427_m_ovg%2Fey c:collection1 x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 2567816 INFO (OverseerStateUpdate-94801665086521348-127.0.0.1:51724_m_ovg%2Fey-n_0000000000) [n:127.0.0.1:51724_m_ovg%2Fey ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:34427/m_ovg/ey",
[junit4] 2> "node_name":"127.0.0.1:34427_m_ovg%2Fey",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"}
[junit4] 2> 2567816 INFO (OverseerStateUpdate-94801665086521348-127.0.0.1:51724_m_ovg%2Fey-n_0000000000) [n:127.0.0.1:51724_m_ovg%2Fey ] o.a.s.c.o.ReplicaMutator Collection already exists with numShards=1
[junit4] 2> 2567817 INFO (OverseerStateUpdate-94801665086521348-127.0.0.1:51724_m_ovg%2Fey-n_0000000000) [n:127.0.0.1:51724_m_ovg%2Fey ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 2567919 INFO (OverseerStateUpdate-94801665086521348-127.0.0.1:51724_m_ovg%2Fey-n_0000000000) [n:127.0.0.1:51724_m_ovg%2Fey ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/collection1/state.json version: 0
[junit4] 2> 2567919 INFO (zkCallback-2566-thread-1-processing-n:127.0.0.1:34427_m_ovg%2Fey) [n:127.0.0.1:34427_m_ovg%2Fey ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json for collection collection1 has occurred - updating... (live nodes size: 2)
[junit4] 2> 2567920 INFO (zkCallback-2566-thread-1-processing-n:127.0.0.1:34427_m_ovg%2Fey) [n:127.0.0.1:34427_m_ovg%2Fey ] o.a.s.c.c.ZkStateReader Updating data for collectio
[...truncated too long message...]
nit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:388)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3$1.run(SolrZkClient.java:269)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:231)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 2927937 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.e.j.s.ServerConnector Stopped ServerConnector@149e4a9b{HTTP/1.1}{127.0.0.1:44435}
[junit4] 2> 2927937 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@571ba103{/m_ovg/ey,null,UNAVAILABLE}
[junit4] 2> 2927939 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[EAFA91E638D68228]) [n:127.0.0.1:44435_m_ovg%2Fey c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.ZkTestServer connecting to 127.0.0.1:58570 58570
[junit4] 2> 2928149 INFO (Thread-54620) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:58570 58570
[junit4] 2> 2928151 WARN (Thread-54620) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 6 /solr/aliases.json
[junit4] 2> 5 /solr/security.json
[junit4] 2> 5 /solr/configs/conf1
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 6 /solr/clusterstate.json
[junit4] 2> 4 /solr/collections/collection1/state.json
[junit4] 2> 3 /solr/overseer_elect/election/94801665086521348-127.0.0.1:51724_m_ovg%2Fey-n_0000000000
[junit4] 2> 3 /solr/collections/all_in_lir/state.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 6 /solr/collections
[junit4] 2> 4 /solr/live_nodes
[junit4] 2> 3 /solr/overseer/queue
[junit4] 2> 3 /solr/overseer/collection-queue-work
[junit4] 2>
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=LeaderInitiatedRecoveryOnShardRestartTest -Dtests.method=testRestartWithAllInLIR -Dtests.seed=EAFA91E638D68228 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=es_PE -Dtests.timezone=MIT -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[junit4] ERROR 364s J0 | LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR <<<
[junit4] > Throwable #1: java.lang.AssertionError: There are still nodes recoverying - waited for 330 seconds
[junit4] > at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:172)
[junit4] > at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:133)
[junit4] > at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:128)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:830)
[junit4] > at org.apache.solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR(LeaderInitiatedRecoveryOnShardRestartTest.java:81)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:963)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:938)
[junit4] > at java.lang.Thread.run(Thread.java:745)Throwable #2: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=63513, name=coreZkRegister-4791-thread-1, state=RUNNABLE, group=TGRP-LeaderInitiatedRecoveryOnShardRestartTest]
[junit4] > Caused by: java.lang.AssertionError
[junit4] > at __randomizedtesting.SeedInfo.seed([EAFA91E638D68228]:0)
[junit4] > at org.apache.solr.cloud.ZkController.updateLeaderInitiatedRecoveryState(ZkController.java:2126)
[junit4] > at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:433)
[junit4] > at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:197)
[junit4] > at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:157)
[junit4] > at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:346)
[junit4] > at org.apache.solr.cloud.ZkController.joinElection(ZkController.java:1113)
[junit4] > at org.apache.solr.cloud.ZkController.register(ZkController.java:926)
[junit4] > at org.apache.solr.cloud.ZkController.register(ZkController.java:881)
[junit4] > at org.apache.solr.core.ZkContainer$2.run(ZkContainer.java:183)
[junit4] > at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:231)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 2928161 INFO (SUITE-LeaderInitiatedRecoveryOnShardRestartTest-seed#[EAFA91E638D68228]-worker) [n:127.0.0.1:44435_m_ovg%2Fey c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_EAFA91E638D68228-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene60): {}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=false,coord=crazy): {}, locale=es_PE, timezone=MIT
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_45 (64-bit)/cpus=4,threads=1,free=191435672,total=529006592
[junit4] 2> NOTE: All tests run in this JVM: [TestLeaderElectionZkExpiry, FileUtilsTest, ResponseLogComponentTest, ExternalFileFieldSortTest, TestSolrJ, TestExpandComponent, TestMergePolicyConfig, TestReplicationHandler, DistributedSpellCheckComponentTest, TestDistributedSearch, BigEndianAscendingWordSerializerTest, TestJoin, DataDrivenBlockJoinTest, TestHighFrequencyDictionaryFactory, PingRequestHandlerTest, TestCSVLoader, RankQueryTest, TestSolrConfigHandler, TestDocBasedVersionConstraints, TestFunctionQuery, PeerSyncTest, HdfsChaosMonkeyNothingIsSafeTest, SyncSliceTest, CursorPagingTest, TestRangeQuery, TestSolrConfigHandlerCloud, VersionInfoTest, TestIBSimilarityFactory, OutputWriterTest, HttpPartitionTest, EnumFieldTest, OverseerStatusTest, TestPKIAuthenticationPlugin, TestSolrConfigHandlerConcurrent, DateFieldTest, TestArbitraryIndexDir, UUIDUpdateProcessorFallbackTest, HdfsThreadLeakTest, OverseerRolesTest, TestBlobHandler, ChangedSchemaMergeTest, TestSolr4Spatial2, CdcrReplicationDistributedZkTest, CachingDirectoryFactoryTest, TestInfoStreamLogging, TestAtomicUpdateErrorCases, TestRestManager, BasicZkTest, QueryElevationComponentTest, SpellingQueryConverterTest, CloneFieldUpdateProcessorFactoryTest, TestBadConfig, DistributedFacetPivotLargeTest, TestConfigSetsAPIExclusivity, DistribJoinFromCollectionTest, OpenExchangeRatesOrgProviderTest, TestValueSourceCache, TestFoldingMultitermQuery, TestConfig, TestMiniSolrCloudCluster, TestSolrXml, CurrencyFieldOpenExchangeTest, SmileWriterTest, ExitableDirectoryReaderTest, XsltUpdateRequestHandlerTest, CoreMergeIndexesAdminHandlerTest, TestAuthorizationFramework, PathHierarchyTokenizerFactoryTest, DistributedQueryElevationComponentTest, BadCopyFieldTest, LeaderInitiatedRecoveryOnShardRestartTest]
[junit4] Completed [415/554] on J0 in 363.84s, 1 test, 1 error <<< FAILURES!
[...truncated 446 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987: There were test failures: 554 suites (8 ignored), 2182 tests, 1 error, 31 ignored (18 assumptions) [seed: EAFA91E638D68228]
Total time: 195 minutes 28 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 840 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/840/
3 tests failed.
FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test
Error Message:
Captured an uncaught exception in thread: Thread[id=18519, name=collection0, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=18519, name=collection0, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:51725/se/nh: collection already exists: awholynewstresscollection_collection0_0
at __randomizedtesting.SeedInfo.seed([F7260FB173B27178]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1574)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1595)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:888)
FAILED: org.apache.solr.cloud.RollingRestartTest.test
Error Message:
Unable to restart (#6): CloudJettyRunner [url=http://127.0.0.1:49972/collection1]
Stack Trace:
java.lang.AssertionError: Unable to restart (#6): CloudJettyRunner [url=http://127.0.0.1:49972/collection1]
at __randomizedtesting.SeedInfo.seed([F7260FB173B27178:7F72306BDD4E1C80]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.cloud.RollingRestartTest.restartWithRolesTest(RollingRestartTest.java:104)
at org.apache.solr.cloud.RollingRestartTest.test(RollingRestartTest.java:53)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1660)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:866)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:902)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:916)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:963)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:938)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:875)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:777)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:811)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:822)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR
Error Message:
Captured an uncaught exception in thread: Thread[id=15832, name=coreZkRegister-5980-thread-2, state=RUNNABLE, group=TGRP-LeaderInitiatedRecoveryOnShardRestartTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=15832, name=coreZkRegister-5980-thread-2, state=RUNNABLE, group=TGRP-LeaderInitiatedRecoveryOnShardRestartTest]
Caused by: java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([F7260FB173B27178]:0)
at org.apache.solr.cloud.ZkController.updateLeaderInitiatedRecoveryState(ZkController.java:2126)
at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:433)
at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:197)
at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:157)
at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:346)
at org.apache.solr.cloud.ZkController.joinElection(ZkController.java:1113)
at org.apache.solr.cloud.ZkController.register(ZkController.java:926)
at org.apache.solr.cloud.ZkController.register(ZkController.java:881)
at org.apache.solr.core.ZkContainer$2.run(ZkContainer.java:183)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:231)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 10375 lines...]
[junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_F7260FB173B27178-001/init-core-data-001
[junit4] 2> 1324402 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[F7260FB173B27178]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true)
[junit4] 2> 1324402 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[F7260FB173B27178]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /se/nh
[junit4] 2> 1324406 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1324406 INFO (Thread-12325) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1324406 INFO (Thread-12325) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1324506 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.ZkTestServer start zk server on port:59505
[junit4] 2> 1324506 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1324507 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1324509 INFO (zkCallback-1264-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6abf9406 name:ZooKeeperConnection Watcher:127.0.0.1:59505 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1324510 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1324510 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1324510 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 1324513 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1324513 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1324514 INFO (zkCallback-1265-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4653b39d name:ZooKeeperConnection Watcher:127.0.0.1:59505/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1324514 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1324515 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1324515 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
[junit4] 2> 1324517 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
[junit4] 2> 1324518 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
[junit4] 2> 1324519 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
[junit4] 2> 1324520 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 1324520 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 1324523 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 1324523 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
[junit4] 2> 1324524 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1324524 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1324526 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 1324526 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
[junit4] 2> 1324527 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 1324527 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
[junit4] 2> 1324529 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 1324529 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
[junit4] 2> 1324530 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 1324531 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 1324532 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1324532 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 1324533 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1324534 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1324535 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 1324535 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 1324537 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 1324537 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
[junit4] 2> 1324902 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_F7260FB173B27178-001/control-001/cores/collection1
[junit4] 2> 1324904 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.e.j.s.Server jetty-9.2.13.v20150730
[junit4] 2> 1324905 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6cb2c5c3{/se/nh,null,AVAILABLE}
[junit4] 2> 1324906 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.e.j.s.ServerConnector Started ServerConnector@7d13f6af{HTTP/1.1}{127.0.0.1:60070}
[junit4] 2> 1324906 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.e.j.s.Server Started @1328149ms
[junit4] 2> 1324906 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_F7260FB173B27178-001/tempDir-001/control/data, hostContext=/se/nh, hostPort=60070, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_F7260FB173B27178-001/control-001/cores}
[junit4] 2> 1324906 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 1324906 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_F7260FB173B27178-001/control-001/'
[junit4] 2> 1324906 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1324906 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 1324924 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1324925 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1324926 INFO (zkCallback-1266-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2fbfafb name:ZooKeeperConnection Watcher:127.0.0.1:59505/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1324926 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1324926 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1324927 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1324928 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_F7260FB173B27178-001/control-001/solr.xml
[junit4] 2> 1324933 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_F7260FB173B27178-001/control-001/cores
[junit4] 2> 1324933 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.CoreContainer New CoreContainer 655098749
[junit4] 2> 1324933 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_F7260FB173B27178-001/control-001/]
[junit4] 2> 1324933 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_F7260FB173B27178-001/control-001/lib
[junit4] 2> 1324933 WARN (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_F7260FB173B27178-001/control-001/lib).
[junit4] 2> 1324950 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 1324952 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1324952 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1324952 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1324952 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:59505/solr
[junit4] 2> 1324952 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 1324952 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1324953 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1324954 INFO (zkCallback-1268-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7e20cd94 name:ZooKeeperConnection Watcher:127.0.0.1:59505 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1324954 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1324955 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1324957 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [n:127.0.0.1:60070_se%2Fnh ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1324958 INFO (zkCallback-1269-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@bcae212 name:ZooKeeperConnection Watcher:127.0.0.1:59505/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1324958 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [n:127.0.0.1:60070_se%2Fnh ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1324960 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [n:127.0.0.1:60070_se%2Fnh ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
[junit4] 2> 1324962 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [n:127.0.0.1:60070_se%2Fnh ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 1324965 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [n:127.0.0.1:60070_se%2Fnh ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 1324967 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [n:127.0.0.1:60070_se%2Fnh ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 1324969 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [n:127.0.0.1:60070_se%2Fnh ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 1324971 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [n:127.0.0.1:60070_se%2Fnh ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 1324972 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [n:127.0.0.1:60070_se%2Fnh ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 1324973 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [n:127.0.0.1:60070_se%2Fnh ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 1324975 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [n:127.0.0.1:60070_se%2Fnh ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 1324976 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [n:127.0.0.1:60070_se%2Fnh ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60070_se%2Fnh
[junit4] 2> 1324977 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [n:127.0.0.1:60070_se%2Fnh ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:60070_se%2Fnh
[junit4] 2> 1324978 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [n:127.0.0.1:60070_se%2Fnh ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 1324979 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [n:127.0.0.1:60070_se%2Fnh ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 1324980 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [n:127.0.0.1:60070_se%2Fnh ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1324981 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [n:127.0.0.1:60070_se%2Fnh ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94795429130207236-127.0.0.1:60070_se%2Fnh-n_0000000000
[junit4] 2> 1324981 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [n:127.0.0.1:60070_se%2Fnh ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:60070_se%2Fnh
[junit4] 2> 1324981 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [n:127.0.0.1:60070_se%2Fnh ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
[junit4] 2> 1324982 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [n:127.0.0.1:60070_se%2Fnh ] o.a.s.c.Overseer Overseer (id=94795429130207236-127.0.0.1:60070_se%2Fnh-n_0000000000) starting
[junit4] 2> 1324984 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [n:127.0.0.1:60070_se%2Fnh ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
[junit4] 2> 1324989 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [n:127.0.0.1:60070_se%2Fnh ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 1324990 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [n:127.0.0.1:60070_se%2Fnh ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 1324990 INFO (OverseerCollectionConfigSetProcessor-94795429130207236-127.0.0.1:60070_se%2Fnh-n_0000000000) [n:127.0.0.1:60070_se%2Fnh ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
[junit4] 2> 1324991 INFO (OverseerStateUpdate-94795429130207236-127.0.0.1:60070_se%2Fnh-n_0000000000) [n:127.0.0.1:60070_se%2Fnh ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 1325009 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [n:127.0.0.1:60070_se%2Fnh ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 1325009 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [n:127.0.0.1:60070_se%2Fnh ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 1325010 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [n:127.0.0.1:60070_se%2Fnh ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_F7260FB173B27178-001/control-001/cores
[junit4] 2> 1325011 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [n:127.0.0.1:60070_se%2Fnh ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_F7260FB173B27178-001/control-001/cores/collection1, collection=control_collection, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_F7260FB173B27178-001/control-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 1325011 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [n:127.0.0.1:60070_se%2Fnh ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_F7260FB173B27178-001/control-001/cores/collection1/
[junit4] 2> 1325011 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [n:127.0.0.1:60070_se%2Fnh ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 1325012 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [n:127.0.0.1:60070_se%2Fnh ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4] 2> 1325012 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [n:127.0.0.1:60070_se%2Fnh ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 1325013 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 1325013 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 1325015 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 1325015 INFO (OverseerStateUpdate-94795429130207236-127.0.0.1:60070_se%2Fnh-n_0000000000) [n:127.0.0.1:60070_se%2Fnh ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:60070/se/nh",
[junit4] 2> "node_name":"127.0.0.1:60070_se%2Fnh",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 1325015 INFO (OverseerStateUpdate-94795429130207236-127.0.0.1:60070_se%2Fnh-n_0000000000) [n:127.0.0.1:60070_se%2Fnh ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:60070/se/nh",
[junit4] 2> "node_name":"127.0.0.1:60070_se%2Fnh",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 1325016 INFO (OverseerStateUpdate-94795429130207236-127.0.0.1:60070_se%2Fnh-n_0000000000) [n:127.0.0.1:60070_se%2Fnh ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
[junit4] 2> 1325017 INFO (OverseerStateUpdate-94795429130207236-127.0.0.1:60070_se%2Fnh-n_0000000000) [n:127.0.0.1:60070_se%2Fnh ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 1325018 INFO (zkCallback-1269-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1326015 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 1326015 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
[junit4] 2> 1326016 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 1326016 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 1326017 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1326017 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_F7260FB173B27178-001/control-001/cores/collection1/'
[junit4] 2> 1326017 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1326017 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 1326031 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 1326035 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 1326039 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 1326047 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1326048 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 1326053 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 1326172 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 1326177 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 1326179 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 1326187 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 1326189 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 1326195 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1326196 WARN (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 1326196 WARN (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 1326196 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1326197 WARN (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 1326197 WARN (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 1326198 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4] 2> 1326198 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 1326198 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1326198 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_F7260FB173B27178-001/control-001/cores/collection1/], dataDir=[null]
[junit4] 2> 1326198 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3cb7d63c
[junit4] 2> 1326199 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_F7260FB173B27178-001/control-001/cores/collection1/data
[junit4] 2> 1326200 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_F7260FB173B27178-001/control-001/cores/collection1/data/index/
[junit4] 2> 1326200 WARN (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_F7260FB173B27178-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1326200 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_F7260FB173B27178-001/control-001/cores/collection1/data/index
[junit4] 2> 1326200 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=23, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 1326201 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@2302f610 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5ab9004d),segFN=segments_1,generation=1}
[junit4] 2> 1326201 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 1326201 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_F7260FB173B27178-001/control-001/cores/collection1/data/
[junit4] 2> 1326202 WARN (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_F7260FB173B27178-001/control-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
[junit4] 2> 1326205 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1326206 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1326206 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1326206 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1326206 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1326206 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1326206 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1326206 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1326206 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1326208 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1326209 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1326210 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1326211 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1326214 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 1326214 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 1326215 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1326215 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1326215 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
[junit4] 2> 1326215 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
[junit4] 2> 1326216 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=17, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=1.361328125, noCFSRatio=0.487429656309311]
[junit4] 2> 1326216 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@2302f610 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5ab9004d),segFN=segments_1,generation=1}
[junit4] 2> 1326216 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 1326217 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@63335722[collection1] main
[junit4] 2> 1326217 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 1326218 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1326218 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 1326219 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1326219 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
[junit4] 2> 1326219 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1326219 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 1326219 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1326219 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 1326219 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 1326220 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
[junit4] 2> 1326220 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
[junit4] 2> 1326220 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
[junit4] 2> 1326220 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1516726867984384000
[junit4] 2> 1326222 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 2.0ms to seed version buckets with highest version 1516726867984384000
[junit4] 2> 1326222 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
[junit4] 2> 1326223 INFO (searcherExecutor-4821-thread-1-processing-n:127.0.0.1:60070_se%2Fnh x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@63335722[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1326223 INFO (coreLoadExecutor-4820-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 1326223 INFO (coreZkRegister-4814-thread-1-processing-n:127.0.0.1:60070_se%2Fnh x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:60070/se/nh collection:control_collection shard:shard1
[junit4] 2> 1326224 INFO (coreZkRegister-4814-thread-1-processing-n:127.0.0.1:60070_se%2Fnh x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 1326227 INFO (coreZkRegister-4814-thread-1-processing-n:127.0.0.1:60070_se%2Fnh x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/94795429130207236-core_node1-n_0000000000
[junit4] 2> 1326227 INFO (coreZkRegister-4814-thread-1-processing-n:127.0.0.1:60070_se%2Fnh x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1
[junit4] 2> 1326229 INFO (coreZkRegister-4814-thread-1-processing-n:127.0.0.1:60070_se%2Fnh x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1326229 INFO (coreZkRegister-4814-thread-1-processing-n:127.0.0.1:60070_se%2Fnh x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1326229 INFO (coreZkRegister-4814-thread-1-processing-n:127.0.0.1:60070_se%2Fnh x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:60070/se/nh/collection1/
[junit4] 2> 1326229 INFO (coreZkRegister-4814-thread-1-processing-n:127.0.0.1:60070_se%2Fnh x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1326229 INFO (OverseerStateUpdate-94795429130207236-127.0.0.1:60070_se%2Fnh-n_0000000000) [n:127.0.0.1:60070_se%2Fnh ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection"} current state version: 1
[junit4] 2> 1326229 INFO (coreZkRegister-4814-thread-1-processing-n:127.0.0.1:60070_se%2Fnh x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:60070/se/nh/collection1/ has no replicas
[junit4] 2> 1326229 INFO (coreZkRegister-4814-thread-1-processing-n:127.0.0.1:60070_se%2Fnh x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:60070/se/nh/collection1/ shard1
[junit4] 2> 1326229 INFO (coreZkRegister-4814-thread-1-processing-n:127.0.0.1:60070_se%2Fnh x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 1326232 INFO (coreZkRegister-4814-thread-1-processing-n:127.0.0.1:60070_se%2Fnh x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
[junit4] 2> 1326234 INFO (OverseerStateUpdate-94795429130207236-127.0.0.1:60070_se%2Fnh-n_0000000000) [n:127.0.0.1:60070_se%2Fnh ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:60070/se/nh",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 1
[junit4] 2> 1326337 INFO (zkCallback-1269-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1326385 INFO (coreZkRegister-4814-thread-1-processing-n:127.0.0.1:60070_se%2Fnh x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:60070/se/nh/collection1/ and leader is http://127.0.0.1:60070/se/nh/collection1/
[junit4] 2> 1326385 INFO (coreZkRegister-4814-thread-1-processing-n:127.0.0.1:60070_se%2Fnh x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:60070/se/nh
[junit4] 2> 1326385 INFO (coreZkRegister-4814-thread-1-processing-n:127.0.0.1:60070_se%2Fnh x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1326385 INFO (coreZkRegister-4814-thread-1-processing-n:127.0.0.1:60070_se%2Fnh x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
[junit4] 2> 1326385 INFO (coreZkRegister-4814-thread-1-processing-n:127.0.0.1:60070_se%2Fnh x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:60070_se%2Fnh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 1326387 INFO (OverseerStateUpdate-94795429130207236-127.0.0.1:60070_se%2Fnh-n_0000000000) [n:127.0.0.1:60070_se%2Fnh ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:60070/se/nh",
[junit4] 2> "node_name":"127.0.0.1:60070_se%2Fnh",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 2
[junit4] 2> 1326387 INFO (OverseerStateUpdate-94795429130207236-127.0.0.1:60070_se%2Fnh-n_0000000000) [n:127.0.0.1:60070_se%2Fnh ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:60070/se/nh",
[junit4] 2> "node_name":"127.0.0.1:60070_se%2Fnh",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 1326490 INFO (zkCallback-1269-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1326514 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1326515 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1326516 INFO (zkCallback-1271-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@57efd54f name:ZooKeeperConnection Watcher:127.0.0.1:59505/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1326516 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1326516 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1326516 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 1326518 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 1326844 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_F7260FB173B27178-001/shard-1-001/cores/collection1
[junit4] 2> 1326845 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_F7260FB173B27178-001/shard-1-001
[junit4] 2> 1326846 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.e.j.s.Server jetty-9.2.13.v20150730
[junit4] 2> 1326848 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1a7684ca{/se/nh,null,AVAILABLE}
[junit4] 2> 1326848 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.e.j.s.ServerConnector Started ServerConnector@65f3e651{HTTP/1.1}{127.0.0.1:51725}
[junit4] 2> 1326848 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.e.j.s.Server Started @1330091ms
[junit4] 2> 1326848 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_F7260FB173B27178-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/se/nh, hostPort=51725, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_F7260FB173B27178-001/shard-1-001/cores}
[junit4] 2> 1326848 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 1326848 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_F7260FB173B27178-001/shard-1-001/'
[junit4] 2> 1326849 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1326849 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 1326865 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1326865 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1326867 INFO (zkCallback-1272-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4a12381f name:ZooKeeperConnection Watcher:127.0.0.1:59505/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1326867 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1326867 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1326868 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1326868 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_F7260FB173B27178-001/shard-1-001/solr.xml
[junit4] 2> 1326873 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_F7260FB173B27178-001/shard-1-001/cores
[junit4] 2> 1326873 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.CoreContainer New CoreContainer 1900683545
[junit4] 2> 1326873 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_F7260FB173B27178-001/shard-1-001/]
[junit4] 2> 1326873 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_F7260FB173B27178-001/shard-1-001/lib
[junit4] 2> 1326873 WARN (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_F7260FB173B27178-001/shard-1-001/lib).
[junit4] 2> 1326881 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 1326882 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1326903 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1326903 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1326903 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:59505/solr
[junit4] 2> 1326903 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 1326903 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1326904 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1326905 INFO (zkCallback-1274-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@10d5485e name:ZooKeeperConnection Watcher:127.0.0.1:59505 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1326905 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1326905 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1326906 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [n:127.0.0.1:51725_se%2Fnh ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1326907 INFO (zkCallback-1275-thread-1-processing-n:127.0.0.1:51725_se%2Fnh) [n:127.0.0.1:51725_se%2Fnh ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@30b2be61 name:ZooKeeperConnection Watcher:127.0.0.1:59505/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1326907 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [n:127.0.0.1:51725_se%2Fnh ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1326912 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [n:127.0.0.1:51725_se%2Fnh ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 1327917 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [n:127.0.0.1:51725_se%2Fnh ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51725_se%2Fnh
[junit4] 2> 1327917 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [n:127.0.0.1:51725_se%2Fnh ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:51725_se%2Fnh
[junit4] 2> 1327918 INFO (zkCallback-1275-thread-1-processing-n:127.0.0.1:51725_se%2Fnh) [n:127.0.0.1:51725_se%2Fnh ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1327918 INFO (zkCallback-1269-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1327918 INFO (zkCallback-1271-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1327921 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [n:127.0.0.1:51725_se%2Fnh ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1327921 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [n:127.0.0.1:51725_se%2Fnh ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94795429130207240-127.0.0.1:51725_se%2Fnh-n_0000000001
[junit4] 2> 1327922 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [n:127.0.0.1:51725_se%2Fnh ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/94795429130207236-127.0.0.1:60070_se%2Fnh-n_0000000000 to know if I could be the leader
[junit4] 2> 1327935 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [n:127.0.0.1:51725_se%2Fnh ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 1327935 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [n:127.0.0.1:51725_se%2Fnh ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 1327936 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [n:127.0.0.1:51725_se%2Fnh ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_F7260FB173B27178-001/shard-1-001/cores
[junit4] 2> 1327937 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [n:127.0.0.1:51725_se%2Fnh ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_F7260FB173B27178-001/shard-1-001/cores/collection1, collection=collection1, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_F7260FB173B27178-001/shard-1-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 1327937 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [n:127.0.0.1:51725_se%2Fnh ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_F7260FB173B27178-001/shard-1-001/cores/collection1/
[junit4] 2> 1327937 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [n:127.0.0.1:51725_se%2Fnh ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 1327938 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [n:127.0.0.1:51725_se%2Fnh ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4] 2> 1327938 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[F7260FB173B27178]) [n:127.0.0.1:51725_se%2Fnh ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 1327939 INFO (coreLoadExecutor-4831-thread-1-processing-n:127.0.0.1:51725_se%2Fnh) [n:127.0.0.1:51725_se%2Fnh c:collection1 x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 1327939 INFO (coreLoadExecutor-4831-thread-1-processing-n:127.0.0.1:51725_se%2Fnh) [n:127.0.0.1:51725_se%2Fnh c:collection1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 1327940 INFO (OverseerStateUpdate-94795429130207236-127.0.0.1:60070_se%2Fnh-n_0000000000) [n:127.0.0.1:60070_se%2Fnh ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:51725/se/nh",
[junit4] 2> "node_name":"127.0.0.1:51725_se%2Fnh",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"} current state version: 3
[junit4] 2> 1327941 INFO (coreLoadExecutor-4831-thread-1-processing-n:127.0.0.1:51725_se%2Fnh) [n:127.0.0.1:51725_se%2Fnh c:collection1 x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 1327941 INFO (OverseerStateUpdate-94795429130207236-127.0.0.1:60070_se%2Fnh-n_0000000000) [n:127.0.0.1:60070_se%2Fnh ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:51725/se/nh",
[junit4] 2> "node_name":"127.0.0.1:51725_se%2Fnh",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"}
[junit4] 2> 1327941 INFO (OverseerStateUpdate-94795429130207236-127.0.0.1:60070_se%2Fnh-n_0000000000) [n:127.0.0.1:60070_se%2Fnh ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
[junit4] 2> 1327941 INFO (OverseerStateUpdate-94795429130207236-127.0.0.1:60070_se%2Fnh-n_0000000000) [n:127.0.0.1:60070_se%2Fnh ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2
[junit4] 2> 1328043 INFO (zkCallback-1269-thread-1-processing-n:127.0.0.1:60070_se%2Fnh) [n:127.0.0.1:60070_se%2Fnh ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1328043 INFO (zkCallback-1275-thread-1-processing-n:127.0.0.1:51725_se%2Fnh) [n:127.0.0.1:51725_se%2Fnh ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1328043 INFO (zkCallback-1271-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1328941 INFO (coreLoadExecutor-4831-thread-1-processing-n:127.0.0.1:51725_se%2Fnh) [n:127.0.0.1:51725_se%2Fnh c:collection1 x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 1328942 INFO (coreLoadExecutor-4831-thread-1-processing-n:127.0.0.1:51725_se%2Fnh) [n:127.0.0.1:51725_se%2Fnh c:collection1 x:collection1] o.a.s.c.ZkController Check for collection zkNode:collection1
[junit4] 2> 1328942 INFO (coreLoadExecutor-4831-thread-1-processing-n:127.0.0.1:51725_se%2Fnh) [n:127.0.0.1:51725_se%2Fnh c:collection1 x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 1328942 INFO (coreLoadExecutor-4831-thread-1-processing-n:127.0.0.1:51725_se%2Fnh) [n:127.0.0.1:51725_se%2Fnh c:collection1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/collection1
[junit4] 2> 1328943 INFO (coreLoadExecutor-4831-thread-1-processing-n:127.0.0.1:51725_se%2Fnh) [n:127.0.0.1:51725_se%2Fnh c:collection1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1328943 INFO (coreLoadExecutor-4831-thread-1-processing-n:127.0.0.1:51725_se%2Fnh) [n:127.0.0.1:51725_se%2Fnh c:collection1 x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_F7260FB173B27178-001/shard-1-001/cores/collection1/'
[junit4] 2> 1328943 INFO (coreLoadExecutor-4831-thread-1-processing-n:127.0.0.1:51725_se%2Fnh) [n:127.0.0.1:51725_se%2Fnh c:collection1 x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1328943 INFO (coreLoadExecutor-4831-thread-1-processing-n:127.0.0.1:51725_se%2Fnh) [n:127.0.0.1:51725_se%2Fnh c:collection1 x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 1328957 INFO (coreLoadExecutor-4831-thread-1-processing-n:127.0.0.1:51725_se%2Fnh) [n:127.0.0.1:51725_se%2Fnh c:collection1
[...truncated too long message...]
seer_elect/election/94795528501461048-127.0.0.1:55566_-n_0000000023
[junit4] 2> 2 /solr/overseer_elect/election/94795528501461018-127.0.0.1:47741_-n_0000000007
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard2/election/94795528501461141-core_node15-n_0000000017
[junit4] 2> 2 /solr/overseer_elect/election/94795528501461336-127.0.0.1:55566_-n_0000000155
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard1/election/94795528501461174-core_node10-n_0000000038
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard2/election/94795528501461165-core_node5-n_0000000019
[junit4] 2> 2 /solr/overseer_elect/election/94795528501461006-127.0.0.1:49643_-n_0000000020
[junit4] 2> 2 /solr/overseer_elect/election/94795528501461096-127.0.0.1:55566_-n_0000000045
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard2/election/94795528501461213-core_node5-n_0000000024
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard2/election/94795528501461189-core_node15-n_0000000022
[junit4] 2> 2 /solr/overseer_elect/election/94795528501461024-127.0.0.1:39481_-n_0000000009
[junit4] 2> 2 /solr/overseer_elect/election/94795528501461006-127.0.0.1:49643_-n_0000000163
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard2/election/94795528501461261-core_node5-n_0000000029
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard2/election/94795528501461333-core_node15-n_0000000037
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard2/election/94795528501461309-core_node5-n_0000000034
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard1/election/94795528501461342-core_node8-n_0000000075
[junit4] 2> 2 /solr/overseer_elect/election/94795528501461009-127.0.0.1:40189_-n_0000000021
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard1/election/94795528501461126-core_node10-n_0000000027
[junit4] 2> 2 /solr/overseer_elect/election/94795528501461036-127.0.0.1:49741_-n_0000000013
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard2/election/94795528501461117-core_node5-n_0000000014
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard1/election/94795528501461078-core_node10-n_0000000016
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard2/election/94795528501461042-core_node15-n_0000000007
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 122 /solr/collections
[junit4] 2> 58 /solr/overseer/collection-queue-work
[junit4] 2> 57 /solr/overseer/queue
[junit4] 2> 20 /solr/overseer/queue-work
[junit4] 2> 18 /solr/live_nodes
[junit4] 2>
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=RollingRestartTest -Dtests.method=test -Dtests.seed=F7260FB173B27178 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=ko_KR -Dtests.timezone=Europe/Zagreb -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[junit4] FAILURE 819s J2 | RollingRestartTest.test <<<
[junit4] > Throwable #1: java.lang.AssertionError: Unable to restart (#6): CloudJettyRunner [url=http://127.0.0.1:49972/collection1]
[junit4] > at __randomizedtesting.SeedInfo.seed([F7260FB173B27178:7F72306BDD4E1C80]:0)
[junit4] > at org.apache.solr.cloud.RollingRestartTest.restartWithRolesTest(RollingRestartTest.java:104)
[junit4] > at org.apache.solr.cloud.RollingRestartTest.test(RollingRestartTest.java:53)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:963)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:938)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 3659831 INFO (SUITE-RollingRestartTest-seed#[F7260FB173B27178]-worker) [n:127.0.0.1:60226_ c:collection1 s:shard1 r:core_node16 x:collection1] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.RollingRestartTest_F7260FB173B27178-001
[junit4] 2> Nov 02, 2015 12:03:12 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene60): {}, docValues:{}, sim=ClassicSimilarity, locale=ko_KR, timezone=Europe/Zagreb
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_45 (64-bit)/cpus=4,threads=1,free=91458864,total=518520832
[junit4] 2> NOTE: All tests run in this JVM: [DistribCursorPagingTest, OverriddenZkACLAndCredentialsProvidersTest, AnalyticsMergeStrategyTest, ShowFileRequestHandlerTest, TestExactSharedStatsCache, QueryParsingTest, AddBlockUpdateTest, CursorMarkTest, TestOverriddenPrefixQueryForCustomFieldType, TestDistributedStatsComponentCardinality, XmlUpdateRequestHandlerTest, TestManagedStopFilterFactory, TestPerFieldSimilarity, ResponseHeaderTest, UnloadDistributedZkTest, CurrencyFieldXmlFileTest, DistributedQueryComponentCustomSortTest, DocValuesMultiTest, TestLeaderElectionZkExpiry, AsyncMigrateRouteKeyTest, TestConfigSetsAPI, TestDefaultSimilarityFactory, TermVectorComponentDistributedTest, HdfsDirectoryFactoryTest, LeaderElectionTest, DirectUpdateHandlerTest, SuggesterWFSTTest, TestSha256AuthenticationProvider, ConcurrentDeleteAndCreateCollectionTest, UpdateParamsTest, ClusterStateTest, TestReversedWildcardFilterFactory, RecoveryZkTest, TestFieldTypeResource, CloudMLTQParserTest, TestSmileRequest, TestWriterPerf, TestXIncludeConfig, DistributedDebugComponentTest, OverseerTest, TestPostingsSolrHighlighter, ZkNodePropsTest, TestSearchPerf, HdfsBasicDistributedZkTest, TestMinMaxOnMultiValuedField, SolrCoreCheckLockOnStartupTest, TestSort, BasicDistributedZk2Test, TestCSVResponseWriter, BlockCacheTest, LukeRequestHandlerTest, AutoCommitTest, TestStressReorder, PrimitiveFieldTypeTest, SearchHandlerTest, TestManagedResourceStorage, TestAuthenticationFramework, TestIndexSearcher, FullSolrCloudDistribCmdsTest, AddSchemaFieldsUpdateProcessorFactoryTest, TestElisionMultitermQuery, SecurityConfHandlerTest, DeleteShardTest, HLLSerializationTest, TestSolrIndexConfig, TestGroupingSearch, TestSolrCLIRunExample, BinaryUpdateRequestHandlerTest, OverseerCollectionConfigSetProcessorTest, TestFieldResource, TestScoreJoinQPNoScore, BasicAuthIntegrationTest, TestShortCircuitedRequests, TestCoreDiscovery, HighlighterConfigTest, RegexBoostProcessorTest, BigEndianAscendingWordDeserializerTest, ZkStateReaderTest, FieldAnalysisRequestHandlerTest, CoreAdminHandlerTest, CdcrUpdateLogTest, TestTrieFacet, TestQueryWrapperFilter, QueryResultKeyTest, BadComponentTest, TestManagedSchemaDynamicFieldResource, TestReload, AnalyticsQueryTest, BasicZkTest, TestZkChroot, TestRandomDVFaceting, TestDistributedSearch, TestCoreContainer, SolrCmdDistributorTest, TestFiltering, SolrRequestParserTest, SuggesterTest, PolyFieldTest, FieldMutatingUpdateProcessorTest, QueryEqualityTest, TestRemoteStreaming, SolrInfoMBeanTest, DebugComponentTest, TestQueryUtils, TermsComponentTest, PathHierarchyTokenizerFactoryTest, TermVectorComponentTest, TestSolrQueryParser, TestJmxIntegration, JsonLoaderTest, TestBinaryResponseWriter, AlternateDirectoryTest, SolrIndexConfigTest, TestDocSet, MinimalSchemaTest, TestConfig, TestFuzzyAnalyzedSuggestions, TestPhraseSuggestions, TestSweetSpotSimilarityFactory, TestFastWriter, TestFastOutputStream, ScriptEngineTest, TestSystemIdResolver, TestSuggestSpellingConverter, DateFieldTest, SpellingQueryConverterTest, RAMDirectoryFactoryTest, TestSolrJ, TestLRUCache, SliceStateTest, SystemInfoHandlerTest, UUIDFieldTest, FileUtilsTest, TestRTGBase, CursorPagingTest, BaseCdcrDistributedZkTest, CdcrRequestHandlerTest, CollectionStateFormat2Test, DeleteInactiveReplicaTest, DistributedVersionInfoTest, MigrateRouteKeyTest, MultiThreadedOCPTest, OverseerStatusTest, OverseerTaskQueueTest, RecoveryAfterSoftCommitTest, ReplicationFactorTest, RollingRestartTest]
[junit4] Completed [451/553] on J2 in 819.59s, 1 test, 1 failure <<< FAILURES!
[...truncated 316 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987: There were test failures: 553 suites (8 ignored), 2176 tests, 2 errors, 1 failure, 31 ignored (18 assumptions) [seed: F7260FB173B27178]
Total time: 198 minutes 18 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 839 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/839/
1 tests failed.
FAILED: org.apache.solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR
Error Message:
Captured an uncaught exception in thread: Thread[id=10668, name=coreZkRegister-1043-thread-2, state=RUNNABLE, group=TGRP-LeaderInitiatedRecoveryOnShardRestartTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=10668, name=coreZkRegister-1043-thread-2, state=RUNNABLE, group=TGRP-LeaderInitiatedRecoveryOnShardRestartTest]
Caused by: java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([23A6EC34FC14F77A]:0)
at org.apache.solr.cloud.ZkController.updateLeaderInitiatedRecoveryState(ZkController.java:2126)
at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:433)
at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:197)
at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:157)
at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:346)
at org.apache.solr.cloud.ZkController.joinElection(ZkController.java:1113)
at org.apache.solr.cloud.ZkController.register(ZkController.java:926)
at org.apache.solr.cloud.ZkController.register(ZkController.java:881)
at org.apache.solr.core.ZkContainer$2.run(ZkContainer.java:183)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:231)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 10141 lines...]
[junit4] Suite: org.apache.solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_23A6EC34FC14F77A-001/init-core-data-001
[junit4] 2> 440301 INFO (SUITE-LeaderInitiatedRecoveryOnShardRestartTest-seed#[23A6EC34FC14F77A]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /f_dlr/h
[junit4] 2> 440305 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 440309 INFO (Thread-9093) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 440309 INFO (Thread-9093) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 440409 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.ZkTestServer start zk server on port:34217
[junit4] 2> 440409 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 440412 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 440420 INFO (zkCallback-226-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7c316a08 name:ZooKeeperConnection Watcher:127.0.0.1:34217 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 440420 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 440421 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 440421 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 440424 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 440432 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 440442 INFO (zkCallback-227-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@189070cc name:ZooKeeperConnection Watcher:127.0.0.1:34217/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 440442 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 440443 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 440443 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
[junit4] 2> 440444 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
[junit4] 2> 440446 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
[junit4] 2> 440447 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
[junit4] 2> 440448 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 440448 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 440450 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 440450 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
[junit4] 2> 440451 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 440452 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 440453 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 440453 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
[junit4] 2> 440454 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 440454 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
[junit4] 2> 440455 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 440455 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
[junit4] 2> 440457 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 440457 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 440458 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 440458 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 440459 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 440460 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 440464 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 440464 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 440466 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 440466 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
[junit4] 2> 440802 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_23A6EC34FC14F77A-001/control-001/cores/collection1
[junit4] 2> 440803 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.e.j.s.Server jetty-9.2.13.v20150730
[junit4] 2> 440805 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6111d254{/f_dlr/h,null,AVAILABLE}
[junit4] 2> 440806 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.e.j.s.ServerConnector Started ServerConnector@60c4ff2b{HTTP/1.1}{127.0.0.1:58984}
[junit4] 2> 440806 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.e.j.s.Server Started @443587ms
[junit4] 2> 440806 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_23A6EC34FC14F77A-001/tempDir-001/control/data, hostContext=/f_dlr/h, hostPort=58984, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_23A6EC34FC14F77A-001/control-001/cores}
[junit4] 2> 440807 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 440807 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_23A6EC34FC14F77A-001/control-001/'
[junit4] 2> 440807 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 440807 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 440822 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 440824 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 440827 INFO (zkCallback-228-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3cf43ab3 name:ZooKeeperConnection Watcher:127.0.0.1:34217/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 440827 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 440828 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 440830 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 440830 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_23A6EC34FC14F77A-001/control-001/solr.xml
[junit4] 2> 440835 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_23A6EC34FC14F77A-001/control-001/cores
[junit4] 2> 440835 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.CoreContainer New CoreContainer 1220789211
[junit4] 2> 440835 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_23A6EC34FC14F77A-001/control-001/]
[junit4] 2> 440835 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_23A6EC34FC14F77A-001/control-001/lib
[junit4] 2> 440835 WARN (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_23A6EC34FC14F77A-001/control-001/lib).
[junit4] 2> 440844 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 440845 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 440846 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 440846 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 440846 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34217/solr
[junit4] 2> 440846 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 440846 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 440847 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 440855 INFO (zkCallback-230-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@20510216 name:ZooKeeperConnection Watcher:127.0.0.1:34217 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 440855 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 440855 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 440859 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [n:127.0.0.1:58984_f_dlr%2Fh ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 440881 INFO (zkCallback-231-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@12de497d name:ZooKeeperConnection Watcher:127.0.0.1:34217/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 440881 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [n:127.0.0.1:58984_f_dlr%2Fh ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 440882 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [n:127.0.0.1:58984_f_dlr%2Fh ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
[junit4] 2> 440889 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [n:127.0.0.1:58984_f_dlr%2Fh ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 440891 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [n:127.0.0.1:58984_f_dlr%2Fh ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 440892 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [n:127.0.0.1:58984_f_dlr%2Fh ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 440894 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [n:127.0.0.1:58984_f_dlr%2Fh ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 440895 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [n:127.0.0.1:58984_f_dlr%2Fh ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 440901 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [n:127.0.0.1:58984_f_dlr%2Fh ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 440905 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [n:127.0.0.1:58984_f_dlr%2Fh ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 440906 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [n:127.0.0.1:58984_f_dlr%2Fh ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 440907 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [n:127.0.0.1:58984_f_dlr%2Fh ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58984_f_dlr%2Fh
[junit4] 2> 440907 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [n:127.0.0.1:58984_f_dlr%2Fh ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:58984_f_dlr%2Fh
[junit4] 2> 440909 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [n:127.0.0.1:58984_f_dlr%2Fh ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 440910 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [n:127.0.0.1:58984_f_dlr%2Fh ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 440912 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [n:127.0.0.1:58984_f_dlr%2Fh ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 440913 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [n:127.0.0.1:58984_f_dlr%2Fh ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94789660481486852-127.0.0.1:58984_f_dlr%2Fh-n_0000000000
[junit4] 2> 440913 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [n:127.0.0.1:58984_f_dlr%2Fh ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:58984_f_dlr%2Fh
[junit4] 2> 440913 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [n:127.0.0.1:58984_f_dlr%2Fh ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
[junit4] 2> 440914 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [n:127.0.0.1:58984_f_dlr%2Fh ] o.a.s.c.Overseer Overseer (id=94789660481486852-127.0.0.1:58984_f_dlr%2Fh-n_0000000000) starting
[junit4] 2> 440921 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [n:127.0.0.1:58984_f_dlr%2Fh ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
[junit4] 2> 440929 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [n:127.0.0.1:58984_f_dlr%2Fh ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 440938 INFO (OverseerStateUpdate-94789660481486852-127.0.0.1:58984_f_dlr%2Fh-n_0000000000) [n:127.0.0.1:58984_f_dlr%2Fh ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 440938 INFO (OverseerStateUpdate-94789660481486852-127.0.0.1:58984_f_dlr%2Fh-n_0000000000) [n:127.0.0.1:58984_f_dlr%2Fh ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 440948 INFO (OverseerCollectionConfigSetProcessor-94789660481486852-127.0.0.1:58984_f_dlr%2Fh-n_0000000000) [n:127.0.0.1:58984_f_dlr%2Fh ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
[junit4] 2> 440957 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [n:127.0.0.1:58984_f_dlr%2Fh ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 440970 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [n:127.0.0.1:58984_f_dlr%2Fh ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 440970 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [n:127.0.0.1:58984_f_dlr%2Fh ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 440971 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [n:127.0.0.1:58984_f_dlr%2Fh ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_23A6EC34FC14F77A-001/control-001/cores
[junit4] 2> 440971 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [n:127.0.0.1:58984_f_dlr%2Fh ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_23A6EC34FC14F77A-001/control-001/cores/collection1, collection=control_collection, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_23A6EC34FC14F77A-001/control-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 440972 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [n:127.0.0.1:58984_f_dlr%2Fh ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_23A6EC34FC14F77A-001/control-001/cores/collection1/
[junit4] 2> 440972 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [n:127.0.0.1:58984_f_dlr%2Fh ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 440977 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 440978 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 440978 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [n:127.0.0.1:58984_f_dlr%2Fh ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4] 2> 440978 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [n:127.0.0.1:58984_f_dlr%2Fh ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 440979 INFO (OverseerStateUpdate-94789660481486852-127.0.0.1:58984_f_dlr%2Fh-n_0000000000) [n:127.0.0.1:58984_f_dlr%2Fh ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:58984/f_dlr/h",
[junit4] 2> "node_name":"127.0.0.1:58984_f_dlr%2Fh",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 440980 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 440980 INFO (OverseerStateUpdate-94789660481486852-127.0.0.1:58984_f_dlr%2Fh-n_0000000000) [n:127.0.0.1:58984_f_dlr%2Fh ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:58984/f_dlr/h",
[junit4] 2> "node_name":"127.0.0.1:58984_f_dlr%2Fh",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 440980 INFO (OverseerStateUpdate-94789660481486852-127.0.0.1:58984_f_dlr%2Fh-n_0000000000) [n:127.0.0.1:58984_f_dlr%2Fh ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
[junit4] 2> 440981 INFO (OverseerStateUpdate-94789660481486852-127.0.0.1:58984_f_dlr%2Fh-n_0000000000) [n:127.0.0.1:58984_f_dlr%2Fh ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 440982 INFO (zkCallback-231-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 440996 INFO (zkCallback-231-thread-2-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 441980 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 441980 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
[junit4] 2> 441981 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 441981 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 441982 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 441982 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_23A6EC34FC14F77A-001/control-001/cores/collection1/'
[junit4] 2> 441982 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 441982 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 441998 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 442002 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 442006 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 442014 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
[junit4] 2> 442015 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 442020 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 442123 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 442129 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 442130 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 442140 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 442143 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 442147 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 442148 WARN (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 442148 WARN (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 442148 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 442149 WARN (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 442149 WARN (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 442150 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4] 2> 442150 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 442150 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 442150 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_23A6EC34FC14F77A-001/control-001/cores/collection1/], dataDir=[null]
[junit4] 2> 442150 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@392b887
[junit4] 2> 442157 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_23A6EC34FC14F77A-001/control-001/cores/collection1/data
[junit4] 2> 442157 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_23A6EC34FC14F77A-001/control-001/cores/collection1/data/index/
[junit4] 2> 442157 WARN (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_23A6EC34FC14F77A-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 442157 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_23A6EC34FC14F77A-001/control-001/cores/collection1/data/index
[junit4] 2> 442158 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@43e442ff
[junit4] 2> 442164 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=RawDirectoryWrapper(SimpleFSDirectory@/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_23A6EC34FC14F77A-001/index-SimpleFSDirectory-001 lockFactory=org.apache.lucene.store.NativeFSLockFactory@74948fa1),segFN=segments_1,generation=1}
[junit4] 2> 442165 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 442165 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_23A6EC34FC14F77A-001/control-001/cores/collection1/data/
[junit4] 2> 442165 WARN (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_23A6EC34FC14F77A-001/control-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
[junit4] 2> 442169 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 442169 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
[junit4] 2> 442169 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 442169 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 442169 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 442169 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 442170 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 442170 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 442170 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 442172 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 442172 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 442173 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 442174 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 442177 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 442178 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 442181 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 442181 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 442182 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
[junit4] 2> 442182 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
[junit4] 2> 442182 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=3, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=1.2216796875, noCFSRatio=1.0]
[junit4] 2> 442183 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=RawDirectoryWrapper(SimpleFSDirectory@/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_23A6EC34FC14F77A-001/index-SimpleFSDirectory-001 lockFactory=org.apache.lucene.store.NativeFSLockFactory@74948fa1),segFN=segments_1,generation=1}
[junit4] 2> 442183 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 442183 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@255ab702[collection1] main
[junit4] 2> 442184 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 442185 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 442185 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 442186 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 442186 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
[junit4] 2> 442186 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 442186 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 442186 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 442186 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 442187 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 442187 INFO (searcherExecutor-1006-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@255ab702[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 442187 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
[junit4] 2> 442187 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
[junit4] 2> 442187 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
[junit4] 2> 442187 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1516634569662529536
[junit4] 2> 442190 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 2.0ms to seed version buckets with highest version 1516634569662529536
[junit4] 2> 442190 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
[junit4] 2> 442190 INFO (coreLoadExecutor-1005-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 442191 INFO (coreZkRegister-999-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:58984/f_dlr/h collection:control_collection shard:shard1
[junit4] 2> 442191 INFO (coreZkRegister-999-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 442195 INFO (coreZkRegister-999-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/94789660481486852-core_node1-n_0000000000
[junit4] 2> 442195 INFO (coreZkRegister-999-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1
[junit4] 2> 442197 INFO (coreZkRegister-999-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 442197 INFO (coreZkRegister-999-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 442197 INFO (coreZkRegister-999-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:58984/f_dlr/h/collection1/
[junit4] 2> 442197 INFO (coreZkRegister-999-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 442197 INFO (coreZkRegister-999-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:58984/f_dlr/h/collection1/ has no replicas
[junit4] 2> 442197 INFO (coreZkRegister-999-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:58984/f_dlr/h/collection1/ shard1
[junit4] 2> 442197 INFO (OverseerStateUpdate-94789660481486852-127.0.0.1:58984_f_dlr%2Fh-n_0000000000) [n:127.0.0.1:58984_f_dlr%2Fh ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection"} current state version: 1
[junit4] 2> 442197 INFO (coreZkRegister-999-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 442200 INFO (coreZkRegister-999-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
[junit4] 2> 442202 INFO (OverseerStateUpdate-94789660481486852-127.0.0.1:58984_f_dlr%2Fh-n_0000000000) [n:127.0.0.1:58984_f_dlr%2Fh ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:58984/f_dlr/h",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 1
[junit4] 2> 442305 INFO (zkCallback-231-thread-2-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 442305 INFO (zkCallback-231-thread-3-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 442354 INFO (coreZkRegister-999-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:58984/f_dlr/h/collection1/ and leader is http://127.0.0.1:58984/f_dlr/h/collection1/
[junit4] 2> 442354 INFO (coreZkRegister-999-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:58984/f_dlr/h
[junit4] 2> 442354 INFO (coreZkRegister-999-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 442354 INFO (coreZkRegister-999-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
[junit4] 2> 442354 INFO (coreZkRegister-999-thread-1-processing-n:127.0.0.1:58984_f_dlr%2Fh x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:58984_f_dlr%2Fh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 442356 INFO (OverseerStateUpdate-94789660481486852-127.0.0.1:58984_f_dlr%2Fh-n_0000000000) [n:127.0.0.1:58984_f_dlr%2Fh ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:58984/f_dlr/h",
[junit4] 2> "node_name":"127.0.0.1:58984_f_dlr%2Fh",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 2
[junit4] 2> 442357 INFO (OverseerStateUpdate-94789660481486852-127.0.0.1:58984_f_dlr%2Fh-n_0000000000) [n:127.0.0.1:58984_f_dlr%2Fh ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:58984/f_dlr/h",
[junit4] 2> "node_name":"127.0.0.1:58984_f_dlr%2Fh",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 442461 INFO (zkCallback-231-thread-3-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 442461 INFO (zkCallback-231-thread-2-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 442479 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 442480 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 442485 INFO (zkCallback-233-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@89c49b9 name:ZooKeeperConnection Watcher:127.0.0.1:34217/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 442485 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 442485 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 442485 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 442487 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 442487 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with stateFormat=2
[junit4] 2> 442487 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 442488 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 442489 INFO (zkCallback-234-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3cfc14c9 name:ZooKeeperConnection Watcher:127.0.0.1:34217/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 442489 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 442490 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 442493 INFO (OverseerStateUpdate-94789660481486852-127.0.0.1:58984_f_dlr%2Fh-n_0000000000) [n:127.0.0.1:58984_f_dlr%2Fh ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"create",
[junit4] 2> "name":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "stateFormat":"2"} current state version: 3
[junit4] 2> 442493 INFO (OverseerStateUpdate-94789660481486852-127.0.0.1:58984_f_dlr%2Fh-n_0000000000) [n:127.0.0.1:58984_f_dlr%2Fh ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
[junit4] 2> 442596 INFO (OverseerStateUpdate-94789660481486852-127.0.0.1:58984_f_dlr%2Fh-n_0000000000) [n:127.0.0.1:58984_f_dlr%2Fh ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/collection1/state.json
[junit4] 2> 442808 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_23A6EC34FC14F77A-001/shard-1-001/cores/collection1
[junit4] 2> 442809 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_23A6EC34FC14F77A-001/shard-1-001
[junit4] 2> 442810 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.e.j.s.Server jetty-9.2.13.v20150730
[junit4] 2> 442811 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3bbc54ef{/f_dlr/h,null,AVAILABLE}
[junit4] 2> 442812 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.e.j.s.ServerConnector Started ServerConnector@616216a3{HTTP/1.1}{127.0.0.1:52480}
[junit4] 2> 442812 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.e.j.s.Server Started @445593ms
[junit4] 2> 442812 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_23A6EC34FC14F77A-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/f_dlr/h, hostPort=52480, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_23A6EC34FC14F77A-001/shard-1-001/cores}
[junit4] 2> 442812 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 442812 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_23A6EC34FC14F77A-001/shard-1-001/'
[junit4] 2> 442813 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 442813 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 442827 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 442828 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 442833 INFO (zkCallback-235-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1f3c85af name:ZooKeeperConnection Watcher:127.0.0.1:34217/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 442833 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 442833 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 442835 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 442835 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_23A6EC34FC14F77A-001/shard-1-001/solr.xml
[junit4] 2> 442840 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_23A6EC34FC14F77A-001/shard-1-001/cores
[junit4] 2> 442840 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.CoreContainer New CoreContainer 1757798446
[junit4] 2> 442840 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_23A6EC34FC14F77A-001/shard-1-001/]
[junit4] 2> 442840 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_23A6EC34FC14F77A-001/shard-1-001/lib
[junit4] 2> 442840 WARN (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_23A6EC34FC14F77A-001/shard-1-001/lib).
[junit4] 2> 442847 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 442848 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 442849 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 442849 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 442849 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34217/solr
[junit4] 2> 442849 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 442849 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 442854 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 442856 INFO (zkCallback-237-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@781f7da3 name:ZooKeeperConnection Watcher:127.0.0.1:34217 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 442857 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 442857 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 442865 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [n:127.0.0.1:52480_f_dlr%2Fh ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 442867 INFO (zkCallback-238-thread-1-processing-n:127.0.0.1:52480_f_dlr%2Fh) [n:127.0.0.1:52480_f_dlr%2Fh ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@78dcafe0 name:ZooKeeperConnection Watcher:127.0.0.1:34217/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 442867 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [n:127.0.0.1:52480_f_dlr%2Fh ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 442872 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [n:127.0.0.1:52480_f_dlr%2Fh ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 443876 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [n:127.0.0.1:52480_f_dlr%2Fh ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52480_f_dlr%2Fh
[junit4] 2> 443877 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [n:127.0.0.1:52480_f_dlr%2Fh ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:52480_f_dlr%2Fh
[junit4] 2> 443878 INFO (zkCallback-231-thread-2-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 443878 INFO (zkCallback-233-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 443878 INFO (zkCallback-231-thread-3-processing-n:127.0.0.1:58984_f_dlr%2Fh) [n:127.0.0.1:58984_f_dlr%2Fh ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 443878 INFO (zkCallback-238-thread-1-processing-n:127.0.0.1:52480_f_dlr%2Fh) [n:127.0.0.1:52480_f_dlr%2Fh ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 443879 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [n:127.0.0.1:52480_f_dlr%2Fh ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 443880 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [n:127.0.0.1:52480_f_dlr%2Fh ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94789660481486857-127.0.0.1:52480_f_dlr%2Fh-n_0000000001
[junit4] 2> 443880 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [n:127.0.0.1:52480_f_dlr%2Fh ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/94789660481486852-127.0.0.1:58984_f_dlr%2Fh-n_0000000000 to know if I could be the leader
[junit4] 2> 443907 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [n:127.0.0.1:52480_f_dlr%2Fh ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 443907 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [n:127.0.0.1:52480_f_dlr%2Fh ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 443908 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [n:127.0.0.1:52480_f_dlr%2Fh ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_23A6EC34FC14F77A-001/shard-1-001/cores
[junit4] 2> 443909 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [n:127.0.0.1:52480_f_dlr%2Fh ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_23A6EC34FC14F77A-001/shard-1-001/cores/collection1, collection=collection1, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_23A6EC34FC14F77A-001/shard-1-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 443909 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [n:127.0.0.1:52480_f_dlr%2Fh ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_23A6EC34FC14F77A-001/shard-1-001/cores/collection1/
[junit4] 2> 443909 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [n:127.0.0.1:52480_f_dlr%2Fh ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 443911 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [n:127.0.0.1:52480_f_dlr%2Fh ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4] 2> 443911 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [n:127.0.0.1:52480_f_dlr%2Fh ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 443913 INFO (coreLoadExecutor-1016-thread-1-processing-n:127.0.0.1:52480_f_dlr%2Fh) [n:127.0.0.1:52480_f_dlr%2Fh c:collection1 x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 443915 INFO (coreLoadExecutor-1016-thread-1-processing-n:127.0.0.1:52480_f_dlr%2Fh) [n:127.0.0.1:52480_f_dlr%2Fh c:collection1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 443917 INFO (coreLoadExecutor-1016-thread-1-processing-n:127.0.0.1:52480_f_dlr%2Fh) [n:127.0.0.1:52480_f_dlr%2Fh c:collection1 x:collection1] o.a.s.c.ZkController Registering watch for collection collection1
[junit4] 2> 443917 INFO (coreLoadExecutor-1016-thread-1-processing-n:127.0.0.1:52480_f_dlr%2Fh) [n:127.0.0.1:52480_f_dlr%2Fh c:collection1 x:collection1] o.a.s.c.c.ZkStateReader addZkWatch collection1
[junit4] 2> 443917 INFO (OverseerStateUpdate-94789
[...truncated too long message...]
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:241)
[junit4] 2> at org.apache.solr.cloud.ElectionContext.cancelElection(ElectionContext.java:85)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContextBase.cancelElection(ElectionContext.java:166)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.cancelElection(ElectionContext.java:267)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:449)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:197)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:157)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:58)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:388)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3$1.run(SolrZkClient.java:269)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:231)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 813480 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.e.j.s.ServerConnector Stopped ServerConnector@7ebf0b68{HTTP/1.1}{127.0.0.1:53914}
[junit4] 2> 813481 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@698d4fac{/f_dlr/h,null,UNAVAILABLE}
[junit4] 2> 813482 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[23A6EC34FC14F77A]) [n:127.0.0.1:53914_f_dlr%2Fh c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.ZkTestServer connecting to 127.0.0.1:34217 34217
[junit4] 2> 813683 INFO (Thread-9093) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:34217 34217
[junit4] 2> 813685 WARN (Thread-9093) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 7 /solr/aliases.json
[junit4] 2> 6 /solr/security.json
[junit4] 2> 5 /solr/configs/conf1
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 11 /solr/clusterstate.json
[junit4] 2> 4 /solr/collections/collection1/state.json
[junit4] 2> 4 /solr/collections/all_in_lir/state.json
[junit4] 2> 3 /solr/overseer_elect/election/94789660481486852-127.0.0.1:58984_f_dlr%2Fh-n_0000000000
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 11 /solr/live_nodes
[junit4] 2> 8 /solr/collections
[junit4] 2> 3 /solr/overseer/queue
[junit4] 2> 3 /solr/overseer/collection-queue-work
[junit4] 2>
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=LeaderInitiatedRecoveryOnShardRestartTest -Dtests.method=testRestartWithAllInLIR -Dtests.seed=23A6EC34FC14F77A -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=es_UY -Dtests.timezone=Indian/Cocos -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[junit4] ERROR 373s J0 | LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR <<<
[junit4] > Throwable #1: java.lang.AssertionError: There are still nodes recoverying - waited for 330 seconds
[junit4] > at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:172)
[junit4] > at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:133)
[junit4] > at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:128)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:830)
[junit4] > at org.apache.solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR(LeaderInitiatedRecoveryOnShardRestartTest.java:81)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:963)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:938)
[junit4] > at java.lang.Thread.run(Thread.java:745)Throwable #2: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=10668, name=coreZkRegister-1043-thread-2, state=RUNNABLE, group=TGRP-LeaderInitiatedRecoveryOnShardRestartTest]
[junit4] > Caused by: java.lang.AssertionError
[junit4] > at __randomizedtesting.SeedInfo.seed([23A6EC34FC14F77A]:0)
[junit4] > at org.apache.solr.cloud.ZkController.updateLeaderInitiatedRecoveryState(ZkController.java:2126)
[junit4] > at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:433)
[junit4] > at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:197)
[junit4] > at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:157)
[junit4] > at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:346)
[junit4] > at org.apache.solr.cloud.ZkController.joinElection(ZkController.java:1113)
[junit4] > at org.apache.solr.cloud.ZkController.register(ZkController.java:926)
[junit4] > at org.apache.solr.cloud.ZkController.register(ZkController.java:881)
[junit4] > at org.apache.solr.core.ZkContainer$2.run(ZkContainer.java:183)
[junit4] > at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:231)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 813692 INFO (SUITE-LeaderInitiatedRecoveryOnShardRestartTest-seed#[23A6EC34FC14F77A]-worker) [n:127.0.0.1:53914_f_dlr%2Fh c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_23A6EC34FC14F77A-001
[junit4] 2> Nov 01, 2015 11:03:27 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene54): {}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=false,coord=crazy): {}, locale=es_UY, timezone=Indian/Cocos
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_45 (64-bit)/cpus=4,threads=1,free=141532096,total=443023360
[junit4] 2> NOTE: All tests run in this JVM: [TestRealTimeGet, RankQueryTest, TestDistributedMissingSort, TestArbitraryIndexDir, ExitableDirectoryReaderTest, LeaderInitiatedRecoveryOnCommitTest, SolrRequestParserTest, TimeZoneUtilsTest, HdfsBasicDistributedZk2Test, TestRemoteStreaming, DocumentAnalysisRequestHandlerTest, CacheHeaderTest, TestSolrConfigHandler, TestRandomDVFaceting, PolyFieldTest, ParsingFieldUpdateProcessorsTest, DistributedMLTComponentTest, TestConfig, TestAtomicUpdateErrorCases, RequiredFieldsTest, SolrCoreTest, PKIAuthenticationIntegrationTest, JsonLoaderTest, ResourceLoaderTest, TestDocBasedVersionConstraints, OverseerRolesTest, TestCloudManagedSchema, TestMissingGroups, LeaderInitiatedRecoveryOnShardRestartTest]
[junit4] Completed [135/553] on J0 in 373.69s, 1 test, 1 error <<< FAILURES!
[...truncated 1359 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987: There were test failures: 553 suites (8 ignored), 2176 tests, 1 error, 31 ignored (18 assumptions) [seed: 23A6EC34FC14F77A]
Total time: 184 minutes 45 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 838 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/838/
2 tests failed.
FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test
Error Message:
Captured an uncaught exception in thread: Thread[id=44642, name=collection1, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=44642, name=collection1, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:51980/iz: collection already exists: awholynewstresscollection_collection1_0
at __randomizedtesting.SeedInfo.seed([FADE41E91FCC5B43]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1574)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1595)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:888)
FAILED: org.apache.solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR
Error Message:
Captured an uncaught exception in thread: Thread[id=5349, name=coreZkRegister-1081-thread-2, state=RUNNABLE, group=TGRP-LeaderInitiatedRecoveryOnShardRestartTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=5349, name=coreZkRegister-1081-thread-2, state=RUNNABLE, group=TGRP-LeaderInitiatedRecoveryOnShardRestartTest]
Caused by: java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([FADE41E91FCC5B43]:0)
at org.apache.solr.cloud.ZkController.updateLeaderInitiatedRecoveryState(ZkController.java:2126)
at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:433)
at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:197)
at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:157)
at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:346)
at org.apache.solr.cloud.ZkController.joinElection(ZkController.java:1113)
at org.apache.solr.cloud.ZkController.register(ZkController.java:926)
at org.apache.solr.cloud.ZkController.register(ZkController.java:881)
at org.apache.solr.core.ZkContainer$2.run(ZkContainer.java:183)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:231)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 10100 lines...]
[junit4] Suite: org.apache.solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/init-core-data-001
[junit4] 2> 379168 INFO (SUITE-LeaderInitiatedRecoveryOnShardRestartTest-seed#[FADE41E91FCC5B43]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /lsql/n
[junit4] 2> 379182 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 379185 INFO (Thread-3890) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 379186 INFO (Thread-3890) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 379285 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.ZkTestServer start zk server on port:49195
[junit4] 2> 379286 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 379286 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 379295 INFO (zkCallback-233-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@fa5904 name:ZooKeeperConnection Watcher:127.0.0.1:49195 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 379295 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 379296 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 379296 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 379299 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 379320 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 379321 INFO (zkCallback-234-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@56a9664b name:ZooKeeperConnection Watcher:127.0.0.1:49195/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 379322 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 379322 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 379322 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
[junit4] 2> 379324 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
[junit4] 2> 379325 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
[junit4] 2> 379326 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
[junit4] 2> 379327 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 379327 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 379341 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 379341 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
[junit4] 2> 379358 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 379358 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 379359 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 379359 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
[junit4] 2> 379360 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 379361 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
[junit4] 2> 379362 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 379362 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
[junit4] 2> 379363 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 379363 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 379365 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 379365 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 379367 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 379367 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 379369 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 379369 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 379371 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 379372 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
[junit4] 2> 379694 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/control-001/cores/collection1
[junit4] 2> 379695 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.e.j.s.Server jetty-9.2.13.v20150730
[junit4] 2> 379697 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@20db55db{/lsql/n,null,AVAILABLE}
[junit4] 2> 379697 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.e.j.s.ServerConnector Started ServerConnector@59f16bb9{HTTP/1.1}{127.0.0.1:54768}
[junit4] 2> 379697 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.e.j.s.Server Started @382913ms
[junit4] 2> 379697 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/tempDir-001/control/data, hostContext=/lsql/n, hostPort=54768, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/control-001/cores}
[junit4] 2> 379698 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 379698 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/control-001/'
[junit4] 2> 379698 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 379698 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 379713 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 379714 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 379719 INFO (zkCallback-235-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@721e0a44 name:ZooKeeperConnection Watcher:127.0.0.1:49195/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 379719 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 379720 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 379720 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 379721 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/control-001/solr.xml
[junit4] 2> 379725 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/control-001/cores
[junit4] 2> 379725 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.CoreContainer New CoreContainer 1540021142
[junit4] 2> 379725 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/control-001/]
[junit4] 2> 379725 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/control-001/lib
[junit4] 2> 379726 WARN (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/control-001/lib).
[junit4] 2> 379733 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 379734 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 379734 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 379734 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 379734 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:49195/solr
[junit4] 2> 379734 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 379734 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 379735 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 379736 INFO (zkCallback-237-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7061b95c name:ZooKeeperConnection Watcher:127.0.0.1:49195 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 379737 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 379737 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 379738 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 379739 INFO (zkCallback-238-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7c6cb3dc name:ZooKeeperConnection Watcher:127.0.0.1:49195/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 379739 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 379740 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
[junit4] 2> 379742 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 379744 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 379746 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 379748 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 379749 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 379751 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 379752 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 379753 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 379753 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54768_lsql%2Fn
[junit4] 2> 379754 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:54768_lsql%2Fn
[junit4] 2> 379756 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 379757 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 379758 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 379759 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94783968837107716-127.0.0.1:54768_lsql%2Fn-n_0000000000
[junit4] 2> 379759 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:54768_lsql%2Fn
[junit4] 2> 379759 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
[junit4] 2> 379760 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.Overseer Overseer (id=94783968837107716-127.0.0.1:54768_lsql%2Fn-n_0000000000) starting
[junit4] 2> 379761 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
[junit4] 2> 379766 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 379767 INFO (OverseerCollectionConfigSetProcessor-94783968837107716-127.0.0.1:54768_lsql%2Fn-n_0000000000) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
[junit4] 2> 379767 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 379767 INFO (OverseerStateUpdate-94783968837107716-127.0.0.1:54768_lsql%2Fn-n_0000000000) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 379782 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 379782 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 379782 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/control-001/cores
[junit4] 2> 379783 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/control-001/cores/collection1, collection=control_collection, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/control-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 379783 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/control-001/cores/collection1/
[junit4] 2> 379783 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 379785 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 379785 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 379788 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 379792 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4] 2> 379792 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 379793 INFO (OverseerStateUpdate-94783968837107716-127.0.0.1:54768_lsql%2Fn-n_0000000000) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:54768/lsql/n",
[junit4] 2> "node_name":"127.0.0.1:54768_lsql%2Fn",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 379793 INFO (OverseerStateUpdate-94783968837107716-127.0.0.1:54768_lsql%2Fn-n_0000000000) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:54768/lsql/n",
[junit4] 2> "node_name":"127.0.0.1:54768_lsql%2Fn",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 379794 INFO (OverseerStateUpdate-94783968837107716-127.0.0.1:54768_lsql%2Fn-n_0000000000) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
[junit4] 2> 379794 INFO (OverseerStateUpdate-94783968837107716-127.0.0.1:54768_lsql%2Fn-n_0000000000) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 379795 INFO (zkCallback-238-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 380788 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 380788 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
[junit4] 2> 380789 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 380789 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 380789 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 380789 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/control-001/cores/collection1/'
[junit4] 2> 380790 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 380790 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 380804 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 380809 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 380813 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 380821 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
[junit4] 2> 380821 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 380826 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 380915 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 380920 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 380921 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 380929 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 380931 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 380933 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 380934 WARN (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 380934 WARN (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 380934 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 380935 WARN (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 380935 WARN (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 380935 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4] 2> 380936 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 380936 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 380936 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/control-001/cores/collection1/], dataDir=[null]
[junit4] 2> 380936 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@64d74c9
[junit4] 2> 380937 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/control-001/cores/collection1/data
[junit4] 2> 380937 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/control-001/cores/collection1/data/index/
[junit4] 2> 380937 WARN (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 380937 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/control-001/cores/collection1/data/index
[junit4] 2> 380937 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@d1fe2b9
[junit4] 2> 380937 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=RawDirectoryWrapper(RAMDirectory@251aef8f lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4ce8f959),segFN=segments_1,generation=1}
[junit4] 2> 380938 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 380938 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/control-001/cores/collection1/data/
[junit4] 2> 380938 WARN (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/control-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
[junit4] 2> 380942 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 380942 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
[junit4] 2> 380942 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 380942 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 380942 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 380942 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 380942 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 380942 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 380943 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 380945 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 380945 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 380946 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 380947 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 380950 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 380950 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 380951 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 380951 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 380951 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
[junit4] 2> 380952 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
[junit4] 2> 380952 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=2, maxMergeAtOnceExplicit=6, maxMergedSegmentMB=21.3740234375, floorSegmentMB=1.0869140625, forceMergeDeletesPctAllowed=23.03199811859806, segmentsPerTier=10.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.865220202192173
[junit4] 2> 380952 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=RawDirectoryWrapper(RAMDirectory@251aef8f lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4ce8f959),segFN=segments_1,generation=1}
[junit4] 2> 380952 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 380952 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@160f8825[collection1] main
[junit4] 2> 380952 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 380953 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 380953 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 380953 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 380953 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
[junit4] 2> 380954 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 380954 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 380954 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 380954 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 380954 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 380955 INFO (searcherExecutor-1044-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@160f8825[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 380955 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
[junit4] 2> 380955 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
[junit4] 2> 380955 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
[junit4] 2> 380955 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1516543503236071424
[junit4] 2> 380957 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 2.0ms to seed version buckets with highest version 1516543503236071424
[junit4] 2> 380957 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
[junit4] 2> 380957 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 380958 INFO (coreZkRegister-1037-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:54768/lsql/n collection:control_collection shard:shard1
[junit4] 2> 380959 INFO (coreZkRegister-1037-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 380962 INFO (coreZkRegister-1037-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/94783968837107716-core_node1-n_0000000000
[junit4] 2> 380962 INFO (coreZkRegister-1037-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1
[junit4] 2> 380963 INFO (coreZkRegister-1037-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 380964 INFO (coreZkRegister-1037-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 380964 INFO (OverseerStateUpdate-94783968837107716-127.0.0.1:54768_lsql%2Fn-n_0000000000) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection"} current state version: 1
[junit4] 2> 380964 INFO (coreZkRegister-1037-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:54768/lsql/n/collection1/
[junit4] 2> 380964 INFO (coreZkRegister-1037-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 380964 INFO (coreZkRegister-1037-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:54768/lsql/n/collection1/ has no replicas
[junit4] 2> 380964 INFO (coreZkRegister-1037-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:54768/lsql/n/collection1/ shard1
[junit4] 2> 380965 INFO (coreZkRegister-1037-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 380967 INFO (coreZkRegister-1037-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
[junit4] 2> 380969 INFO (OverseerStateUpdate-94783968837107716-127.0.0.1:54768_lsql%2Fn-n_0000000000) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:54768/lsql/n",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 1
[junit4] 2> 381071 INFO (zkCallback-238-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 381120 INFO (coreZkRegister-1037-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:54768/lsql/n/collection1/ and leader is http://127.0.0.1:54768/lsql/n/collection1/
[junit4] 2> 381120 INFO (coreZkRegister-1037-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:54768/lsql/n
[junit4] 2> 381120 INFO (coreZkRegister-1037-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 381120 INFO (coreZkRegister-1037-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
[junit4] 2> 381120 INFO (coreZkRegister-1037-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 381122 INFO (OverseerStateUpdate-94783968837107716-127.0.0.1:54768_lsql%2Fn-n_0000000000) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:54768/lsql/n",
[junit4] 2> "node_name":"127.0.0.1:54768_lsql%2Fn",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 2
[junit4] 2> 381122 INFO (OverseerStateUpdate-94783968837107716-127.0.0.1:54768_lsql%2Fn-n_0000000000) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:54768/lsql/n",
[junit4] 2> "node_name":"127.0.0.1:54768_lsql%2Fn",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 381225 INFO (zkCallback-238-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 381294 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 381295 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 381296 INFO (zkCallback-240-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@643a1b36 name:ZooKeeperConnection Watcher:127.0.0.1:49195/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 381296 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 381296 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 381296 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 381298 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 381606 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/shard-1-001/cores/collection1
[junit4] 2> 381607 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/shard-1-001
[junit4] 2> 381609 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.e.j.s.Server jetty-9.2.13.v20150730
[junit4] 2> 381611 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1ccebf9d{/lsql/n,null,AVAILABLE}
[junit4] 2> 381611 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.e.j.s.ServerConnector Started ServerConnector@4921b96f{HTTP/1.1}{127.0.0.1:43086}
[junit4] 2> 381611 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.e.j.s.Server Started @384827ms
[junit4] 2> 381611 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/lsql/n, hostPort=43086, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/shard-1-001/cores}
[junit4] 2> 381615 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 381615 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/shard-1-001/'
[junit4] 2> 381615 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 381615 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 381630 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 381632 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 381633 INFO (zkCallback-241-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5fc5117d name:ZooKeeperConnection Watcher:127.0.0.1:49195/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 381633 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 381633 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 381634 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 381634 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/shard-1-001/solr.xml
[junit4] 2> 381639 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/shard-1-001/cores
[junit4] 2> 381639 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.CoreContainer New CoreContainer 1008133124
[junit4] 2> 381639 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/shard-1-001/]
[junit4] 2> 381639 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/shard-1-001/lib
[junit4] 2> 381640 WARN (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/shard-1-001/lib).
[junit4] 2> 381647 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 381648 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 381648 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 381649 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 381649 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:49195/solr
[junit4] 2> 381649 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 381649 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 381649 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 381651 INFO (zkCallback-243-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7cd58078 name:ZooKeeperConnection Watcher:127.0.0.1:49195 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 381651 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 381652 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 381653 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:43086_lsql%2Fn ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 381654 INFO (zkCallback-244-thread-1-processing-n:127.0.0.1:43086_lsql%2Fn) [n:127.0.0.1:43086_lsql%2Fn ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2e3d041 name:ZooKeeperConnection Watcher:127.0.0.1:49195/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 381654 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:43086_lsql%2Fn ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 381659 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:43086_lsql%2Fn ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 382665 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:43086_lsql%2Fn ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43086_lsql%2Fn
[junit4] 2> 382665 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:43086_lsql%2Fn ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:43086_lsql%2Fn
[junit4] 2> 382667 INFO (zkCallback-244-thread-1-processing-n:127.0.0.1:43086_lsql%2Fn) [n:127.0.0.1:43086_lsql%2Fn ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 382667 INFO (zkCallback-240-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 382667 INFO (zkCallback-238-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 382668 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:43086_lsql%2Fn ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 382669 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:43086_lsql%2Fn ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94783968837107720-127.0.0.1:43086_lsql%2Fn-n_0000000001
[junit4] 2> 382670 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:43086_lsql%2Fn ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/94783968837107716-127.0.0.1:54768_lsql%2Fn-n_0000000000 to know if I could be the leader
[junit4] 2> 382694 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:43086_lsql%2Fn ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 382694 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:43086_lsql%2Fn ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 382695 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:43086_lsql%2Fn ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/shard-1-001/cores
[junit4] 2> 382696 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:43086_lsql%2Fn ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/shard-1-001/cores/collection1, collection=collection1, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/shard-1-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 382696 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:43086_lsql%2Fn ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/shard-1-001/cores/collection1/
[junit4] 2> 382696 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:43086_lsql%2Fn ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 382697 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:43086_lsql%2Fn ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4] 2> 382697 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:43086_lsql%2Fn ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 382697 INFO (coreLoadExecutor-1054-thread-1-processing-n:127.0.0.1:43086_lsql%2Fn) [n:127.0.0.1:43086_lsql%2Fn c:collection1 x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 382697 INFO (coreLoadExecutor-1054-thread-1-processing-n:127.0.0.1:43086_lsql%2Fn) [n:127.0.0.1:43086_lsql%2Fn c:collection1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 382699 INFO (coreLoadExecutor-1054-thread-1-processing-n:127.0.0.1:43086_lsql%2Fn) [n:127.0.0.1:43086_lsql%2Fn c:collection1 x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 382699 INFO (OverseerStateUpdate-94783968837107716-127.0.0.1:54768_lsql%2Fn-n_0000000000) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:43086/lsql/n",
[junit4] 2> "node_name":"127.0.0.1:43086_lsql%2Fn",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"} current state version: 3
[junit4] 2> 382700 INFO (OverseerStateUpdate-94783968837107716-127.0.0.1:54768_lsql%2Fn-n_0000000000) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:43086/lsql/n",
[junit4] 2> "node_name":"127.0.0.1:43086_lsql%2Fn",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"}
[junit4] 2> 382700 INFO (OverseerStateUpdate-94783968837107716-127.0.0.1:54768_lsql%2Fn-n_0000000000) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
[junit4] 2> 382700 INFO (OverseerStateUpdate-94783968837107716-127.0.0.1:54768_lsql%2Fn-n_0000000000) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 382803 INFO (zkCallback-240-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 382803 INFO (zkCallback-244-thread-1-processing-n:127.0.0.1:43086_lsql%2Fn) [n:127.0.0.1:43086_lsql%2Fn ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 382803 INFO (zkCallback-238-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 383699 INFO (coreLoadExecutor-1054-thread-1-processing-n:127.0.0.1:43086_lsql%2Fn) [n:127.0.0.1:43086_lsql%2Fn c:collection1 x:collection1] o.a.s
[...truncated too long message...]
.0.0.1:51980/iz: collection already exists: awholynewstresscollection_collection0_0
[junit4] > at __randomizedtesting.SeedInfo.seed([FADE41E91FCC5B43]:0)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
[junit4] > at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1574)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1595)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:888)Throwable #5: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=44645, name=collection4, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:49270/iz: Could not find collection : awholynewstresscollection_collection4_0
[junit4] > at __randomizedtesting.SeedInfo.seed([FADE41E91FCC5B43]:0)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
[junit4] > at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:895)Throwable #6: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=44646, name=collection5, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:51980/iz: collection already exists: awholynewstresscollection_collection5_0
[junit4] > at __randomizedtesting.SeedInfo.seed([FADE41E91FCC5B43]:0)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
[junit4] > at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1574)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1595)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:888)
[junit4] 2> 1780402 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[FADE41E91FCC5B43]-worker) [n:127.0.0.1:53065_iz c:addReplicaColl s:shard1 r:core_node4 x:addReplicaColl_shard1_replica1] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene54): {other_tl1=PostingsFormat(name=Memory doPackFST= false), range_facet_l_dv=PostingsFormat(name=Memory doPackFST= true), _version_=PostingsFormat(name=Memory doPackFST= false), multiDefault=PostingsFormat(name=LuceneFixedGap), a_t=PostingsFormat(name=LuceneFixedGap), intDefault=PostingsFormat(name=Memory doPackFST= false), a_i1=PostingsFormat(name=LuceneFixedGap), id=PostingsFormat(name=Memory doPackFST= true), range_facet_i_dv=PostingsFormat(name=LuceneFixedGap), text=FST50, range_facet_l=PostingsFormat(name=LuceneFixedGap), timestamp=PostingsFormat(name=LuceneFixedGap)}, docValues:{range_facet_l_dv=DocValuesFormat(name=Asserting), range_facet_i_dv=DocValuesFormat(name=Memory), timestamp=DocValuesFormat(name=Memory)}, sim=RandomSimilarityProvider(queryNorm=false,coord=no): {}, locale=ru_RU, timezone=Europe/Kiev
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_45 (64-bit)/cpus=4,threads=1,free=156264376,total=500695040
[junit4] 2> NOTE: All tests run in this JVM: [TestLRUStatsCache, DeleteShardTest, TestTrieFacet, DocValuesMissingTest, FieldAnalysisRequestHandlerTest, TestPHPSerializedResponseWriter, HighlighterConfigTest, HdfsDirectoryFactoryTest, TestStressReorder, PluginInfoTest, FacetPivotSmallTest, TestCharFilters, BinaryUpdateRequestHandlerTest, TestQueryWrapperFilter, AnalyticsQueryTest, TestGroupingSearch, TestScoreJoinQPScore, MultiThreadedOCPTest, SampleTest, DirectUpdateHandlerOptimizeTest, HdfsNNFailoverTest, SolrCoreCheckLockOnStartupTest, DistribCursorPagingTest, StatsComponentTest, TestFieldTypeCollectionResource, HdfsBasicDistributedZkTest, TestReqParamsAPI, CoreAdminHandlerTest, CloudExitableDirectoryReaderTest, DebugComponentTest, TestHashQParserPlugin, LukeRequestHandlerTest, TestConfigSetsAPIExclusivity, TestFieldResource, SystemInfoHandlerTest, TestMiniSolrCloudClusterBase, SearchHandlerTest, SharedFSAutoReplicaFailoverUtilsTest, TestSha256AuthenticationProvider, SimpleMLTQParserTest, SuggesterTest, ClusterStateTest, RAMDirectoryFactoryTest, TestPostingsSolrHighlighter, TestBulkSchemaAPI, DocValuesMultiTest, ConcurrentDeleteAndCreateCollectionTest, BadIndexSchemaTest, TermVectorComponentDistributedTest, TestLeaderInitiatedRecoveryThread, TestDownShardTolerantSearch, UUIDFieldTest, TestFastWriter, MergeStrategyTest, TestCSVResponseWriter, DistributedFacetPivotSmallAdvancedTest, TestWriterPerf, TestCollationField, CursorMarkTest, LeaderElectionTest, TestSchemaNameResource, TestStressRecovery, TestCursorMarkWithoutUniqueKey, TestFieldSortValues, TestCustomSort, TestOverriddenPrefixQueryForCustomFieldType, TestDynamicFieldCollectionResource, DirectSolrConnectionTest, ResponseHeaderTest, TestXIncludeConfig, TestManagedSchemaDynamicFieldResource, BlockCacheTest, TestConfigReload, HLLSerializationTest, TestSearcherReuse, TestSolrQueryParser, OverseerCollectionConfigSetProcessorTest, OverseerTest, DirectUpdateHandlerTest, TestReloadAndDeleteDocs, TestBulkSchemaConcurrent, HdfsSyncSliceTest, AutoCommitTest, AsyncCallRequestStatusResponseTest, TestShardHandlerFactory, FieldMutatingUpdateProcessorTest, TestRecovery, ShowFileRequestHandlerTest, BasicDistributedZk2Test, UnloadDistributedZkTest, CollectionsAPIDistributedZkTest]
[junit4] Completed [238/553] on J2 in 412.50s, 1 test, 1 error <<< FAILURES!
[...truncated 1040 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987: There were test failures: 553 suites (8 ignored), 2176 tests, 2 errors, 31 ignored (18 assumptions) [seed: FADE41E91FCC5B43]
Total time: 192 minutes 42 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 837 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/837/
3 tests failed.
FAILED: org.apache.solr.cloud.CdcrReplicationHandlerTest.doTest
Error Message:
Captured an uncaught exception in thread: Thread[id=3516, name=RecoveryThread-source_collection_shard1_replica2, state=RUNNABLE, group=TGRP-CdcrReplicationHandlerTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=3516, name=RecoveryThread-source_collection_shard1_replica2, state=RUNNABLE, group=TGRP-CdcrReplicationHandlerTest]
Caused by: org.apache.solr.common.cloud.ZooKeeperException:
at __randomizedtesting.SeedInfo.seed([7B0BD13C5F474F3C]:0)
at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:232)
Caused by: org.apache.solr.common.SolrException: java.io.FileNotFoundException: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_7B0BD13C5F474F3C-001/jetty-001/cores/source_collection_shard1_replica2/data/tlog/tlog.0000000000000000006.1516476067262496768 (No such file or directory)
at org.apache.solr.update.CdcrTransactionLog.reopenOutputStream(CdcrTransactionLog.java:244)
at org.apache.solr.update.CdcrTransactionLog.incref(CdcrTransactionLog.java:173)
at org.apache.solr.update.UpdateLog.getRecentUpdates(UpdateLog.java:1079)
at org.apache.solr.update.UpdateLog.seedBucketsWithHighestVersion(UpdateLog.java:1579)
at org.apache.solr.update.UpdateLog.seedBucketsWithHighestVersion(UpdateLog.java:1610)
at org.apache.solr.core.SolrCore.seedVersionBuckets(SolrCore.java:877)
at org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:534)
at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:225)
Caused by: java.io.FileNotFoundException: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_7B0BD13C5F474F3C-001/jetty-001/cores/source_collection_shard1_replica2/data/tlog/tlog.0000000000000000006.1516476067262496768 (No such file or directory)
at java.io.RandomAccessFile.open0(Native Method)
at java.io.RandomAccessFile.open(RandomAccessFile.java:316)
at java.io.RandomAccessFile.<init>(RandomAccessFile.java:243)
at org.apache.solr.update.CdcrTransactionLog.reopenOutputStream(CdcrTransactionLog.java:236)
... 7 more
FAILED: org.apache.solr.handler.TestReplicationHandler.doTestReplicateAfterCoreReload
Error Message:
expected:<[{indexVersion=1446226431125,generation=2,filelist=[_0.fdt, _0.fdx, _0.fnm, _0.nvd, _0.nvm, _0.si, _0_BlockTreeOrds_0.doc, _0_BlockTreeOrds_0.tio, _0_BlockTreeOrds_0.tipo, _1.fdt, _1.fdx, _1.fnm, _1.nvd, _1.nvm, _1.si, _1_BlockTreeOrds_0.doc, _1_BlockTreeOrds_0.tio, _1_BlockTreeOrds_0.tipo, _2.fdt, _2.fdx, _2.fnm, _2.nvd, _2.nvm, _2.si, _2_BlockTreeOrds_0.doc, _2_BlockTreeOrds_0.tio, _2_BlockTreeOrds_0.tipo, _3.fdt, _3.fdx, _3.fnm, _3.nvd, _3.nvm, _3.si, _3_BlockTreeOrds_0.doc, _3_BlockTreeOrds_0.tio, _3_BlockTreeOrds_0.tipo, _4.fdt, _4.fdx, _4.fnm, _4.nvd, _4.nvm, _4.si, _4_BlockTreeOrds_0.doc, _4_BlockTreeOrds_0.tio, _4_BlockTreeOrds_0.tipo, _5.fdt, _5.fdx, _5.fnm, _5.nvd, _5.nvm, _5.si, _5_BlockTreeOrds_0.doc, _5_BlockTreeOrds_0.tio, _5_BlockTreeOrds_0.tipo, segments_2]}]> but was:<[{indexVersion=1446226431125,generation=2,filelist=[_0.fdt, _0.fdx, _0.fnm, _0.nvd, _0.nvm, _0.si, _0_BlockTreeOrds_0.doc, _0_BlockTreeOrds_0.tio, _0_BlockTreeOrds_0.tipo, _1.fdt, _1.fdx, _1.fnm, _1.nvd, _1.nvm, _1.si, _1_BlockTreeOrds_0.doc, _1_BlockTreeOrds_0.tio, _1_BlockTreeOrds_0.tipo, _2.fdt, _2.fdx, _2.fnm, _2.nvd, _2.nvm, _2.si, _2_BlockTreeOrds_0.doc, _2_BlockTreeOrds_0.tio, _2_BlockTreeOrds_0.tipo, _3.fdt, _3.fdx, _3.fnm, _3.nvd, _3.nvm, _3.si, _3_BlockTreeOrds_0.doc, _3_BlockTreeOrds_0.tio, _3_BlockTreeOrds_0.tipo, _4.fdt, _4.fdx, _4.fnm, _4.nvd, _4.nvm, _4.si, _4_BlockTreeOrds_0.doc, _4_BlockTreeOrds_0.tio, _4_BlockTreeOrds_0.tipo, _5.fdt, _5.fdx, _5.fnm, _5.nvd, _5.nvm, _5.si, _5_BlockTreeOrds_0.doc, _5_BlockTreeOrds_0.tio, _5_BlockTreeOrds_0.tipo, segments_2]}, {indexVersion=1446226431125,generation=3,filelist=[_0.fdt, _0.fdx, _0.fnm, _0.nvd, _0.nvm, _0.si, _0_BlockTreeOrds_0.doc, _0_BlockTreeOrds_0.tio, _0_BlockTreeOrds_0.tipo, _3.fdt, _3.fdx, _3.fnm, _3.nvd, _3.nvm, _3.si, _3_BlockTreeOrds_0.doc, _3_BlockTreeOrds_0.tio, _3_BlockTreeOrds_0.tipo, _5.fdt, _5.fdx, _5.fnm, _5.nvd, _5.nvm, _5.si, _5_BlockTreeOrds_0.doc, _5_BlockTreeOrds_0.tio, _5_BlockTreeOrds_0.tipo, _6.cfe, _6.cfs, _6.si, segments_3]}]>
Stack Trace:
java.lang.AssertionError: expected:<[{indexVersion=1446226431125,generation=2,filelist=[_0.fdt, _0.fdx, _0.fnm, _0.nvd, _0.nvm, _0.si, _0_BlockTreeOrds_0.doc, _0_BlockTreeOrds_0.tio, _0_BlockTreeOrds_0.tipo, _1.fdt, _1.fdx, _1.fnm, _1.nvd, _1.nvm, _1.si, _1_BlockTreeOrds_0.doc, _1_BlockTreeOrds_0.tio, _1_BlockTreeOrds_0.tipo, _2.fdt, _2.fdx, _2.fnm, _2.nvd, _2.nvm, _2.si, _2_BlockTreeOrds_0.doc, _2_BlockTreeOrds_0.tio, _2_BlockTreeOrds_0.tipo, _3.fdt, _3.fdx, _3.fnm, _3.nvd, _3.nvm, _3.si, _3_BlockTreeOrds_0.doc, _3_BlockTreeOrds_0.tio, _3_BlockTreeOrds_0.tipo, _4.fdt, _4.fdx, _4.fnm, _4.nvd, _4.nvm, _4.si, _4_BlockTreeOrds_0.doc, _4_BlockTreeOrds_0.tio, _4_BlockTreeOrds_0.tipo, _5.fdt, _5.fdx, _5.fnm, _5.nvd, _5.nvm, _5.si, _5_BlockTreeOrds_0.doc, _5_BlockTreeOrds_0.tio, _5_BlockTreeOrds_0.tipo, segments_2]}]> but was:<[{indexVersion=1446226431125,generation=2,filelist=[_0.fdt, _0.fdx, _0.fnm, _0.nvd, _0.nvm, _0.si, _0_BlockTreeOrds_0.doc, _0_BlockTreeOrds_0.tio, _0_BlockTreeOrds_0.tipo, _1.fdt, _1.fdx, _1.fnm, _1.nvd, _1.nvm, _1.si, _1_BlockTreeOrds_0.doc, _1_BlockTreeOrds_0.tio, _1_BlockTreeOrds_0.tipo, _2.fdt, _2.fdx, _2.fnm, _2.nvd, _2.nvm, _2.si, _2_BlockTreeOrds_0.doc, _2_BlockTreeOrds_0.tio, _2_BlockTreeOrds_0.tipo, _3.fdt, _3.fdx, _3.fnm, _3.nvd, _3.nvm, _3.si, _3_BlockTreeOrds_0.doc, _3_BlockTreeOrds_0.tio, _3_BlockTreeOrds_0.tipo, _4.fdt, _4.fdx, _4.fnm, _4.nvd, _4.nvm, _4.si, _4_BlockTreeOrds_0.doc, _4_BlockTreeOrds_0.tio, _4_BlockTreeOrds_0.tipo, _5.fdt, _5.fdx, _5.fnm, _5.nvd, _5.nvm, _5.si, _5_BlockTreeOrds_0.doc, _5_BlockTreeOrds_0.tio, _5_BlockTreeOrds_0.tipo, segments_2]}, {indexVersion=1446226431125,generation=3,filelist=[_0.fdt, _0.fdx, _0.fnm, _0.nvd, _0.nvm, _0.si, _0_BlockTreeOrds_0.doc, _0_BlockTreeOrds_0.tio, _0_BlockTreeOrds_0.tipo, _3.fdt, _3.fdx, _3.fnm, _3.nvd, _3.nvm, _3.si, _3_BlockTreeOrds_0.doc, _3_BlockTreeOrds_0.tio, _3_BlockTreeOrds_0.tipo, _5.fdt, _5.fdx, _5.fnm, _5.nvd, _5.nvm, _5.si, _5_BlockTreeOrds_0.doc, _5_BlockTreeOrds_0.tio, _5_BlockTreeOrds_0.tipo, _6.cfe, _6.cfs, _6.si, segments_3]}]>
at __randomizedtesting.SeedInfo.seed([7B0BD13C5F474F3C:5EDCCA0C2F0F413F]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:147)
at org.apache.solr.handler.TestReplicationHandler.doTestReplicateAfterCoreReload(TestReplicationHandler.java:1138)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1660)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:866)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:902)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:875)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:777)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:811)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:822)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR
Error Message:
Captured an uncaught exception in thread: Thread[id=9715, name=coreZkRegister-1572-thread-1, state=RUNNABLE, group=TGRP-LeaderInitiatedRecoveryOnShardRestartTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=9715, name=coreZkRegister-1572-thread-1, state=RUNNABLE, group=TGRP-LeaderInitiatedRecoveryOnShardRestartTest]
Caused by: java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([7B0BD13C5F474F3C]:0)
at org.apache.solr.cloud.ZkController.updateLeaderInitiatedRecoveryState(ZkController.java:2126)
at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:433)
at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:197)
at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:157)
at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:346)
at org.apache.solr.cloud.ZkController.joinElection(ZkController.java:1113)
at org.apache.solr.cloud.ZkController.register(ZkController.java:926)
at org.apache.solr.cloud.ZkController.register(ZkController.java:881)
at org.apache.solr.core.ZkContainer$2.run(ZkContainer.java:183)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:231)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 10147 lines...]
[junit4] Suite: org.apache.solr.cloud.CdcrReplicationHandlerTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_7B0BD13C5F474F3C-001/init-core-data-001
[junit4] 2> 307425 INFO (SUITE-CdcrReplicationHandlerTest-seed#[7B0BD13C5F474F3C]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false)
[junit4] 2> 307425 INFO (SUITE-CdcrReplicationHandlerTest-seed#[7B0BD13C5F474F3C]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /ng_tlq/yp
[junit4] 2> 307428 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 307428 INFO (Thread-2352) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 307429 INFO (Thread-2352) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 307529 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.ZkTestServer start zk server on port:58274
[junit4] 2> 307529 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 307530 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 307535 INFO (zkCallback-140-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7b4adee4 name:ZooKeeperConnection Watcher:127.0.0.1:58274 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 307535 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 307536 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 307536 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 307540 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 307540 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 307542 INFO (zkCallback-141-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1f4e0c4c name:ZooKeeperConnection Watcher:127.0.0.1:58274/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 307542 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 307542 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 307543 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
[junit4] 2> 307545 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
[junit4] 2> 307547 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
[junit4] 2> 307549 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
[junit4] 2> 307551 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-cdcr.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 307551 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 307554 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 307554 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
[junit4] 2> 307556 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 307556 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 307558 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 307558 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
[junit4] 2> 307560 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 307560 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
[junit4] 2> 307562 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 307562 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
[junit4] 2> 307564 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 307564 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 307566 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 307566 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 307569 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 307570 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 307573 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 307573 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 307576 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 307576 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
[junit4] 2> 307579 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 307580 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 307585 INFO (zkCallback-142-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@54c56b81 name:ZooKeeperConnection Watcher:127.0.0.1:58274/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 307585 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 307585 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 307588 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.SolrTestCaseJ4 ###Starting doTest
[junit4] 2> 307974 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_7B0BD13C5F474F3C-001/jetty-001/cores/collection1
[junit4] 2> 307996 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.e.j.s.Server jetty-9.2.13.v20150730
[junit4] 2> 308000 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@17b40073{/ng_tlq/yp,null,AVAILABLE}
[junit4] 2> 308083 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.e.j.s.ServerConnector Started ServerConnector@3f97b5e{SSL-http/1.1}{127.0.0.1:60881}
[junit4] 2> 308083 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.e.j.s.Server Started @310984ms
[junit4] 2> 308083 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {shards=shard1, hostContext=/ng_tlq/yp, hostPort=60881, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_7B0BD13C5F474F3C-001/jetty-001/cores}
[junit4] 2> 308084 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 308084 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_7B0BD13C5F474F3C-001/jetty-001/'
[junit4] 2> 308084 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 308084 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 308102 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 308103 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 308111 INFO (zkCallback-143-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@24cb423c name:ZooKeeperConnection Watcher:127.0.0.1:58274/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 308111 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 308111 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 308113 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 308113 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_7B0BD13C5F474F3C-001/jetty-001/solr.xml
[junit4] 2> 308121 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_7B0BD13C5F474F3C-001/jetty-001/cores
[junit4] 2> 308121 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.CoreContainer New CoreContainer 611436622
[junit4] 2> 308121 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_7B0BD13C5F474F3C-001/jetty-001/]
[junit4] 2> 308121 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_7B0BD13C5F474F3C-001/jetty-001/lib
[junit4] 2> 308121 WARN (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_7B0BD13C5F474F3C-001/jetty-001/lib).
[junit4] 2> 308141 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 308144 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 308147 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 308147 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 308147 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:58274/solr
[junit4] 2> 308147 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 308147 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 308148 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 308153 INFO (zkCallback-145-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@75c0f229 name:ZooKeeperConnection Watcher:127.0.0.1:58274 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 308153 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 308154 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 308157 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [n:127.0.0.1:60881_ng_tlq%2Fyp ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 308161 INFO (zkCallback-146-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5061ca7f name:ZooKeeperConnection Watcher:127.0.0.1:58274/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 308161 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [n:127.0.0.1:60881_ng_tlq%2Fyp ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 308163 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [n:127.0.0.1:60881_ng_tlq%2Fyp ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
[junit4] 2> 308165 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [n:127.0.0.1:60881_ng_tlq%2Fyp ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 308168 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [n:127.0.0.1:60881_ng_tlq%2Fyp ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 308170 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [n:127.0.0.1:60881_ng_tlq%2Fyp ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 308173 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [n:127.0.0.1:60881_ng_tlq%2Fyp ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 308176 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [n:127.0.0.1:60881_ng_tlq%2Fyp ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 308178 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [n:127.0.0.1:60881_ng_tlq%2Fyp ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 308180 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [n:127.0.0.1:60881_ng_tlq%2Fyp ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 308181 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [n:127.0.0.1:60881_ng_tlq%2Fyp ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 308183 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [n:127.0.0.1:60881_ng_tlq%2Fyp ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60881_ng_tlq%2Fyp
[junit4] 2> 308183 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [n:127.0.0.1:60881_ng_tlq%2Fyp ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:60881_ng_tlq%2Fyp
[junit4] 2> 308186 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [n:127.0.0.1:60881_ng_tlq%2Fyp ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 308187 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [n:127.0.0.1:60881_ng_tlq%2Fyp ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 308189 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [n:127.0.0.1:60881_ng_tlq%2Fyp ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 308190 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [n:127.0.0.1:60881_ng_tlq%2Fyp ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94779750034046981-127.0.0.1:60881_ng_tlq%2Fyp-n_0000000000
[junit4] 2> 308191 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [n:127.0.0.1:60881_ng_tlq%2Fyp ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:60881_ng_tlq%2Fyp
[junit4] 2> 308191 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [n:127.0.0.1:60881_ng_tlq%2Fyp ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
[junit4] 2> 308192 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [n:127.0.0.1:60881_ng_tlq%2Fyp ] o.a.s.c.Overseer Overseer (id=94779750034046981-127.0.0.1:60881_ng_tlq%2Fyp-n_0000000000) starting
[junit4] 2> 308195 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [n:127.0.0.1:60881_ng_tlq%2Fyp ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
[junit4] 2> 308201 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [n:127.0.0.1:60881_ng_tlq%2Fyp ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 308201 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [n:127.0.0.1:60881_ng_tlq%2Fyp ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 308201 INFO (OverseerCollectionConfigSetProcessor-94779750034046981-127.0.0.1:60881_ng_tlq%2Fyp-n_0000000000) [n:127.0.0.1:60881_ng_tlq%2Fyp ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
[junit4] 2> 308202 INFO (OverseerStateUpdate-94779750034046981-127.0.0.1:60881_ng_tlq%2Fyp-n_0000000000) [n:127.0.0.1:60881_ng_tlq%2Fyp ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 308220 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [n:127.0.0.1:60881_ng_tlq%2Fyp ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 308220 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [n:127.0.0.1:60881_ng_tlq%2Fyp ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 308221 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [n:127.0.0.1:60881_ng_tlq%2Fyp ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_7B0BD13C5F474F3C-001/jetty-001/cores
[junit4] 2> 308222 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [n:127.0.0.1:60881_ng_tlq%2Fyp ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_7B0BD13C5F474F3C-001/jetty-001/cores/collection1, collection=tmp_collection, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_7B0BD13C5F474F3C-001/jetty-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 308222 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [n:127.0.0.1:60881_ng_tlq%2Fyp ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_7B0BD13C5F474F3C-001/jetty-001/cores/collection1/
[junit4] 2> 308222 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [n:127.0.0.1:60881_ng_tlq%2Fyp ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 308223 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [n:127.0.0.1:60881_ng_tlq%2Fyp ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4] 2> 308223 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [n:127.0.0.1:60881_ng_tlq%2Fyp ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 308223 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 308223 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 308225 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 308225 INFO (OverseerStateUpdate-94779750034046981-127.0.0.1:60881_ng_tlq%2Fyp-n_0000000000) [n:127.0.0.1:60881_ng_tlq%2Fyp ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:60881/ng_tlq/yp",
[junit4] 2> "node_name":"127.0.0.1:60881_ng_tlq%2Fyp",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"tmp_collection",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 308226 INFO (OverseerStateUpdate-94779750034046981-127.0.0.1:60881_ng_tlq%2Fyp-n_0000000000) [n:127.0.0.1:60881_ng_tlq%2Fyp ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:60881/ng_tlq/yp",
[junit4] 2> "node_name":"127.0.0.1:60881_ng_tlq%2Fyp",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"tmp_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 308226 INFO (OverseerStateUpdate-94779750034046981-127.0.0.1:60881_ng_tlq%2Fyp-n_0000000000) [n:127.0.0.1:60881_ng_tlq%2Fyp ] o.a.s.c.o.ClusterStateMutator building a new cName: tmp_collection
[junit4] 2> 308226 INFO (OverseerStateUpdate-94779750034046981-127.0.0.1:60881_ng_tlq%2Fyp-n_0000000000) [n:127.0.0.1:60881_ng_tlq%2Fyp ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 308227 INFO (zkCallback-146-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 309225 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 309225 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection x:collection1] o.a.s.c.ZkController Check for collection zkNode:tmp_collection
[junit4] 2> 309226 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection x:collection1] o.a.s.c.ZkController Creating collection in ZooKeeper:tmp_collection
[junit4] 2> 309226 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection x:collection1] o.a.s.c.ZkController Looking for collection configName
[junit4] 2> 309227 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection x:collection1] o.a.s.c.ZkController Only one config set found in zk - using it:conf1
[junit4] 2> 309228 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/tmp_collection
[junit4] 2> 309230 INFO (zkCallback-146-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp ] o.a.s.c.c.ZkStateReader A collections change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections, has occurred - updating...
[junit4] 2> 309230 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/tmp_collection
[junit4] 2> 309231 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection x:collection1] o.a.s.c.c.ZkStateReader path=/collections/tmp_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 309231 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_7B0BD13C5F474F3C-001/jetty-001/cores/collection1/'
[junit4] 2> 309231 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 309231 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 309249 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 309255 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 309258 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 309265 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
[junit4] 2> 309267 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 309271 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 309357 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 309358 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 309359 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 309362 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 309386 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4] 2> 309386 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection tmp_collection
[junit4] 2> 309386 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore solr.StandardDirectoryFactory
[junit4] 2> 309393 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_7B0BD13C5F474F3C-001/jetty-001/cores/collection1/], dataDir=[null]
[junit4] 2> 309393 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@74b9fdd0
[junit4] 2> 309394 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_7B0BD13C5F474F3C-001/jetty-001/cores/collection1/data
[junit4] 2> 309394 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_7B0BD13C5F474F3C-001/jetty-001/cores/collection1/data/index/
[junit4] 2> 309394 WARN (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_7B0BD13C5F474F3C-001/jetty-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 309395 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_7B0BD13C5F474F3C-001/jetty-001/cores/collection1/data/index
[junit4] 2> 309395 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=33, maxMergeAtOnceExplicit=26, maxMergedSegmentMB=31.65625, floorSegmentMB=1.341796875, forceMergeDeletesPctAllowed=11.370204429928904, segmentsPerTier=26.0, maxCFSSegmentSizeMB=0.244140625, noCFSRatio=1.0
[junit4] 2> 309401 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_7B0BD13C5F474F3C-001/jetty-001/cores/collection1/data/index,segFN=segments_1,generation=1}
[junit4] 2> 309401 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 309402 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_7B0BD13C5F474F3C-001/jetty-001/cores/collection1/data/
[junit4] 2> 309406 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "cdcr-processor-chain"
[junit4] 2> 309422 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 309428 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 309429 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 309430 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 309431 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 309443 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/cdcr,/update,/admin/file
[junit4] 2> 309443 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 309453 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.CdcrUpdateLog
[junit4] 2> 309453 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 309454 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
[junit4] 2> 309454 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
[junit4] 2> 309456 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=710886250, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 309457 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_7B0BD13C5F474F3C-001/jetty-001/cores/collection1/data/index,segFN=segments_1,generation=1}
[junit4] 2> 309457 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 309457 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@35686949[collection1] main
[junit4] 2> 309457 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/tmp_collection
[junit4] 2> 309458 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/tmp_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 309458 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 309458 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 309458 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
[junit4] 2> 309459 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 309459 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 309459 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 309459 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 309459 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 309464 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/tmp_collection/cdcr/state
[junit4] 2> 309468 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.CdcrBufferStateManager Created znode /collections/tmp_collection/cdcr/state/buffer
[junit4] 2> 309474 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.CdcrProcessStateManager Created znode /collections/tmp_collection/cdcr/state/process
[junit4] 2> 309494 INFO (searcherExecutor-593-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp x:collection1 s:shard1 c:tmp_collection r:core_node1) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@35686949[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 309494 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
[junit4] 2> 309494 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
[junit4] 2> 309494 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
[junit4] 2> 309494 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1516476002707963904
[junit4] 2> 309496 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 2.0ms to seed version buckets with highest version 1516476002707963904
[junit4] 2> 309496 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
[junit4] 2> 309497 INFO (coreLoadExecutor-592-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 309497 INFO (coreZkRegister-586-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp x:collection1 s:shard1 c:tmp_collection r:core_node1) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:https://127.0.0.1:60881/ng_tlq/yp collection:tmp_collection shard:shard1
[junit4] 2> 309498 INFO (coreZkRegister-586-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp x:collection1 s:shard1 c:tmp_collection r:core_node1) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/tmp_collection/leader_elect/shard1/election
[junit4] 2> 309505 INFO (coreZkRegister-586-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp x:collection1 s:shard1 c:tmp_collection r:core_node1) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/tmp_collection/leader_elect/shard1/election/94779750034046981-core_node1-n_0000000000
[junit4] 2> 309505 INFO (coreZkRegister-586-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp x:collection1 s:shard1 c:tmp_collection r:core_node1) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1
[junit4] 2> 309507 INFO (coreZkRegister-586-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp x:collection1 s:shard1 c:tmp_collection r:core_node1) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 309507 INFO (coreZkRegister-586-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp x:collection1 s:shard1 c:tmp_collection r:core_node1) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 309507 INFO (coreZkRegister-586-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp x:collection1 s:shard1 c:tmp_collection r:core_node1) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:60881/ng_tlq/yp/collection1/
[junit4] 2> 309507 INFO (coreZkRegister-586-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp x:collection1 s:shard1 c:tmp_collection r:core_node1) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 309507 INFO (OverseerStateUpdate-94779750034046981-127.0.0.1:60881_ng_tlq%2Fyp-n_0000000000) [n:127.0.0.1:60881_ng_tlq%2Fyp ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"tmp_collection"} current state version: 1
[junit4] 2> 309507 INFO (coreZkRegister-586-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp x:collection1 s:shard1 c:tmp_collection r:core_node1) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy https://127.0.0.1:60881/ng_tlq/yp/collection1/ has no replicas
[junit4] 2> 309507 INFO (coreZkRegister-586-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp x:collection1 s:shard1 c:tmp_collection r:core_node1) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:60881/ng_tlq/yp/collection1/ shard1
[junit4] 2> 309508 INFO (coreZkRegister-586-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp x:collection1 s:shard1 c:tmp_collection r:core_node1) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/tmp_collection/leaders/shard1
[junit4] 2> 309513 INFO (coreZkRegister-586-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp x:collection1 s:shard1 c:tmp_collection r:core_node1) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
[junit4] 2> 309514 INFO (zkCallback-146-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp ] o.a.s.h.CdcrProcessStateManager Received new leader state @ tmp_collection:shard1
[junit4] 2> 309517 INFO (OverseerStateUpdate-94779750034046981-127.0.0.1:60881_ng_tlq%2Fyp-n_0000000000) [n:127.0.0.1:60881_ng_tlq%2Fyp ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"tmp_collection",
[junit4] 2> "base_url":"https://127.0.0.1:60881/ng_tlq/yp",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 1
[junit4] 2> 309621 INFO (zkCallback-146-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 309669 INFO (coreZkRegister-586-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp x:collection1 s:shard1 c:tmp_collection r:core_node1) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are https://127.0.0.1:60881/ng_tlq/yp/collection1/ and leader is https://127.0.0.1:60881/ng_tlq/yp/collection1/
[junit4] 2> 309669 INFO (coreZkRegister-586-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp x:collection1 s:shard1 c:tmp_collection r:core_node1) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:60881/ng_tlq/yp
[junit4] 2> 309669 INFO (coreZkRegister-586-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp x:collection1 s:shard1 c:tmp_collection r:core_node1) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 309669 INFO (coreZkRegister-586-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp x:collection1 s:shard1 c:tmp_collection r:core_node1) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
[junit4] 2> 309669 INFO (coreZkRegister-586-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp x:collection1 s:shard1 c:tmp_collection r:core_node1) [n:127.0.0.1:60881_ng_tlq%2Fyp c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 309672 INFO (OverseerStateUpdate-94779750034046981-127.0.0.1:60881_ng_tlq%2Fyp-n_0000000000) [n:127.0.0.1:60881_ng_tlq%2Fyp ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:60881/ng_tlq/yp",
[junit4] 2> "node_name":"127.0.0.1:60881_ng_tlq%2Fyp",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"tmp_collection",
[junit4] 2> "operation":"state"} current state version: 2
[junit4] 2> 309674 INFO (OverseerStateUpdate-94779750034046981-127.0.0.1:60881_ng_tlq%2Fyp-n_0000000000) [n:127.0.0.1:60881_ng_tlq%2Fyp ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:60881/ng_tlq/yp",
[junit4] 2> "node_name":"127.0.0.1:60881_ng_tlq%2Fyp",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"tmp_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 309777 INFO (zkCallback-146-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 310118 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_7B0BD13C5F474F3C-001/jetty-002/cores/collection1
[junit4] 2> 310120 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.e.j.s.Server jetty-9.2.13.v20150730
[junit4] 2> 310122 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@45560516{/ng_tlq/yp,null,AVAILABLE}
[junit4] 2> 310132 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.e.j.s.ServerConnector Started ServerConnector@5275d3dc{SSL-http/1.1}{127.0.0.1:45874}
[junit4] 2> 310132 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.e.j.s.Server Started @313033ms
[junit4] 2> 310132 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {shards=shard2, hostContext=/ng_tlq/yp, hostPort=45874, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_7B0BD13C5F474F3C-001/jetty-002/cores}
[junit4] 2> 310132 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 310133 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_7B0BD13C5F474F3C-001/jetty-002/'
[junit4] 2> 310133 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 310133 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 310151 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 310152 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 310154 INFO (zkCallback-147-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@214bbc35 name:ZooKeeperConnection Watcher:127.0.0.1:58274/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 310154 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 310155 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 310160 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 310160 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_7B0BD13C5F474F3C-001/jetty-002/solr.xml
[junit4] 2> 310166 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_7B0BD13C5F474F3C-001/jetty-002/cores
[junit4] 2> 310166 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.CoreContainer New CoreContainer 412693348
[junit4] 2> 310166 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_7B0BD13C5F474F3C-001/jetty-002/]
[junit4] 2> 310166 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_7B0BD13C5F474F3C-001/jetty-002/lib
[junit4] 2> 310167 WARN (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_7B0BD13C5F474F3C-001/jetty-002/lib).
[junit4] 2> 310176 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 310179 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 310181 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 310181 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 310181 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:58274/solr
[junit4] 2> 310181 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 310181 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 310181 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 310184 INFO (zkCallback-149-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@70f38996 name:ZooKeeperConnection Watcher:127.0.0.1:58274 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 310185 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 310186 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 310190 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [n:127.0.0.1:45874_ng_tlq%2Fyp ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 310196 INFO (zkCallback-150-thread-1-processing-n:127.0.0.1:45874_ng_tlq%2Fyp) [n:127.0.0.1:45874_ng_tlq%2Fyp ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@76fa1c4f name:ZooKeeperConnection Watcher:127.0.0.1:58274/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 310196 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [n:127.0.0.1:45874_ng_tlq%2Fyp ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 310202 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [n:127.0.0.1:45874_ng_tlq%2Fyp ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 311209 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [n:127.0.0.1:45874_ng_tlq%2Fyp ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45874_ng_tlq%2Fyp
[junit4] 2> 311209 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [n:127.0.0.1:45874_ng_tlq%2Fyp ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:45874_ng_tlq%2Fyp
[junit4] 2> 311210 INFO (zkCallback-146-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 311210 INFO (zkCallback-150-thread-1-processing-n:127.0.0.1:45874_ng_tlq%2Fyp) [n:127.0.0.1:45874_ng_tlq%2Fyp ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 311212 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [n:127.0.0.1:45874_ng_tlq%2Fyp ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 311212 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [n:127.0.0.1:45874_ng_tlq%2Fyp ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94779750034046984-127.0.0.1:45874_ng_tlq%2Fyp-n_0000000001
[junit4] 2> 311213 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [n:127.0.0.1:45874_ng_tlq%2Fyp ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/94779750034046981-127.0.0.1:60881_ng_tlq%2Fyp-n_0000000000 to know if I could be the leader
[junit4] 2> 311226 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [n:127.0.0.1:45874_ng_tlq%2Fyp ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 311226 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [n:127.0.0.1:45874_ng_tlq%2Fyp ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 311227 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [n:127.0.0.1:45874_ng_tlq%2Fyp ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_7B0BD13C5F474F3C-001/jetty-002/cores
[junit4] 2> 311227 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [n:127.0.0.1:45874_ng_tlq%2Fyp ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_7B0BD13C5F474F3C-001/jetty-002/cores/collection1, collection=tmp_collection, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_7B0BD13C5F474F3C-001/jetty-002/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 311227 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [n:127.0.0.1:45874_ng_tlq%2Fyp ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_7B0BD13C5F474F3C-001/jetty-002/cores/collection1/
[junit4] 2> 311228 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [n:127.0.0.1:45874_ng_tlq%2Fyp ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 311229 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [n:127.0.0.1:45874_ng_tlq%2Fyp ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4] 2> 311229 INFO (TEST-CdcrReplicationHandlerTest.doTest-seed#[7B0BD13C5F474F3C]) [n:127.0.0.1:45874_ng_tlq%2Fyp ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 311229 INFO (coreLoadExecutor-604-thread-1-processing-n:127.0.0.1:45874_ng_tlq%2Fyp) [n:127.0.0.1:45874_ng_tlq%2Fyp c:tmp_collection x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 311230 INFO (coreLoadExecutor-604-thread-1-processing-n:127.0.0.1:45874_ng_tlq%2Fyp) [n:127.0.0.1:45874_ng_tlq%2Fyp c:tmp_collection x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 311230 INFO (coreLoadExecutor-604-thread-1-processing-n:127.0.0.1:45874_ng_tlq%2Fyp) [n:127.0.0.1:45874_ng_tlq%2Fyp c:tmp_collection x:collection1] o.a.s.c.ZkController Registering watch for collection tmp_collection
[junit4] 2> 311231 INFO (coreLoadExecutor-604-thread-1-processing-n:127.0.0.1:45874_ng_tlq%2Fyp) [n:127.0.0.1:45874_ng_tlq%2Fyp c:tmp_collection x:collection1] o.a.s.c.c.ZkStateReader addZkWatch tmp_collection
[junit4] 2> 311231 INFO (OverseerStateUpdate-94779750034046981-127.0.0.1:60881_ng_tlq%2Fyp-n_0000000000) [n:127.0.0.1:60881_ng_tlq%2Fyp ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:45874/ng_tlq/yp",
[junit4] 2> "node_name":"127.0.0.1:45874_ng_tlq%2Fyp",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"tmp_collection",
[junit4] 2> "operation":"state"} current state version: 3
[junit4] 2> 311231 INFO (coreLoadExecutor-604-thread-1-processing-n:127.0.0.1:45874_ng_tlq%2Fyp) [n:127.0.0.1:45874_ng_tlq%2Fyp c:tmp_collection x:collection1] o.a.s.c.c.ZkStateReader Deleting data for tmp_collection
[junit4] 2> 311232 INFO (OverseerStateUpdate-94779750034046981-127.0.0.1:60881_ng_tlq%2Fyp-n_0000000000) [n:127.0.0.1:60881_ng_tlq%2Fyp ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:45874/ng_tlq/yp",
[junit4] 2> "node_name":"127.0.0.1:45874_ng_tlq%2Fyp",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"tmp_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 311232 INFO (OverseerStateUpdate-94779750034046981-127.0.0.1:60881_ng_tlq%2Fyp-n_0000000000) [n:127.0.0.1:60881_ng_tlq%2Fyp ] o.a.s.c.o.ReplicaMutator Collection already exists with numShards=1
[junit4] 2> 311232 INFO (OverseerStateUpdate-94779750034046981-127.0.0.1:60881_ng_tlq%2Fyp-n_0000000000) [n:127.0.0.1:60881_ng_tlq%2Fyp ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 311234 INFO (coreLoadExecutor-604-thread-1-processing-n:127.0.0.1:45874_ng_tlq%2Fyp) [n:127.0.0.1:45874_ng_tlq%2Fyp c:tmp_collection x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 311334 INFO (zkCallback-150-thread-1-processing-n:127.0.0.1:45874_ng_tlq%2Fyp) [n:127.0.0.1:45874_ng_tlq%2Fyp ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 311334 INFO (zkCallback-146-thread-1-processing-n:127.0.0.1:60881_ng_tlq%2Fyp) [n:127.0.0.1:60881_ng_tlq%2Fyp ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 312234 INFO (coreLoadExecutor-604-thread-1-processing-n:127.0.0.1:45874_ng_tlq%2Fyp) [n:127.0.0.1:45874_ng_tlq%2Fyp c:tmp_collection x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 312235 INFO (coreLoadExecutor-604-thread-1-processing-n:127.0.0.1:45874_ng_tlq%2Fyp) [n:127.0.0.1:45874_ng_tlq%2Fyp c:tmp_collection x:collection1] o.a.s.c.ZkController Check for collection zkNode:tmp_collection
[junit4] 2> 312236 INFO (coreLoadExecutor-604-thread-1-processing-n:127.0.0.1:45874_ng_tlq%2Fyp) [n:127.0.0.1:45874_ng_tlq%2Fyp c:tmp_collection x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 312236 INFO (coreLoadExecutor-604-thread-1-processing-n:127.0.0.1:45874_ng_tlq%2Fyp) [n:127.0.0.1:45874_ng_tlq%2Fyp c:tmp_collection x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/tmp_collection
[junit4] 2> 312236 INFO (coreLoadExecutor-604-thread-1-processing-n:127.0.0.1:45874_ng_tlq%2Fyp) [n:127.0.0.1:45874_ng_tlq%2Fyp c:tmp_collection x:collection1] o.a.s.c.c.ZkStateReader path=/collections/tmp_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 312237 INFO (coreLoadExecutor-604-thread-1-processing-n:127.0.0.1:45874_ng_tlq%2Fyp) [n:127.0.0.1:45874_ng_tlq%2Fyp c:tmp_collection x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_7B0BD13C5F474F3C-001/jetty-002/cores/collection1/'
[junit4] 2> 312237 INFO (coreLoadExecutor-604-thread-1-processing-n:127.0.0.1:45874_ng_tlq%2Fyp) [n:127.0.0.1:45874_ng_tlq%2Fyp c:tmp_collection x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 312237 INFO (coreLoadExecutor-604-thread-1-processing-n:127.0.0.1:45874_ng_tlq%2Fyp) [n:127.0.0.1:45874_ng_tlq%2Fyp c:tmp_collection x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 312256 INFO (coreLoadExecutor-604-thread-1-processing-n:127.0.0.1:45874_ng_tlq%2Fyp) [n:127.0.0.1:45874_ng_tlq%2Fyp c:tmp_collection x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 312263 INFO (coreLoadExecutor-604-thread-1-processing-n:127.0.0.1:45874_ng_tlq%2Fyp) [n:127.0.0.1:45874_ng_tlq%2Fyp c:tmp_collection x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 312266 INFO (coreLoadExecutor-604-thread-1-processing-n:1
[...truncated too long message...]
474F3C-001/solr-instance-026/./collection1/data
[junit4] 2> 2530407 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[7B0BD13C5F474F3C]) [ x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_7B0BD13C5F474F3C-001/solr-instance-026/./collection1/data/index [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_7B0BD13C5F474F3C-001/solr-instance-026/./collection1/data/index;done=false>>]
[junit4] 2> 2530408 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[7B0BD13C5F474F3C]) [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_7B0BD13C5F474F3C-001/solr-instance-026/./collection1/data/index
[junit4] 2> 2530408 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[7B0BD13C5F474F3C]) [ x:collection1] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@4d205c92{/solr,null,UNAVAILABLE}
[junit4] 2> 2530428 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[7B0BD13C5F474F3C]) [ ] o.e.j.s.ServerConnector Stopped ServerConnector@2eb3ee3{HTTP/1.1}{127.0.0.1:0}
[junit4] 2> 2530429 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[7B0BD13C5F474F3C]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=879147856
[junit4] 2> 2530429 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[7B0BD13C5F474F3C]) [ x:collection1] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@5ca743cd
[junit4] 2> 2530429 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[7B0BD13C5F474F3C]) [ x:collection1] o.a.s.u.UpdateHandler closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 2530429 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[7B0BD13C5F474F3C]) [ x:collection1] o.a.s.u.SolrCoreState Closing SolrCoreState
[junit4] 2> 2530429 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[7B0BD13C5F474F3C]) [ x:collection1] o.a.s.u.DefaultSolrCoreState SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 2530429 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[7B0BD13C5F474F3C]) [ x:collection1] o.a.s.u.DefaultSolrCoreState closing IndexWriter with IndexWriterCloser
[junit4] 2> 2530430 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[7B0BD13C5F474F3C]) [ x:collection1] o.a.s.c.SolrCore [collection1] Closing main searcher on request.
[junit4] 2> 2530481 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[7B0BD13C5F474F3C]) [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 2530481 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[7B0BD13C5F474F3C]) [ x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_7B0BD13C5F474F3C-001/solr-instance-027/./collection1/data [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_7B0BD13C5F474F3C-001/solr-instance-027/./collection1/data;done=false>>]
[junit4] 2> 2530481 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[7B0BD13C5F474F3C]) [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_7B0BD13C5F474F3C-001/solr-instance-027/./collection1/data
[junit4] 2> 2530481 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[7B0BD13C5F474F3C]) [ x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_7B0BD13C5F474F3C-001/solr-instance-027/./collection1/data/index [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_7B0BD13C5F474F3C-001/solr-instance-027/./collection1/data/index;done=false>>]
[junit4] 2> 2530481 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[7B0BD13C5F474F3C]) [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_7B0BD13C5F474F3C-001/solr-instance-027/./collection1/data/index
[junit4] 2> 2530482 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[7B0BD13C5F474F3C]) [ x:collection1] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@3325e933{/solr,null,UNAVAILABLE}
[junit4] 2> 2530483 INFO (SUITE-TestReplicationHandler-seed#[7B0BD13C5F474F3C]-worker) [ ] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_7B0BD13C5F474F3C-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene54): {name=BlockTreeOrds(blocksize=128), id=BlockTreeOrds(blocksize=128), newname=BlockTreeOrds(blocksize=128)}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=true,coord=no): {}, locale=zh_CN, timezone=America/North_Dakota/Beulah
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_45 (64-bit)/cpus=4,threads=1,free=179469176,total=522715136
[junit4] 2> NOTE: All tests run in this JVM: [TestGroupingSearch, TestXIncludeConfig, SuggesterTSTTest, FullSolrCloudDistribCmdsTest, TestScoreJoinQPNoScore, CurrencyFieldXmlFileTest, TestSearchPerf, TestPostingsSolrHighlighter, AnalyticsMergeStrategyTest, OverseerTest, CloudMLTQParserTest, DirectUpdateHandlerOptimizeTest, SecurityConfHandlerTest, SolrCoreCheckLockOnStartupTest, CloudExitableDirectoryReaderTest, SearchHandlerTest, HdfsSyncSliceTest, TestLeaderInitiatedRecoveryThread, TestLeaderElectionZkExpiry, OverseerCollectionConfigSetProcessorTest, TestLRUCache, TestIndexSearcher, TestMinMaxOnMultiValuedField, SampleTest, ResponseHeaderTest, BlockCacheTest, TestReplicationHandlerBackup, TestManagedStopFilterFactory, TestConfigSetsAPI, TestSolrQueryParser, TestReqParamsAPI, HdfsWriteToMultipleCollectionsTest, OverseerStatusTest, TestSolrIndexConfig, TestStressRecovery, TestConfigSetsAPIExclusivity, ClusterStateTest, HLLSerializationTest, TestFastWriter, TestManagedResourceStorage, ConcurrentDeleteAndCreateCollectionTest, FacetPivotSmallTest, RequestHandlersTest, TestSolrCLIRunExample, MultiThreadedOCPTest, TestMiniSolrCloudClusterBase, SolrTestCaseJ4Test, TestElisionMultitermQuery, BigEndianAscendingWordDeserializerTest, DistributedFacetPivotSmallTest, UUIDFieldTest, FieldAnalysisRequestHandlerTest, FieldMutatingUpdateProcessorTest, CoreAdminHandlerTest, AddBlockUpdateTest, SystemInfoHandlerTest, QueryResultKeyTest, ZkNodePropsTest, RegexBoostProcessorTest, TestRandomRequestDistribution, BadIndexSchemaTest, TestTrieFacet, UpdateParamsTest, TestJsonFacets, TestDownShardTolerantSearch, BinaryUpdateRequestHandlerTest, PrimitiveFieldTypeTest, DocValuesMissingTest, ScriptEngineTest, CdcrUpdateLogTest, TestQueryWrapperFilter, TestIndexingPerformance, TestScoreJoinQPScore, TestPerFieldSimilarity, SimpleFacetsTest, TestShardHandlerFactory, StatsComponentTest, TestManagedSchemaDynamicFieldResource, HardAutoCommitTest, TestCSVResponseWriter, BasicAuthIntegrationTest, TestDistributedStatsComponentCardinality, LukeRequestHandlerTest, SimpleMLTQParserTest, AsyncCallRequestStatusResponseTest, TestReloadAndDeleteDocs, TestAuthenticationFramework, TestRecovery, TestHashQParserPlugin, BasicDistributedZkTest, BasicDistributedZk2Test, UnloadDistributedZkTest, SyncSliceTest, ShardRoutingTest, RecoveryZkTest, TestReplicationHandler]
[junit4] Completed [296/553] on J2 in 681.83s, 13 tests, 1 failure <<< FAILURES!
[...truncated 818 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987: There were test failures: 553 suites (8 ignored), 2176 tests, 2 errors, 1 failure, 31 ignored (18 assumptions) [seed: 7B0BD13C5F474F3C]
Total time: 204 minutes 27 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 836 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/836/
3 tests failed.
FAILED: org.apache.solr.cloud.OverseerTest.testExternalClusterStateChangeBehavior
Error Message:
Illegal state, was: down expected:active clusterState:live nodes:[]collections:{c1=DocCollection(c1)={ "shards":{"shard1":{ "parent":null, "range":null, "state":"active", "replicas":{"core_node1":{ "base_url":"http://127.0.0.1/solr", "node_name":"node1", "core":"core1", "roles":"", "state":"down"}}}}, "router":{"name":"implicit"}}, test=LazyCollectionRef(test)}
Stack Trace:
java.lang.AssertionError: Illegal state, was: down expected:active clusterState:live nodes:[]collections:{c1=DocCollection(c1)={
"shards":{"shard1":{
"parent":null,
"range":null,
"state":"active",
"replicas":{"core_node1":{
"base_url":"http://127.0.0.1/solr",
"node_name":"node1",
"core":"core1",
"roles":"",
"state":"down"}}}},
"router":{"name":"implicit"}}, test=LazyCollectionRef(test)}
at __randomizedtesting.SeedInfo.seed([AA04CF969E3D1668:C21ACC7A7CAD4C26]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.OverseerTest.verifyStatus(OverseerTest.java:601)
at org.apache.solr.cloud.OverseerTest.testExternalClusterStateChangeBehavior(OverseerTest.java:1261)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1660)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:866)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:902)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:875)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:777)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:811)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:822)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.SharedFSAutoReplicaFailoverTest.test
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([AA04CF969E3D1668:2250F04C30C17B90]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertTrue(Assert.java:54)
at org.apache.solr.cloud.SharedFSAutoReplicaFailoverTest.testBasics(SharedFSAutoReplicaFailoverTest.java:227)
at org.apache.solr.cloud.SharedFSAutoReplicaFailoverTest.test(SharedFSAutoReplicaFailoverTest.java:108)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1660)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:866)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:902)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:916)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:963)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:938)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:875)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:777)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:811)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:822)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR
Error Message:
Captured an uncaught exception in thread: Thread[id=19115, name=coreZkRegister-2842-thread-1, state=RUNNABLE, group=TGRP-LeaderInitiatedRecoveryOnShardRestartTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=19115, name=coreZkRegister-2842-thread-1, state=RUNNABLE, group=TGRP-LeaderInitiatedRecoveryOnShardRestartTest]
Caused by: java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([AA04CF969E3D1668]:0)
at org.apache.solr.cloud.ZkController.updateLeaderInitiatedRecoveryState(ZkController.java:2126)
at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:433)
at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:197)
at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:157)
at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:346)
at org.apache.solr.cloud.ZkController.joinElection(ZkController.java:1113)
at org.apache.solr.cloud.ZkController.register(ZkController.java:926)
at org.apache.solr.cloud.ZkController.register(ZkController.java:881)
at org.apache.solr.core.ZkContainer$2.run(ZkContainer.java:183)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:231)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 9991 lines...]
[junit4] Suite: org.apache.solr.cloud.SharedFSAutoReplicaFailoverTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_AA04CF969E3D1668-001/init-core-data-001
[junit4] 2> 257203 INFO (SUITE-SharedFSAutoReplicaFailoverTest-seed#[AA04CF969E3D1668]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
[junit4] 1> Formatting using clusterid: testClusterID
[junit4] 2> 257287 WARN (SUITE-SharedFSAutoReplicaFailoverTest-seed#[AA04CF969E3D1668]-worker) [ ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
[junit4] 2> 257335 WARN (SUITE-SharedFSAutoReplicaFailoverTest-seed#[AA04CF969E3D1668]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 257337 INFO (SUITE-SharedFSAutoReplicaFailoverTest-seed#[AA04CF969E3D1668]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 257376 INFO (SUITE-SharedFSAutoReplicaFailoverTest-seed#[AA04CF969E3D1668]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_45897_hdfs____569527/webapp
[junit4] 2> 257577 INFO (SUITE-SharedFSAutoReplicaFailoverTest-seed#[AA04CF969E3D1668]-worker) [ ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
[junit4] 2> 257818 INFO (SUITE-SharedFSAutoReplicaFailoverTest-seed#[AA04CF969E3D1668]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45897
[junit4] 2> 257960 WARN (SUITE-SharedFSAutoReplicaFailoverTest-seed#[AA04CF969E3D1668]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 257961 INFO (SUITE-SharedFSAutoReplicaFailoverTest-seed#[AA04CF969E3D1668]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 257975 INFO (SUITE-SharedFSAutoReplicaFailoverTest-seed#[AA04CF969E3D1668]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_46300_datanode____.xr60h4/webapp
[junit4] 2> 258097 INFO (SUITE-SharedFSAutoReplicaFailoverTest-seed#[AA04CF969E3D1668]-worker) [ ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
[junit4] 2> 258299 INFO (SUITE-SharedFSAutoReplicaFailoverTest-seed#[AA04CF969E3D1668]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46300
[junit4] 2> 258434 WARN (SUITE-SharedFSAutoReplicaFailoverTest-seed#[AA04CF969E3D1668]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 258435 INFO (SUITE-SharedFSAutoReplicaFailoverTest-seed#[AA04CF969E3D1668]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 258453 INFO (SUITE-SharedFSAutoReplicaFailoverTest-seed#[AA04CF969E3D1668]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_49206_datanode____sxilq2/webapp
[junit4] 2> 258500 INFO (IPC Server handler 4 on 46921) [ ] BlockStateChange BLOCK* processReport: from storage DS-b5b9bd9b-cf1c-43b1-abdd-e141582fee2f node DatanodeRegistration(127.0.0.1, datanodeUuid=6af1b9e8-fb77-4dcf-baee-bd8760414e49, infoPort=46300, ipcPort=41404, storageInfo=lv=-56;cid=testClusterID;nsid=1098262640;c=0), blocks: 0, hasStaleStorages: true, processing time: 1 msecs
[junit4] 2> 258500 INFO (IPC Server handler 4 on 46921) [ ] BlockStateChange BLOCK* processReport: from storage DS-26168be7-fbbf-434c-9e30-746c43226fda node DatanodeRegistration(127.0.0.1, datanodeUuid=6af1b9e8-fb77-4dcf-baee-bd8760414e49, infoPort=46300, ipcPort=41404, storageInfo=lv=-56;cid=testClusterID;nsid=1098262640;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
[junit4] 2> 258575 INFO (SUITE-SharedFSAutoReplicaFailoverTest-seed#[AA04CF969E3D1668]-worker) [ ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
[junit4] 2> 258777 INFO (SUITE-SharedFSAutoReplicaFailoverTest-seed#[AA04CF969E3D1668]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:49206
[junit4] 2> 258862 INFO (IPC Server handler 8 on 46921) [ ] BlockStateChange BLOCK* processReport: from storage DS-34cb8d2a-e316-4898-8334-32a445227e96 node DatanodeRegistration(127.0.0.1, datanodeUuid=5035c9c7-319b-4c9a-b4bd-19b917299aaf, infoPort=49206, ipcPort=55199, storageInfo=lv=-56;cid=testClusterID;nsid=1098262640;c=0), blocks: 0, hasStaleStorages: true, processing time: 1 msecs
[junit4] 2> 258862 INFO (IPC Server handler 8 on 46921) [ ] BlockStateChange BLOCK* processReport: from storage DS-3be7ebf7-800b-426d-b9b8-064409480f3f node DatanodeRegistration(127.0.0.1, datanodeUuid=5035c9c7-319b-4c9a-b4bd-19b917299aaf, infoPort=49206, ipcPort=55199, storageInfo=lv=-56;cid=testClusterID;nsid=1098262640;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
[junit4] 2> 258953 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 258953 INFO (Thread-1893) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 258953 INFO (Thread-1893) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 259053 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.ZkTestServer start zk server on port:41204
[junit4] 2> 259053 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 259054 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 259062 INFO (zkCallback-187-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1e37eaab name:ZooKeeperConnection Watcher:127.0.0.1:41204 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 259062 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 259062 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 259062 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 259067 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 259067 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 259069 INFO (zkCallback-188-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@e6c4851 name:ZooKeeperConnection Watcher:127.0.0.1:41204/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 259069 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 259069 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 259069 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
[junit4] 2> 259072 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
[junit4] 2> 259073 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
[junit4] 2> 259074 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
[junit4] 2> 259076 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 259076 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 259079 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 259079 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
[junit4] 2> 259081 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 259081 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 259082 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 259083 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
[junit4] 2> 259084 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 259084 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
[junit4] 2> 259085 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 259086 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
[junit4] 2> 259087 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 259087 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 259089 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 259089 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 259091 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 259091 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 259093 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 259093 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 259095 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 259095 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
[junit4] 2> 259384 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_AA04CF969E3D1668-001/control-001/cores/collection1
[junit4] 2> 259386 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.e.j.s.Server jetty-9.2.13.v20150730
[junit4] 2> 259388 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@785564fd{/,null,AVAILABLE}
[junit4] 2> 259388 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.e.j.s.ServerConnector Started ServerConnector@2dc54231{HTTP/1.1}{127.0.0.1:32889}
[junit4] 2> 259388 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.e.j.s.Server Started @262385ms
[junit4] 2> 259388 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, hostPort=32889, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_AA04CF969E3D1668-001/control-001/cores}
[junit4] 2> 259389 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 259389 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_AA04CF969E3D1668-001/control-001/'
[junit4] 2> 259389 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 259389 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 259403 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 259404 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 259406 INFO (zkCallback-189-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@15819602 name:ZooKeeperConnection Watcher:127.0.0.1:41204/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 259406 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 259406 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 259408 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 259408 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_AA04CF969E3D1668-001/control-001/solr.xml
[junit4] 2> 259414 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_AA04CF969E3D1668-001/control-001/cores
[junit4] 2> 259414 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.CoreContainer New CoreContainer 1231525329
[junit4] 2> 259414 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_AA04CF969E3D1668-001/control-001/]
[junit4] 2> 259414 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_AA04CF969E3D1668-001/control-001/lib
[junit4] 2> 259414 WARN (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_AA04CF969E3D1668-001/control-001/lib).
[junit4] 2> 259421 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 259422 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 259423 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 259423 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 259423 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41204/solr
[junit4] 2> 259423 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 259423 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 259424 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 259435 INFO (zkCallback-191-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@38828034 name:ZooKeeperConnection Watcher:127.0.0.1:41204 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 259436 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 259436 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 259438 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [n:127.0.0.1:32889_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 259440 INFO (zkCallback-192-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@39651718 name:ZooKeeperConnection Watcher:127.0.0.1:41204/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 259440 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [n:127.0.0.1:32889_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 259442 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [n:127.0.0.1:32889_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
[junit4] 2> 259443 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [n:127.0.0.1:32889_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 259446 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [n:127.0.0.1:32889_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 259448 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [n:127.0.0.1:32889_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 259452 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [n:127.0.0.1:32889_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 259453 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [n:127.0.0.1:32889_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 259455 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [n:127.0.0.1:32889_ ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 259456 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [n:127.0.0.1:32889_ ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 259457 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [n:127.0.0.1:32889_ ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 259458 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [n:127.0.0.1:32889_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:32889_
[junit4] 2> 259458 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [n:127.0.0.1:32889_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:32889_
[junit4] 2> 259460 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [n:127.0.0.1:32889_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 259461 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [n:127.0.0.1:32889_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 259462 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [n:127.0.0.1:32889_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 259462 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [n:127.0.0.1:32889_ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94772972084461572-127.0.0.1:32889_-n_0000000000
[junit4] 2> 259462 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [n:127.0.0.1:32889_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:32889_
[junit4] 2> 259463 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [n:127.0.0.1:32889_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
[junit4] 2> 259464 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [n:127.0.0.1:32889_ ] o.a.s.c.Overseer Overseer (id=94772972084461572-127.0.0.1:32889_-n_0000000000) starting
[junit4] 2> 259465 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [n:127.0.0.1:32889_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
[junit4] 2> 259470 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [n:127.0.0.1:32889_ ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 259471 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [n:127.0.0.1:32889_ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 259471 INFO (OverseerCollectionConfigSetProcessor-94772972084461572-127.0.0.1:32889_-n_0000000000) [n:127.0.0.1:32889_ ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
[junit4] 2> 259472 INFO (OverseerStateUpdate-94772972084461572-127.0.0.1:32889_-n_0000000000) [n:127.0.0.1:32889_ ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 259487 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [n:127.0.0.1:32889_ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 259487 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [n:127.0.0.1:32889_ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 259488 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [n:127.0.0.1:32889_ ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_AA04CF969E3D1668-001/control-001/cores
[junit4] 2> 259488 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [n:127.0.0.1:32889_ ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_AA04CF969E3D1668-001/control-001/cores/collection1, collection=control_collection, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_AA04CF969E3D1668-001/control-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 259488 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [n:127.0.0.1:32889_ ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_AA04CF969E3D1668-001/control-001/cores/collection1/
[junit4] 2> 259489 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [n:127.0.0.1:32889_ ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 259490 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [n:127.0.0.1:32889_ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2
[junit4] 2> 259490 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [n:127.0.0.1:32889_ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 259491 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 259491 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 259493 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 259494 INFO (OverseerStateUpdate-94772972084461572-127.0.0.1:32889_-n_0000000000) [n:127.0.0.1:32889_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:32889",
[junit4] 2> "node_name":"127.0.0.1:32889_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 259495 INFO (OverseerStateUpdate-94772972084461572-127.0.0.1:32889_-n_0000000000) [n:127.0.0.1:32889_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:32889",
[junit4] 2> "node_name":"127.0.0.1:32889_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 259495 INFO (OverseerStateUpdate-94772972084461572-127.0.0.1:32889_-n_0000000000) [n:127.0.0.1:32889_ ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
[junit4] 2> 259496 INFO (OverseerStateUpdate-94772972084461572-127.0.0.1:32889_-n_0000000000) [n:127.0.0.1:32889_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 259499 INFO (zkCallback-192-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 260494 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 260494 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
[junit4] 2> 260494 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 260494 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 260495 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 260495 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_AA04CF969E3D1668-001/control-001/cores/collection1/'
[junit4] 2> 260495 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 260495 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 260510 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 260515 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 260518 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 260526 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
[junit4] 2> 260527 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 260531 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 261267 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 261274 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 261275 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 261289 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 261292 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 261305 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 261306 WARN (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 261306 WARN (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 261306 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 261307 WARN (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 261307 WARN (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 261308 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2
[junit4] 2> 261308 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 261308 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.HdfsDirectoryFactory
[junit4] 2> 261309 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:46921/solr_hdfs_home
[junit4] 2> 261309 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 261309 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_AA04CF969E3D1668-001/control-001/cores/collection1/], dataDir=[null]
[junit4] 2> 261309 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@211ff1d3
[junit4] 2> 261309 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:46921/solr_hdfs_home/control_collection/core_node1/data
[junit4] 2> 261325 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for hdfs://localhost:46921/solr_hdfs_home/control_collection/core_node1/data
[junit4] 2> 261331 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=hdfs://localhost:46921/solr_hdfs_home/control_collection/core_node1/data/index/
[junit4] 2> 261346 WARN (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory 'hdfs:/localhost:46921/solr_hdfs_home/control_collection/core_node1/data/index' doesn't exist. Creating new index...
[junit4] 2> 261346 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:46921/solr_hdfs_home/control_collection/core_node1/data/index
[junit4] 2> 261354 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 261354 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
[junit4] 2> 261355 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Creating new single instance HDFS BlockCache
[junit4] 2> 261368 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 261368 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for hdfs://localhost:46921/solr_hdfs_home/control_collection/core_node1/data/index
[junit4] 2> 261369 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=5, maxMergeAtOnceExplicit=8, maxMergedSegmentMB=77.9404296875, floorSegmentMB=1.2353515625, forceMergeDeletesPctAllowed=20.134495863785705, segmentsPerTier=30.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6400632919989094
[junit4] 2> 261428 INFO (IPC Server handler 8 on 46921) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:36983 is added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-26168be7-fbbf-434c-9e30-746c43226fda:NORMAL:127.0.0.1:41125|RBW], ReplicaUnderConstruction[[DISK]DS-3be7ebf7-800b-426d-b9b8-064409480f3f:NORMAL:127.0.0.1:36983|FINALIZED]]} size 0
[junit4] 2> 261430 INFO (IPC Server handler 3 on 46921) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:41125 is added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-3be7ebf7-800b-426d-b9b8-064409480f3f:NORMAL:127.0.0.1:36983|FINALIZED], ReplicaUnderConstruction[[DISK]DS-b5b9bd9b-cf1c-43b1-abdd-e141582fee2f:NORMAL:127.0.0.1:41125|FINALIZED]]} size 0
[junit4] 2> 261434 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=NRTCachingDirectory(BlockDirectory(HdfsDirectory@b79cb73b lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@bae7ae); maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
[junit4] 2> 261434 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 261443 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in hdfs://localhost:46921/solr_hdfs_home/control_collection/core_node1/data/
[junit4] 2> 261447 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 261447 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
[junit4] 2> 261447 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 261447 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 261447 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 261447 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 261447 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 261448 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 261448 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 261449 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 261451 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 261451 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 261452 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 261457 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 261457 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 261458 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
[junit4] 2> 261458 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing HdfsUpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 tlogDfsReplication=2
[junit4] 2> 261470 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
[junit4] 2> 261470 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
[junit4] 2> 261472 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=41, maxMergeAtOnceExplicit=11, maxMergedSegmentMB=53.806640625, floorSegmentMB=1.662109375, forceMergeDeletesPctAllowed=9.796561528239746, segmentsPerTier=34.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.24180929010922886
[junit4] 2> 261487 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=NRTCachingDirectory(BlockDirectory(HdfsDirectory@b79cb73b lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@bae7ae); maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
[junit4] 2> 261487 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 261488 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@56deabfe[collection1] main
[junit4] 2> 261488 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 261489 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 261489 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 261489 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 261489 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
[junit4] 2> 261489 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 261490 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 261490 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 261490 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 261490 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 261492 INFO (searcherExecutor-539-thread-1-processing-n:127.0.0.1:32889_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@56deabfe[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 261505 WARN (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.h.HdfsLocalityReporter Could not retrieve locality information for hdfs://localhost:49471/solr3 due to exception: java.net.ConnectException: Call From lucene1-us-west/10.41.0.5 to localhost:49471 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
[junit4] 2> 261505 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
[junit4] 2> 261505 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 256 version buckets from index
[junit4] 2> 261505 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
[junit4] 2> 261506 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1516367556027351040
[junit4] 2> 261506 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 0.0ms to seed version buckets with highest version 1516367556027351040
[junit4] 2> 261506 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
[junit4] 2> 261507 INFO (coreLoadExecutor-538-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 261513 INFO (coreZkRegister-532-thread-1-processing-n:127.0.0.1:32889_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:32889 collection:control_collection shard:shard1
[junit4] 2> 261514 INFO (coreZkRegister-532-thread-1-processing-n:127.0.0.1:32889_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 261518 INFO (coreZkRegister-532-thread-1-processing-n:127.0.0.1:32889_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/94772972084461572-core_node1-n_0000000000
[junit4] 2> 261518 INFO (coreZkRegister-532-thread-1-processing-n:127.0.0.1:32889_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1
[junit4] 2> 261521 INFO (coreZkRegister-532-thread-1-processing-n:127.0.0.1:32889_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 261521 INFO (coreZkRegister-532-thread-1-processing-n:127.0.0.1:32889_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 261521 INFO (coreZkRegister-532-thread-1-processing-n:127.0.0.1:32889_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:32889/collection1/
[junit4] 2> 261521 INFO (OverseerStateUpdate-94772972084461572-127.0.0.1:32889_-n_0000000000) [n:127.0.0.1:32889_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection"} current state version: 1
[junit4] 2> 261521 INFO (coreZkRegister-532-thread-1-processing-n:127.0.0.1:32889_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 261521 INFO (coreZkRegister-532-thread-1-processing-n:127.0.0.1:32889_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:32889/collection1/ has no replicas
[junit4] 2> 261521 INFO (coreZkRegister-532-thread-1-processing-n:127.0.0.1:32889_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:32889/collection1/ shard1
[junit4] 2> 261522 INFO (coreZkRegister-532-thread-1-processing-n:127.0.0.1:32889_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 261523 INFO (zkCallback-192-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 261527 INFO (coreZkRegister-532-thread-1-processing-n:127.0.0.1:32889_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
[junit4] 2> 261530 INFO (OverseerStateUpdate-94772972084461572-127.0.0.1:32889_-n_0000000000) [n:127.0.0.1:32889_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:32889",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 2
[junit4] 2> 261633 INFO (zkCallback-192-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 261682 INFO (coreZkRegister-532-thread-1-processing-n:127.0.0.1:32889_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:32889/collection1/ and leader is http://127.0.0.1:32889/collection1/
[junit4] 2> 261682 INFO (coreZkRegister-532-thread-1-processing-n:127.0.0.1:32889_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:32889
[junit4] 2> 261682 INFO (coreZkRegister-532-thread-1-processing-n:127.0.0.1:32889_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 261682 INFO (coreZkRegister-532-thread-1-processing-n:127.0.0.1:32889_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
[junit4] 2> 261682 INFO (coreZkRegister-532-thread-1-processing-n:127.0.0.1:32889_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:32889_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 261684 INFO (OverseerStateUpdate-94772972084461572-127.0.0.1:32889_-n_0000000000) [n:127.0.0.1:32889_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:32889",
[junit4] 2> "node_name":"127.0.0.1:32889_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 3
[junit4] 2> 261685 INFO (OverseerStateUpdate-94772972084461572-127.0.0.1:32889_-n_0000000000) [n:127.0.0.1:32889_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:32889",
[junit4] 2> "node_name":"127.0.0.1:32889_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 261691 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 261691 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 261694 INFO (zkCallback-194-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3b4572 name:ZooKeeperConnection Watcher:127.0.0.1:41204/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 261695 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 261695 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 261695 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 261700 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 261700 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with stateFormat=2
[junit4] 2> 261700 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 261701 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 261704 INFO (zkCallback-195-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@14384141 name:ZooKeeperConnection Watcher:127.0.0.1:41204/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 261704 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 261704 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 261709 INFO (OverseerStateUpdate-94772972084461572-127.0.0.1:32889_-n_0000000000) [n:127.0.0.1:32889_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"create",
[junit4] 2> "name":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "stateFormat":"2"} current state version: 3
[junit4] 2> 261709 INFO (OverseerStateUpdate-94772972084461572-127.0.0.1:32889_-n_0000000000) [n:127.0.0.1:32889_ ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
[junit4] 2> 261712 INFO (zkCallback-192-thread-1-processing-n:127.0.0.1:32889_) [n:127.0.0.1:32889_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 261717 INFO (zkCallback-194-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 261815 INFO (OverseerStateUpdate-94772972084461572-127.0.0.1:32889_-n_0000000000) [n:127.0.0.1:32889_ ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/collection1/state.json
[junit4] 2> 262039 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_AA04CF969E3D1668-001/shard-1-001/cores/collection1
[junit4] 2> 262040 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_AA04CF969E3D1668-001/shard-1-001
[junit4] 2> 262040 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.e.j.s.Server jetty-9.2.13.v20150730
[junit4] 2> 262042 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@624688e{/,null,AVAILABLE}
[junit4] 2> 262043 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.e.j.s.ServerConnector Started ServerConnector@7b1f2cea{HTTP/1.1}{127.0.0.1:49300}
[junit4] 2> 262043 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.e.j.s.Server Started @265040ms
[junit4] 2> 262043 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solrconfig=solrconfig.xml, hostContext=/, hostPort=49300, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_AA04CF969E3D1668-001/shard-1-001/cores}
[junit4] 2> 262043 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 262043 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_AA04CF969E3D1668-001/shard-1-001/'
[junit4] 2> 262043 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 262043 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 262058 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 262059 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 262061 INFO (zkCallback-196-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@a12073a name:ZooKeeperConnection Watcher:127.0.0.1:41204/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 262061 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 262061 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 262063 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 262063 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_AA04CF969E3D1668-001/shard-1-001/solr.xml
[junit4] 2> 262068 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_AA04CF969E3D1668-001/shard-1-001/cores
[junit4] 2> 262068 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.CoreContainer New CoreContainer 1596567787
[junit4] 2> 262068 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_AA04CF969E3D1668-001/shard-1-001/]
[junit4] 2> 262069 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_AA04CF969E3D1668-001/shard-1-001/lib
[junit4] 2> 262069 WARN (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_AA04CF969E3D1668-001/shard-1-001/lib).
[junit4] 2> 262077 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 262078 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 262079 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 262079 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 262079 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41204/solr
[junit4] 2> 262079 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 262079 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 262079 INFO (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 262081 INFO (zkCallback-198-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@18f7ccb4 name:ZooKeeperConnection Watcher:127.0.0.1:41204 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[...truncated too long message...]
3
[junit4] 2> 5 /solr/collections/collection1/leader_elect/shard12/election/94773090430156855-node51_core51-n_0000000004
[junit4] 2> 4 /solr/collections/collection1/leader_elect/shard11/election/94773090430156875-node71_core71-n_0000000004
[junit4] 2> 4 /solr/collections/collection1/leader_elect/shard2/election/94773090430156869-node65_core65-n_0000000004
[junit4] 2> 3 /solr/collections/collection1/leader_elect/shard2/election/94773090430156873-node69_core142-n_0000000010
[junit4] 2> 3 /solr/collections/collection1/leader_elect/shard3/election/94773090430156876-node72_core145-n_0000000010
[junit4] 2> 3 /solr/collections/collection1/leader_elect/shard5/election/94773090430156867-node63_core136-n_0000000010
[junit4] 2> 3 /solr/collections/collection1/leader_elect/shard1/election/94773090430156875-node71_core144-n_0000000010
[junit4] 2> 3 /solr/collections/collection1/leader_elect/shard2/election/94773090430156834-node30_core30-n_0000000005
[junit4] 2> 3 /solr/collections/collection1/leader_elect/shard6/election/94773090430156874-node70_core143-n_0000000010
[junit4] 2> 3 /solr/collections/collection1/leader_elect/shard7/election/94773090430156855-node51_core124-n_0000000010
[junit4] 2> 3 /solr/collections/collection1/leader_elect/shard12/election/94773090430156868-node64_core137-n_0000000009
[junit4] 2> 3 /solr/collections/collection1/leader_elect/shard10/election/94773090430156835-node31_core104-n_0000000010
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard9/election/94773090430156826-node22_core168-n_0000000012
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard11/election/94773090430156847-node43_core116-n_0000000007
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard6/election/94773090430156845-node41_core41-n_0000000001
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard3/election/94773090430156817-node13_core13-n_0000000005
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard9/election/94773090430156865-node61_core61-n_0000000003
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard8/election/94773090430156869-node65_core138-n_0000000009
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard9/election/94773090430156831-node27_core100-n_0000000010
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard12/election/94773090430156867-node63_core63-n_0000000003
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard11/election/94773090430156863-node59_core132-n_0000000010
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard8/election/94773090430156834-node30_core103-n_0000000010
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard4/election/94773090430156857-node53_core53-n_0000000002
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard1/election/94773090430156821-node17_core17-n_0000000005
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard4/election/94773090430156808-node4_core77-n_0000000011
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard8/election/94773090430156816-node12_core85-n_0000000011
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard12/election/94773090430156830-node26_core172-n_0000000012
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard3/election/94773090430156840-node36_core109-n_0000000007
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard11/election/94773090430156828-node24_core170-n_0000000012
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard4/election/94773090430156872-node68_core141-n_0000000010
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 75 /solr/live_nodes
[junit4] 2> 75 /solr/collections
[junit4] 2>
[junit4] 2> 2105770 INFO (TEST-OverseerTest.testShardAssignmentBigger-seed#[AA04CF969E3D1668]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testShardAssignmentBigger
[junit4] 2> 2105770 INFO (TEST-OverseerTest.testShardAssignmentBigger-seed#[AA04CF969E3D1668]) [ ] o.a.s.c.Overseer Overseer (id=94773090430156803-127.0.0.1:53254_solr-n_0000000000) closing
[junit4] 2> 2105770 INFO (OverseerStateUpdate-94773090430156803-127.0.0.1:53254_solr-n_0000000000) [ ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:53254_solr
[junit4] 2> 2105770 ERROR (OverseerExitThread) [ ] o.a.s.c.Overseer could not read the data
[junit4] 2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:353)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:350)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:350)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:304)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:87)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater$2.run(Overseer.java:265)
[junit4] 2> 2108771 INFO (SUITE-OverseerTest-seed#[AA04CF969E3D1668]-worker) [ ] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.OverseerTest_AA04CF969E3D1668-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene54): {}, docValues:{}, sim=ClassicSimilarity, locale=es_PY, timezone=Asia/Jakarta
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_45 (64-bit)/cpus=4,threads=1,free=252094488,total=509083648
[junit4] 2> NOTE: All tests run in this JVM: [TestPhraseSuggestions, DataDrivenBlockJoinTest, TestComponentsName, TestExceedMaxTermLength, DistributedQueryComponentOptimizationTest, ParsingFieldUpdateProcessorsTest, FileBasedSpellCheckerTest, SpellingQueryConverterTest, HdfsBasicDistributedZk2Test, TestRawResponseWriter, TestSolr4Spatial, TestLazyCores, SOLR749Test, TestSolrConfigHandlerConcurrent, TestTrackingShardHandlerFactory, DistributedFacetPivotLargeTest, TestInitQParser, TestReplicationHandler, HttpPartitionTest, TestHighlightDedupGrouping, TestArbitraryIndexDir, ZkStateWriterTest, PrimUtilsTest, TestFunctionQuery, TestHdfsUpdateLog, PingRequestHandlerTest, TestPivotHelperCode, DistributedVersionInfoTest, AssignTest, TestRecoveryHdfs, SmileWriterTest, TestDocSet, TestCloudManagedSchemaConcurrent, TestSimpleTrackingShardHandler, BufferStoreTest, TestFilteredDocIdSet, DateRangeFieldTest, OutOfBoxZkACLAndCredentialsProvidersTest, DistributedMLTComponentTest, DistribJoinFromCollectionTest, TestSolrXml, UUIDUpdateProcessorFallbackTest, CurrencyFieldOpenExchangeTest, SparseHLLTest, ReturnFieldsTest, VersionInfoTest, CursorPagingTest, TestValueSourceCache, DateMathParserTest, TestRealTimeGet, DistributedQueryElevationComponentTest, TestNoOpRegenerator, CoreMergeIndexesAdminHandlerTest, TestPseudoReturnFields, StandardRequestHandlerTest, CollectionStateFormat2Test, TestInitParams, LeaderInitiatedRecoveryOnShardRestartTest, TestLuceneMatchVersion, SolrXmlInZkTest, TestDynamicFieldResource, QueryEqualityTest, TestRestManager, TestCollationFieldDocValues, TestSolrJ, TestIBSimilarityFactory, TestFaceting, TestBadConfig, DistributedSuggestComponentTest, TestHighFrequencyDictionaryFactory, TestDistributedMissingSort, TestMergePolicyConfig, RankQueryTest, HdfsChaosMonkeySafeLeaderTest, CacheHeaderTest, TestRTimerTree, TestSolrDynamicMBean, OutputWriterTest, EchoParamsTest, HdfsThreadLeakTest, TimeZoneUtilsTest, PolyFieldTest, TestExpandComponent, HdfsChaosMonkeyNothingIsSafeTest, TestConfigSetsAPIZkFailure, AnalysisAfterCoreReloadTest, DocumentAnalysisRequestHandlerTest, AnalysisErrorHandlingTest, SegmentsInfoRequestHandlerTest, EnumFieldTest, OverseerTest]
[junit4] Completed [255/553] on J0 in 98.97s, 12 tests, 1 failure, 1 skipped <<< FAILURES!
[...truncated 946 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987: There were test failures: 553 suites (8 ignored), 2176 tests, 1 error, 2 failures, 31 ignored (18 assumptions) [seed: AA04CF969E3D1668]
Total time: 182 minutes 15 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 835 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/835/
3 tests failed.
FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test
Error Message:
Captured an uncaught exception in thread: Thread[id=520, name=collection2, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=520, name=collection2, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:36735: Could not find collection : awholynewstresscollection_collection2_3
at __randomizedtesting.SeedInfo.seed([7321E9508C7EB203]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:895)
FAILED: org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.test
Error Message:
Captured an uncaught exception in thread: Thread[id=63230, name=Thread-55338, state=RUNNABLE, group=TGRP-FullSolrCloudDistribCmdsTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=63230, name=Thread-55338, state=RUNNABLE, group=TGRP-FullSolrCloudDistribCmdsTest]
Caused by: java.lang.RuntimeException: org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:40002/collection1
at __randomizedtesting.SeedInfo.seed([7321E9508C7EB203]:0)
at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest$1IndexThread.run(FullSolrCloudDistribCmdsTest.java:645)
Caused by: org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:40002/collection1
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:587)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:150)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:167)
at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest$1IndexThread.run(FullSolrCloudDistribCmdsTest.java:643)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:170)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:480)
... 5 more
FAILED: org.apache.solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR
Error Message:
Captured an uncaught exception in thread: Thread[id=56037, name=coreZkRegister-2723-thread-1, state=RUNNABLE, group=TGRP-LeaderInitiatedRecoveryOnShardRestartTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=56037, name=coreZkRegister-2723-thread-1, state=RUNNABLE, group=TGRP-LeaderInitiatedRecoveryOnShardRestartTest]
Caused by: java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([7321E9508C7EB203]:0)
at org.apache.solr.cloud.ZkController.updateLeaderInitiatedRecoveryState(ZkController.java:2126)
at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:433)
at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:197)
at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:157)
at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:346)
at org.apache.solr.cloud.ZkController.joinElection(ZkController.java:1113)
at org.apache.solr.cloud.ZkController.register(ZkController.java:926)
at org.apache.solr.cloud.ZkController.register(ZkController.java:881)
at org.apache.solr.core.ZkContainer$2.run(ZkContainer.java:183)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:231)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 9862 lines...]
[junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_7321E9508C7EB203-001/init-core-data-001
[junit4] 2> 8353 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[7321E9508C7EB203]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
[junit4] 2> 8354 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[7321E9508C7EB203]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
[junit4] 2> 8372 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 8412 INFO (Thread-10) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 8412 INFO (Thread-10) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 8604 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.ZkTestServer start zk server on port:40824
[junit4] 2> 8620 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 8740 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 8778 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Exception causing close of session 0x0 due to java.io.IOException: ZooKeeperServer not running
[junit4] 2> 10035 INFO (zkCallback-4-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7ce5001a name:ZooKeeperConnection Watcher:127.0.0.1:40824 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 10039 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 10040 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 10043 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 10072 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x150ae3627e00000, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 10075 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 10077 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 10081 INFO (zkCallback-5-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5f905472 name:ZooKeeperConnection Watcher:127.0.0.1:40824/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 10081 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 10082 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 10086 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
[junit4] 2> 10091 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
[junit4] 2> 10095 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
[junit4] 2> 10098 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
[junit4] 2> 10102 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 10111 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 10119 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 10119 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
[junit4] 2> 10123 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 10123 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 10128 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 10128 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
[junit4] 2> 10132 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 10132 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
[junit4] 2> 10136 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 10136 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
[junit4] 2> 10139 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 10139 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 10151 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 10151 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 10155 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 10155 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 10158 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 10158 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 10161 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 10162 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
[junit4] 2> 10168 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 10176 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 10186 INFO (zkCallback-6-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@68460e67 name:ZooKeeperConnection Watcher:127.0.0.1:40824 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 10186 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 10187 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 10187 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 10200 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 10208 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 10211 INFO (zkCallback-7-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@490459c5 name:ZooKeeperConnection Watcher:127.0.0.1:40824/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 10211 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 10211 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 10212 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf2/solrconfig.xml
[junit4] 2> 10212 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/solrconfig.xml
[junit4] 2> 10217 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf2/schema.xml
[junit4] 2> 10217 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/schema.xml
[junit4] 2> 10220 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf2/enumsConfig.xml
[junit4] 2> 10220 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/enumsConfig.xml
[junit4] 2> 10224 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf2/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 10224 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 10227 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf2/stopwords.txt
[junit4] 2> 10227 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/stopwords.txt
[junit4] 2> 10230 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf2/protwords.txt
[junit4] 2> 10230 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/protwords.txt
[junit4] 2> 10233 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf2/currency.xml
[junit4] 2> 10234 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/currency.xml
[junit4] 2> 10237 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf2/open-exchange-rates.json
[junit4] 2> 10237 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/open-exchange-rates.json
[junit4] 2> 10250 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf2/mapping-ISOLatin1Accent.txt
[junit4] 2> 10250 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/mapping-ISOLatin1Accent.txt
[junit4] 2> 10254 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf2/old_synonyms.txt
[junit4] 2> 10254 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/old_synonyms.txt
[junit4] 2> 10258 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf2/synonyms.txt
[junit4] 2> 10258 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/synonyms.txt
[junit4] 2> 10263 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/elevate.xml to /configs/conf2/elevate.xml
[junit4] 2> 10263 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/elevate.xml
[junit4] 2> 10656 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_7321E9508C7EB203-001/control-001/cores/collection1
[junit4] 2> 10788 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.e.j.u.log Logging initialized @14303ms
[junit4] 2> 10944 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.e.j.s.Server jetty-9.2.13.v20150730
[junit4] 2> 11131 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@42198797{/,null,AVAILABLE}
[junit4] 2> 11147 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.e.j.s.ServerConnector Started ServerConnector@7e0d2ec0{HTTP/1.1}{127.0.0.1:50831}
[junit4] 2> 11147 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.e.j.s.Server Started @14667ms
[junit4] 2> 11148 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_7321E9508C7EB203-001/tempDir-001/control/data, hostContext=/, hostPort=50831, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_7321E9508C7EB203-001/control-001/cores}
[junit4] 2> 11158 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 11159 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_7321E9508C7EB203-001/control-001/'
[junit4] 2> 11159 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 11160 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 11189 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 11190 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 11198 INFO (zkCallback-8-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@74fd902e name:ZooKeeperConnection Watcher:127.0.0.1:40824/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 11198 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 11199 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 11202 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 11205 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_7321E9508C7EB203-001/control-001/solr.xml
[junit4] 2> 11220 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_7321E9508C7EB203-001/control-001/cores
[junit4] 2> 11221 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.CoreContainer New CoreContainer 1426537180
[junit4] 2> 11221 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_7321E9508C7EB203-001/control-001/]
[junit4] 2> 11221 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_7321E9508C7EB203-001/control-001/lib
[junit4] 2> 11221 WARN (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_7321E9508C7EB203-001/control-001/lib).
[junit4] 2> 11241 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 11242 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 11243 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 11243 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 11243 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40824/solr
[junit4] 2> 11258 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 11258 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 11258 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 11261 INFO (zkCallback-10-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@42d4b294 name:ZooKeeperConnection Watcher:127.0.0.1:40824 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 11262 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 11262 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 11271 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [n:127.0.0.1:50831_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 11274 INFO (zkCallback-11-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@19e4700 name:ZooKeeperConnection Watcher:127.0.0.1:40824/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 11274 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [n:127.0.0.1:50831_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 11282 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [n:127.0.0.1:50831_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
[junit4] 2> 11293 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [n:127.0.0.1:50831_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 11301 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [n:127.0.0.1:50831_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 11307 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [n:127.0.0.1:50831_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 11311 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [n:127.0.0.1:50831_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 11327 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [n:127.0.0.1:50831_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 11331 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [n:127.0.0.1:50831_ ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 11333 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [n:127.0.0.1:50831_ ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 11335 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [n:127.0.0.1:50831_ ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 11337 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [n:127.0.0.1:50831_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50831_
[junit4] 2> 11339 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [n:127.0.0.1:50831_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:50831_
[junit4] 2> 11345 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [n:127.0.0.1:50831_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 11347 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [n:127.0.0.1:50831_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 11350 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [n:127.0.0.1:50831_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 11351 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [n:127.0.0.1:50831_ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94767139795238918-127.0.0.1:50831_-n_0000000000
[junit4] 2> 11356 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [n:127.0.0.1:50831_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:50831_
[junit4] 2> 11356 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [n:127.0.0.1:50831_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
[junit4] 2> 11358 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [n:127.0.0.1:50831_ ] o.a.s.c.Overseer Overseer (id=94767139795238918-127.0.0.1:50831_-n_0000000000) starting
[junit4] 2> 11365 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [n:127.0.0.1:50831_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
[junit4] 2> 11394 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [n:127.0.0.1:50831_ ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 11398 INFO (OverseerCollectionConfigSetProcessor-94767139795238918-127.0.0.1:50831_-n_0000000000) [n:127.0.0.1:50831_ ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
[junit4] 2> 11398 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [n:127.0.0.1:50831_ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 11408 INFO (OverseerStateUpdate-94767139795238918-127.0.0.1:50831_-n_0000000000) [n:127.0.0.1:50831_ ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 11492 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [n:127.0.0.1:50831_ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 11492 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [n:127.0.0.1:50831_ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 11494 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [n:127.0.0.1:50831_ ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_7321E9508C7EB203-001/control-001/cores
[junit4] 2> 11497 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [n:127.0.0.1:50831_ ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_7321E9508C7EB203-001/control-001/cores/collection1, collection=control_collection, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_7321E9508C7EB203-001/control-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 11498 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [n:127.0.0.1:50831_ ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_7321E9508C7EB203-001/control-001/cores/collection1/
[junit4] 2> 11498 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [n:127.0.0.1:50831_ ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 11501 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 11501 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 11502 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [n:127.0.0.1:50831_ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4] 2> 11503 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [n:127.0.0.1:50831_ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 11513 INFO (OverseerStateUpdate-94767139795238918-127.0.0.1:50831_-n_0000000000) [n:127.0.0.1:50831_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:50831",
[junit4] 2> "node_name":"127.0.0.1:50831_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 11515 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 11522 INFO (OverseerStateUpdate-94767139795238918-127.0.0.1:50831_-n_0000000000) [n:127.0.0.1:50831_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:50831",
[junit4] 2> "node_name":"127.0.0.1:50831_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 11524 INFO (OverseerStateUpdate-94767139795238918-127.0.0.1:50831_-n_0000000000) [n:127.0.0.1:50831_ ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
[junit4] 2> 11534 INFO (OverseerStateUpdate-94767139795238918-127.0.0.1:50831_-n_0000000000) [n:127.0.0.1:50831_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 11539 INFO (zkCallback-11-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 12516 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 12516 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
[junit4] 2> 12517 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 12517 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 12518 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 12519 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_7321E9508C7EB203-001/control-001/cores/collection1/'
[junit4] 2> 12519 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 12519 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 12569 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 12587 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 12593 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 12610 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
[junit4] 2> 12614 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 12640 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 12787 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 12799 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 12800 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 12822 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 12825 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 12828 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 12829 WARN (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 12829 WARN (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 12830 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 12831 WARN (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 12831 WARN (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 12832 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4] 2> 12832 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 12832 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 12833 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_7321E9508C7EB203-001/control-001/cores/collection1/], dataDir=[null]
[junit4] 2> 12835 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@24b151ad
[junit4] 2> 12840 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_7321E9508C7EB203-001/control-001/cores/collection1/data
[junit4] 2> 12840 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_7321E9508C7EB203-001/control-001/cores/collection1/data/index/
[junit4] 2> 12840 WARN (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_7321E9508C7EB203-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 12844 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_7321E9508C7EB203-001/control-001/cores/collection1/data/index
[junit4] 2> 12844 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=16, maxMergeAtOnceExplicit=30, maxMergedSegmentMB=14.482421875, floorSegmentMB=1.0751953125, forceMergeDeletesPctAllowed=21.77378160478481, segmentsPerTier=29.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.30887223824920773
[junit4] 2> 12855 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(NIOFSDirectory@/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_7321E9508C7EB203-001/index-NIOFSDirectory-001 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3fac91f3),segFN=segments_1,generation=1}
[junit4] 2> 12856 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 12860 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_7321E9508C7EB203-001/control-001/cores/collection1/data/
[junit4] 2> 12861 WARN (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_7321E9508C7EB203-001/control-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
[junit4] 2> 12876 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 12885 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
[junit4] 2> 12886 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 12886 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 12886 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 12886 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 12886 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 12887 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 12887 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 12890 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 12892 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 12893 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 12895 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 12905 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 12906 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 12912 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 12912 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 12920 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
[junit4] 2> 12920 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
[junit4] 2> 12921 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@15cd27dd
[junit4] 2> 12925 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(NIOFSDirectory@/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_7321E9508C7EB203-001/index-NIOFSDirectory-001 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3fac91f3),segFN=segments_1,generation=1}
[junit4] 2> 12925 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 12926 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@5ab90b87[collection1] main
[junit4] 2> 12926 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 12927 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 12927 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 12930 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 12930 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
[junit4] 2> 12930 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 12930 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 12931 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 12931 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 12931 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 12933 INFO (searcherExecutor-41-thread-1-processing-n:127.0.0.1:50831_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@5ab90b87[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 12934 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
[junit4] 2> 12934 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
[junit4] 2> 12934 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
[junit4] 2> 12934 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1516274241300856832
[junit4] 2> 12939 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 5.0ms to seed version buckets with highest version 1516274241300856832
[junit4] 2> 12940 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
[junit4] 2> 12942 INFO (coreLoadExecutor-40-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 12944 INFO (coreZkRegister-34-thread-1-processing-n:127.0.0.1:50831_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:50831 collection:control_collection shard:shard1
[junit4] 2> 12952 INFO (coreZkRegister-34-thread-1-processing-n:127.0.0.1:50831_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 12958 INFO (coreZkRegister-34-thread-1-processing-n:127.0.0.1:50831_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/94767139795238918-core_node1-n_0000000000
[junit4] 2> 12959 INFO (coreZkRegister-34-thread-1-processing-n:127.0.0.1:50831_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1
[junit4] 2> 12963 INFO (coreZkRegister-34-thread-1-processing-n:127.0.0.1:50831_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 12963 INFO (coreZkRegister-34-thread-1-processing-n:127.0.0.1:50831_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 12963 INFO (OverseerStateUpdate-94767139795238918-127.0.0.1:50831_-n_0000000000) [n:127.0.0.1:50831_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection"} current state version: 1
[junit4] 2> 12964 INFO (coreZkRegister-34-thread-1-processing-n:127.0.0.1:50831_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:50831/collection1/
[junit4] 2> 12964 INFO (coreZkRegister-34-thread-1-processing-n:127.0.0.1:50831_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 12964 INFO (coreZkRegister-34-thread-1-processing-n:127.0.0.1:50831_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:50831/collection1/ has no replicas
[junit4] 2> 12964 INFO (coreZkRegister-34-thread-1-processing-n:127.0.0.1:50831_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:50831/collection1/ shard1
[junit4] 2> 12971 INFO (coreZkRegister-34-thread-1-processing-n:127.0.0.1:50831_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 12979 INFO (coreZkRegister-34-thread-1-processing-n:127.0.0.1:50831_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
[junit4] 2> 12997 INFO (OverseerStateUpdate-94767139795238918-127.0.0.1:50831_-n_0000000000) [n:127.0.0.1:50831_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:50831",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 1
[junit4] 2> 13030 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 13031 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 13034 INFO (zkCallback-13-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3850ea7f name:ZooKeeperConnection Watcher:127.0.0.1:40824/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 13034 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 13034 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 13034 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 13040 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 13102 INFO (zkCallback-13-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 13102 INFO (zkCallback-11-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 13150 INFO (coreZkRegister-34-thread-1-processing-n:127.0.0.1:50831_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:50831/collection1/ and leader is http://127.0.0.1:50831/collection1/
[junit4] 2> 13152 INFO (coreZkRegister-34-thread-1-processing-n:127.0.0.1:50831_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:50831
[junit4] 2> 13152 INFO (coreZkRegister-34-thread-1-processing-n:127.0.0.1:50831_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 13152 INFO (coreZkRegister-34-thread-1-processing-n:127.0.0.1:50831_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
[junit4] 2> 13152 INFO (coreZkRegister-34-thread-1-processing-n:127.0.0.1:50831_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:50831_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 13156 INFO (OverseerStateUpdate-94767139795238918-127.0.0.1:50831_-n_0000000000) [n:127.0.0.1:50831_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:50831",
[junit4] 2> "node_name":"127.0.0.1:50831_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 2
[junit4] 2> 13156 INFO (OverseerStateUpdate-94767139795238918-127.0.0.1:50831_-n_0000000000) [n:127.0.0.1:50831_ ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:50831",
[junit4] 2> "node_name":"127.0.0.1:50831_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 13263 INFO (zkCallback-13-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 13263 INFO (zkCallback-11-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 13409 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_7321E9508C7EB203-001/shard-1-001/cores/collection1
[junit4] 2> 13410 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_7321E9508C7EB203-001/shard-1-001
[junit4] 2> 13416 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.e.j.s.Server jetty-9.2.13.v20150730
[junit4] 2> 13437 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@f7cb12c{/,null,AVAILABLE}
[junit4] 2> 13438 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.e.j.s.ServerConnector Started ServerConnector@223bfde6{HTTP/1.1}{127.0.0.1:36735}
[junit4] 2> 13440 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.e.j.s.Server Started @16960ms
[junit4] 2> 13440 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_7321E9508C7EB203-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/, hostPort=36735, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_7321E9508C7EB203-001/shard-1-001/cores}
[junit4] 2> 13441 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 13441 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_7321E9508C7EB203-001/shard-1-001/'
[junit4] 2> 13441 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 13441 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 13461 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 13462 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 13463 INFO (zkCallback-14-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@9900b5f name:ZooKeeperConnection Watcher:127.0.0.1:40824/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 13464 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 13464 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 13467 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x150ae3627e00008, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 13467 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 13468 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_7321E9508C7EB203-001/shard-1-001/solr.xml
[junit4] 2> 13484 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_7321E9508C7EB203-001/shard-1-001/cores
[junit4] 2> 13485 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.CoreContainer New CoreContainer 856006190
[junit4] 2> 13485 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_7321E9508C7EB203-001/shard-1-001/]
[junit4] 2> 13485 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_7321E9508C7EB203-001/shard-1-001/lib
[junit4] 2> 13485 WARN (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_7321E9508C7EB203-001/shard-1-001/lib).
[junit4] 2> 13495 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 13497 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 13497 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 13498 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 13498 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40824/solr
[junit4] 2> 13498 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 13498 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 13498 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 13501 INFO (zkCallback-16-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6dc4e491 name:ZooKeeperConnection Watcher:127.0.0.1:40824 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 13501 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 13502 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 13507 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [n:127.0.0.1:36735_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 13509 INFO (zkCallback-17-thread-1-processing-n:127.0.0.1:36735_) [n:127.0.0.1:36735_ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@10c8df1f name:ZooKeeperConnection Watcher:127.0.0.1:40824/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 13510 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [n:127.0.0.1:36735_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 13520 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [n:127.0.0.1:36735_ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 14531 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [n:127.0.0.1:36735_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36735_
[junit4] 2> 14532 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [n:127.0.0.1:36735_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:36735_
[junit4] 2> 14533 INFO (zkCallback-11-thread-1-processing-n:127.0.0.1:50831_) [n:127.0.0.1:50831_ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 14533 INFO (zkCallback-13-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 14534 INFO (zkCallback-17-thread-1-processing-n:127.0.0.1:36735_) [n:127.0.0.1:36735_ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 14536 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [n:127.0.0.1:36735_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 14537 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [n:127.0.0.1:36735_ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94767139795238922-127.0.0.1:36735_-n_0000000001
[junit4] 2> 14539 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [n:127.0.0.1:36735_ ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/94767139795238918-127.0.0.1:50831_-n_0000000000 to know if I could be the leader
[junit4] 2> 14566 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [n:127.0.0.1:36735_ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 14566 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [n:127.0.0.1:36735_ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 14567 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [n:127.0.0.1:36735_ ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_7321E9508C7EB203-001/shard-1-001/cores
[junit4] 2> 14569 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[7321E9508C7EB203]) [n:127.0.0.1:36735_ ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_7321E9508C7EB203-001/shard-1-001/cores/collection1, collection=collection1, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_7321E9508C7EB203-001/shard-1-001/cores/collection1/, coreNodeName=,
[...truncated too long message...]
.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
[junit4] > at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
[junit4] > at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
[junit4] > at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
[junit4] > at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
[junit4] > at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
[junit4] > at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
[junit4] > at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
[junit4] > at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
[junit4] > at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
[junit4] > at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
[junit4] > at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
[junit4] > at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
[junit4] > at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:480)
[junit4] > ... 5 moreThrowable #3: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=63231, name=Thread-55339, state=RUNNABLE, group=TGRP-FullSolrCloudDistribCmdsTest]
[junit4] > Caused by: java.lang.RuntimeException: org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:40002/collection1
[junit4] > at __randomizedtesting.SeedInfo.seed([7321E9508C7EB203]:0)
[junit4] > at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest$1IndexThread.run(FullSolrCloudDistribCmdsTest.java:645)
[junit4] > Caused by: org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:40002/collection1
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:587)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
[junit4] > at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:150)
[junit4] > at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:167)
[junit4] > at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest$1IndexThread.run(FullSolrCloudDistribCmdsTest.java:643)
[junit4] > Caused by: java.net.SocketTimeoutException: Read timed out
[junit4] > at java.net.SocketInputStream.socketRead0(Native Method)
[junit4] > at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
[junit4] > at java.net.SocketInputStream.read(SocketInputStream.java:170)
[junit4] > at java.net.SocketInputStream.read(SocketInputStream.java:141)
[junit4] > at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
[junit4] > at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
[junit4] > at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
[junit4] > at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
[junit4] > at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
[junit4] > at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
[junit4] > at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
[junit4] > at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
[junit4] > at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
[junit4] > at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
[junit4] > at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
[junit4] > at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
[junit4] > at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
[junit4] > at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
[junit4] > at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
[junit4] > at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
[junit4] > at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:480)
[junit4] > ... 5 more
[junit4] 2> 2598416 INFO (SUITE-FullSolrCloudDistribCmdsTest-seed#[7321E9508C7EB203]-worker) [n:127.0.0.1:41672_ c:collection2 s:shard2 r:core_node21 x:collection2_shard2_replica1] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: test params are: codec=CheapBastard, sim=RandomSimilarityProvider(queryNorm=false,coord=no): {}, locale=fr_CA, timezone=Europe/Minsk
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_45 (64-bit)/cpus=4,threads=1,free=179073136,total=511705088
[junit4] 2> NOTE: All tests run in this JVM: [DistribCursorPagingTest, TestSolrCLIRunExample, TestReloadAndDeleteDocs, FacetPivotSmallTest, TestScoreJoinQPScore, AsyncCallRequestStatusResponseTest, SharedFSAutoReplicaFailoverTest, RecoveryZkTest, TestConfigSetsAPI, TestRawTransformer, UpdateParamsTest, TestQueryWrapperFilter, DeleteShardTest, TestExtendedDismaxParser, FieldMutatingUpdateProcessorTest, CdcrUpdateLogTest, ZkStateReaderTest, SuggesterWFSTTest, BadComponentTest, RAMDirectoryFactoryTest, OverseerTest, TestMiniSolrCloudCluster, BasicAuthIntegrationTest, CursorMarkTest, TestMaxScoreQueryParser, BJQParserTest, TestPostingsSolrHighlighter, TestBulkSchemaConcurrent, SecurityConfHandlerTest, TestPerFieldSimilarity, OverseerStatusTest, TestShortCircuitedRequests, TestFuzzyAnalyzedSuggestions, TermVectorComponentDistributedTest, TestCustomSort, DirectSolrConnectionTest, SimpleFacetsTest, TestManagedSchemaDynamicFieldResource, SimpleMLTQParserTest, TestAddFieldRealTimeGet, CloudExitableDirectoryReaderTest, DistributedFacetPivotSmallAdvancedTest, DebugComponentTest, TestDefaultSimilarityFactory, SharedFSAutoReplicaFailoverUtilsTest, CurrencyFieldXmlFileTest, TestScoreJoinQPNoScore, TestLRUStatsCache, DocValuesMultiTest, TestCoreDiscovery, ZkNodePropsTest, TestDistributedStatsComponentCardinality, TestFastLRUCache, TestOverriddenPrefixQueryForCustomFieldType, TestGroupingSearch, TestFieldResource, TestFieldTypeResource, TestMiniSolrCloudClusterBase, TestXIncludeConfig, TestSolrIndexConfig, DocValuesMissingTest, TestReload, SolrCoreCheckLockOnStartupTest, StatelessScriptUpdateProcessorFactoryTest, TestTrieFacet, DirectUpdateHandlerTest, BigEndianAscendingWordDeserializerTest, TestWriterPerf, XmlUpdateRequestHandlerTest, StatsComponentTest, DistributedDebugComponentTest, TestConfigSetsAPIExclusivity, HdfsBasicDistributedZkTest, TestReqParamsAPI, RequestHandlersTest, AnalyticsQueryTest, OverriddenZkACLAndCredentialsProvidersTest, MultiThreadedOCPTest, BasicDistributedZk2Test, TestSearcherReuse, TestJsonFacets, HdfsDirectoryFactoryTest, FieldAnalysisRequestHandlerTest, TestStressReorder, TestSmileRequest, HardAutoCommitTest, UUIDFieldTest, TestCharFilters, QueryResultKeyTest, BasicDistributedZkTest, ChaosMonkeySafeLeaderTest, UnloadDistributedZkTest, SyncSliceTest, LeaderElectionIntegrationTest, ShardRoutingTest, FullSolrCloudDistribCmdsTest]
[junit4] Completed [280/553] on J2 in 349.90s, 1 test, 1 error <<< FAILURES!
[...truncated 892 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987: There were test failures: 553 suites (8 ignored), 2175 tests, 3 errors, 31 ignored (18 assumptions) [seed: 7321E9508C7EB203]
Total time: 193 minutes 32 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 834 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/834/
3 tests failed.
FAILED: org.apache.solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR
Error Message:
Captured an uncaught exception in thread: Thread[id=9664, name=coreZkRegister-825-thread-2, state=RUNNABLE, group=TGRP-LeaderInitiatedRecoveryOnShardRestartTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=9664, name=coreZkRegister-825-thread-2, state=RUNNABLE, group=TGRP-LeaderInitiatedRecoveryOnShardRestartTest]
Caused by: java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([A3548F75606FC63B]:0)
at org.apache.solr.cloud.ZkController.updateLeaderInitiatedRecoveryState(ZkController.java:2126)
at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:433)
at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:197)
at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:157)
at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:346)
at org.apache.solr.cloud.ZkController.joinElection(ZkController.java:1113)
at org.apache.solr.cloud.ZkController.register(ZkController.java:926)
at org.apache.solr.cloud.ZkController.register(ZkController.java:881)
at org.apache.solr.core.ZkContainer$2.run(ZkContainer.java:183)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:231)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.RollingRestartTest.test
Error Message:
Unable to restart (#2): CloudJettyRunner [url=http://127.0.0.1:54178/i_x/xk/collection1]
Stack Trace:
java.lang.AssertionError: Unable to restart (#2): CloudJettyRunner [url=http://127.0.0.1:54178/i_x/xk/collection1]
at __randomizedtesting.SeedInfo.seed([A3548F75606FC63B:2B00B0AFCE93ABC3]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.cloud.RollingRestartTest.restartWithRolesTest(RollingRestartTest.java:104)
at org.apache.solr.cloud.RollingRestartTest.test(RollingRestartTest.java:53)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1665)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:864)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:900)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:914)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:963)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:938)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:873)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:775)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:809)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:820)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.handler.TestReplicationHandler.doTestIndexAndConfigAliasReplication
Error Message:
Index: 0, Size: 0
Stack Trace:
java.lang.IndexOutOfBoundsException: Index: 0, Size: 0
at __randomizedtesting.SeedInfo.seed([A3548F75606FC63B:5427612DA68769DD]:0)
at java.util.ArrayList.rangeCheck(ArrayList.java:653)
at java.util.ArrayList.get(ArrayList.java:429)
at org.apache.solr.handler.TestReplicationHandler.doTestIndexAndConfigAliasReplication(TestReplicationHandler.java:1239)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1665)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:864)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:900)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:914)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:873)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:775)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:809)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:820)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 10085 lines...]
[junit4] Suite: org.apache.solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_A3548F75606FC63B-001/init-core-data-001
[junit4] 2> 646601 INFO (SUITE-LeaderInitiatedRecoveryOnShardRestartTest-seed#[A3548F75606FC63B]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /gr_ioy/n
[junit4] 2> 646604 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 646604 INFO (Thread-6597) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 646604 INFO (Thread-6597) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 646704 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.ZkTestServer start zk server on port:39974
[junit4] 2> 646704 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 646705 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 646709 INFO (zkCallback-972-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6b7be472 name:ZooKeeperConnection Watcher:127.0.0.1:39974 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 646709 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 646709 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 646709 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 646712 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x150a8c206c60000, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 646716 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 646716 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 646718 INFO (zkCallback-973-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@86e254 name:ZooKeeperConnection Watcher:127.0.0.1:39974/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 646718 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 646718 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 646718 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
[junit4] 2> 646720 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
[junit4] 2> 646721 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
[junit4] 2> 646722 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
[junit4] 2> 646724 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 646724 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 646726 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 646726 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
[junit4] 2> 646728 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 646728 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 646729 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 646729 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
[junit4] 2> 646731 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 646731 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
[junit4] 2> 646732 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 646732 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
[junit4] 2> 646734 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 646734 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 646735 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 646735 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 646737 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 646737 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 646738 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 646738 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 646740 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 646740 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
[junit4] 2> 647036 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_A3548F75606FC63B-001/control-001/cores/collection1
[junit4] 2> 647037 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.e.j.s.Server jetty-9.2.13.v20150730
[junit4] 2> 647039 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4d34d22f{/gr_ioy/n,null,AVAILABLE}
[junit4] 2> 647043 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.e.j.s.ServerConnector Started ServerConnector@f7b6871{HTTP/1.1}{127.0.0.1:35305}
[junit4] 2> 647043 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.e.j.s.Server Started @650266ms
[junit4] 2> 647043 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_A3548F75606FC63B-001/tempDir-001/control/data, hostContext=/gr_ioy/n, hostPort=35305, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_A3548F75606FC63B-001/control-001/cores}
[junit4] 2> 647043 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 647043 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_A3548F75606FC63B-001/control-001/'
[junit4] 2> 647044 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 647044 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 647059 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 647059 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 647063 INFO (zkCallback-974-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4c3f7c86 name:ZooKeeperConnection Watcher:127.0.0.1:39974/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 647063 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 647064 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 647065 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 647065 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_A3548F75606FC63B-001/control-001/solr.xml
[junit4] 2> 647070 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_A3548F75606FC63B-001/control-001/cores
[junit4] 2> 647070 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.CoreContainer New CoreContainer 947830759
[junit4] 2> 647071 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_A3548F75606FC63B-001/control-001/]
[junit4] 2> 647071 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_A3548F75606FC63B-001/control-001/lib
[junit4] 2> 647071 WARN (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_A3548F75606FC63B-001/control-001/lib).
[junit4] 2> 647078 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 647079 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 647079 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 647079 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 647079 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39974/solr
[junit4] 2> 647079 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 647079 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 647080 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 647083 INFO (zkCallback-976-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@774e8caa name:ZooKeeperConnection Watcher:127.0.0.1:39974 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 647084 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 647084 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 647087 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [n:127.0.0.1:35305_gr_ioy%2Fn ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 647090 INFO (zkCallback-977-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@ebd278c name:ZooKeeperConnection Watcher:127.0.0.1:39974/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 647090 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [n:127.0.0.1:35305_gr_ioy%2Fn ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 647092 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [n:127.0.0.1:35305_gr_ioy%2Fn ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
[junit4] 2> 647093 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [n:127.0.0.1:35305_gr_ioy%2Fn ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 647096 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [n:127.0.0.1:35305_gr_ioy%2Fn ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 647098 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [n:127.0.0.1:35305_gr_ioy%2Fn ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 647099 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [n:127.0.0.1:35305_gr_ioy%2Fn ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 647101 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [n:127.0.0.1:35305_gr_ioy%2Fn ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 647103 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [n:127.0.0.1:35305_gr_ioy%2Fn ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 647104 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [n:127.0.0.1:35305_gr_ioy%2Fn ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 647105 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [n:127.0.0.1:35305_gr_ioy%2Fn ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 647106 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [n:127.0.0.1:35305_gr_ioy%2Fn ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35305_gr_ioy%2Fn
[junit4] 2> 647106 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [n:127.0.0.1:35305_gr_ioy%2Fn ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:35305_gr_ioy%2Fn
[junit4] 2> 647108 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [n:127.0.0.1:35305_gr_ioy%2Fn ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 647109 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [n:127.0.0.1:35305_gr_ioy%2Fn ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 647110 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [n:127.0.0.1:35305_gr_ioy%2Fn ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 647110 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [n:127.0.0.1:35305_gr_ioy%2Fn ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94761143465541636-127.0.0.1:35305_gr_ioy%2Fn-n_0000000000
[junit4] 2> 647110 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [n:127.0.0.1:35305_gr_ioy%2Fn ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:35305_gr_ioy%2Fn
[junit4] 2> 647110 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [n:127.0.0.1:35305_gr_ioy%2Fn ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
[junit4] 2> 647111 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [n:127.0.0.1:35305_gr_ioy%2Fn ] o.a.s.c.Overseer Overseer (id=94761143465541636-127.0.0.1:35305_gr_ioy%2Fn-n_0000000000) starting
[junit4] 2> 647113 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [n:127.0.0.1:35305_gr_ioy%2Fn ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
[junit4] 2> 647118 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [n:127.0.0.1:35305_gr_ioy%2Fn ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 647119 INFO (OverseerCollectionConfigSetProcessor-94761143465541636-127.0.0.1:35305_gr_ioy%2Fn-n_0000000000) [n:127.0.0.1:35305_gr_ioy%2Fn ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
[junit4] 2> 647119 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [n:127.0.0.1:35305_gr_ioy%2Fn ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 647119 INFO (OverseerStateUpdate-94761143465541636-127.0.0.1:35305_gr_ioy%2Fn-n_0000000000) [n:127.0.0.1:35305_gr_ioy%2Fn ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 647132 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [n:127.0.0.1:35305_gr_ioy%2Fn ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 647132 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [n:127.0.0.1:35305_gr_ioy%2Fn ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 647133 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [n:127.0.0.1:35305_gr_ioy%2Fn ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_A3548F75606FC63B-001/control-001/cores
[junit4] 2> 647134 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [n:127.0.0.1:35305_gr_ioy%2Fn ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_A3548F75606FC63B-001/control-001/cores/collection1, collection=control_collection, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_A3548F75606FC63B-001/control-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 647134 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [n:127.0.0.1:35305_gr_ioy%2Fn ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_A3548F75606FC63B-001/control-001/cores/collection1/
[junit4] 2> 647134 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [n:127.0.0.1:35305_gr_ioy%2Fn ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 647135 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [n:127.0.0.1:35305_gr_ioy%2Fn ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4] 2> 647135 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [n:127.0.0.1:35305_gr_ioy%2Fn ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 647135 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 647135 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 647136 INFO (OverseerStateUpdate-94761143465541636-127.0.0.1:35305_gr_ioy%2Fn-n_0000000000) [n:127.0.0.1:35305_gr_ioy%2Fn ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:35305/gr_ioy/n",
[junit4] 2> "node_name":"127.0.0.1:35305_gr_ioy%2Fn",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 647137 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 647137 INFO (OverseerStateUpdate-94761143465541636-127.0.0.1:35305_gr_ioy%2Fn-n_0000000000) [n:127.0.0.1:35305_gr_ioy%2Fn ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:35305/gr_ioy/n",
[junit4] 2> "node_name":"127.0.0.1:35305_gr_ioy%2Fn",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 647137 INFO (OverseerStateUpdate-94761143465541636-127.0.0.1:35305_gr_ioy%2Fn-n_0000000000) [n:127.0.0.1:35305_gr_ioy%2Fn ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
[junit4] 2> 647138 INFO (OverseerStateUpdate-94761143465541636-127.0.0.1:35305_gr_ioy%2Fn-n_0000000000) [n:127.0.0.1:35305_gr_ioy%2Fn ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 647139 INFO (zkCallback-977-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 648137 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 648137 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
[junit4] 2> 648138 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 648138 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 648139 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 648139 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_A3548F75606FC63B-001/control-001/cores/collection1/'
[junit4] 2> 648139 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 648139 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 648153 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 648157 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 648161 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 648168 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
[junit4] 2> 648169 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 648174 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 648261 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 648269 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 648270 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 648281 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 648283 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 648284 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 648285 WARN (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 648285 WARN (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 648285 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 648285 WARN (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 648286 WARN (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 648286 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4] 2> 648287 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 648287 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 648287 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_A3548F75606FC63B-001/control-001/cores/collection1/], dataDir=[null]
[junit4] 2> 648287 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f9837d4
[junit4] 2> 648287 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_A3548F75606FC63B-001/control-001/cores/collection1/data
[junit4] 2> 648288 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_A3548F75606FC63B-001/control-001/cores/collection1/data/index/
[junit4] 2> 648288 WARN (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_A3548F75606FC63B-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 648288 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_A3548F75606FC63B-001/control-001/cores/collection1/data/index
[junit4] 2> 648288 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=4, maxMergeAtOnceExplicit=2, maxMergedSegmentMB=83.83203125, floorSegmentMB=1.1982421875, forceMergeDeletesPctAllowed=28.86943889953533, segmentsPerTier=50.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 648289 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(NRTCachingDirectory(RAMDirectory@70e12278 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@bb21784; maxCacheMB=0.8798828125 maxMergeSizeMB=0.9248046875)),segFN=segments_1,generation=1}
[junit4] 2> 648289 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 648289 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_A3548F75606FC63B-001/control-001/cores/collection1/data/
[junit4] 2> 648289 WARN (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_A3548F75606FC63B-001/control-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
[junit4] 2> 648293 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 648293 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
[junit4] 2> 648293 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 648294 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 648294 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 648294 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 648294 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 648294 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 648294 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 648296 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 648297 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 648298 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 648299 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 648301 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 648302 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 648302 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 648302 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 648303 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
[junit4] 2> 648303 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
[junit4] 2> 648303 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=49, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 648304 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(NRTCachingDirectory(RAMDirectory@70e12278 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@bb21784; maxCacheMB=0.8798828125 maxMergeSizeMB=0.9248046875)),segFN=segments_1,generation=1}
[junit4] 2> 648304 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 648304 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@61d80e9b[collection1] main
[junit4] 2> 648304 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 648305 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 648305 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 648306 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 648306 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
[junit4] 2> 648306 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 648306 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 648306 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 648306 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 648307 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 648307 INFO (searcherExecutor-788-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@61d80e9b[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 648307 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
[junit4] 2> 648307 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
[junit4] 2> 648307 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
[junit4] 2> 648307 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1516178297233342464
[junit4] 2> 648310 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 2.0ms to seed version buckets with highest version 1516178297233342464
[junit4] 2> 648310 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
[junit4] 2> 648310 INFO (coreLoadExecutor-787-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 648310 INFO (coreZkRegister-781-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:35305/gr_ioy/n collection:control_collection shard:shard1
[junit4] 2> 648311 INFO (coreZkRegister-781-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 648314 INFO (coreZkRegister-781-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/94761143465541636-core_node1-n_0000000000
[junit4] 2> 648314 INFO (coreZkRegister-781-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1
[junit4] 2> 648315 INFO (coreZkRegister-781-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 648315 INFO (coreZkRegister-781-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 648315 INFO (coreZkRegister-781-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:35305/gr_ioy/n/collection1/
[junit4] 2> 648315 INFO (coreZkRegister-781-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 648316 INFO (coreZkRegister-781-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:35305/gr_ioy/n/collection1/ has no replicas
[junit4] 2> 648316 INFO (coreZkRegister-781-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:35305/gr_ioy/n/collection1/ shard1
[junit4] 2> 648316 INFO (OverseerStateUpdate-94761143465541636-127.0.0.1:35305_gr_ioy%2Fn-n_0000000000) [n:127.0.0.1:35305_gr_ioy%2Fn ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection"} current state version: 1
[junit4] 2> 648316 INFO (coreZkRegister-781-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 648318 INFO (coreZkRegister-781-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
[junit4] 2> 648327 INFO (OverseerStateUpdate-94761143465541636-127.0.0.1:35305_gr_ioy%2Fn-n_0000000000) [n:127.0.0.1:35305_gr_ioy%2Fn ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:35305/gr_ioy/n",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 1
[junit4] 2> 648429 INFO (zkCallback-977-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 648479 INFO (coreZkRegister-781-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:35305/gr_ioy/n/collection1/ and leader is http://127.0.0.1:35305/gr_ioy/n/collection1/
[junit4] 2> 648479 INFO (coreZkRegister-781-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:35305/gr_ioy/n
[junit4] 2> 648479 INFO (coreZkRegister-781-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 648479 INFO (coreZkRegister-781-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
[junit4] 2> 648479 INFO (coreZkRegister-781-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35305_gr_ioy%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 648480 INFO (OverseerStateUpdate-94761143465541636-127.0.0.1:35305_gr_ioy%2Fn-n_0000000000) [n:127.0.0.1:35305_gr_ioy%2Fn ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:35305/gr_ioy/n",
[junit4] 2> "node_name":"127.0.0.1:35305_gr_ioy%2Fn",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 2
[junit4] 2> 648481 INFO (OverseerStateUpdate-94761143465541636-127.0.0.1:35305_gr_ioy%2Fn-n_0000000000) [n:127.0.0.1:35305_gr_ioy%2Fn ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:35305/gr_ioy/n",
[junit4] 2> "node_name":"127.0.0.1:35305_gr_ioy%2Fn",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 648583 INFO (zkCallback-977-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 648636 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 648637 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 648639 INFO (zkCallback-979-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7622a890 name:ZooKeeperConnection Watcher:127.0.0.1:39974/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 648639 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 648639 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 648639 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 648642 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 648642 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with stateFormat=2
[junit4] 2> 648642 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 648642 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 648644 INFO (zkCallback-980-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4fca867a name:ZooKeeperConnection Watcher:127.0.0.1:39974/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 648644 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 648644 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 648647 INFO (OverseerStateUpdate-94761143465541636-127.0.0.1:35305_gr_ioy%2Fn-n_0000000000) [n:127.0.0.1:35305_gr_ioy%2Fn ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"create",
[junit4] 2> "name":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "stateFormat":"2"} current state version: 3
[junit4] 2> 648647 INFO (OverseerStateUpdate-94761143465541636-127.0.0.1:35305_gr_ioy%2Fn-n_0000000000) [n:127.0.0.1:35305_gr_ioy%2Fn ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
[junit4] 2> 648750 INFO (OverseerStateUpdate-94761143465541636-127.0.0.1:35305_gr_ioy%2Fn-n_0000000000) [n:127.0.0.1:35305_gr_ioy%2Fn ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/collection1/state.json
[junit4] 2> 648937 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_A3548F75606FC63B-001/shard-1-001/cores/collection1
[junit4] 2> 648938 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_A3548F75606FC63B-001/shard-1-001
[junit4] 2> 648938 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.e.j.s.Server jetty-9.2.13.v20150730
[junit4] 2> 648940 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7c75159{/gr_ioy/n,null,AVAILABLE}
[junit4] 2> 648940 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.e.j.s.ServerConnector Started ServerConnector@79ddd7ec{HTTP/1.1}{127.0.0.1:43425}
[junit4] 2> 648940 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.e.j.s.Server Started @652163ms
[junit4] 2> 648940 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_A3548F75606FC63B-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/gr_ioy/n, hostPort=43425, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_A3548F75606FC63B-001/shard-1-001/cores}
[junit4] 2> 648941 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 648941 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_A3548F75606FC63B-001/shard-1-001/'
[junit4] 2> 648941 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 648941 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 648956 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 648956 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 648958 INFO (zkCallback-981-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@756398 name:ZooKeeperConnection Watcher:127.0.0.1:39974/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 648958 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 648959 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 648960 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 648960 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_A3548F75606FC63B-001/shard-1-001/solr.xml
[junit4] 2> 648965 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_A3548F75606FC63B-001/shard-1-001/cores
[junit4] 2> 648965 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.CoreContainer New CoreContainer 1072715143
[junit4] 2> 648965 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_A3548F75606FC63B-001/shard-1-001/]
[junit4] 2> 648965 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_A3548F75606FC63B-001/shard-1-001/lib
[junit4] 2> 648965 WARN (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_A3548F75606FC63B-001/shard-1-001/lib).
[junit4] 2> 648973 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 648974 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 648974 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 648974 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 648974 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39974/solr
[junit4] 2> 648974 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 648974 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 648975 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 648977 INFO (zkCallback-983-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@58aa672a name:ZooKeeperConnection Watcher:127.0.0.1:39974 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 648977 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 648977 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 648979 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [n:127.0.0.1:43425_gr_ioy%2Fn ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 648983 INFO (zkCallback-984-thread-1-processing-n:127.0.0.1:43425_gr_ioy%2Fn) [n:127.0.0.1:43425_gr_ioy%2Fn ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@646310a2 name:ZooKeeperConnection Watcher:127.0.0.1:39974/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 648983 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [n:127.0.0.1:43425_gr_ioy%2Fn ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 648987 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [n:127.0.0.1:43425_gr_ioy%2Fn ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 649992 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [n:127.0.0.1:43425_gr_ioy%2Fn ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43425_gr_ioy%2Fn
[junit4] 2> 649993 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [n:127.0.0.1:43425_gr_ioy%2Fn ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:43425_gr_ioy%2Fn
[junit4] 2> 649994 INFO (zkCallback-977-thread-1-processing-n:127.0.0.1:35305_gr_ioy%2Fn) [n:127.0.0.1:35305_gr_ioy%2Fn ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 649994 INFO (zkCallback-979-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 649994 INFO (zkCallback-984-thread-1-processing-n:127.0.0.1:43425_gr_ioy%2Fn) [n:127.0.0.1:43425_gr_ioy%2Fn ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 649996 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A3548F75606FC63B]) [n:127.0.0.1:43425_gr_ioy%2F
[...truncated too long message...]
] 2> 2 /solr/overseer_elect/election/94761305337823372-127.0.0.1:44132_i_x%2Fxk-n_0000000061
[junit4] 2> 2 /solr/overseer_elect/election/94761305337823261-127.0.0.1:35325_i_x%2Fxk-n_0000000031
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard2/election/94761305337823240-core_node1-n_0000000000
[junit4] 2> 2 /solr/overseer_elect/election/94761305337823378-127.0.0.1:39390_i_x%2Fxk-n_0000000063
[junit4] 2> 2 /solr/overseer_elect/election/94761305337823306-127.0.0.1:57617_i_x%2Fxk-n_0000000025
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard1/election/94761305337823351-core_node14-n_0000000013
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard2/election/94761305337823309-core_node13-n_0000000012
[junit4] 2> 2 /solr/overseer_elect/election/94761305337823309-127.0.0.1:36211_i_x%2Fxk-n_0000000026
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard2/election/94761305337823300-core_node15-n_0000000011
[junit4] 2> 2 /solr/overseer_elect/election/94761305337823279-127.0.0.1:58065_i_x%2Fxk-n_0000000014
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 51 /solr/collections
[junit4] 2> 18 /solr/live_nodes
[junit4] 2> 17 /solr/overseer/collection-queue-work
[junit4] 2> 12 /solr/overseer/queue
[junit4] 2> 10 /solr/overseer/queue-work
[junit4] 2>
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=RollingRestartTest -Dtests.method=test -Dtests.seed=A3548F75606FC63B -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=ar_DZ -Dtests.timezone=US/Alaska -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[junit4] FAILURE 330s J0 | RollingRestartTest.test <<<
[junit4] > Throwable #1: java.lang.AssertionError: Unable to restart (#2): CloudJettyRunner [url=http://127.0.0.1:54178/i_x/xk/collection1]
[junit4] > at __randomizedtesting.SeedInfo.seed([A3548F75606FC63B:2B00B0AFCE93ABC3]:0)
[junit4] > at org.apache.solr.cloud.RollingRestartTest.restartWithRolesTest(RollingRestartTest.java:104)
[junit4] > at org.apache.solr.cloud.RollingRestartTest.test(RollingRestartTest.java:53)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:963)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:938)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 3446690 INFO (SUITE-RollingRestartTest-seed#[A3548F75606FC63B]-worker) [n:127.0.0.1:44132_i_x%2Fxk c:collection1 s:shard1 r:core_node16 x:collection1] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.RollingRestartTest_A3548F75606FC63B-001
[junit4] 2> Oct 27, 2015 6:51:39 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=CheapBastard, sim=ClassicSimilarity, locale=ar_DZ, timezone=US/Alaska
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_45 (64-bit)/cpus=4,threads=1,free=120698912,total=529530880
[junit4] 2> NOTE: All tests run in this JVM: [JsonLoaderTest, IndexSchemaRuntimeFieldTest, BigEndianAscendingWordSerializerTest, FileBasedSpellCheckerTest, DataDrivenBlockJoinTest, TestCloudManagedSchemaConcurrent, DateMathParserTest, SparseHLLTest, TestMissingGroups, HttpPartitionTest, TestPhraseSuggestions, ResourceLoaderTest, HdfsBasicDistributedZk2Test, TestFaceting, BasicZkTest, TestImplicitCoreProperties, SignatureUpdateProcessorFactoryTest, DistributedSpellCheckComponentTest, EchoParamsTest, TestDocumentBuilder, AssignTest, DeleteInactiveReplicaTest, TestSolrCloudWithKerberosAlt, TestIBSimilarityFactory, AnalysisAfterCoreReloadTest, LeaderInitiatedRecoveryOnShardRestartTest, TestHdfsUpdateLog, TestCSVLoader, TestAtomicUpdateErrorCases, TestCloudManagedSchema, PingRequestHandlerTest, HdfsUnloadDistributedZkTest, DistributedQueryElevationComponentTest, VersionInfoTest, PrimUtilsTest, TestExpandComponent, IndexSchemaTest, TestSimpleTrackingShardHandler, CacheHeaderTest, TestAnalyzedSuggestions, SpellingQueryConverterTest, TestDefaultStatsCache, TestDocBasedVersionConstraints, AliasIntegrationTest, TestOmitPositions, TestRangeQuery, TestFilteredDocIdSet, TestSolrDynamicMBean, TestManagedSchemaFieldResource, BasicDistributedZkTest, DistributedSuggestComponentTest, SolrRequestParserTest, TestConfig, TestSimpleQParserPlugin, QueryEqualityTest, DistributedVersionInfoTest, DisMaxRequestHandlerTest, TestSolrJ, TestRandomDVFaceting, DefaultValueUpdateProcessorTest, TestRandomFaceting, ExternalFileFieldSortTest, TestDistributedMissingSort, BlockDirectoryTest, TestRawResponseWriter, HdfsChaosMonkeySafeLeaderTest, QueryElevationComponentTest, HdfsChaosMonkeyNothingIsSafeTest, TestRecoveryHdfs, TestFieldCollectionResource, TestReplicaProperties, TestPKIAuthenticationPlugin, TestManagedSynonymFilterFactory, TestCollectionAPI, TestChildDocTransformer, DateFieldTest, TestHighlightDedupGrouping, SimpleCollectionCreateDeleteTest, CdcrReplicationHandlerTest, OutputWriterTest, RankQueryTest, BadCopyFieldTest, TestComponentsName, TestBinaryField, TestSolrConfigHandlerCloud, TestInitParams, TestClassNameShortening, SuggestComponentContextFilterQueryTest, TestCollationFieldDocValues, OverseerTaskQueueTest, ZkStateWriterTest, ResponseLogComponentTest, TestDistributedGrouping, TestRecovery, TestRealTimeGet, TestStressReorder, TestJoin, TestStressVersions, HardAutoCommitTest, SimpleFacetsTest, TestSolr4Spatial, SolrCoreTest, SolrCmdDistributorTest, PeerSyncTest, BadIndexSchemaTest, ConvertedLegacyTest, TestSort, TestFiltering, TestFunctionQuery, BasicFunctionalityTest, TestLazyCores, TestBadConfig, HighlighterTest, ShowFileRequestHandlerTest, CurrencyFieldOpenExchangeTest, TestCoreDiscovery, SpellCheckCollatorTest, CoreAdminHandlerTest, TestFoldingMultitermQuery, DocValuesTest, TestStressLucene, SpatialFilterTest, SuggesterWFSTTest, PolyFieldTest, SchemaVersionSpecificBehaviorTest, SolrCoreCheckLockOnStartupTest, TestPseudoReturnFields, TestUpdate, FieldMutatingUpdateProcessorTest, SortByFunctionTest, TestRemoteStreaming, DocValuesMultiTest, DistanceFunctionTest, XsltUpdateRequestHandlerTest, DebugComponentTest, IndexBasedSpellCheckerTest, TestSurroundQueryParser, LukeRequestHandlerTest, StandardRequestHandlerTest, TestWriterPerf, DocumentAnalysisRequestHandlerTest, TestQueryTypes, PrimitiveFieldTypeTest, RequestHandlersTest, TestValueSourceCache, PathHierarchyTokenizerFactoryTest, MoreLikeThisHandlerTest, RequiredFieldsTest, TestSolrQueryParser, TestArbitraryIndexDir, LoggingHandlerTest, ReturnFieldsTest, JSONWriterTest, TestCSVResponseWriter, QueryParsingTest, BinaryUpdateRequestHandlerTest, TestPHPSerializedResponseWriter, CSVRequestHandlerTest, TestBinaryResponseWriter, SOLR749Test, AlternateDirectoryTest, TestSolrIndexConfig, TestQuerySenderNoQuery, CopyFieldTest, BadComponentTest, TestMergePolicyConfig, TestDocSet, TestSearchPerf, NumericFieldsTest, MinimalSchemaTest, TestElisionMultitermQuery, TestLuceneMatchVersion, SynonymTokenizerTest, TestXIncludeConfig, TestPerFieldSimilarity, TestLMDirichletSimilarityFactory, TestBM25SimilarityFactory, TestFastWriter, TestJmxMonitoredMap, TimeZoneUtilsTest, TestFastOutputStream, ScriptEngineTest, OpenExchangeRatesOrgProviderTest, URLClassifyProcessorTest, PluginInfoTest, TestSystemIdResolver, DOMUtilTest, TestUtils, UUIDFieldTest, FileUtilsTest, DistributedMLTComponentTest, TestRTGBase, CursorPagingTest, DistributedIntervalFacetingTest, CdcrRequestHandlerTest, CdcrVersionReplicationTest, CleanupOldIndexTest, CollectionStateFormat2Test, CollectionsAPIAsyncDistributedZkTest, DeleteShardTest, DistribJoinFromCollectionTest, LeaderInitiatedRecoveryOnCommitTest, OutOfBoxZkACLAndCredentialsProvidersTest, OverriddenZkACLAndCredentialsProvidersTest, OverseerRolesTest, ReplicationFactorTest, RollingRestartTest]
[junit4] Completed [439/553] on J0 in 330.64s, 1 test, 1 failure <<< FAILURES!
[...truncated 358 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987: There were test failures: 553 suites (8 ignored), 2173 tests, 2 errors, 1 failure, 31 ignored (18 assumptions) [seed: A3548F75606FC63B]
Total time: 189 minutes 8 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 833 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/833/
1 tests failed.
FAILED: org.apache.solr.cloud.CdcrReplicationDistributedZkTest.doTests
Error Message:
Timeout waiting for CDCR replication to complete @source_collection:shard1
Stack Trace:
java.lang.RuntimeException: Timeout waiting for CDCR replication to complete @source_collection:shard1
at __randomizedtesting.SeedInfo.seed([2FE311D462CF525A:278364F86DC17A51]:0)
at org.apache.solr.cloud.BaseCdcrDistributedZkTest.waitForReplicationToComplete(BaseCdcrDistributedZkTest.java:732)
at org.apache.solr.cloud.CdcrReplicationDistributedZkTest.doTestUpdateLogSynchronisation(CdcrReplicationDistributedZkTest.java:363)
at org.apache.solr.cloud.CdcrReplicationDistributedZkTest.doTests(CdcrReplicationDistributedZkTest.java:52)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1665)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:864)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:900)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:914)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:963)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:938)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:873)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:775)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:809)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:820)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 10335 lines...]
[junit4] JVM J1: stdout was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/temp/junit4-J1-20151026_055139_419.sysout
[junit4] >>> JVM J1: stdout (verbatim) ----
[junit4] java.lang.OutOfMemoryError: GC overhead limit exceeded
[junit4] Dumping heap to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/heapdumps/java_pid4496.hprof ...
[junit4] Heap dump file created [619028760 bytes in 16.375 secs]
[junit4] <<< JVM J1: EOF ----
[junit4] JVM J1: stderr was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/temp/junit4-J1-20151026_055139_419.syserr
[junit4] >>> JVM J1: stderr (verbatim) ----
[junit4] WARN: Unhandled exception in event serialization. -> java.lang.OutOfMemoryError: GC overhead limit exceeded
[junit4] <<< JVM J1: EOF ----
[...truncated 580 lines...]
[junit4] Suite: org.apache.solr.cloud.CdcrReplicationDistributedZkTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_2FE311D462CF525A-001/init-core-data-001
[junit4] 2> 3163159 INFO (SUITE-CdcrReplicationDistributedZkTest-seed#[2FE311D462CF525A]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false)
[junit4] 2> 3163160 INFO (SUITE-CdcrReplicationDistributedZkTest-seed#[2FE311D462CF525A]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
[junit4] 2> 3163165 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 3163165 INFO (Thread-65563) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 3163165 INFO (Thread-65563) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 3163265 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.ZkTestServer start zk server on port:42084
[junit4] 2> 3163265 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 3163268 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 3163271 INFO (zkCallback-1320-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1caff402 name:ZooKeeperConnection Watcher:127.0.0.1:42084 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 3163271 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 3163271 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 3163271 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 3163276 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 3163277 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 3163277 INFO (zkCallback-1321-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5414aa99 name:ZooKeeperConnection Watcher:127.0.0.1:42084/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 3163277 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 3163277 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 3163277 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
[junit4] 2> 3163279 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
[junit4] 2> 3163281 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
[junit4] 2> 3163282 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
[junit4] 2> 3163283 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-cdcr.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 3163283 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 3163285 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 3163285 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
[junit4] 2> 3163287 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 3163287 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 3163289 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 3163289 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
[junit4] 2> 3163290 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 3163290 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
[junit4] 2> 3163292 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 3163292 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
[junit4] 2> 3163293 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 3163293 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 3163295 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 3163295 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 3163296 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 3163296 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 3163298 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 3163298 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 3163299 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 3163299 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
[junit4] 2> 3163301 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 3163302 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 3163303 INFO (zkCallback-1322-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@58f0bac9 name:ZooKeeperConnection Watcher:127.0.0.1:42084/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 3163303 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 3163304 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 3163304 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.SolrTestCaseJ4 ###Starting doTests
[junit4] 2> 3163626 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_2FE311D462CF525A-001/jetty-001/cores/collection1
[junit4] 2> 3163628 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.e.j.s.Server jetty-9.2.13.v20150730
[junit4] 2> 3163629 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4b7e3b7a{/,null,AVAILABLE}
[junit4] 2> 3163633 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.e.j.s.ServerConnector Started ServerConnector@47e919ea{SSL-http/1.1}{127.0.0.1:36465}
[junit4] 2> 3163633 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.e.j.s.Server Started @3166788ms
[junit4] 2> 3163633 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {shards=shard1, hostContext=/, hostPort=36465, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_2FE311D462CF525A-001/jetty-001/cores}
[junit4] 2> 3163633 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 3163633 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_2FE311D462CF525A-001/jetty-001/'
[junit4] 2> 3163633 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 3163633 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 3163648 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 3163648 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 3163649 INFO (zkCallback-1323-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1f2e97f8 name:ZooKeeperConnection Watcher:127.0.0.1:42084/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 3163649 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 3163650 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 3163651 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 3163651 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_2FE311D462CF525A-001/jetty-001/solr.xml
[junit4] 2> 3163655 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_2FE311D462CF525A-001/jetty-001/cores
[junit4] 2> 3163656 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.CoreContainer New CoreContainer 289810153
[junit4] 2> 3163656 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_2FE311D462CF525A-001/jetty-001/]
[junit4] 2> 3163656 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_2FE311D462CF525A-001/jetty-001/lib
[junit4] 2> 3163656 WARN (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_2FE311D462CF525A-001/jetty-001/lib).
[junit4] 2> 3163663 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 3163665 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 3163666 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 3163666 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 3163666 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42084/solr
[junit4] 2> 3163666 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 3163666 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 3163666 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 3163667 INFO (zkCallback-1325-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1deeaf7a name:ZooKeeperConnection Watcher:127.0.0.1:42084 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 3163667 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 3163668 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 3163669 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [n:127.0.0.1:36465_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 3163669 INFO (zkCallback-1326-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6f39ffc name:ZooKeeperConnection Watcher:127.0.0.1:42084/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 3163670 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [n:127.0.0.1:36465_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 3163670 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [n:127.0.0.1:36465_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
[junit4] 2> 3163672 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [n:127.0.0.1:36465_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 3163675 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [n:127.0.0.1:36465_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 3163676 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [n:127.0.0.1:36465_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 3163678 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [n:127.0.0.1:36465_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 3163680 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [n:127.0.0.1:36465_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 3163681 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [n:127.0.0.1:36465_ ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 3163682 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [n:127.0.0.1:36465_ ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 3163683 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [n:127.0.0.1:36465_ ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 3163684 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [n:127.0.0.1:36465_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36465_
[junit4] 2> 3163684 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [n:127.0.0.1:36465_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:36465_
[junit4] 2> 3163685 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [n:127.0.0.1:36465_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 3163686 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [n:127.0.0.1:36465_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 3163687 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [n:127.0.0.1:36465_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 3163688 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [n:127.0.0.1:36465_ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94755636234944517-127.0.0.1:36465_-n_0000000000
[junit4] 2> 3163688 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [n:127.0.0.1:36465_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:36465_
[junit4] 2> 3163688 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [n:127.0.0.1:36465_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
[junit4] 2> 3163689 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [n:127.0.0.1:36465_ ] o.a.s.c.Overseer Overseer (id=94755636234944517-127.0.0.1:36465_-n_0000000000) starting
[junit4] 2> 3163691 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [n:127.0.0.1:36465_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
[junit4] 2> 3163695 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [n:127.0.0.1:36465_ ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 3163696 INFO (OverseerCollectionConfigSetProcessor-94755636234944517-127.0.0.1:36465_-n_0000000000) [n:127.0.0.1:36465_ ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
[junit4] 2> 3163696 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [n:127.0.0.1:36465_ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 3163696 INFO (OverseerStateUpdate-94755636234944517-127.0.0.1:36465_-n_0000000000) [n:127.0.0.1:36465_ ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 3163714 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [n:127.0.0.1:36465_ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 3163714 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [n:127.0.0.1:36465_ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 3163715 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [n:127.0.0.1:36465_ ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_2FE311D462CF525A-001/jetty-001/cores
[junit4] 2> 3163716 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [n:127.0.0.1:36465_ ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_2FE311D462CF525A-001/jetty-001/cores/collection1, collection=tmp_collection, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_2FE311D462CF525A-001/jetty-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 3163716 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [n:127.0.0.1:36465_ ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_2FE311D462CF525A-001/jetty-001/cores/collection1/
[junit4] 2> 3163716 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [n:127.0.0.1:36465_ ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 3163717 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [n:127.0.0.1:36465_ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4] 2> 3163717 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 3163717 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 3163717 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [n:127.0.0.1:36465_ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 3163718 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 3163719 INFO (OverseerStateUpdate-94755636234944517-127.0.0.1:36465_-n_0000000000) [n:127.0.0.1:36465_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:36465",
[junit4] 2> "node_name":"127.0.0.1:36465_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"tmp_collection",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 3163719 INFO (OverseerStateUpdate-94755636234944517-127.0.0.1:36465_-n_0000000000) [n:127.0.0.1:36465_ ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:36465",
[junit4] 2> "node_name":"127.0.0.1:36465_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"tmp_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 3163719 INFO (OverseerStateUpdate-94755636234944517-127.0.0.1:36465_-n_0000000000) [n:127.0.0.1:36465_ ] o.a.s.c.o.ClusterStateMutator building a new cName: tmp_collection
[junit4] 2> 3163719 INFO (OverseerStateUpdate-94755636234944517-127.0.0.1:36465_-n_0000000000) [n:127.0.0.1:36465_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2
[junit4] 2> 3163720 INFO (zkCallback-1326-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 3164719 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 3164719 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection x:collection1] o.a.s.c.ZkController Check for collection zkNode:tmp_collection
[junit4] 2> 3164719 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection x:collection1] o.a.s.c.ZkController Creating collection in ZooKeeper:tmp_collection
[junit4] 2> 3164720 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection x:collection1] o.a.s.c.ZkController Looking for collection configName
[junit4] 2> 3164720 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection x:collection1] o.a.s.c.ZkController Only one config set found in zk - using it:conf1
[junit4] 2> 3164720 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/tmp_collection
[junit4] 2> 3164721 INFO (zkCallback-1326-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ ] o.a.s.c.c.ZkStateReader A collections change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections, has occurred - updating...
[junit4] 2> 3164721 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/tmp_collection
[junit4] 2> 3164722 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection x:collection1] o.a.s.c.c.ZkStateReader path=/collections/tmp_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 3164722 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_2FE311D462CF525A-001/jetty-001/cores/collection1/'
[junit4] 2> 3164722 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 3164722 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 3164735 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 3164739 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 3164742 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 3164760 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
[junit4] 2> 3164761 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 3164765 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 3164852 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 3164853 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 3164854 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 3164856 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 3164878 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4] 2> 3164878 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection tmp_collection
[junit4] 2> 3164878 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 3164879 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_2FE311D462CF525A-001/jetty-001/cores/collection1/], dataDir=[null]
[junit4] 2> 3164879 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4258022e
[junit4] 2> 3164879 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_2FE311D462CF525A-001/jetty-001/cores/collection1/data
[junit4] 2> 3164879 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_2FE311D462CF525A-001/jetty-001/cores/collection1/data/index/
[junit4] 2> 3164879 WARN (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_2FE311D462CF525A-001/jetty-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 3164880 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_2FE311D462CF525A-001/jetty-001/cores/collection1/data/index
[junit4] 2> 3164880 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=8, maxMergeAtOnceExplicit=2, maxMergedSegmentMB=58.15625, floorSegmentMB=0.802734375, forceMergeDeletesPctAllowed=0.33033335573043665, segmentsPerTier=20.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7331699971042055
[junit4] 2> 3164880 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@7a9141be lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@281421ae),segFN=segments_1,generation=1}
[junit4] 2> 3164880 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 3164881 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_2FE311D462CF525A-001/jetty-001/cores/collection1/data/
[junit4] 2> 3164881 WARN (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_2FE311D462CF525A-001/jetty-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
[junit4] 2> 3164884 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "cdcr-processor-chain"
[junit4] 2> 3164884 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 3164886 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 3164886 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 3164887 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 3164888 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 3164891 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/cdcr,/update,/admin/file
[junit4] 2> 3164891 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 3164892 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.CdcrUpdateLog
[junit4] 2> 3164892 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 3164893 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
[junit4] 2> 3164893 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
[junit4] 2> 3164893 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=21, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=2.0595703125, noCFSRatio=0.49383199893712015]
[junit4] 2> 3164893 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@7a9141be lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@281421ae),segFN=segments_1,generation=1}
[junit4] 2> 3164893 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 3164893 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@248a7e25[collection1] main
[junit4] 2> 3164893 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/tmp_collection
[junit4] 2> 3164895 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/tmp_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 3164895 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 3164896 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 3164896 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
[junit4] 2> 3164896 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 3164896 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 3164896 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 3164897 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 3164897 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 3164897 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/tmp_collection/cdcr/state
[junit4] 2> 3164900 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.h.CdcrBufferStateManager Created znode /collections/tmp_collection/cdcr/state/buffer
[junit4] 2> 3164901 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.h.CdcrProcessStateManager Created znode /collections/tmp_collection/cdcr/state/process
[junit4] 2> 3164902 INFO (searcherExecutor-5335-thread-1-processing-n:127.0.0.1:36465_ x:collection1 s:shard2 c:tmp_collection r:core_node1) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@248a7e25[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 3164902 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
[junit4] 2> 3164902 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
[junit4] 2> 3164902 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
[junit4] 2> 3164902 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1516090181579440128
[junit4] 2> 3164905 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 2.0ms to seed version buckets with highest version 1516090181579440128
[junit4] 2> 3164905 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
[junit4] 2> 3164905 INFO (coreLoadExecutor-5334-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 3164905 INFO (coreZkRegister-5328-thread-1-processing-n:127.0.0.1:36465_ x:collection1 s:shard2 c:tmp_collection r:core_node1) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:https://127.0.0.1:36465 collection:tmp_collection shard:shard2
[junit4] 2> 3164906 INFO (coreZkRegister-5328-thread-1-processing-n:127.0.0.1:36465_ x:collection1 s:shard2 c:tmp_collection r:core_node1) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/tmp_collection/leader_elect/shard2/election
[junit4] 2> 3164909 INFO (coreZkRegister-5328-thread-1-processing-n:127.0.0.1:36465_ x:collection1 s:shard2 c:tmp_collection r:core_node1) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/tmp_collection/leader_elect/shard2/election/94755636234944517-core_node1-n_0000000000
[junit4] 2> 3164910 INFO (coreZkRegister-5328-thread-1-processing-n:127.0.0.1:36465_ x:collection1 s:shard2 c:tmp_collection r:core_node1) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard2
[junit4] 2> 3164911 INFO (coreZkRegister-5328-thread-1-processing-n:127.0.0.1:36465_ x:collection1 s:shard2 c:tmp_collection r:core_node1) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 3164911 INFO (coreZkRegister-5328-thread-1-processing-n:127.0.0.1:36465_ x:collection1 s:shard2 c:tmp_collection r:core_node1) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 3164911 INFO (OverseerStateUpdate-94755636234944517-127.0.0.1:36465_-n_0000000000) [n:127.0.0.1:36465_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"tmp_collection"} current state version: 1
[junit4] 2> 3164911 INFO (coreZkRegister-5328-thread-1-processing-n:127.0.0.1:36465_ x:collection1 s:shard2 c:tmp_collection r:core_node1) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:36465/collection1/
[junit4] 2> 3164912 INFO (coreZkRegister-5328-thread-1-processing-n:127.0.0.1:36465_ x:collection1 s:shard2 c:tmp_collection r:core_node1) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 3164912 INFO (coreZkRegister-5328-thread-1-processing-n:127.0.0.1:36465_ x:collection1 s:shard2 c:tmp_collection r:core_node1) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.SyncStrategy https://127.0.0.1:36465/collection1/ has no replicas
[junit4] 2> 3164912 INFO (coreZkRegister-5328-thread-1-processing-n:127.0.0.1:36465_ x:collection1 s:shard2 c:tmp_collection r:core_node1) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:36465/collection1/ shard2
[junit4] 2> 3164912 INFO (coreZkRegister-5328-thread-1-processing-n:127.0.0.1:36465_ x:collection1 s:shard2 c:tmp_collection r:core_node1) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/tmp_collection/leaders/shard2
[junit4] 2> 3164914 INFO (coreZkRegister-5328-thread-1-processing-n:127.0.0.1:36465_ x:collection1 s:shard2 c:tmp_collection r:core_node1) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
[junit4] 2> 3164915 INFO (zkCallback-1326-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ ] o.a.s.h.CdcrProcessStateManager Received new leader state @ tmp_collection:shard2
[junit4] 2> 3164918 INFO (OverseerStateUpdate-94755636234944517-127.0.0.1:36465_-n_0000000000) [n:127.0.0.1:36465_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"tmp_collection",
[junit4] 2> "base_url":"https://127.0.0.1:36465",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 1
[junit4] 2> 3165020 INFO (zkCallback-1326-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 3165069 INFO (coreZkRegister-5328-thread-1-processing-n:127.0.0.1:36465_ x:collection1 s:shard2 c:tmp_collection r:core_node1) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.ZkController We are https://127.0.0.1:36465/collection1/ and leader is https://127.0.0.1:36465/collection1/
[junit4] 2> 3165072 INFO (coreZkRegister-5328-thread-1-processing-n:127.0.0.1:36465_ x:collection1 s:shard2 c:tmp_collection r:core_node1) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:36465
[junit4] 2> 3165073 INFO (coreZkRegister-5328-thread-1-processing-n:127.0.0.1:36465_ x:collection1 s:shard2 c:tmp_collection r:core_node1) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 3165073 INFO (coreZkRegister-5328-thread-1-processing-n:127.0.0.1:36465_ x:collection1 s:shard2 c:tmp_collection r:core_node1) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
[junit4] 2> 3165073 INFO (coreZkRegister-5328-thread-1-processing-n:127.0.0.1:36465_ x:collection1 s:shard2 c:tmp_collection r:core_node1) [n:127.0.0.1:36465_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 3165075 INFO (OverseerStateUpdate-94755636234944517-127.0.0.1:36465_-n_0000000000) [n:127.0.0.1:36465_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:36465",
[junit4] 2> "node_name":"127.0.0.1:36465_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"tmp_collection",
[junit4] 2> "operation":"state"} current state version: 2
[junit4] 2> 3165076 INFO (OverseerStateUpdate-94755636234944517-127.0.0.1:36465_-n_0000000000) [n:127.0.0.1:36465_ ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:36465",
[junit4] 2> "node_name":"127.0.0.1:36465_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"tmp_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 3165178 INFO (zkCallback-1326-thread-1-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 3165544 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_2FE311D462CF525A-001/jetty-002/cores/collection1
[junit4] 2> 3165546 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.e.j.s.Server jetty-9.2.13.v20150730
[junit4] 2> 3165547 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@51cac4ff{/,null,AVAILABLE}
[junit4] 2> 3165551 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.e.j.s.ServerConnector Started ServerConnector@d145d90{SSL-http/1.1}{127.0.0.1:47357}
[junit4] 2> 3165551 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.e.j.s.Server Started @3168706ms
[junit4] 2> 3165551 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {shards=shard2, hostContext=/, hostPort=47357, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_2FE311D462CF525A-001/jetty-002/cores}
[junit4] 2> 3165551 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 3165551 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_2FE311D462CF525A-001/jetty-002/'
[junit4] 2> 3165551 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 3165551 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 3165565 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 3165566 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 3165567 INFO (zkCallback-1327-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@68809fa9 name:ZooKeeperConnection Watcher:127.0.0.1:42084/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 3165567 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 3165567 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 3165568 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 3165568 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_2FE311D462CF525A-001/jetty-002/solr.xml
[junit4] 2> 3165572 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_2FE311D462CF525A-001/jetty-002/cores
[junit4] 2> 3165573 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.CoreContainer New CoreContainer 599322745
[junit4] 2> 3165573 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_2FE311D462CF525A-001/jetty-002/]
[junit4] 2> 3165573 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_2FE311D462CF525A-001/jetty-002/lib
[junit4] 2> 3165573 WARN (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_2FE311D462CF525A-001/jetty-002/lib).
[junit4] 2> 3165579 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 3165581 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 3165582 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 3165582 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 3165582 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42084/solr
[junit4] 2> 3165582 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 3165582 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 3165583 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 3165584 INFO (zkCallback-1329-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3abccd14 name:ZooKeeperConnection Watcher:127.0.0.1:42084 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 3165584 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 3165584 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 3165586 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [n:127.0.0.1:47357_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 3165586 INFO (zkCallback-1330-thread-1-processing-n:127.0.0.1:47357_) [n:127.0.0.1:47357_ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@385618ae name:ZooKeeperConnection Watcher:127.0.0.1:42084/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 3165586 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [n:127.0.0.1:47357_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 3165591 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [n:127.0.0.1:47357_ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 3166597 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [n:127.0.0.1:47357_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47357_
[junit4] 2> 3166597 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [n:127.0.0.1:47357_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:47357_
[junit4] 2> 3166598 INFO (zkCallback-1326-thread-2-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 3166598 INFO (zkCallback-1330-thread-1-processing-n:127.0.0.1:47357_) [n:127.0.0.1:47357_ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 3166599 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [n:127.0.0.1:47357_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 3166600 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [n:127.0.0.1:47357_ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94755636234944520-127.0.0.1:47357_-n_0000000001
[junit4] 2> 3166601 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [n:127.0.0.1:47357_ ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/94755636234944517-127.0.0.1:36465_-n_0000000000 to know if I could be the leader
[junit4] 2> 3166611 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [n:127.0.0.1:47357_ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 3166611 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [n:127.0.0.1:47357_ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 3166611 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [n:127.0.0.1:47357_ ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_2FE311D462CF525A-001/jetty-002/cores
[junit4] 2> 3166612 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [n:127.0.0.1:47357_ ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_2FE311D462CF525A-001/jetty-002/cores/collection1, collection=tmp_collection, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_2FE311D462CF525A-001/jetty-002/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 3166612 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [n:127.0.0.1:47357_ ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_2FE311D462CF525A-001/jetty-002/cores/collection1/
[junit4] 2> 3166612 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [n:127.0.0.1:47357_ ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 3166613 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [n:127.0.0.1:47357_ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4] 2> 3166613 INFO (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[2FE311D462CF525A]) [n:127.0.0.1:47357_ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 3166613 INFO (coreLoadExecutor-5346-thread-1-processing-n:127.0.0.1:47357_) [n:127.0.0.1:47357_ c:tmp_collection x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 3166613 INFO (coreLoadExecutor-5346-thread-1-processing-n:127.0.0.1:47357_) [n:127.0.0.1:47357_ c:tmp_collection x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 3166614 INFO (coreLoadExecutor-5346-thread-1-processing-n:127.0.0.1:47357_) [n:127.0.0.1:47357_ c:tmp_collection x:collection1] o.a.s.c.ZkController Registering watch for collection tmp_collection
[junit4] 2> 3166614 INFO (coreLoadExecutor-5346-thread-1-processing-n:127.0.0.1:47357_) [n:127.0.0.1:47357_ c:tmp_collection x:collection1] o.a.s.c.c.ZkStateReader addZkWatch tmp_collection
[junit4] 2> 3166615 INFO (OverseerStateUpdate-94755636234944517-127.0.0.1:36465_-n_0000000000) [n:127.0.0.1:36465_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:47357",
[junit4] 2> "node_name":"127.0.0.1:47357_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"tmp_collection",
[junit4] 2> "operation":"state"} current state version: 3
[junit4] 2> 3166615 INFO (coreLoadExecutor-5346-thread-1-processing-n:127.0.0.1:47357_) [n:127.0.0.1:47357_ c:tmp_collection x:collection1] o.a.s.c.c.ZkStateReader Deleting data for tmp_collection
[junit4] 2> 3166615 INFO (OverseerStateUpdate-94755636234944517-127.0.0.1:36465_-n_0000000000) [n:127.0.0.1:36465_ ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:47357",
[junit4] 2> "node_name":"127.0.0.1:47357_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"tmp_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 3166615 INFO (OverseerStateUpdate-94755636234944517-127.0.0.1:36465_-n_0000000000) [n:127.0.0.1:36465_ ] o.a.s.c.o.ReplicaMutator Collection already exists with numShards=2
[junit4] 2> 3166615 INFO (OverseerStateUpdate-94755636234944517-127.0.0.1:36465_-n_0000000000) [n:127.0.0.1:36465_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 3166617 INFO (coreLoadExecutor-5346-thread-1-processing-n:127.0.0.1:47357_) [n:127.0.0.1:47357_ c:tmp_collection x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 3166718 INFO (zkCallback-1326-thread-2-processing-n:127.0.0.1:36465_) [n:127.0.0.1:36465_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 3166718 INFO (zkCallback-1330-thread-1-processing-n:127.0.0.1:47357_) [n:127.0.0.1:47357_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 3167617 INFO (coreLoadExecutor-5346-thread-1-processing-n:127.0.0.1:47357_) [n:127.0.0.1:47357_ c:tmp_collection x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 3167617 INFO (coreLoadExecutor-5346-thread-1-processing-n:127.0.0.1:47357_) [n:127.0.0.1:47357_ c:tmp_collection x:collection1] o.a.s.c.ZkController Check for collection zkNode:tmp_collection
[junit4] 2> 3167617 INFO (coreLoadExecutor-5346-thread-1-processing-n:127.0.0.1:47357_) [n:127.0.0.1:47357_ c:tmp_collection x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 3167617 INFO (coreLoadExecutor-5346-thread-1-processing-n:127.0.0.1:47357_) [n:127.0.0.1:47357_ c:tmp_collection x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/tmp_collection
[junit4] 2> 3167618 INFO (coreLoadExecutor-5346-thread-1-processing-n:127.0.0.1:47357_) [n:127.0.0.1:47357_ c:tmp_collection x:collection1] o.a.s.c.c.ZkStateReader path=/collections/tmp_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 3167618 INFO (coreLoadExecutor-5346-thread-1-processing-n:127.0.0.1:47357_) [n:127.0.0.1:47357_ c:tmp_collection x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_2FE311D462CF525A-001/jetty-002/cores/collection1/'
[junit4] 2> 3167618 INFO (coreLoadExecutor-5346-thread-1-processing-n:127.0.0.1:47357_) [n:127.0.0.1:47357_ c:tmp_collection x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 3167618 INFO (coreLoadExecutor-5346-thread-1-processing-n:127.0.0.1:47357_) [n:127.0.0.1:47357_ c:tmp_collection x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 3167645 INFO (coreLoadExecutor-5346-thread-1-processing-n:127.0.0.1:47357_) [n:127.0.0.1:47357_ c:tmp_collection x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 3167649 INFO (coreLoadExecutor-5346-thread-1-processing-n:127.0.0.1:47357_) [n:127.0.0.1:47357_ c:tmp_collection x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 3167652 INFO (coreLoadExecutor-5346-thread-1-processing-n:127.0.0.1:47357_) [n:127.0.0.1:47357_ c:tmp_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 3167659 INFO (coreLoadExecutor-5346-thread-1-processing-n:127.0.0.1:47357_) [n:127.0.0.1:47357_ c:tmp_collection x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
[junit4] 2> 3167660 INFO (coreLoadExecutor-5346-thread-1-processing-n:127.0.0.1:47357_) [n:127.0.0.1:47357_ c:tmp_collection x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 3167664 INFO (coreLoadExecutor-5346-thread-1-processing-n:127.0.0.1:47357_) [n:127.0.0.1:47357_ c:tmp_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 3167748 INFO (coreLoadExecutor-5346-thread-1-processing-n:127.0.0.1:47357_) [n:127.0.0.1:47357_ c:tmp_collection x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 3167749 INFO (coreLoadExecutor-5346-thread-1-processing-n:127.0.0.1:47357_) [n:127.0.0.1:47357_ c:tmp_collection x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 3167750 INFO (coreLoadExecutor-5346-thread-1-processing-n:127.0.0.1:47357_) [n:127.0.0.1:47357_ c:tmp_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 3167752 INFO (coreLoadExecutor-5346-thread-1-processing-n:127.0.0.1:47357_) [n:127.0.0.1:47357_ c:tmp_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 3167765 INFO (coreLoadExecutor-5346-thread-1-processing-n:127.0.0.1:47357_) [n:127.0.0.1:47357_ c:tmp_collection x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4] 2> 3167765 INFO (coreLoadExecutor-5346-thread-1-processing-n:127.0.0.1:47357_) [n:127.0.0.1:47357_ c:tmp_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection tmp_collection
[junit4] 2> 3167765 INFO (coreLoadExecutor-5346-thread-1-processing-n:127.0.0.1:47357_) [n:127.0.0.1:47357_ c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 3167765 INFO (coreLoadExecutor-5346-thread-1-processing-n:127.0.0.1:47357_) [n:127.0.0.1:47357_ c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_2FE311D462CF525A-001/jetty-002/cores/collection1/], dataDir=[null]
[junit4] 2> 3167765 INFO (coreLoadExecutor-5346-thread-1-processing-n:127.0.0.1:47357_) [n:127.0.0.1:47357_ c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4258022e
[junit4] 2> 3167766 INFO (coreLoadExecutor-5346-thread-1-processing-n:127.0.0.1:47357_) [n:127.0.0.1:47357_ c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_2FE311D462CF525A-001/jetty-002/cores/collection1/data
[junit4] 2> 3167766 INFO (coreLoadExecutor-5346-thread-1-processing-n:127.0.0.1:47357_) [n:127.0.0.1:47357_ c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_2FE311D462CF525A-001/jetty-002/cores/collection1/data/index/
[junit4] 2> 3167766 WARN (coreLoadExecutor-5346-thread-1-processing-n:127.0.0.1:47357_) [n:127.0.0.1:47357_ c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_2FE311D462CF525A-001/jetty-002/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 3167766 INFO (coreLoadExecutor-5346-thread-1-processing-n:127.0.0.1:47357_) [n:127.0.0.1:47357_ c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_2FE311D462CF525A-001/jetty-002/cores/collection1/data/index
[junit4] 2> 3167766 INFO (coreLoadExecutor-5346-thread-1-processing-n:127.0.0.1:47357_) [n:127.0.0.1:47357_ c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=8, maxMergeAtOnceExplicit=2, maxMergedSegmentMB=58.15625, floorSegmentMB=0.802734375, forceMergeDeletesPctAllowed=0.33033335573043665, segmentsPerTier=20.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7331699971042055
[junit4] 2> 3167767 INFO (coreLoadExecutor-5346-thread-1-processing-n:127.0.0.1:47357_) [n:127.0.0.1:47357_ c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@7c77cd67 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@342e1c5a),segFN=segments_1,generation=1}
[junit4] 2> 3167767 INFO (coreLoadExecutor-5346-thread-1-processing-n:127.0.0.1:47357_) [n:127.0.0.1:47357_ c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 3167767 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:47357_ c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_2FE311D462CF525A-001/jetty-002/cores/collection1/data/
[junit4] 2> 3167767 WARN (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:47357_ c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_2FE311D462CF525A-001/jetty-002/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
[junit4] 2> 3167770 INFO (coreLoadExecutor-5346-thread-1-processing-n:127.0.0.1:47357_) [n:127.0.0.1:47357_ c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "cdcr-processor-chain"
[junit4] 2> 3167771 INFO (coreLoadExecutor-5346-thread-1-processing-n:127.0.0.1:47357_) [n:127.0.0.1:47357_ c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 3167772 INFO (coreLoadExecutor-5346-thread-1-processing-n:127.0.0.1:47357_) [n:127.0.0.1:47357_ c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 3167773 INFO (coreLoadExecutor-5346-thread-1-processing-n:127.0.0.1:47357_) [n:127.0.0.1:47357_ c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 3167774 INFO (coreLoadExecutor-5346-thread-1-processing-n:127.0.0.1:47357_) [n:127.0.0.1:47357_ c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 3167775 INFO (coreLoadExecutor-5346-thread-1-processing-n:127.0.0.1:47357_) [n:127.0.0.1:47357_ c:tmp_collection s:shard1 r:core_nod
[...truncated too long message...]
2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-collective-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-event-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-exception-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-journal-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-normalization-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-operational-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-referral-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-schema-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-subtree-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-trigger-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-jdbm-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-jdbm1-2.0.0-M2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-kerberos-codec-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-ldif-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-mavibot-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-protocol-kerberos-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-protocol-ldap-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-protocol-shared-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-xdbm-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/api-all-1.0.0-M20.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/bcprov-jdk15-1.45.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/cglib-nodep-2.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/commons-collections-3.2.1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/commons-math3-3.4.1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/easymock-3.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/ehcache-core-2.4.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/hadoop-common-2.6.0-tests.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/hadoop-hdfs-2.6.0-tests.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/hadoop-minikdc-2.6.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/jackson-annotations-2.5.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/jackson-databind-2.5.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/jcl-over-slf4j-1.7.7.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/jersey-core-1.9.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/jersey-server-1.9.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/jetty-6.1.26.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/jetty-util-6.1.26.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/mina-core-2.0.0-M5.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/objenesis-1.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/presto-parser-0.122.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/slice-0.10.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/analysis/icu/lucene-analyzers-icu-6.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-analysis-extras/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/contrib/analysis-extras/lib/icu4j-54.1.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-launcher.jar:/x1/jenkins/.ant/lib/ivy-2.3.0.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-antlr.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-regexp.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-resolver.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-commons-net.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jmf.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-oro.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-xalan2.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-commons-logging.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jsch.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-junit4.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-javamail.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jai.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jdepend.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-junit.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-bsf.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-swing.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-netrexx.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-bcel.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-testutil.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-log4j.jar:/x1/jenkins/jenkins-slave/tools/hudson.model.JDK/latest1.8/lib/tools.jar:/x1/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.1.17.jar com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe -eventsfile /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/temp/junit4-J1-20151026_055139_419.events @/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/temp/junit4-J1-20151026_055139_419.suites -stdin
[junit4] ERROR: JVM J1 ended with an exception: Quit event not received from the forked process? This may indicate JVM crash or runner bugs.
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4.executeSlave(JUnit4.java:1505)
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4.access$000(JUnit4.java:133)
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:963)
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:960)
[junit4] at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] at java.lang.Thread.run(Thread.java:745)
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987: At least one slave process threw an exception, first: Quit event not received from the forked process? This may indicate JVM crash or runner bugs.
Total time: 194 minutes 5 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 832 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/832/
6 tests failed.
FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test
Error Message:
GC overhead limit exceeded
Stack Trace:
java.lang.OutOfMemoryError: GC overhead limit exceeded
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.CollectionsAPIDistributedZkTest
Error Message:
528 threads leaked from SUITE scope at org.apache.solr.cloud.CollectionsAPIDistributedZkTest: 1) Thread[id=15054, name=Thread-9920, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:108) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:76) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.core.RequestParams.getFreshRequestParams(RequestParams.java:148) at org.apache.solr.core.SolrConfig.refreshRequestParams(SolrConfig.java:917) at org.apache.solr.core.SolrCore$11.run(SolrCore.java:2596) at org.apache.solr.cloud.ZkController$5.run(ZkController.java:2468) 2) Thread[id=15303, name=Thread-10153, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:108) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:76) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.core.RequestParams.getFreshRequestParams(RequestParams.java:148) at org.apache.solr.core.SolrConfig.refreshRequestParams(SolrConfig.java:917) at org.apache.solr.core.SolrCore$11.run(SolrCore.java:2596) at org.apache.solr.cloud.ZkController$5.run(ZkController.java:2468) 3) Thread[id=15391, name=Thread-10234, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:108) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:76) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.core.RequestParams.getFreshRequestParams(RequestParams.java:148) at org.apache.solr.core.SolrConfig.refreshRequestParams(SolrConfig.java:917) at org.apache.solr.core.SolrCore$11.run(SolrCore.java:2596) at org.apache.solr.cloud.ZkController$5.run(ZkController.java:2468) 4) Thread[id=13065, name=searcherExecutor-3543-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 5) Thread[id=15281, name=Thread-10134, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at org.apache.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:1342) at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1040) at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:302) at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:299) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.core.RequestParams.getFreshRequestParams(RequestParams.java:148) at org.apache.solr.core.SolrConfig.refreshRequestParams(SolrConfig.java:917) at org.apache.solr.core.SolrCore$11.run(SolrCore.java:2596) at org.apache.solr.cloud.ZkController$5.run(ZkController.java:2468) 6) Thread[id=15344, name=Thread-10189, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:108) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:76) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.core.RequestParams.getFreshRequestParams(RequestParams.java:148) at org.apache.solr.core.SolrConfig.refreshRequestParams(SolrConfig.java:917) at org.apache.solr.core.SolrCore$11.run(SolrCore.java:2596) at org.apache.solr.cloud.ZkController$5.run(ZkController.java:2468) 7) Thread[id=15354, name=Thread-10198, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at org.apache.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:1342) at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1040) at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:302) at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:299) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.core.RequestParams.getFreshRequestParams(RequestParams.java:148) at org.apache.solr.core.SolrConfig.refreshRequestParams(SolrConfig.java:917) at org.apache.solr.core.SolrCore$11.run(SolrCore.java:2596) at org.apache.solr.cloud.ZkController$5.run(ZkController.java:2468) 8) Thread[id=12935, name=searcherExecutor-3370-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 9) Thread[id=13308, name=searcherExecutor-3783-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 10) Thread[id=13934, name=zkCallback-941-thread-18-processing-n:127.0.0.1:33879_-EventThread, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494) 11) Thread[id=15326, name=Thread-10172, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:108) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:76) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.core.RequestParams.getFreshRequestParams(RequestParams.java:148) at org.apache.solr.core.SolrConfig.refreshRequestParams(SolrConfig.java:917) at org.apache.solr.core.SolrCore$11.run(SolrCore.java:2596) at org.apache.solr.cloud.ZkController$5.run(ZkController.java:2468) 12) Thread[id=12123, name=qtp1631332304-12123, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:389) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:531) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$700(QueuedThreadPool.java:47) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:590) at java.lang.Thread.run(Thread.java:745) 13) Thread[id=13250, name=searcherExecutor-3733-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 14) Thread[id=14260, name=qtp1827900685-14260, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:389) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:531) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$700(QueuedThreadPool.java:47) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:590) at java.lang.Thread.run(Thread.java:745) 15) Thread[id=14158, name=qtp1827900685-14158, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:389) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:531) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$700(QueuedThreadPool.java:47) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:590) at java.lang.Thread.run(Thread.java:745) 16) Thread[id=13044, name=searcherExecutor-3510-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 17) Thread[id=13028, name=searcherExecutor-3508-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 18) Thread[id=14986, name=Thread-9853, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:108) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:76) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.core.RequestParams.getFreshRequestParams(RequestParams.java:148) at org.apache.solr.core.SolrConfig.refreshRequestParams(SolrConfig.java:917) at org.apache.solr.core.SolrCore$11.run(SolrCore.java:2596) at org.apache.solr.cloud.ZkController$5.run(ZkController.java:2468) 19) Thread[id=15105, name=Thread-9970, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:108) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:76) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.core.RequestParams.getFreshRequestParams(RequestParams.java:148) at org.apache.solr.core.SolrConfig.refreshRequestParams(SolrConfig.java:917) at org.apache.solr.core.SolrCore$11.run(SolrCore.java:2596) at org.apache.solr.cloud.ZkController$5.run(ZkController.java:2468) 20) Thread[id=15192, name=Thread-10055, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at org.apache.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:1342) at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1040) at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:302) at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:299) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.core.RequestParams.getFreshRequestParams(RequestParams.java:148) at org.apache.solr.core.SolrConfig.refreshRequestParams(SolrConfig.java:917) at org.apache.solr.core.SolrCore$11.run(SolrCore.java:2596) at org.apache.solr.cloud.ZkController$5.run(ZkController.java:2468) 21) Thread[id=14991, name=Thread-9858, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:108) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:76) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.core.RequestParams.getFreshRequestParams(RequestParams.java:148) at org.apache.solr.core.SolrConfig.refreshRequestParams(SolrConfig.java:917) at org.apache.solr.core.SolrCore$11.run(SolrCore.java:2596) at org.apache.solr.cloud.ZkController$5.run(ZkController.java:2468) 22) Thread[id=12054, name=Scheduler-346774206, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 23) Thread[id=11996, name=Scheduler-1448316559, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 24) Thread[id=14843, name=Thread-9713, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:108) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:76) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.core.RequestParams.getFreshRequestParams(RequestParams.java:148) at org.apache.solr.core.SolrConfig.refreshRequestParams(SolrConfig.java:917) at org.apache.solr.core.SolrCore$11.run(SolrCore.java:2596) at org.apache.solr.cloud.ZkController$5.run(ZkController.java:2468) 25) Thread[id=15271, name=Thread-10124, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:108) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:76) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.core.RequestParams.getFreshRequestParams(RequestParams.java:148) at org.apache.solr.core.SolrConfig.refreshRequestParams(SolrConfig.java:917) at org.apache.solr.core.SolrCore$11.run(SolrCore.java:2596) at org.apache.solr.cloud.ZkController$5.run(ZkController.java:2468) 26) Thread[id=15250, name=Thread-10104, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at org.apache.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:1342) at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1040) at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:302) at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:299) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.core.RequestParams.getFreshRequestParams(RequestParams.java:148) at org.apache.solr.core.SolrConfig.refreshRequestParams(SolrConfig.java:917) at org.apache.solr.core.SolrCore$11.run(SolrCore.java:2596) at org.apache.solr.cloud.ZkController$5.run(ZkController.java:2468) 27) Thread[id=12326, name=searcherExecutor-3115-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 28) Thread[id=13334, name=searcherExecutor-3794-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 29) Thread[id=14882, name=Thread-9750, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at org.apache.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:1342) at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1040) at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:302) at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:299) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.core.RequestParams.getFreshRequestParams(RequestParams.java:148) at org.apache.solr.core.SolrConfig.refreshRequestParams(SolrConfig.java:917) at org.apache.solr.core.SolrCore$11.run(SolrCore.java:2596) at org.apache.solr.cloud.ZkController$5.run(ZkController.java:2468) 30) Thread[id=15388, name=Thread-10231, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at org.apache.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:1342) at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1040) at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:302) at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:299) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.core.RequestParams.getFreshRequestParams(RequestParams.java:148) at org.apache.solr.core.SolrConfig.refreshRequestParams(SolrConfig.java:917) at org.apache.solr.core.SolrCore$11.run(SolrCore.java:2596) at org.apache.solr.cloud.ZkController$5.run(ZkController.java:2468) 31) Thread[id=13613, name=searcherExecutor-3868-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 32) Thread[id=12151, name=searcherExecutor-2946-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 33) Thread[id=15403, name=Thread-10246, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at org.apache.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:1342) at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1040) at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:302) at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:299) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.core.RequestParams.getFreshRequestParams(RequestParams.java:148) at org.apache.solr.core.SolrConfig.refreshRequestParams(SolrConfig.java:917) at org.apache.solr.core.SolrCore$11.run(SolrCore.java:2596) at org.apache.solr.cloud.ZkController$5.run(ZkController.java:2468) 34) Thread[id=15233, name=Thread-10089, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:108) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:76) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.core.RequestParams.getFreshRequestParams(RequestParams.java:148) at org.apache.solr.core.SolrConfig.refreshRequestParams(SolrConfig.java:917) at org.apache.solr.core.SolrCore$11.run(SolrCore.java:2596) at org.apache.solr.cloud.ZkController$5.run(ZkController.java:2468) 35) Thread[id=15257, name=Thread-10111, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:108) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:76) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.core.RequestParams.getFreshRequestParams(RequestParams.java:148) at org.apache.solr.core.SolrConfig.refreshRequestParams(SolrConfig.java:917) at org.apache.solr.core.SolrCore$11.run(SolrCore.java:2596) at org.apache.solr.cloud.ZkController$5.run(ZkController.java:2468) 36) Thread[id=15328, name=Thread-10174, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:108) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:76) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.core.RequestParams.getFreshRequestParams(RequestParams.java:148) at org.apache.solr.core.SolrConfig.refreshRequestParams(SolrConfig.java:917) at org.apache.solr.core.SolrCore$11.run(SolrCore.java:2596) at org.apache.solr.cloud.ZkController$5.run(ZkController.java:2468) 37) Thread[id=15203, name=Thread-10064, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:108) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:76) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.core.RequestParams.getFreshRequestParams(RequestParams.java:148) at org.apache.solr.core.SolrConfig.refreshRequestParams(SolrConfig.java:917) at org.apache.solr.core.SolrCore$11.run(SolrCore.java:2596) at org.apache.solr.cloud.ZkController$5.run(ZkController.java:2468) 38) Thread[id=14807, name=Thread-9677, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:108) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:76) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.core.RequestParams.getFreshRequestParams(RequestParams.java:148) at org.apache.solr.core.SolrConfig.refreshRequestParams(SolrConfig.java:917) at org.apache.solr.core.SolrCore$11.run(SolrCore.java:2596) at org.apache.solr.cloud.ZkController$5.run(ZkController.java:2468) 39) Thread[id=15027, name=Thread-9893, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:108) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:76) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.core.RequestParams.getFreshRequestParams(RequestParams.java:148) at org.apache.solr.core.SolrConfig.refreshRequestParams(SolrConfig.java:917) at org.apache.solr.core.SolrCore$11.run(SolrCore.java:2596) at org.apache.solr.cloud.ZkController$5.run(ZkController.java:2468) 40) Thread[id=15323, name=Thread-10170, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:108) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:76) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.core.RequestParams.getFreshRequestParams(RequestParams.java:148) at org.apache.solr.core.SolrConfig.refreshRequestParams(SolrConfig.java:917) at org.apache.solr.core.SolrCore$11.run(SolrCore.java:2596) at org.apache.solr.cloud.ZkController$5.run(ZkController.java:2468) 41) Thread[id=15280, name=Thread-10133, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at org.apache.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:1342) at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1040) at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:302) at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:299) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.core.RequestParams.getFreshRequestParams(RequestParams.java:148) at org.apache.solr.core.SolrConfig.refreshRequestParams(SolrConfig.java:917) at org.apache.solr.core.SolrCore$11.run(SolrCore.java:2596) at org.apache.solr.cloud.ZkController$5.run(ZkController.java:2468) 42) Thread[id=13169, name=searcherExecutor-3637-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 43) Thread[id=15210, name=Thread-10071, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at org.apache.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:1342) at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1040) at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:302) at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:299) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.core.RequestParams.getFreshRequestParams(RequestParams.java:148) at org.apache.solr.core.SolrConfig.refreshRequestParams(SolrConfig.java:917) at org.apache.solr.core.SolrCore$11.run(SolrCore.java:2596) at org.apache.solr.cloud.ZkController$5.run(ZkController.java:2468) 44) Thread[id=11990, name=qtp1631332304-11990-acceptor-0@2ecfc8e4-ServerConnector@206cabeb{HTTP/1.1}{127.0.0.1:33879}, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest] at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method) at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:422) at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:250) at org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:377) at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:500) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555) at java.lang.Thread.run(Thread.java:745) 45) Thread[id=15350, name=Thread-10194, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:108) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:76) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.core.RequestParams.getFreshRequestParams(RequestParams.java:148) at org.apache.solr.core.SolrConfig.refreshRequestParams(SolrConfig.java:917) at org.apache.solr.core.SolrCore$11.run(SolrCore.java:2596) at org.apache.solr.cloud.ZkController$5.run(ZkController.java:2468) 46) Thread[id=15110, name=Thread-9975, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at org.apache.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:1342) at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1040) at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:302) at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:299) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.core.RequestParams.getFreshRequestParams(RequestParams.java:148) at org.apache.solr.core.SolrConfig.refreshRequestParams(SolrConfig.java:917) at org.apache.solr.core.SolrCore$11.run(SolrCore.java:2596) at org.apache.solr.cloud.ZkController$5.run(ZkController.java:2468) 47) Thread[id=13332, name=searcherExecutor-3785-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 48) Thread[id=15353, name=Thread-10197, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at org.apache.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:1342) at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1040) at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:302) at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:299) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.core.RequestParams.getFreshRequestParams(RequestParams.java:148) at org.apache.solr.core.SolrConfig.refreshRequestParams(SolrConfig.java:917) at org.apache.solr.core.SolrCore$11.run(SolrCore.java:2596) at org.apache.solr.cloud.ZkController$5.run(ZkController.java:2468) 49) Thread[id=11959, name=qtp1827900685-11959-acceptor-0@31d15da2-ServerConnector@14e66b5b{HTTP/1.1}{127.0.0.1:59749}, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest] at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method) at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:422) at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:250) at org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:377) at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:500) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555) at java.lang.Thread.run(Thread.java:745) 50) Thread[id=13002, name=searcherExecutor-3454-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 51) Thread[id=13985, name=OverseerThreadFactory-3955-thread-3, state=WAITING, group=Overseer collection creation process.] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 52) Thread[id=15405, name=Thread-10248, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at org.apache.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:1342) at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1040) at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:302) at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:299) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.core.RequestParams.getFreshRequestParams(RequestParams.java:148) at org.apache.solr.core.SolrConfig.refreshRequestParams(SolrConfig.java:917) at org.apache.solr.core.SolrCore$11.run(SolrCore.java:2596) at org.apache.solr.cloud.ZkController$5.run(ZkController.java:2468) 53) Thread[id=15254, name=Thread-10108, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:108) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:76) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.core.RequestParams.getFreshRequestParams(RequestParams.java:148) at org.apache.solr.core.SolrConfig.refreshRequestParams(SolrConfig.java:917) at org.apache.solr.core.SolrCore$11.run(SolrCore.java:2596) at org.apache.solr.cloud.ZkController$5.run(ZkController.java:2468) 54) Thread[id=12413, name=Scheduler-1477714105, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 55) Thread[id=12129, name=searcherExecutor-2924-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 56) Thread[id=15365, name=Thread-10209, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:108) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:76) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.core.RequestParams.getFreshRequestParams(RequestParams.java:148) at org.apache.solr.core.SolrConfig.refreshRequestParams(SolrConfig.java:917) at org.apache.solr.core.SolrCore$11.run(SolrCore.java:2596) at org.apache.solr.cloud.ZkController$5.run(ZkController.java:2468) 57) Thread[id=14780, name=Thread-9652, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:108) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:76) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.core.RequestParams.getFreshRequestParams(RequestParams.java:148) at org.apache.solr.core.SolrConfig.refreshRequestParams(SolrConfig.java:917) at org.apache.solr.core.SolrCore$11.run(SolrCore.java:2596) at org.apache.solr.cloud.ZkController$5.run(ZkController.java:2468) 58) Thread[id=15262, name=Thread-10115, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at org.apache.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:1342) at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1040) at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:302) at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:299) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.core.RequestParams.getFreshRequestParams(RequestParams.java:148) at org.apache.solr.core.SolrConfig.refreshRequestParams(SolrConfig.java:917) at org.apache.solr.core.SolrCore$11.run(SolrCore.java:2596) at org.apache.solr.cloud.ZkController$5.run(ZkController.java:2468) 59) Thread[id=15287, name=Thread-10139, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:108) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:76) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.core.RequestParams.getFreshRequestParams(RequestParams.java:148) at org.apache.solr.core.SolrConfig.refreshRequestParams(SolrConfig.java:917) at org.apache.solr.core.SolrCore$11.run(SolrCore.java:2596) at org.apache.solr.cloud.ZkController$5.run(ZkController.java:2468) 60) Thread[id=14721, name=Thread-9593, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at org.apache.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:1342) at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1040) at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:302) at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:299) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.core.RequestParams.getFreshRequestParams(RequestParams.java:148) at org.apache.solr.core.SolrConfig.refreshRequestParams(SolrConfig.java:917) at org.apache.solr.core.SolrCore$11.run(SolrCore.java:2596) at org.apache.solr.cloud.ZkController$5.run(ZkController.java:2468) 61) Thread[id=14771, name=Thread-9643, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:108) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:76) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.core.RequestParams.getFreshRequestParams(RequestParams.java:148) at org.apache.solr.core.SolrConfig.refreshRequestParams(SolrConfig.java:917) at org.apache.solr.core.SolrCore$11.run(SolrCore.java:2596) at org.apache.solr.cloud.ZkController$5.run(ZkController.java:2468) 62) Thread[id=15099, name=Thread-9964, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:108) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:76) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.core.RequestParams.getFreshRequestParams(RequestParams.java:148) at org.apache.solr.core.SolrConfig.refreshRequestParams(SolrConfig.java:917) at org.apache.solr.core.SolrCore$11.run(SolrCore.java:2596) at org.apache.solr.cloud.ZkController$5.run(ZkController.java:2468) 63) Thread[id=12538, name=SessionTracker, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Object.wait(Native Method) at org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:146) 64) Thread[id=13168, name=searcherExecutor-3649-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 65) Thread[id=13609, name=searcherExecutor-3867-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 66) Thread[id=13090, name=searcherExecutor-3591-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 67) Thread[id=12319, name=searcherExecutor-3097-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 68) Thread[id=12622, name=searcherExecutor-3280-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 69) Thread[id=13333, name=searcherExecutor-3791-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 70) Thread[id=14739, name=Thread-9611, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:108) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:76) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.core.RequestParams.getFreshRequestParams(RequestParams.java:148) at org.apache.solr.core.SolrConfig.refreshRequestParams(SolrConfig.java:917) at org.apache.solr.core.SolrCore$11.run(SolrCore.java:2596) at org.apache.solr.cloud.ZkController$5.run(ZkController.java:2468) 71) Thread[id=13290, name=qtp1631332304-13290, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:389) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:531) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$700(QueuedThreadPool.java:47) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:590) at java.lang.Thread.run(Thread.java:745) 72) Thread[id=14726, name=Thread-9598, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at org.apache.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:1342) at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1040) at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:302) at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:299) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.core.RequestParams.getFreshRequestParams(RequestParams.java:148) at org.apache.solr.core.SolrConfig.refreshRequestParams(SolrConfig.java:917) at org.apache.solr.core.SolrCore$11.run(SolrCore.java:2596) at org.apache.solr.cloud.ZkController$5.run(ZkController.java:2468) 73) Thread[id=15375, name=Thread-10219, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:108) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:76) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.core.RequestParams.getFreshRequestParams(RequestParams.java:148) at org.apache.solr.core.SolrConfig.refreshRequestParams(SolrConfig.java:917) at org.apache.solr.core.SolrCore$11.run(SolrCore.java:2596) at org.apache.solr.cloud.ZkController$5.run(ZkController.java:2468) 74) Thread[id=12179, name=searcherExecutor-2999-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 75) Thread[id=15279, name=Thread-10132, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at org.apache.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:1342) at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1040) at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:302) at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:299) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.core.RequestParams.getFreshRequestParams(RequestParams.java:148) at org.apache.solr.core.SolrConfig.refreshRequestParams(SolrConfig.java:917) at org.apache.solr.core.SolrCore$11.run(SolrCore.java:2596) at org.apache.solr.cloud.ZkController$5.run(ZkController.java:2468) 76) Thread[id=15286, name=Thread-10138, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:108) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:76) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.core.RequestParams.getFreshRequestParams(RequestParams.java:148) at org.apache.solr.core.SolrConfig.refreshRequestParams(SolrConfig.java:917) at org.apache.solr.core.SolrCore$11.run(SolrCore.java:2596) at org.apache.solr.cloud.ZkController$5.run(ZkController.java:2468) 77) Thread[id=15317, name=Thread-10164, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at org.apache.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:1342) at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1040) at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:302) at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:299) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.core.RequestParams.getFreshRequestParams(RequestParams.java:148) at org.apache.solr.core.SolrConfig.refreshRequestParams(SolrConfig.java:917) at org.apache.solr.core.SolrCore$11.run(SolrCore.java:2596) at org.apache.solr.cloud.ZkController$5.run(ZkController.java:2468) 78) Thread[id=14942, name=Thread-9809, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:108) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:76) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.core.RequestParams.getFreshRequestParams(RequestParams.java:148) at org.apache.solr.core.SolrConfig.refreshRequestParams(SolrConfig.java:917) at org.apache.solr.core.SolrCore$11.run(SolrCore.java:2596) at org.apache.solr.cloud.ZkController$5.run(ZkController.java:2468) 79) Thread[id=15380, name=Thread-10224, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:108) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:76) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.core.RequestParams.getFreshRequestParams(RequestParams.java:148) at org.apache.solr.core.SolrConfig.refreshRequestParams(SolrConfig.java:917) at org.apache.solr.core.SolrCore$11.run(SolrCore.java:2596) at org.apache.solr.cloud.ZkController$5.run(ZkController.java:2468) 80) Thread[id=15282, name=Thread-10135, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at org.apache.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:1342) at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1040) at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:302) at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:299) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.core.RequestParams.getFreshRequestParams(RequestParams.java:148) at org.apache.solr.core.SolrConfig.refreshRequestParams(SolrConfig.java:917) at org.apache.solr.core.SolrCore$11.run(SolrCore.java:2596) at org.apache.solr.cloud.ZkController$5.run(ZkController.java:2468) 81) Thread[id=15259, name=Thread-10113, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:108) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:76) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.core.RequestParams.getFreshRequestParams(RequestParams.java:148) at org.apache.solr.core.SolrConfig.refreshRequestParams(SolrConfig.java:917) at org.apache.solr.core.SolrCore$11.run(SolrCore.java:2596) at org.apache.solr.cloud.ZkController$5.run(ZkController.java:2468) 82) Thread[id=14957, name=Thread-9824, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at org.apache.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:1342) at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1040) at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:302) at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:299) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.core.RequestParams.getFreshRequestParams(RequestParams.java:148) at org.apache.solr.core.SolrConfig.refreshRequestParams(SolrConfig.java:917) at org.apache.solr.core.SolrCore$11.run(SolrCore.java:2596) at org.apache.solr.cloud.ZkController$5.run(ZkController.java:2468) 83) Thread[id=14684, name=Thread-9558, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at org.apache.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:1342) at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1040) at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:302) at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:299) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.core.RequestParams.getFreshRequestParams(RequestParams.java:148) at org.apache.solr.core.SolrConfig.refreshRequestParams(SolrConfig.java:917) at org.apache.solr.core.SolrCore$11.run(SolrCore.java:2596) at org.apache.solr.cloud.ZkController$5.run(ZkController.java:2468) 84) Thread[id=15335, name=Thread-10180, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at org.apache.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:1342) at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1040) at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:302) at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:299) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.core.RequestParams.getFreshRequestParams(RequestParams.java:148) at org.apache.solr.core.SolrConfig.refreshRequestParams(SolrConfig.java:917) at org.apache.solr.core.SolrCore$11.run(SolrCore.java:2596) at org.apache.solr.cloud.ZkController$5.run(ZkController.java:2468) 85) Thread[id=15357, name=Thread-10201, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:108) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:76) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.core.RequestParams.getFreshRequestParams(RequestParams.java:148) at org.apache.solr.core.SolrConfig.refreshRequestParams(SolrConfig.java:917) at org.apache.solr.core.SolrCore$11.run(SolrCore.java:2596) at org.apache.solr.cloud.ZkController$5.run(ZkController.java:2468) 86) Thread[id=14775, name=Thread-9647, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:108) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:76) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.core.RequestParams.getFreshRequestParams(RequestParams.java:148) at org.apache.solr.core.SolrConfig.refreshRequestParams(SolrConfig.java:917) at org.apache.solr.core.SolrCore$11.run(SolrCore.java:2596) at org.apache.solr.cloud.ZkController$5.run(ZkController.java:2468) 87) Thread[id=13326, name=searcherExecutor-3784-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 88) Thread[id=15385, name=Thread-10229, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at org.apache.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:1342) at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1040) at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:302) at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:299) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.core.RequestParams.getFreshRequestParams(RequestParams.java:148) at org.apache.solr.core.SolrConfig.refreshRequestParams(SolrConfig.java:917) at org.apache.solr.core.SolrCore$11.run(SolrCore.java:2596) at org.apache.solr.cloud.ZkController$5.run(ZkController.java:2468) 89) Thread[id=13019, name=searcherExecutor-3484-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 90) Thread[id=12966, name=searcherExecutor-3418-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 91) Thread[id=15398, name=Thread-10241, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:108) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:76) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.core.RequestParams.getFreshRequestParams(RequestParams.java:148) at org.apache.solr.core.SolrConfig.refreshRequestParams(SolrConfig.java:917) at org.apache.solr.core.SolrCore$11.run(SolrCore.java:2596) at org.apache.solr.cloud.ZkController$5.run(ZkController.java:2468) 92) Thread[id=15325, name=Thread-10171, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:108) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:76) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.core.RequestParams.getFreshRequestParams(RequestParams.java:148) at org.apache.solr.core.SolrConfig.refreshRequestParams(SolrConfig.java:917) at org.apache.solr.core.SolrCore$11.run(SolrCore.java:2596) at org.apache.solr.cloud.ZkController$5.run(ZkController.java:2468) 93) Thread[id=13104, name=searcherExecutor-3594-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 94) Thread[id=12339, name=searcherExecutor-3126-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 95) Thread[id=12992, name=searcherExecutor-3419-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 96) Thread[id=12859, name=qtp1631332304-12859, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:389) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:531) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$700(QueuedThreadPool.java:47) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:590) at java.lang.Thread.run(Thread.java:745) 97) Thread[id=14913, name=Thread-9780, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at org.apache.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:1342) at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1040) at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:302) at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:299) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.core.RequestParams.getFreshRequestParams(RequestParams.java:148) at org.apache.solr.core.SolrConfig.refreshRequestParams(SolrConfig.java:917) at org.apache.solr.core.SolrCore$11.run(SolrCore.java:2596) at org.apache.solr.cloud.ZkController$5.run(ZkController.java:2468) 98) Thread[id=15289, name=Thread-10141, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:108) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:76) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.core.RequestParams.getFreshRequestParams(RequestParams.java:148) at org.apache.solr.core.SolrConfig.refreshRequestParams(SolrConfig.java:917) at org.apache.solr.core.SolrCore$11.run(SolrCore.java:2596) at org.apache.solr.cloud.ZkController$5.run(ZkController.java:2468) 99) Thread[id=15238, name=Thread-10093, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:108) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:76) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.core.RequestParams.getFreshRequestParams(RequestParams.java:148) at org.apache.solr.core.SolrConfig.refreshRequestParams(SolrConfig.java:917) at org.apache.solr.core.SolrCore$11.run(SolrCore.java:2596) at org.apache.solr.cloud.ZkController$5.run(ZkController.java:2468) 100) Thread[id=11937, name=Scheduler-197755805, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 101) Thread[id=15260, name=Thread-10114, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:108) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:76) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.core.RequestParams.getFreshRequestParams(RequestParams.java:148) at org.apache.solr.core.SolrConfig.refreshRequestParams(SolrConfig.java:917) at org.apache.solr.core.SolrCore$11.run(SolrCore.java:2596) at org.apache.solr.cloud.ZkController$5.run(ZkController.java:2468) 102) Thread[id=12144, name=searcherExecutor-2935-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 103) Thread[id=14852, name=zkCallback-936-thread-81-processing-n:127.0.0.1:59749_, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:108) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:76) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.cloud.ZkController$WatcherImpl.process(ZkController.java:2430) at org.apache.solr.common.cloud.SolrZkClient$3$1.run(SolrZkClient.java:269) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:231) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 104) Thread[id=15258, name=Thread-10112, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:108) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:76) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.core.RequestParams.getFreshRequestParams(RequestParams.java:148) at org.apache.solr.core.SolrConfig.refreshRequestParams(SolrConfig.java:917) at org.apache.solr.core.SolrCore$11.run(SolrCore.java:2596) at org.apache.solr.cloud.ZkController$5.run(ZkController.java:2468) 105) Thread[id=12781, name=qtp493791191-12781, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:389) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:531) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$700(QueuedThreadPool.java:47) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:590) at java.lang.Thread.run(Thread.java:745) 106) Thread[id=15080, name=Thread-9946, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at org.apache.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:1342) at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1040) at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:302) at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:299) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.core.RequestParams.getFreshRequestParams(RequestParams.java:148) at org.apache.solr.core.SolrConfig.refreshRequestParams(SolrConfig.java:917) at org.apache.solr.core.SolrCore$11.run(SolrCore.java:2596) at org.apache.solr.cloud.ZkController$5.run(ZkController.java:2468) 107) Thread[id=14803, name=Thread-9673, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at org.apache.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:1342) at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1040) at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:302) at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:299) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.core.RequestParams.getFreshRequestParams(RequestParams.java:148) at org.apache.solr.core.SolrConfig.refreshRequestParams(SolrConfig.java:917) at org.apache.solr.core.SolrCore$11.run(SolrCore.java:2596) at org.apache.solr.cloud.ZkController$5.run(ZkController.java:2468) 108) Thread[id=13091, name=searcherExecutor-3600-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 109) Thread[id=15256, name=Thread-10110, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:108) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:76) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299) at org.apache.solr.core.RequestParams.getFreshRequestParams(RequestParams.java:148) at org.apache.solr.core.SolrConfig.refreshRequestParams(S
[...truncated too long message...]
le.stop(ContainerLifeCycle.java:143)
[junit4] 2> at org.eclipse.jetty.util.component.ContainerLifeCycle.doStop(ContainerLifeCycle.java:162)
[junit4] 2> at org.eclipse.jetty.server.handler.AbstractHandler.doStop(AbstractHandler.java:73)
[junit4] 2> at org.eclipse.jetty.server.Server.doStop(Server.java:456)
[junit4] 2> ... 40 more
[junit4] 2> Caused by: java.lang.InterruptedException
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1326)
[junit4] 2> at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
[junit4] 2> at org.eclipse.jetty.server.AbstractConnector.doStop(AbstractConnector.java:298)
[junit4] 2> at org.eclipse.jetty.server.AbstractNetworkConnector.doStop(AbstractNetworkConnector.java:88)
[junit4] 2> at org.eclipse.jetty.util.component.AbstractLifeCycle.stop(AbstractLifeCycle.java:89)
[junit4] 2> at org.eclipse.jetty.server.Server.doStop(Server.java:445)
[junit4] 2> ... 40 more
[junit4] 2> 9553028 INFO (SUITE-TestReplicationHandler-seed#[745A041AC46B65F1]-worker) [ ] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_745A041AC46B65F1-001
[junit4] 2> Oct 25, 2015 9:03:36 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> SEVERE: There are still zombie threads that couldn't be terminated:
[junit4] 2> 1) Thread[id=67450, name=qtp1396019072-67450-selector-ServerConnectorManager@5f87c55d/0, state=RUNNABLE, group=TGRP-TestReplicationHandler]
[junit4] 2> at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
[junit4] 2> at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
[junit4] 2> at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
[junit4] 2> at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
[junit4] 2> at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
[junit4] 2> at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
[junit4] 2> at org.eclipse.jetty.io.SelectorManager$ManagedSelector.select(SelectorManager.java:600)
[junit4] 2> at org.eclipse.jetty.io.SelectorManager$ManagedSelector.run(SelectorManager.java:549)
[junit4] 2> at org.eclipse.jetty.util.thread.NonBlockingThread.run(NonBlockingThread.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 2) Thread[id=67451, name=qtp1396019072-67451-selector-ServerConnectorManager@5f87c55d/1, state=RUNNABLE, group=TGRP-TestReplicationHandler]
[junit4] 2> at sun.nio.ch.IOUtil.drain(Native Method)
[junit4] 2> at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:90)
[junit4] 2> at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
[junit4] 2> at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
[junit4] 2> at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
[junit4] 2> at org.eclipse.jetty.io.SelectorManager$ManagedSelector.select(SelectorManager.java:600)
[junit4] 2> at org.eclipse.jetty.io.SelectorManager$ManagedSelector.run(SelectorManager.java:549)
[junit4] 2> at org.eclipse.jetty.util.thread.NonBlockingThread.run(NonBlockingThread.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 3) Thread[id=67467, name=Scheduler-872252599, state=WAITING, group=TGRP-TestReplicationHandler]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
[junit4] 2> at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081)
[junit4] 2> at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene53), sim=RandomSimilarityProvider(queryNorm=true,coord=yes): {}, locale=ar_YE, timezone=Indian/Maldives
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_45 (64-bit)/cpus=4,threads=4,free=135742248,total=468189184
[junit4] 2> NOTE: All tests run in this JVM: [CollectionStateFormat2Test, TestSolrXml, FileBasedSpellCheckerTest, TestSolrCloudWithKerberosAlt, HttpPartitionTest, EchoParamsTest, TestLuceneMatchVersion, TestStressLucene, MigrateRouteKeyTest, DateMathParserTest, TestPseudoReturnFields, CursorPagingTest, EnumFieldTest, TestDocBasedVersionConstraints, TestHighlightDedupGrouping, DateRangeFieldTest, TestDocumentBuilder, SparseHLLTest, TestOmitPositions, TestBinaryField, AssignTest, TestConfigSetsAPIZkFailure, TestValueSourceCache, TestDynamicFieldResource, TestFilteredDocIdSet, HdfsThreadLeakTest, DistribJoinFromCollectionTest, TestExactStatsCache, AlternateDirectoryTest, TestPKIAuthenticationPlugin, TestStandardQParsers, TestDistributedSearch, UUIDUpdateProcessorFallbackTest, TestRequestStatusCollectionAPI, FileUtilsTest, SynonymTokenizerTest, DefaultValueUpdateProcessorTest, DistributedQueryComponentOptimizationTest, LeaderInitiatedRecoveryOnCommitTest, AliasIntegrationTest, LeaderElectionIntegrationTest, TestRangeQuery, SmileWriterTest, TestLMDirichletSimilarityFactory, VersionInfoTest, TestSolrConfigHandlerConcurrent, TestExpandComponent, SolrXmlInZkTest, SyncSliceTest, TestCSVLoader, HdfsChaosMonkeySafeLeaderTest, CacheHeaderTest, DateFieldTest, TestCloudManagedSchema, TestFunctionQuery, PrimUtilsTest, OutputWriterTest, TestRestManager, BlockDirectoryTest, BufferStoreTest, TestSimpleQParserPlugin, TestCollectionAPI, LeaderInitiatedRecoveryOnShardRestartTest, BigEndianAscendingWordSerializerTest, OverseerRolesTest, TestArbitraryIndexDir, TestIBSimilarityFactory, IndexSchemaRuntimeFieldTest, ReturnFieldsTest, DataDrivenBlockJoinTest, TestCollationFieldDocValues, RemoteQueryErrorTest, TestExceedMaxTermLength, QueryEqualityTest, CoreMergeIndexesAdminHandlerTest, TestPivotHelperCode, CollectionsAPIAsyncDistributedZkTest, TestSolrConfigHandlerCloud, TestNoOpRegenerator, BasicDistributedZkTest, SpellingQueryConverterTest, TestHighFrequencyDictionaryFactory, SuggestComponentContextFilterQueryTest, ParsingFieldUpdateProcessorsTest, TestRandomFaceting, TestImplicitCoreProperties, TestInfoStreamLogging, SegmentsInfoRequestHandlerTest, JsonLoaderTest, DocumentAnalysisRequestHandlerTest, DeleteInactiveReplicaTest, ShardRoutingTest, BasicZkTest, TestReplicationHandler]
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestReplicationHandler -Dtests.seed=745A041AC46B65F1 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=ar_YE -Dtests.timezone=Indian/Maldives -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] ERROR 0.00s J0 | TestReplicationHandler (suite) <<<
[junit4] > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
[junit4] > at __randomizedtesting.SeedInfo.seed([745A041AC46B65F1]:0)
[junit4] Completed [553/553] on J0 in 7223.33s, 13 tests, 2 errors <<< FAILURES!
[...truncated 15 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987: There were test failures: 553 suites (8 ignored), 2173 tests, 3 suite-level errors, 3 errors, 423 ignored (14 assumptions) [seed: 745A041AC46B65F1]
Total time: 296 minutes 34 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 831 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/831/
2 tests failed.
FAILED: org.apache.solr.cloud.RollingRestartTest.test
Error Message:
Unable to restart (#4): CloudJettyRunner [url=http://127.0.0.1:42307/collection1]
Stack Trace:
java.lang.AssertionError: Unable to restart (#4): CloudJettyRunner [url=http://127.0.0.1:42307/collection1]
at __randomizedtesting.SeedInfo.seed([CFF0D230ABFCC59:84AB32F9A443A1A1]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.cloud.RollingRestartTest.restartWithRolesTest(RollingRestartTest.java:104)
at org.apache.solr.cloud.RollingRestartTest.test(RollingRestartTest.java:53)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1665)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:864)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:900)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:914)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:963)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:938)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:873)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:775)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:809)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:820)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR
Error Message:
Captured an uncaught exception in thread: Thread[id=20752, name=coreZkRegister-8952-thread-2, state=RUNNABLE, group=TGRP-LeaderInitiatedRecoveryOnShardRestartTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=20752, name=coreZkRegister-8952-thread-2, state=RUNNABLE, group=TGRP-LeaderInitiatedRecoveryOnShardRestartTest]
Caused by: java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([CFF0D230ABFCC59]:0)
at org.apache.solr.cloud.ZkController.updateLeaderInitiatedRecoveryState(ZkController.java:2126)
at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:433)
at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:197)
at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:157)
at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:346)
at org.apache.solr.cloud.ZkController.joinElection(ZkController.java:1113)
at org.apache.solr.cloud.ZkController.register(ZkController.java:926)
at org.apache.solr.cloud.ZkController.register(ZkController.java:881)
at org.apache.solr.core.ZkContainer$2.run(ZkContainer.java:183)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:231)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 10960 lines...]
[junit4] Suite: org.apache.solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_CFF0D230ABFCC59-001/init-core-data-001
[junit4] 2> 2596313 INFO (SUITE-LeaderInitiatedRecoveryOnShardRestartTest-seed#[CFF0D230ABFCC59]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
[junit4] 2> 2596315 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 2596316 INFO (Thread-11961) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 2596316 INFO (Thread-11961) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 2596416 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.ZkTestServer start zk server on port:38391
[junit4] 2> 2596416 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 2596416 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2596419 INFO (zkCallback-2091-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@52e019ef name:ZooKeeperConnection Watcher:127.0.0.1:38391 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2596419 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2596420 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 2596420 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 2596422 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 2596423 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2596424 INFO (zkCallback-2092-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@444ea876 name:ZooKeeperConnection Watcher:127.0.0.1:38391/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2596424 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2596424 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 2596424 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
[junit4] 2> 2596426 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
[junit4] 2> 2596427 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
[junit4] 2> 2596428 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
[junit4] 2> 2596430 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 2596430 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 2596433 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 2596433 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
[junit4] 2> 2596435 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 2596435 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 2596436 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 2596437 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
[junit4] 2> 2596438 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 2596438 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
[junit4] 2> 2596440 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 2596440 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
[junit4] 2> 2596442 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 2596443 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 2596444 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 2596445 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 2596447 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 2596447 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 2596449 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 2596450 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 2596451 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 2596452 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
[junit4] 2> 2596777 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_CFF0D230ABFCC59-001/control-001/cores/collection1
[junit4] 2> 2596779 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.e.j.s.Server jetty-9.2.13.v20150730
[junit4] 2> 2596781 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@70b76ecb{/,null,AVAILABLE}
[junit4] 2> 2596782 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.e.j.s.ServerConnector Started ServerConnector@5f3ce92c{HTTP/1.1}{127.0.0.1:59753}
[junit4] 2> 2596782 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.e.j.s.Server Started @2600037ms
[junit4] 2> 2596782 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_CFF0D230ABFCC59-001/tempDir-001/control/data, hostContext=/, hostPort=59753, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_CFF0D230ABFCC59-001/control-001/cores}
[junit4] 2> 2596782 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 2596782 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_CFF0D230ABFCC59-001/control-001/'
[junit4] 2> 2596782 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2596783 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 2596799 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 2596799 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2596800 INFO (zkCallback-2093-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@711e27e4 name:ZooKeeperConnection Watcher:127.0.0.1:38391/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2596800 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2596801 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 2596802 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 2596802 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_CFF0D230ABFCC59-001/control-001/solr.xml
[junit4] 2> 2596807 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_CFF0D230ABFCC59-001/control-001/cores
[junit4] 2> 2596807 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.CoreContainer New CoreContainer 1019847410
[junit4] 2> 2596807 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_CFF0D230ABFCC59-001/control-001/]
[junit4] 2> 2596807 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_CFF0D230ABFCC59-001/control-001/lib
[junit4] 2> 2596807 WARN (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_CFF0D230ABFCC59-001/control-001/lib).
[junit4] 2> 2596815 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 2596816 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 2596816 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2596816 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2596817 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38391/solr
[junit4] 2> 2596817 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 2596817 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 2596817 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2596818 INFO (zkCallback-2095-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@27be304c name:ZooKeeperConnection Watcher:127.0.0.1:38391 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2596818 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2596819 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 2596820 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [n:127.0.0.1:59753_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2596821 INFO (zkCallback-2096-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@59509316 name:ZooKeeperConnection Watcher:127.0.0.1:38391/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2596821 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [n:127.0.0.1:59753_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2596822 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [n:127.0.0.1:59753_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
[junit4] 2> 2596823 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [n:127.0.0.1:59753_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 2596826 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [n:127.0.0.1:59753_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 2596827 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [n:127.0.0.1:59753_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 2596829 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [n:127.0.0.1:59753_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 2596831 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [n:127.0.0.1:59753_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 2596832 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [n:127.0.0.1:59753_ ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 2596833 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [n:127.0.0.1:59753_ ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 2596835 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [n:127.0.0.1:59753_ ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 2596835 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [n:127.0.0.1:59753_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59753_
[junit4] 2> 2596836 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [n:127.0.0.1:59753_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:59753_
[junit4] 2> 2596837 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [n:127.0.0.1:59753_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 2596838 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [n:127.0.0.1:59753_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 2596839 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [n:127.0.0.1:59753_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2596840 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [n:127.0.0.1:59753_ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94744662029238276-127.0.0.1:59753_-n_0000000000
[junit4] 2> 2596840 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [n:127.0.0.1:59753_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:59753_
[junit4] 2> 2596840 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [n:127.0.0.1:59753_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
[junit4] 2> 2596841 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [n:127.0.0.1:59753_ ] o.a.s.c.Overseer Overseer (id=94744662029238276-127.0.0.1:59753_-n_0000000000) starting
[junit4] 2> 2596843 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [n:127.0.0.1:59753_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
[junit4] 2> 2596848 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [n:127.0.0.1:59753_ ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 2596848 INFO (OverseerCollectionConfigSetProcessor-94744662029238276-127.0.0.1:59753_-n_0000000000) [n:127.0.0.1:59753_ ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
[junit4] 2> 2596848 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [n:127.0.0.1:59753_ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 2596849 INFO (OverseerStateUpdate-94744662029238276-127.0.0.1:59753_-n_0000000000) [n:127.0.0.1:59753_ ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 2596862 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [n:127.0.0.1:59753_ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 2596862 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [n:127.0.0.1:59753_ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 2596863 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [n:127.0.0.1:59753_ ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_CFF0D230ABFCC59-001/control-001/cores
[junit4] 2> 2596864 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [n:127.0.0.1:59753_ ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_CFF0D230ABFCC59-001/control-001/cores/collection1, collection=control_collection, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_CFF0D230ABFCC59-001/control-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 2596864 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [n:127.0.0.1:59753_ ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_CFF0D230ABFCC59-001/control-001/cores/collection1/
[junit4] 2> 2596864 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [n:127.0.0.1:59753_ ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 2596865 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [n:127.0.0.1:59753_ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4] 2> 2596865 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [n:127.0.0.1:59753_ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 2596865 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 2596865 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 2596867 INFO (OverseerStateUpdate-94744662029238276-127.0.0.1:59753_-n_0000000000) [n:127.0.0.1:59753_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:59753",
[junit4] 2> "node_name":"127.0.0.1:59753_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 2596867 INFO (OverseerStateUpdate-94744662029238276-127.0.0.1:59753_-n_0000000000) [n:127.0.0.1:59753_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:59753",
[junit4] 2> "node_name":"127.0.0.1:59753_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 2596867 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 2596867 INFO (OverseerStateUpdate-94744662029238276-127.0.0.1:59753_-n_0000000000) [n:127.0.0.1:59753_ ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
[junit4] 2> 2596868 INFO (OverseerStateUpdate-94744662029238276-127.0.0.1:59753_-n_0000000000) [n:127.0.0.1:59753_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 2596869 INFO (zkCallback-2096-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2597868 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 2597868 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
[junit4] 2> 2597869 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 2597869 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 2597869 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2597869 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_CFF0D230ABFCC59-001/control-001/cores/collection1/'
[junit4] 2> 2597870 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2597870 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 2597883 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 2597887 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 2597891 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 2597898 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2597899 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 2597903 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 2597991 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 2597996 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 2597997 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 2598011 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 2598013 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 2598015 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2598015 WARN (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 2598016 WARN (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 2598016 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2598016 WARN (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 2598016 WARN (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 2598017 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4] 2> 2598017 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 2598018 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 2598018 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_CFF0D230ABFCC59-001/control-001/cores/collection1/], dataDir=[null]
[junit4] 2> 2598018 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@246a7b51
[junit4] 2> 2598018 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_CFF0D230ABFCC59-001/control-001/cores/collection1/data
[junit4] 2> 2598019 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_CFF0D230ABFCC59-001/control-001/cores/collection1/data/index/
[junit4] 2> 2598019 WARN (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_CFF0D230ABFCC59-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 2598019 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_CFF0D230ABFCC59-001/control-001/cores/collection1/data/index
[junit4] 2> 2598019 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@4d1a6536
[junit4] 2> 2598019 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@3f13b6bc lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@179896d9),segFN=segments_1,generation=1}
[junit4] 2> 2598019 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 2598020 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_CFF0D230ABFCC59-001/control-001/cores/collection1/data/
[junit4] 2> 2598020 WARN (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_CFF0D230ABFCC59-001/control-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
[junit4] 2> 2598023 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 2598024 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
[junit4] 2> 2598024 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2598024 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 2598024 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2598024 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 2598024 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2598025 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2598025 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 2598026 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 2598027 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 2598028 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 2598029 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 2598032 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 2598032 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 2598033 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 2598033 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 2598033 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
[junit4] 2> 2598033 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
[junit4] 2> 2598034 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=44, maxMergeAtOnceExplicit=45, maxMergedSegmentMB=73.580078125, floorSegmentMB=1.78125, forceMergeDeletesPctAllowed=1.5464313436320687, segmentsPerTier=34.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 2598034 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@3f13b6bc lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@179896d9),segFN=segments_1,generation=1}
[junit4] 2> 2598034 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 2598034 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@54b672b6[collection1] main
[junit4] 2> 2598034 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 2598035 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2598035 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 2598035 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 2598035 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
[junit4] 2> 2598035 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2598036 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 2598036 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2598036 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 2598036 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 2598037 INFO (searcherExecutor-8915-thread-1-processing-n:127.0.0.1:59753_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@54b672b6[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2598037 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
[junit4] 2> 2598037 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
[junit4] 2> 2598037 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
[junit4] 2> 2598037 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1515914594270314496
[junit4] 2> 2598039 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 2.0ms to seed version buckets with highest version 1515914594270314496
[junit4] 2> 2598039 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
[junit4] 2> 2598039 INFO (coreLoadExecutor-8914-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 2598040 INFO (coreZkRegister-8908-thread-1-processing-n:127.0.0.1:59753_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:59753 collection:control_collection shard:shard1
[junit4] 2> 2598040 INFO (coreZkRegister-8908-thread-1-processing-n:127.0.0.1:59753_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 2598045 INFO (coreZkRegister-8908-thread-1-processing-n:127.0.0.1:59753_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/94744662029238276-core_node1-n_0000000000
[junit4] 2> 2598045 INFO (coreZkRegister-8908-thread-1-processing-n:127.0.0.1:59753_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1
[junit4] 2> 2598046 INFO (coreZkRegister-8908-thread-1-processing-n:127.0.0.1:59753_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 2598046 INFO (coreZkRegister-8908-thread-1-processing-n:127.0.0.1:59753_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 2598046 INFO (coreZkRegister-8908-thread-1-processing-n:127.0.0.1:59753_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:59753/collection1/
[junit4] 2> 2598046 INFO (coreZkRegister-8908-thread-1-processing-n:127.0.0.1:59753_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 2598047 INFO (coreZkRegister-8908-thread-1-processing-n:127.0.0.1:59753_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:59753/collection1/ has no replicas
[junit4] 2> 2598047 INFO (coreZkRegister-8908-thread-1-processing-n:127.0.0.1:59753_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:59753/collection1/ shard1
[junit4] 2> 2598047 INFO (OverseerStateUpdate-94744662029238276-127.0.0.1:59753_-n_0000000000) [n:127.0.0.1:59753_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection"} current state version: 1
[junit4] 2> 2598047 INFO (coreZkRegister-8908-thread-1-processing-n:127.0.0.1:59753_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 2598049 INFO (coreZkRegister-8908-thread-1-processing-n:127.0.0.1:59753_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
[junit4] 2> 2598051 INFO (OverseerStateUpdate-94744662029238276-127.0.0.1:59753_-n_0000000000) [n:127.0.0.1:59753_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:59753",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 1
[junit4] 2> 2598153 INFO (zkCallback-2096-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2598202 INFO (coreZkRegister-8908-thread-1-processing-n:127.0.0.1:59753_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:59753/collection1/ and leader is http://127.0.0.1:59753/collection1/
[junit4] 2> 2598202 INFO (coreZkRegister-8908-thread-1-processing-n:127.0.0.1:59753_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:59753
[junit4] 2> 2598202 INFO (coreZkRegister-8908-thread-1-processing-n:127.0.0.1:59753_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 2598202 INFO (coreZkRegister-8908-thread-1-processing-n:127.0.0.1:59753_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
[junit4] 2> 2598202 INFO (coreZkRegister-8908-thread-1-processing-n:127.0.0.1:59753_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 2598204 INFO (OverseerStateUpdate-94744662029238276-127.0.0.1:59753_-n_0000000000) [n:127.0.0.1:59753_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:59753",
[junit4] 2> "node_name":"127.0.0.1:59753_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 2
[junit4] 2> 2598204 INFO (OverseerStateUpdate-94744662029238276-127.0.0.1:59753_-n_0000000000) [n:127.0.0.1:59753_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:59753",
[junit4] 2> "node_name":"127.0.0.1:59753_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 2598306 INFO (zkCallback-2096-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2598367 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 2598367 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2598368 INFO (zkCallback-2098-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@65e5eb17 name:ZooKeeperConnection Watcher:127.0.0.1:38391/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2598368 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2598369 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 2598369 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 2598372 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 2598372 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with stateFormat=2
[junit4] 2> 2598372 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 2598372 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2598373 INFO (zkCallback-2099-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2159c2f2 name:ZooKeeperConnection Watcher:127.0.0.1:38391/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2598373 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2598374 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 2598378 INFO (OverseerStateUpdate-94744662029238276-127.0.0.1:59753_-n_0000000000) [n:127.0.0.1:59753_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"create",
[junit4] 2> "name":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "stateFormat":"2"} current state version: 3
[junit4] 2> 2598378 INFO (OverseerStateUpdate-94744662029238276-127.0.0.1:59753_-n_0000000000) [n:127.0.0.1:59753_ ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
[junit4] 2> 2598480 INFO (OverseerStateUpdate-94744662029238276-127.0.0.1:59753_-n_0000000000) [n:127.0.0.1:59753_ ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/collection1/state.json
[junit4] 2> 2598708 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_CFF0D230ABFCC59-001/shard-1-001/cores/collection1
[junit4] 2> 2598708 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_CFF0D230ABFCC59-001/shard-1-001
[junit4] 2> 2598709 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.e.j.s.Server jetty-9.2.13.v20150730
[junit4] 2> 2598711 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@59de619d{/,null,AVAILABLE}
[junit4] 2> 2598712 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.e.j.s.ServerConnector Started ServerConnector@27d70312{HTTP/1.1}{127.0.0.1:52125}
[junit4] 2> 2598712 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.e.j.s.Server Started @2601967ms
[junit4] 2> 2598712 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_CFF0D230ABFCC59-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/, hostPort=52125, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_CFF0D230ABFCC59-001/shard-1-001/cores}
[junit4] 2> 2598712 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
[junit4] 2> 2598712 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_CFF0D230ABFCC59-001/shard-1-001/'
[junit4] 2> 2598713 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2598713 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 2598737 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 2598737 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2598739 INFO (zkCallback-2100-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@11f6fb66 name:ZooKeeperConnection Watcher:127.0.0.1:38391/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2598739 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2598739 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 2598740 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 2598740 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_CFF0D230ABFCC59-001/shard-1-001/solr.xml
[junit4] 2> 2598745 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_CFF0D230ABFCC59-001/shard-1-001/cores
[junit4] 2> 2598745 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.CoreContainer New CoreContainer 1287003714
[junit4] 2> 2598745 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_CFF0D230ABFCC59-001/shard-1-001/]
[junit4] 2> 2598745 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_CFF0D230ABFCC59-001/shard-1-001/lib
[junit4] 2> 2598745 WARN (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_CFF0D230ABFCC59-001/shard-1-001/lib).
[junit4] 2> 2598753 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 2598754 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 2598754 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2598754 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2598754 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38391/solr
[junit4] 2> 2598755 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 2598755 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 2598755 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2598756 INFO (zkCallback-2102-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2d1756e9 name:ZooKeeperConnection Watcher:127.0.0.1:38391 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2598756 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2598756 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 2598758 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [n:127.0.0.1:52125_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2598758 INFO (zkCallback-2103-thread-1-processing-n:127.0.0.1:52125_) [n:127.0.0.1:52125_ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@38626258 name:ZooKeeperConnection Watcher:127.0.0.1:38391/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2598758 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [n:127.0.0.1:52125_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2598763 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [n:127.0.0.1:52125_ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 2599770 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [n:127.0.0.1:52125_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52125_
[junit4] 2> 2599771 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [n:127.0.0.1:52125_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:52125_
[junit4] 2> 2599772 INFO (zkCallback-2103-thread-1-processing-n:127.0.0.1:52125_) [n:127.0.0.1:52125_ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2599772 INFO (zkCallback-2098-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2599772 INFO (zkCallback-2096-thread-1-processing-n:127.0.0.1:59753_) [n:127.0.0.1:59753_ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2599775 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [n:127.0.0.1:52125_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2599775 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [n:127.0.0.1:52125_ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94744662029238281-127.0.0.1:52125_-n_0000000001
[junit4] 2> 2599776 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [n:127.0.0.1:52125_ ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/94744662029238276-127.0.0.1:59753_-n_0000000000 to know if I could be the leader
[junit4] 2> 2599786 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [n:127.0.0.1:52125_ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 2599787 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [n:127.0.0.1:52125_ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 2599787 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [n:127.0.0.1:52125_ ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_CFF0D230ABFCC59-001/shard-1-001/cores
[junit4] 2> 2599788 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [n:127.0.0.1:52125_ ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_CFF0D230ABFCC59-001/shard-1-001/cores/collection1, collection=collection1, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_CFF0D230ABFCC59-001/shard-1-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 2599788 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [n:127.0.0.1:52125_ ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_CFF0D230ABFCC59-001/shard-1-001/cores/collection1/
[junit4] 2> 2599788 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [n:127.0.0.1:52125_ ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 2599790 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [n:127.0.0.1:52125_ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4] 2> 2599790 INFO (coreLoadExecutor-8925-thread-1-processing-n:127.0.0.1:52125_) [n:127.0.0.1:52125_ c:collection1 x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 2599790 INFO (coreLoadExecutor-8925-thread-1-processing-n:127.0.0.1:52125_) [n:127.0.0.1:52125_ c:collection1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 2599790 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[CFF0D230ABFCC59]) [n:127.0.0.1:52125_ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 2599791 INFO (coreLoadExecutor-8925-thread-1-processing-n:127.0.0.1:52125_) [n:127.0.0.1:52125_ c:collection1 x:collection1] o.a.s.c.ZkController Registering watch for collection collection1
[junit4] 2> 2599791 INFO (coreLoadExecutor-8925-thread-1-processing-n:127.0.0.1:52125_) [n:127.0.0.1:52125_ c:collection1 x:collection1] o.a.s.c.c.ZkStateReader addZkWatch collection1
[junit4] 2> 2599791 INFO (OverseerStateUpdate-94744662029238276-127.0.0.1:59753_-n_0000000000) [n:127.0.0.1:59753_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:52125",
[junit4] 2> "node_name":"127.0.0.1:52125_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"} current state version: 3
[junit4] 2> 2599792 INFO (coreLoadExecutor-8925-thread-1-processing-n:127.0.0.1:52125_) [n:127.0.0.1:52125_ c:collection1 x:collection1] o.a.s.c.c.ZkStateReader Add data for collection1 ver 0
[junit4] 2> 2599792 INFO (coreLoadExecutor-8925-thread-1-processing-n:127.0.0.1:52125_) [n:127.0.0.1:52125_ c:collection1 x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 2599792 INFO (OverseerStateUpdate-94744662029238276-127.0.0.1:59753_-n_0000000000) [n:127.0.0.1:59753_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:52125",
[junit4] 2> "node_name":"127.0.0.1:52125_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"}
[junit4] 2> 2599792 INFO (OverseerStateUpdate-94744662029238276-127.0.0.1:59753_-n_0000000000) [n:127.0.0.1:59753_ ] o.a.s.c.o.ReplicaMutator Collection already exists with numShards=1
[junit4] 2> 2599792 INFO (OverseerStateUpdate-94744662029238276-127.0.0.1:59753_-n_0000000000) [n:127.0.0.1:59753_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 2599894 INFO (OverseerStateUpdate-94744662029238276-127.0.0.1:59753_-n_0000000000) [n:127.0.0.1:59753_ ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/collection1/state.json version: 0
[junit4] 2> 2599895 INFO (zkCallback-2103-thread-1-processing-n:127.0.0.1:52125_) [n:127.0.0.1:52125_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent
[...truncated too long message...]
/solr/overseer_elect/election/94744672858538154-127.0.0.1:41487_-n_0000000081
[junit4] 2> 2 /solr/overseer_elect/election/94744672858538058-127.0.0.1:41487_-n_0000000026
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard2/election/94744672858538184-core_node1-n_0000000044
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard1/election/94744672858538007-core_node6-n_0000000002
[junit4] 2> 2 /solr/overseer_elect/election/94744672858538049-127.0.0.1:37136_-n_0000000022
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard2/election/94744672858537998-core_node3-n_0000000001
[junit4] 2> 2 /solr/overseer_elect/election/94744672858538010-127.0.0.1:39446_-n_0000000007
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard2/election/94744672858538022-core_node11-n_0000000005
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard2/election/94744672858538178-core_node11-n_0000000042
[junit4] 2> 2 /solr/overseer_elect/election/94744672858538115-127.0.0.1:39446_-n_0000000060
[junit4] 2> 2 /solr/overseer_elect/election/94744672858538232-127.0.0.1:37203_-n_0000000124
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard2/election/94744672858538259-core_node7-n_0000000062
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard2/election/94744672858538130-core_node11-n_0000000030
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard2/election/94744672858538166-core_node3-n_0000000039
[junit4] 2> 2 /solr/overseer_elect/election/94744672858538031-127.0.0.1:38912_-n_0000000014
[junit4] 2> 2 /solr/overseer_elect/election/94744672858538184-127.0.0.1:37203_-n_0000000099
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard2/election/94744672858538214-core_node3-n_0000000051
[junit4] 2> 2 /solr/overseer_elect/election/94744672858538082-127.0.0.1:54803_-n_0000000041
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard2/election/94744672858538070-core_node3-n_0000000015
[junit4] 2> 2 /solr/overseer_elect/election/94744672858538136-127.0.0.1:37203_-n_0000000070
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard2/election/94744672858538082-core_node11-n_0000000018
[junit4] 2> 2 /solr/overseer_elect/election/94744672858538007-127.0.0.1:43197_-n_0000000142
[junit4] 2> 2 /solr/overseer_elect/election/94744672858538163-127.0.0.1:39446_-n_0000000085
[junit4] 2> 2 /solr/overseer_elect/election/94744672858538067-127.0.0.1:39446_-n_0000000031
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard2/election/94744672858538040-core_node1-n_0000000008
[junit4] 2> 2 /solr/overseer_elect/election/94744672858538178-127.0.0.1:54803_-n_0000000092
[junit4] 2> 2 /solr/overseer_elect/election/94744672858538211-127.0.0.1:39446_-n_0000000111
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard2/election/94744672858538262-core_node3-n_0000000063
[junit4] 2> 2 /solr/overseer_elect/election/94744672858538130-127.0.0.1:54803_-n_0000000066
[junit4] 2> 2 /solr/overseer_elect/election/94744672858538226-127.0.0.1:54803_-n_0000000121
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 97 /solr/collections
[junit4] 2> 36 /solr/overseer/collection-queue-work
[junit4] 2> 29 /solr/overseer/queue
[junit4] 2> 18 /solr/live_nodes
[junit4] 2> 11 /solr/overseer/queue-work
[junit4] 2>
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=RollingRestartTest -Dtests.method=test -Dtests.seed=CFF0D230ABFCC59 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=hr_HR -Dtests.timezone=Asia/Almaty -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[junit4] FAILURE 652s J0 | RollingRestartTest.test <<<
[junit4] > Throwable #1: java.lang.AssertionError: Unable to restart (#4): CloudJettyRunner [url=http://127.0.0.1:42307/collection1]
[junit4] > at __randomizedtesting.SeedInfo.seed([CFF0D230ABFCC59:84AB32F9A443A1A1]:0)
[junit4] > at org.apache.solr.cloud.RollingRestartTest.restartWithRolesTest(RollingRestartTest.java:104)
[junit4] > at org.apache.solr.cloud.RollingRestartTest.test(RollingRestartTest.java:53)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:963)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:938)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 3413161 INFO (SUITE-RollingRestartTest-seed#[CFF0D230ABFCC59]-worker) [n:127.0.0.1:49444_ c:collection1 s:shard1 r:core_node16 x:collection1] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.RollingRestartTest_CFF0D230ABFCC59-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene53), sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=hr_HR, timezone=Asia/Almaty
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_45 (64-bit)/cpus=4,threads=1,free=152762520,total=525860864
[junit4] 2> NOTE: All tests run in this JVM: [AliasIntegrationTest, TestPseudoReturnFields, TestManagedResource, StandardRequestHandlerTest, TestBinaryField, TestSimpleTrackingShardHandler, TestSolrConfigHandler, TestNoOpRegenerator, TestOmitPositions, TestRandomDVFaceting, TestBlobHandler, TestRestManager, CopyFieldTest, TestManagedSynonymFilterFactory, FileUtilsTest, TestLazyCores, TestSchemaSimilarityResource, BasicZkTest, TestIBSimilarityFactory, TestSolrConfigHandlerConcurrent, TestExceedMaxTermLength, CollectionTooManyReplicasTest, ResourceLoaderTest, TestAnalyzedSuggestions, HdfsBasicDistributedZk2Test, HttpPartitionTest, DataDrivenBlockJoinTest, TestStandardQParsers, IndexSchemaRuntimeFieldTest, PrimUtilsTest, OutOfBoxZkACLAndCredentialsProvidersTest, TestSolrXml, TestComponentsName, TestSortingResponseWriter, TestHighFrequencyDictionaryFactory, RankQueryTest, TestSchemaResource, TestCollapseQParserPlugin, CurrencyFieldOpenExchangeTest, BaseCdcrDistributedZkTest, TestFilteredDocIdSet, QueryEqualityTest, TestRecoveryHdfs, DistributedSpellCheckComponentTest, SmileWriterTest, TestCollationFieldDocValues, AssignTest, HdfsChaosMonkeyNothingIsSafeTest, SignatureUpdateProcessorFactoryTest, LeaderElectionIntegrationTest, TestDocumentBuilder, BigEndianAscendingWordSerializerTest, BlockDirectoryTest, DisMaxRequestHandlerTest, PingRequestHandlerTest, TestFunctionQuery, TestCSVLoader, JSONWriterTest, DocumentAnalysisRequestHandlerTest, TestSimpleQParserPlugin, VersionInfoTest, CacheHeaderTest, XsltUpdateRequestHandlerTest, SolrCoreTest, TestDocSet, SegmentsInfoRequestHandlerTest, TestDefaultStatsCache, TestExclusionRuleCollectionAccess, TestCloudSchemaless, FileBasedSpellCheckerTest, TestMergePolicyConfig, TestRangeQuery, TestReplicationHandler, TestJoin, PeerSyncTest, ZkStateWriterTest, TestFaceting, SynonymTokenizerTest, TestExpandComponent, TestSolr4Spatial, TestInfoStreamLogging, DistributedSuggestComponentTest, RequiredFieldsTest, TestPhraseSuggestions, ExitableDirectoryReaderTest, DeleteLastCustomShardedReplicaTest, DateFieldTest, JavabinLoaderTest, QueryElevationComponentTest, JsonLoaderTest, SpellingQueryConverterTest, DOMUtilTest, RAMDirectoryFactoryTest, TestSolrJ, TestLRUCache, SliceStateTest, SystemInfoHandlerTest, DistributedMLTComponentTest, CursorPagingTest, SolrTestCaseJ4Test, TestCursorMarkWithoutUniqueKey, TestDistributedMissingSort, TestHighlightDedupGrouping, TestTolerantSearch, TestEmbeddedSolrServerConstructors, ActionThrottleTest, AsyncMigrateRouteKeyTest, CdcrVersionReplicationTest, CleanupOldIndexTest, CollectionReloadTest, CollectionsAPIAsyncDistributedZkTest, ConcurrentDeleteAndCreateCollectionTest, DistribJoinFromCollectionTest, DistributedQueueTest, DistributedVersionInfoTest, LeaderInitiatedRecoveryOnCommitTest, MigrateRouteKeyTest, OverseerRolesTest, ReplicationFactorTest, RollingRestartTest]
[junit4] Completed [437/552] on J0 in 652.08s, 1 test, 1 failure <<< FAILURES!
[...truncated 385 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987: There were test failures: 552 suites (8 ignored), 2172 tests, 1 error, 1 failure, 31 ignored (18 assumptions) [seed: CFF0D230ABFCC59]
Total time: 201 minutes 10 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any