You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2017/01/27 04:47:05 UTC
[JENKINS] Lucene-Solr-NightlyTests-6.x - Build # 268 - Still
Unstable
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.x/268/
10 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.CleanupOldIndexTest
Error Message:
1 thread leaked from SUITE scope at org.apache.solr.cloud.CleanupOldIndexTest: 1) Thread[id=27329, name=OverseerHdfsCoreFailoverThread-97352969672851467-127.0.0.1:53806_solr-n_0000000002, state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.] at java.lang.Thread.sleep(Native Method) at org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:139) at java.lang.Thread.run(Thread.java:745)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.CleanupOldIndexTest:
1) Thread[id=27329, name=OverseerHdfsCoreFailoverThread-97352969672851467-127.0.0.1:53806_solr-n_0000000002, state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.]
at java.lang.Thread.sleep(Native Method)
at org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:139)
at java.lang.Thread.run(Thread.java:745)
at __randomizedtesting.SeedInfo.seed([807A1E143D26CFDB]:0)
FAILED: org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.deletePartiallyCreatedCollection
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([807A1E143D26CFDB:AAFA72F18AFCEF13]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertTrue(Assert.java:54)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.deletePartiallyCreatedCollection(CollectionsAPIDistributedZkTest.java:165)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.testNoCollectionSpecified
Error Message:
Error from server at http://127.0.0.1:53792/solr: Error CREATEing SolrCore 'corewithnocollection': Unable to create core [corewithnocollection] Caused by: Direct buffer memory
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:53792/solr: Error CREATEing SolrCore 'corewithnocollection': Unable to create core [corewithnocollection] Caused by: Direct buffer memory
at __randomizedtesting.SeedInfo.seed([807A1E143D26CFDB:F3D99EE4894E9AF9]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:610)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:279)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:268)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:435)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:387)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1344)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:1095)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:1037)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testNoCollectionSpecified(CollectionsAPIDistributedZkTest.java:333)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.testSpecificConfigsets
Error Message:
KeeperErrorCode = NoNode for /collections/withconfigset2
Stack Trace:
org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /collections/withconfigset2
at __randomizedtesting.SeedInfo.seed([807A1E143D26CFDB:AD04514ECA0275D7]:0)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:356)
at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:353)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:353)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testSpecificConfigsets(CollectionsAPIDistributedZkTest.java:425)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.testDeleteNonExistentCollection
Error Message:
Collection creation after a bad delete failed null Last available state: null
Stack Trace:
java.lang.AssertionError: Collection creation after a bad delete failed
null
Last available state: null
at __randomizedtesting.SeedInfo.seed([807A1E143D26CFDB:675D0E292A45B022]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.SolrCloudTestCase.waitForState(SolrCloudTestCase.java:265)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testDeleteNonExistentCollection(CollectionsAPIDistributedZkTest.java:418)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.addReplicaTest
Error Message:
Could not find collection : addReplicaColl
Stack Trace:
org.apache.solr.common.SolrException: Could not find collection : addReplicaColl
at __randomizedtesting.SeedInfo.seed([807A1E143D26CFDB:13DA4932B32E840A]:0)
at org.apache.solr.common.cloud.ClusterState.getCollection(ClusterState.java:194)
at org.apache.solr.cloud.SolrCloudTestCase.getCollectionState(SolrCloudTestCase.java:245)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.addReplicaTest(CollectionsAPIDistributedZkTest.java:666)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.testCreateShouldFailOnExistingCore
Error Message:
Error from server at http://127.0.0.1:52052/solr: Error CREATEing SolrCore 'halfcollection_shard1_replica1': Unable to create core [halfcollection_shard1_replica1] Caused by: Direct buffer memory
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:52052/solr: Error CREATEing SolrCore 'halfcollection_shard1_replica1': Unable to create core [halfcollection_shard1_replica1] Caused by: Direct buffer memory
at __randomizedtesting.SeedInfo.seed([807A1E143D26CFDB:6CBCB3A0C6BA723F]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:610)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:279)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:268)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCreateShouldFailOnExistingCore(CollectionsAPIDistributedZkTest.java:283)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.testCollectionsAPI
Error Message:
Expected to see collection awhollynewcollection_0 null Last available state: DocCollection(awhollynewcollection_0//collections/awhollynewcollection_0/state.json/3)={ "replicationFactor":"1", "shards":{ "shard1":{ "range":"80000000-ffffffff", "state":"active", "replicas":{}}, "shard2":{ "range":"0-7fffffff", "state":"active", "replicas":{}}}, "router":{"name":"compositeId"}, "maxShardsPerNode":"1", "autoAddReplicas":"false"}
Stack Trace:
java.lang.AssertionError: Expected to see collection awhollynewcollection_0
null
Last available state: DocCollection(awhollynewcollection_0//collections/awhollynewcollection_0/state.json/3)={
"replicationFactor":"1",
"shards":{
"shard1":{
"range":"80000000-ffffffff",
"state":"active",
"replicas":{}},
"shard2":{
"range":"0-7fffffff",
"state":"active",
"replicas":{}}},
"router":{"name":"compositeId"},
"maxShardsPerNode":"1",
"autoAddReplicas":"false"}
at __randomizedtesting.SeedInfo.seed([807A1E143D26CFDB:C80F6AA03B15E04E]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.SolrCloudTestCase.waitForState(SolrCloudTestCase.java:265)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:496)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.hdfs.StressHdfsTest.test
Error Message:
Timeout occured while waiting response from server at: http://127.0.0.1:52136/j/ov
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:52136/j/ov
at __randomizedtesting.SeedInfo.seed([807A1E143D26CFDB:82E21CE93DAA223]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:621)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:279)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:268)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:435)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:387)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1344)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:1095)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:1037)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
at org.apache.solr.cloud.hdfs.StressHdfsTest.createAndDeleteCollection(StressHdfsTest.java:220)
at org.apache.solr.cloud.hdfs.StressHdfsTest.test(StressHdfsTest.java:103)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:170)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:515)
... 51 more
FAILED: org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest.test
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([807A1E143D26CFDB:82E21CE93DAA223]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertTrue(Assert.java:54)
at org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest.test(HdfsWriteToMultipleCollectionsTest.java:137)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 12827 lines...]
[junit4] Suite: org.apache.solr.cloud.CleanupOldIndexTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.CleanupOldIndexTest_807A1E143D26CFDB-001/init-core-data-001
[junit4] 2> 3258016 INFO (SUITE-CleanupOldIndexTest-seed#[807A1E143D26CFDB]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 2> 3258016 INFO (SUITE-CleanupOldIndexTest-seed#[807A1E143D26CFDB]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.CleanupOldIndexTest_807A1E143D26CFDB-001/tempDir-001
[junit4] 2> 3258017 INFO (SUITE-CleanupOldIndexTest-seed#[807A1E143D26CFDB]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 3258017 INFO (Thread-17053) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 3258017 INFO (Thread-17053) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 3258117 INFO (SUITE-CleanupOldIndexTest-seed#[807A1E143D26CFDB]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:50982
[junit4] 2> 3258129 INFO (jetty-launcher-1562-thread-1) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 3258132 INFO (jetty-launcher-1562-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@8894375{/solr,null,AVAILABLE}
[junit4] 2> 3258135 INFO (jetty-launcher-1562-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@6fc2f7ad{SSL,[ssl, http/1.1]}{127.0.0.1:53806}
[junit4] 2> 3258135 INFO (jetty-launcher-1562-thread-1) [ ] o.e.j.s.Server Started @3261931ms
[junit4] 2> 3258135 INFO (jetty-launcher-1562-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=53806}
[junit4] 2> 3258138 ERROR (jetty-launcher-1562-thread-1) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 3258138 INFO (jetty-launcher-1562-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 6.5.0
[junit4] 2> 3258138 INFO (jetty-launcher-1562-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 3258138 INFO (jetty-launcher-1562-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 3258138 INFO (jetty-launcher-1562-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-01-27T03:40:28.966Z
[junit4] 2> 3258136 INFO (jetty-launcher-1562-thread-2) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 3258141 INFO (jetty-launcher-1562-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@35b8e8f8{/solr,null,AVAILABLE}
[junit4] 2> 3258141 INFO (jetty-launcher-1562-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 3258143 INFO (jetty-launcher-1562-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@1ecb85e9{SSL,[ssl, http/1.1]}{127.0.0.1:39748}
[junit4] 2> 3258143 INFO (jetty-launcher-1562-thread-2) [ ] o.e.j.s.Server Started @3261938ms
[junit4] 2> 3258143 INFO (jetty-launcher-1562-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=39748}
[junit4] 2> 3258143 ERROR (jetty-launcher-1562-thread-2) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 3258144 INFO (jetty-launcher-1562-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 6.5.0
[junit4] 2> 3258144 INFO (jetty-launcher-1562-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 3258144 INFO (jetty-launcher-1562-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 3258144 INFO (jetty-launcher-1562-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-01-27T03:40:28.972Z
[junit4] 2> 3258146 INFO (jetty-launcher-1562-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 3258149 INFO (jetty-launcher-1562-thread-1) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 3258150 INFO (jetty-launcher-1562-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:50982/solr
[junit4] 2> 3258155 INFO (jetty-launcher-1562-thread-2) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 3258159 INFO (jetty-launcher-1562-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:50982/solr
[junit4] 2> 3258176 INFO (jetty-launcher-1562-thread-1) [n:127.0.0.1:53806_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:53806_solr
[junit4] 2> 3258177 INFO (jetty-launcher-1562-thread-1) [n:127.0.0.1:53806_solr ] o.a.s.c.Overseer Overseer (id=97352969672851460-127.0.0.1:53806_solr-n_0000000000) starting
[junit4] 2> 3258186 INFO (jetty-launcher-1562-thread-1) [n:127.0.0.1:53806_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53806_solr
[junit4] 2> 3258188 INFO (zkCallback-1569-thread-1-processing-n:127.0.0.1:53806_solr) [n:127.0.0.1:53806_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 3258190 INFO (jetty-launcher-1562-thread-2) [n:127.0.0.1:39748_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39748_solr
[junit4] 2> 3258195 INFO (zkCallback-1574-thread-1-processing-n:127.0.0.1:39748_solr) [n:127.0.0.1:39748_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 3258199 INFO (zkCallback-1569-thread-1-processing-n:127.0.0.1:53806_solr) [n:127.0.0.1:53806_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 3258268 INFO (jetty-launcher-1562-thread-1) [n:127.0.0.1:53806_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.CleanupOldIndexTest_807A1E143D26CFDB-001/tempDir-001/node1/.
[junit4] 2> 3258269 INFO (jetty-launcher-1562-thread-2) [n:127.0.0.1:39748_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.CleanupOldIndexTest_807A1E143D26CFDB-001/tempDir-001/node2/.
[junit4] 2> 3259177 INFO (SUITE-CleanupOldIndexTest-seed#[807A1E143D26CFDB]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 3259178 INFO (SUITE-CleanupOldIndexTest-seed#[807A1E143D26CFDB]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:50982/solr ready
[junit4] 2> 3259194 INFO (TEST-CleanupOldIndexTest.test-seed#[807A1E143D26CFDB]) [ ] o.a.s.SolrTestCaseJ4 ###Starting test
[junit4] 2> 3259253 INFO (qtp943492118-27218) [n:127.0.0.1:39748_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params async=2736dc83-d141-43b5-9b4a-3444992b892b&replicationFactor=2&collection.configName=conf1&name=oldindextest&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 3259255 INFO (qtp943492118-27218) [n:127.0.0.1:39748_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={async=2736dc83-d141-43b5-9b4a-3444992b892b&replicationFactor=2&collection.configName=conf1&name=oldindextest&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=1
[junit4] 2> 3259257 INFO (qtp943492118-27219) [n:127.0.0.1:39748_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=2736dc83-d141-43b5-9b4a-3444992b892b&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 3259258 INFO (qtp943492118-27219) [n:127.0.0.1:39748_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=2736dc83-d141-43b5-9b4a-3444992b892b&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
[junit4] 2> 3259258 INFO (OverseerThreadFactory-6182-thread-1-processing-n:127.0.0.1:53806_solr) [n:127.0.0.1:53806_solr ] o.a.s.c.CreateCollectionCmd Create collection oldindextest
[junit4] 2> 3259379 INFO (qtp943492118-27216) [n:127.0.0.1:39748_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={async=2736dc83-d141-43b5-9b4a-3444992b892b23864676303556747&qt=/admin/cores&collection.configName=conf1&newCollection=true&name=oldindextest_shard1_replica2&action=CREATE&numShards=1&collection=oldindextest&shard=shard1&wt=javabin&version=2} status=0 QTime=3
[junit4] 2> 3259379 INFO (parallelCoreAdminExecutor-6185-thread-1-processing-n:127.0.0.1:39748_solr 2736dc83-d141-43b5-9b4a-3444992b892b23864676303556747 CREATE) [n:127.0.0.1:39748_solr ] o.a.s.h.a.CoreAdminOperation core create command async=2736dc83-d141-43b5-9b4a-3444992b892b23864676303556747&qt=/admin/cores&collection.configName=conf1&newCollection=true&name=oldindextest_shard1_replica2&action=CREATE&numShards=1&collection=oldindextest&shard=shard1&wt=javabin&version=2
[junit4] 2> 3259425 INFO (qtp156991439-27206) [n:127.0.0.1:53806_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={async=2736dc83-d141-43b5-9b4a-3444992b892b23864676303817224&qt=/admin/cores&collection.configName=conf1&newCollection=true&name=oldindextest_shard1_replica1&action=CREATE&numShards=1&collection=oldindextest&shard=shard1&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 3259425 INFO (parallelCoreAdminExecutor-6183-thread-1-processing-n:127.0.0.1:53806_solr 2736dc83-d141-43b5-9b4a-3444992b892b23864676303817224 CREATE) [n:127.0.0.1:53806_solr ] o.a.s.h.a.CoreAdminOperation core create command async=2736dc83-d141-43b5-9b4a-3444992b892b23864676303817224&qt=/admin/cores&collection.configName=conf1&newCollection=true&name=oldindextest_shard1_replica1&action=CREATE&numShards=1&collection=oldindextest&shard=shard1&wt=javabin&version=2
[junit4] 2> 3259431 INFO (qtp943492118-27217) [n:127.0.0.1:39748_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 2736dc83-d141-43b5-9b4a-3444992b892b23864676303556747
[junit4] 2> 3259431 INFO (qtp943492118-27217) [n:127.0.0.1:39748_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=2736dc83-d141-43b5-9b4a-3444992b892b23864676303556747&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 3259533 INFO (zkCallback-1569-thread-2-processing-n:127.0.0.1:53806_solr) [n:127.0.0.1:53806_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/oldindextest/state.json] for collection [oldindextest] has occurred - updating... (live nodes size: [2])
[junit4] 2> 3259534 INFO (zkCallback-1574-thread-1-processing-n:127.0.0.1:39748_solr) [n:127.0.0.1:39748_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/oldindextest/state.json] for collection [oldindextest] has occurred - updating... (live nodes size: [2])
[junit4] 2> 3260260 INFO (qtp943492118-27212) [n:127.0.0.1:39748_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=2736dc83-d141-43b5-9b4a-3444992b892b&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 3260261 INFO (qtp943492118-27212) [n:127.0.0.1:39748_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=2736dc83-d141-43b5-9b4a-3444992b892b&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 3260408 INFO (parallelCoreAdminExecutor-6185-thread-1-processing-n:127.0.0.1:39748_solr 2736dc83-d141-43b5-9b4a-3444992b892b23864676303556747 CREATE) [n:127.0.0.1:39748_solr c:oldindextest s:shard1 x:oldindextest_shard1_replica2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
[junit4] 2> 3260421 INFO (parallelCoreAdminExecutor-6185-thread-1-processing-n:127.0.0.1:39748_solr 2736dc83-d141-43b5-9b4a-3444992b892b23864676303556747 CREATE) [n:127.0.0.1:39748_solr c:oldindextest s:shard1 x:oldindextest_shard1_replica2] o.a.s.s.IndexSchema [oldindextest_shard1_replica2] Schema name=cloud-dynamic
[junit4] 2> 3260434 INFO (qtp943492118-27218) [n:127.0.0.1:39748_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 2736dc83-d141-43b5-9b4a-3444992b892b23864676303556747
[junit4] 2> 3260434 INFO (qtp943492118-27218) [n:127.0.0.1:39748_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=2736dc83-d141-43b5-9b4a-3444992b892b23864676303556747&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 3260439 INFO (parallelCoreAdminExecutor-6183-thread-1-processing-n:127.0.0.1:53806_solr 2736dc83-d141-43b5-9b4a-3444992b892b23864676303817224 CREATE) [n:127.0.0.1:53806_solr c:oldindextest s:shard1 x:oldindextest_shard1_replica1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
[junit4] 2> 3260445 WARN (parallelCoreAdminExecutor-6185-thread-1-processing-n:127.0.0.1:39748_solr 2736dc83-d141-43b5-9b4a-3444992b892b23864676303556747 CREATE) [n:127.0.0.1:39748_solr c:oldindextest s:shard1 x:oldindextest_shard1_replica2] o.a.s.s.IndexSchema [oldindextest_shard1_replica2] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 3260446 INFO (parallelCoreAdminExecutor-6185-thread-1-processing-n:127.0.0.1:39748_solr 2736dc83-d141-43b5-9b4a-3444992b892b23864676303556747 CREATE) [n:127.0.0.1:39748_solr c:oldindextest s:shard1 x:oldindextest_shard1_replica2] o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
[junit4] 2> 3260448 INFO (parallelCoreAdminExecutor-6185-thread-1-processing-n:127.0.0.1:39748_solr 2736dc83-d141-43b5-9b4a-3444992b892b23864676303556747 CREATE) [n:127.0.0.1:39748_solr c:oldindextest s:shard1 x:oldindextest_shard1_replica2] o.a.s.c.CoreContainer Creating SolrCore 'oldindextest_shard1_replica2' using configuration from collection oldindextest
[junit4] 2> 3260448 INFO (parallelCoreAdminExecutor-6185-thread-1-processing-n:127.0.0.1:39748_solr 2736dc83-d141-43b5-9b4a-3444992b892b23864676303556747 CREATE) [n:127.0.0.1:39748_solr c:oldindextest s:shard1 x:oldindextest_shard1_replica2] o.a.s.c.SolrCore [[oldindextest_shard1_replica2] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.CleanupOldIndexTest_807A1E143D26CFDB-001/tempDir-001/node2/oldindextest_shard1_replica2], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.CleanupOldIndexTest_807A1E143D26CFDB-001/tempDir-001/node2/./oldindextest_shard1_replica2/data/]
[junit4] 2> 3260458 INFO (parallelCoreAdminExecutor-6183-thread-1-processing-n:127.0.0.1:53806_solr 2736dc83-d141-43b5-9b4a-3444992b892b23864676303817224 CREATE) [n:127.0.0.1:53806_solr c:oldindextest s:shard1 x:oldindextest_shard1_replica1] o.a.s.s.IndexSchema [oldindextest_shard1_replica1] Schema name=cloud-dynamic
[junit4] 2> 3260461 INFO (parallelCoreAdminExecutor-6185-thread-1-processing-n:127.0.0.1:39748_solr 2736dc83-d141-43b5-9b4a-3444992b892b23864676303556747 CREATE) [n:127.0.0.1:39748_solr c:oldindextest s:shard1 x:oldindextest_shard1_replica2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 3260461 INFO (parallelCoreAdminExecutor-6185-thread-1-processing-n:127.0.0.1:39748_solr 2736dc83-d141-43b5-9b4a-3444992b892b23864676303556747 CREATE) [n:127.0.0.1:39748_solr c:oldindextest s:shard1 x:oldindextest_shard1_replica2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 3260462 INFO (parallelCoreAdminExecutor-6185-thread-1-processing-n:127.0.0.1:39748_solr 2736dc83-d141-43b5-9b4a-3444992b892b23864676303556747 CREATE) [n:127.0.0.1:39748_solr c:oldindextest s:shard1 x:oldindextest_shard1_replica2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 3260462 INFO (parallelCoreAdminExecutor-6185-thread-1-processing-n:127.0.0.1:39748_solr 2736dc83-d141-43b5-9b4a-3444992b892b23864676303556747 CREATE) [n:127.0.0.1:39748_solr c:oldindextest s:shard1 x:oldindextest_shard1_replica2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 3260463 INFO (parallelCoreAdminExecutor-6185-thread-1-processing-n:127.0.0.1:39748_solr 2736dc83-d141-43b5-9b4a-3444992b892b23864676303556747 CREATE) [n:127.0.0.1:39748_solr c:oldindextest s:shard1 x:oldindextest_shard1_replica2] o.a.s.s.SolrIndexSearcher Opening [Searcher@6d87ce31[oldindextest_shard1_replica2] main]
[junit4] 2> 3260464 INFO (parallelCoreAdminExecutor-6185-thread-1-processing-n:127.0.0.1:39748_solr 2736dc83-d141-43b5-9b4a-3444992b892b23864676303556747 CREATE) [n:127.0.0.1:39748_solr c:oldindextest s:shard1 x:oldindextest_shard1_replica2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 3260464 INFO (parallelCoreAdminExecutor-6185-thread-1-processing-n:127.0.0.1:39748_solr 2736dc83-d141-43b5-9b4a-3444992b892b23864676303556747 CREATE) [n:127.0.0.1:39748_solr c:oldindextest s:shard1 x:oldindextest_shard1_replica2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 3260464 INFO (parallelCoreAdminExecutor-6185-thread-1-processing-n:127.0.0.1:39748_solr 2736dc83-d141-43b5-9b4a-3444992b892b23864676303556747 CREATE) [n:127.0.0.1:39748_solr c:oldindextest s:shard1 x:oldindextest_shard1_replica2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 3260465 INFO (parallelCoreAdminExecutor-6185-thread-1-processing-n:127.0.0.1:39748_solr 2736dc83-d141-43b5-9b4a-3444992b892b23864676303556747 CREATE) [n:127.0.0.1:39748_solr c:oldindextest s:shard1 x:oldindextest_shard1_replica2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1557647517331488768
[junit4] 2> 3260470 INFO (searcherExecutor-6187-thread-1-processing-x:oldindextest_shard1_replica2 2736dc83-d141-43b5-9b4a-3444992b892b23864676303556747 CREATE n:127.0.0.1:39748_solr s:shard1 c:oldindextest) [n:127.0.0.1:39748_solr c:oldindextest s:shard1 x:oldindextest_shard1_replica2] o.a.s.c.SolrCore [oldindextest_shard1_replica2] Registered new searcher Searcher@6d87ce31[oldindextest_shard1_replica2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 3260473 INFO (parallelCoreAdminExecutor-6185-thread-1-processing-n:127.0.0.1:39748_solr 2736dc83-d141-43b5-9b4a-3444992b892b23864676303556747 CREATE) [n:127.0.0.1:39748_solr c:oldindextest s:shard1 x:oldindextest_shard1_replica2] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=9998ms
[junit4] 2> 3260487 WARN (parallelCoreAdminExecutor-6183-thread-1-processing-n:127.0.0.1:53806_solr 2736dc83-d141-43b5-9b4a-3444992b892b23864676303817224 CREATE) [n:127.0.0.1:53806_solr c:oldindextest s:shard1 x:oldindextest_shard1_replica1] o.a.s.s.IndexSchema [oldindextest_shard1_replica1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 3260488 INFO (parallelCoreAdminExecutor-6183-thread-1-processing-n:127.0.0.1:53806_solr 2736dc83-d141-43b5-9b4a-3444992b892b23864676303817224 CREATE) [n:127.0.0.1:53806_solr c:oldindextest s:shard1 x:oldindextest_shard1_replica1] o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
[junit4] 2> 3260489 INFO (parallelCoreAdminExecutor-6183-thread-1-processing-n:127.0.0.1:53806_solr 2736dc83-d141-43b5-9b4a-3444992b892b23864676303817224 CREATE) [n:127.0.0.1:53806_solr c:oldindextest s:shard1 x:oldindextest_shard1_replica1] o.a.s.c.CoreContainer Creating SolrCore 'oldindextest_shard1_replica1' using configuration from collection oldindextest
[junit4] 2> 3260489 INFO (parallelCoreAdminExecutor-6183-thread-1-processing-n:127.0.0.1:53806_solr 2736dc83-d141-43b5-9b4a-3444992b892b23864676303817224 CREATE) [n:127.0.0.1:53806_solr c:oldindextest s:shard1 x:oldindextest_shard1_replica1] o.a.s.c.SolrCore [[oldindextest_shard1_replica1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.CleanupOldIndexTest_807A1E143D26CFDB-001/tempDir-001/node1/oldindextest_shard1_replica1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.CleanupOldIndexTest_807A1E143D26CFDB-001/tempDir-001/node1/./oldindextest_shard1_replica1/data/]
[junit4] 2> 3260499 INFO (parallelCoreAdminExecutor-6183-thread-1-processing-n:127.0.0.1:53806_solr 2736dc83-d141-43b5-9b4a-3444992b892b23864676303817224 CREATE) [n:127.0.0.1:53806_solr c:oldindextest s:shard1 x:oldindextest_shard1_replica1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 3260499 INFO (parallelCoreAdminExecutor-6183-thread-1-processing-n:127.0.0.1:53806_solr 2736dc83-d141-43b5-9b4a-3444992b892b23864676303817224 CREATE) [n:127.0.0.1:53806_solr c:oldindextest s:shard1 x:oldindextest_shard1_replica1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 3260500 INFO (parallelCoreAdminExecutor-6183-thread-1-processing-n:127.0.0.1:53806_solr 2736dc83-d141-43b5-9b4a-3444992b892b23864676303817224 CREATE) [n:127.0.0.1:53806_solr c:oldindextest s:shard1 x:oldindextest_shard1_replica1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 3260500 INFO (parallelCoreAdminExecutor-6183-thread-1-processing-n:127.0.0.1:53806_solr 2736dc83-d141-43b5-9b4a-3444992b892b23864676303817224 CREATE) [n:127.0.0.1:53806_solr c:oldindextest s:shard1 x:oldindextest_shard1_replica1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 3260501 INFO (parallelCoreAdminExecutor-6183-thread-1-processing-n:127.0.0.1:53806_solr 2736dc83-d141-43b5-9b4a-3444992b892b23864676303817224 CREATE) [n:127.0.0.1:53806_solr c:oldindextest s:shard1 x:oldindextest_shard1_replica1] o.a.s.s.SolrIndexSearcher Opening [Searcher@721d6a37[oldindextest_shard1_replica1] main]
[junit4] 2> 3260502 INFO (parallelCoreAdminExecutor-6183-thread-1-processing-n:127.0.0.1:53806_solr 2736dc83-d141-43b5-9b4a-3444992b892b23864676303817224 CREATE) [n:127.0.0.1:53806_solr c:oldindextest s:shard1 x:oldindextest_shard1_replica1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 3260503 INFO (parallelCoreAdminExecutor-6183-thread-1-processing-n:127.0.0.1:53806_solr 2736dc83-d141-43b5-9b4a-3444992b892b23864676303817224 CREATE) [n:127.0.0.1:53806_solr c:oldindextest s:shard1 x:oldindextest_shard1_replica1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 3260503 INFO (parallelCoreAdminExecutor-6183-thread-1-processing-n:127.0.0.1:53806_solr 2736dc83-d141-43b5-9b4a-3444992b892b23864676303817224 CREATE) [n:127.0.0.1:53806_solr c:oldindextest s:shard1 x:oldindextest_shard1_replica1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 3260503 INFO (searcherExecutor-6192-thread-1-processing-x:oldindextest_shard1_replica1 2736dc83-d141-43b5-9b4a-3444992b892b23864676303817224 CREATE n:127.0.0.1:53806_solr s:shard1 c:oldindextest) [n:127.0.0.1:53806_solr c:oldindextest s:shard1 x:oldindextest_shard1_replica1] o.a.s.c.SolrCore [oldindextest_shard1_replica1] Registered new searcher Searcher@721d6a37[oldindextest_shard1_replica1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 3260503 INFO (parallelCoreAdminExecutor-6183-thread-1-processing-n:127.0.0.1:53806_solr 2736dc83-d141-43b5-9b4a-3444992b892b23864676303817224 CREATE) [n:127.0.0.1:53806_solr c:oldindextest s:shard1 x:oldindextest_shard1_replica1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1557647517371334656
[junit4] 2> 3260574 INFO (zkCallback-1569-thread-3-processing-n:127.0.0.1:53806_solr) [n:127.0.0.1:53806_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/oldindextest/state.json] for collection [oldindextest] has occurred - updating... (live nodes size: [2])
[junit4] 2> 3260574 INFO (zkCallback-1574-thread-1-processing-n:127.0.0.1:39748_solr) [n:127.0.0.1:39748_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/oldindextest/state.json] for collection [oldindextest] has occurred - updating... (live nodes size: [2])
[junit4] 2> 3260974 INFO (parallelCoreAdminExecutor-6185-thread-1-processing-n:127.0.0.1:39748_solr 2736dc83-d141-43b5-9b4a-3444992b892b23864676303556747 CREATE) [n:127.0.0.1:39748_solr c:oldindextest s:shard1 x:oldindextest_shard1_replica2] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 3260974 INFO (parallelCoreAdminExecutor-6185-thread-1-processing-n:127.0.0.1:39748_solr 2736dc83-d141-43b5-9b4a-3444992b892b23864676303556747 CREATE) [n:127.0.0.1:39748_solr c:oldindextest s:shard1 x:oldindextest_shard1_replica2] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 3260974 INFO (parallelCoreAdminExecutor-6185-thread-1-processing-n:127.0.0.1:39748_solr 2736dc83-d141-43b5-9b4a-3444992b892b23864676303556747 CREATE) [n:127.0.0.1:39748_solr c:oldindextest s:shard1 x:oldindextest_shard1_replica2] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:39748/solr/oldindextest_shard1_replica2/
[junit4] 2> 3260974 INFO (parallelCoreAdminExecutor-6185-thread-1-processing-n:127.0.0.1:39748_solr 2736dc83-d141-43b5-9b4a-3444992b892b23864676303556747 CREATE) [n:127.0.0.1:39748_solr c:oldindextest s:shard1 x:oldindextest_shard1_replica2] o.a.s.u.PeerSync PeerSync: core=oldindextest_shard1_replica2 url=https://127.0.0.1:39748/solr START replicas=[https://127.0.0.1:53806/solr/oldindextest_shard1_replica1/] nUpdates=100
[junit4] 2> 3260974 INFO (parallelCoreAdminExecutor-6185-thread-1-processing-n:127.0.0.1:39748_solr 2736dc83-d141-43b5-9b4a-3444992b892b23864676303556747 CREATE) [n:127.0.0.1:39748_solr c:oldindextest s:shard1 x:oldindextest_shard1_replica2] o.a.s.u.PeerSync PeerSync: core=oldindextest_shard1_replica2 url=https://127.0.0.1:39748/solr DONE. We have no versions. sync failed.
[junit4] 2> 3260980 INFO (qtp156991439-27203) [n:127.0.0.1:53806_solr c:oldindextest s:shard1 r:core_node2 x:oldindextest_shard1_replica1] o.a.s.c.S.Request [oldindextest_shard1_replica1] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 3260980 INFO (parallelCoreAdminExecutor-6185-thread-1-processing-n:127.0.0.1:39748_solr 2736dc83-d141-43b5-9b4a-3444992b892b23864676303556747 CREATE) [n:127.0.0.1:39748_solr c:oldindextest s:shard1 x:oldindextest_shard1_replica2] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 3260980 INFO (parallelCoreAdminExecutor-6185-thread-1-processing-n:127.0.0.1:39748_solr 2736dc83-d141-43b5-9b4a-3444992b892b23864676303556747 CREATE) [n:127.0.0.1:39748_solr c:oldindextest s:shard1 x:oldindextest_shard1_replica2] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 3260984 INFO (parallelCoreAdminExecutor-6185-thread-1-processing-n:127.0.0.1:39748_solr 2736dc83-d141-43b5-9b4a-3444992b892b23864676303556747 CREATE) [n:127.0.0.1:39748_solr c:oldindextest s:shard1 x:oldindextest_shard1_replica2] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:39748/solr/oldindextest_shard1_replica2/ shard1
[junit4] 2> 3261087 INFO (zkCallback-1569-thread-2-processing-n:127.0.0.1:53806_solr) [n:127.0.0.1:53806_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/oldindextest/state.json] for collection [oldindextest] has occurred - updating... (live nodes size: [2])
[junit4] 2> 3261087 INFO (zkCallback-1574-thread-1-processing-n:127.0.0.1:39748_solr) [n:127.0.0.1:39748_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/oldindextest/state.json] for collection [oldindextest] has occurred - updating... (live nodes size: [2])
[junit4] 2> 3261135 INFO (parallelCoreAdminExecutor-6185-thread-1-processing-n:127.0.0.1:39748_solr 2736dc83-d141-43b5-9b4a-3444992b892b23864676303556747 CREATE) [n:127.0.0.1:39748_solr c:oldindextest s:shard1 x:oldindextest_shard1_replica2] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 3261241 INFO (zkCallback-1569-thread-2-processing-n:127.0.0.1:53806_solr) [n:127.0.0.1:53806_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/oldindextest/state.json] for collection [oldindextest] has occurred - updating... (live nodes size: [2])
[junit4] 2> 3261241 INFO (zkCallback-1574-thread-1-processing-n:127.0.0.1:39748_solr) [n:127.0.0.1:39748_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/oldindextest/state.json] for collection [oldindextest] has occurred - updating... (live nodes size: [2])
[junit4] 2> 3261263 INFO (qtp943492118-27219) [n:127.0.0.1:39748_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=2736dc83-d141-43b5-9b4a-3444992b892b&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 3261264 INFO (qtp943492118-27219) [n:127.0.0.1:39748_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=2736dc83-d141-43b5-9b4a-3444992b892b&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 3261436 INFO (qtp943492118-27218) [n:127.0.0.1:39748_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 2736dc83-d141-43b5-9b4a-3444992b892b23864676303556747
[junit4] 2> 3261436 INFO (qtp943492118-27218) [n:127.0.0.1:39748_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=2736dc83-d141-43b5-9b4a-3444992b892b23864676303556747&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 3261439 INFO (qtp156991439-27207) [n:127.0.0.1:53806_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 2736dc83-d141-43b5-9b4a-3444992b892b23864676303817224
[junit4] 2> 3261439 INFO (qtp156991439-27207) [n:127.0.0.1:53806_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=2736dc83-d141-43b5-9b4a-3444992b892b23864676303817224&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 3261611 INFO (zkCallback-1569-thread-1-processing-n:127.0.0.1:53806_solr) [n:127.0.0.1:53806_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/oldindextest/state.json] for collection [oldindextest] has occurred - updating... (live nodes size: [2])
[junit4] 2> 3261611 INFO (zkCallback-1574-thread-1-processing-n:127.0.0.1:39748_solr) [n:127.0.0.1:39748_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/oldindextest/state.json] for collection [oldindextest] has occurred - updating... (live nodes size: [2])
[junit4] 2> 3262266 INFO (qtp943492118-27215) [n:127.0.0.1:39748_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=2736dc83-d141-43b5-9b4a-3444992b892b&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 3262267 INFO (qtp943492118-27215) [n:127.0.0.1:39748_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=2736dc83-d141-43b5-9b4a-3444992b892b&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
[junit4] 2> 3262441 INFO (qtp156991439-27205) [n:127.0.0.1:53806_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 2736dc83-d141-43b5-9b4a-3444992b892b23864676303817224
[junit4] 2> 3262441 INFO (qtp156991439-27205) [n:127.0.0.1:53806_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=2736dc83-d141-43b5-9b4a-3444992b892b23864676303817224&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 3262444 INFO (OverseerThreadFactory-6182-thread-1-processing-n:127.0.0.1:53806_solr) [n:127.0.0.1:53806_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 3263261 INFO (OverseerCollectionConfigSetProcessor-97352969672851460-127.0.0.1:53806_solr-n_0000000000) [n:127.0.0.1:53806_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 3263269 INFO (qtp943492118-27217) [n:127.0.0.1:39748_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=2736dc83-d141-43b5-9b4a-3444992b892b&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 3263271 INFO (qtp943492118-27217) [n:127.0.0.1:39748_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=2736dc83-d141-43b5-9b4a-3444992b892b&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
[junit4] 2> 3263272 INFO (qtp943492118-27212) [n:127.0.0.1:39748_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :deletestatus with params requestid=2736dc83-d141-43b5-9b4a-3444992b892b&action=DELETESTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 3263273 INFO (qtp943492118-27212) [n:127.0.0.1:39748_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=2736dc83-d141-43b5-9b4a-3444992b892b&action=DELETESTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 3263303 INFO (qtp156991439-27204) [n:127.0.0.1:53806_solr c:oldindextest s:shard1 r:core_node2 x:oldindextest_shard1_replica1] o.a.s.u.p.LogUpdateProcessorFactory [oldindextest_shard1_replica1] webapp=/solr path=/update params={update.distrib=FROMLEADER&distrib.from=https://127.0.0.1:39748/solr/oldindextest_shard1_replica2/&wt=javabin&version=2}{add=[1-0 (1557647520281133056)]} 0 20
[junit4] 2> 3263309 INFO (qtp943492118-27213) [n:127.0.0.1:39748_solr c:oldindextest s:shard1 r:core_node1 x:oldindextest_shard1_replica2] o.a.s.u.p.LogUpdateProcessorFactory [oldindextest_shard1_replica2] webapp=/solr path=/update params={wt=javabin&version=2}{add=[1-0 (1557647520281133056)]} 0 31
[junit4] 2> 3263314 INFO (qtp156991439-27201) [n:127.0.0.1:53806_solr c:oldindextest s:shard1 r:core_node2 x:oldindextest_shard1_replica1] o.a.s.u.p.LogUpdateProcessorFactory [oldindextest_shard1_replica1] webapp=/solr path=/update params={update.distrib=FROMLEADER&distrib.from=https://127.0.0.1:39748/solr/oldindextest_shard1_replica2/&wt=javabin&version=2}{add=[1-1 (1557647520316784640)]} 0 0
[junit4] 2> 3263315 INFO (qtp943492118-27219) [n:127.0.0.1:39748_solr c:oldindextest s:shard1 r:core_node1 x:oldindextest_shard1_replica2] o.a.s.u.p.LogUpdateProcessorFactory [oldindextest_shard1_replica2] webapp=/solr path=/update params={wt=javabin&version=2}{add=[1-1 (1557647520316784640)]} 0 2
[junit4] 2> 3263319 INFO (qtp156991439-27200) [n:127.0.0.1:53806_solr c:oldindextest s:shard1 r:core_node2 x:oldindextest_shard1_replica1] o.a.s.u.p.LogUpdateProcessorFactory [oldindextest_shard1_replica1] webapp=/solr path=/update params={update.distrib=FROMLEADER&distrib.from=https://127.0.0.1:39748/solr/oldindextest_shard1_replica2/&wt=javabin&version=2}{add=[1-2 (1557647520320978944)]} 0 0
[junit4] 2> 3263319 INFO (qtp943492118-27218) [n:127.0.0.1:39748_solr c:oldindextest s:shard1 r:core_node1 x:oldindextest_shard1_replica2] o.a.s.u.p.LogUpdateProcessorFactory [oldindextest_shard1_replica2] webapp=/solr path=/update params={wt=javabin&version=2}{add=[1-2 (1557647520320978944)]} 0 2
[junit4] 2> 3263324 INFO (qtp156991439-27203) [n:127.0.0.1:53806_solr c:oldindextest s:shard1 r:core_node2 x:oldindextest_shard1_replica1] o.a.s.u.p.LogUpdateProcessorFactory [oldindextest_shard1_replica1] webapp=/solr path=/update params={update.distrib=FROMLEADER&distrib.from=https://127.0.0.1:39748/solr/oldindextest_shard1_replica2/&wt=javabin&version=2}{add=[1-3 (1557647520326221824)]} 0 0
[junit4] 2> 3263325 INFO (qtp943492118-27215) [n:127.0.0.1:39748_solr c:oldindextest s:shard1 r:core_node1 x:oldindextest_shard1_replica2] o.a.s.u.p.LogUpdateProcessorFactory [oldindextest_shard1_replica2] webapp=/solr path=/update params={wt=javabin&version=2}{add=[1-3 (1557647520326221824)]} 0 4
[junit4] 2> 3263329 INFO (qtp156991439-27207) [n:127.0.0.1:53806_solr c:oldindextest s:shard1 r:core_node2 x:oldindextest_shard1_replica1] o.a.s.u.p.LogUpdateProcessorFactory [oldindextest_shard1_replica1] webapp=/solr path=/update params={update.distrib=FROMLEADER&distrib.from=https://127.0.0.1:39748/solr/oldindextest_shard1_replica2/&wt=javabin&version=2}{add=[1-4 (1557647520332513280)]} 0 0
[junit4] 2> 3263329 INFO (qtp943492118-27217) [n:127.0.0.1:39748_solr c:oldindextest s:shard1 r:core_node1 x:oldindextest_shard1_replica2] o.a.s.u.p.LogUpdateProcessorFactory [oldindextest_shard1_replica2] webapp=/solr path=/update params={wt=javabin&version=2}{add=[1-4 (1557647520332513280)]} 0 2
[junit4] 2> 3263333 INFO (qtp156991439-27204) [n:127.0.0.1:53806_solr c:oldindextest s:shard1 r:core_node2 x:oldindextest_shard1_replica1] o.a.s.u.p.LogUpdateProcessorFactory [oldindextest_shard1_replica1] webapp=/solr path=/update params={update.distrib=FROMLEADER&distrib.from=https://127.0.0.1:39748/solr/oldindextest_shard1_replica2/&wt=javabin&version=2}{delete=[1-0 (-1557647520336707584)]} 0 0
[junit4] 2> 3263333 INFO (qtp943492118-27217) [n:127.0.0.1:39748_solr c:oldindextest s:shard1 r:core_node1 x:oldindextest_shard1_replica2] o.a.s.u.p.LogUpdateProcessorFactory [oldindextest_shard1_replica2] webapp=/solr path=/update params={wt=javabin&version=2}{delete=[1-0 (-1557647520336707584)]} 0 2
[junit4] 2> 3263341 INFO (qtp156991439-27201) [n:127.0.0.1:53806_solr c:oldindextest s:shard1 r:core_node2 x:oldindextest_shard1_replica1] o.a.s.u.p.LogUpdateProcessorFactory [oldindextest_shard1_replica1] webapp=/solr path=/update params={update.distrib=FROMLEADER&distrib.from=https://127.0.0.1:39748/solr/oldindextest_shard1_replica2/&wt=javabin&version=2}{add=[1-5 (1557647520340901888)]} 0 0
[junit4] 2> 3263341 INFO (qtp943492118-27213) [n:127.0.0.1:39748_solr c:oldindextest s:shard1 r:core_node1 x:oldindextest_shard1_replica2] o.a.s.u.p.LogUpdateProcessorFactory [oldindextest_shard1_replica2] webapp=/solr path=/update params={wt=javabin&version=2}{add=[1-5 (1557647520340901888)]} 0 6
[junit4] 2> 3263344 INFO (qtp156991439-27201) [n:127.0.0.1:53806_solr c:oldindextest s:shard1 r:core_node2 x:oldindextest_shard1_replica1] o.a.s.u.p.LogUpdateProcessorFactory [oldindextest_shard1_replica1] webapp=/solr path=/update params={update.distrib=FROMLEADER&distrib.from=https://127.0.0.1:39748/solr/oldindextest_shard1_replica2/&wt=javabin&version=2}{delete=[1-3 (-1557647520349290496)]} 0 0
[junit4] 2> 3263345 INFO (qtp943492118-27219) [n:127.0.0.1:39748_solr c:oldindextest s:shard1 r:core_node1 x:oldindextest_shard1_replica2] o.a.s.u.p.LogUpdateProcessorFactory [oldindextest_shard1_replica2] webapp=/solr path=/update params={wt=javabin&version=2}{delete=[1-3 (-1557647520349290496)]} 0 1
[junit4] 2> 3263353 INFO (qtp156991439-27201) [n:127.0.0.1:53806_solr c:oldindextest s:shard1 r:core_node2 x:oldindextest_shard1_replica1] o.a.s.u.p.LogUpdateProcessorFactory [oldindextest_shard1_replica1] webapp=/solr path=/update params={update.distrib=FROMLEADER&distrib.from=https://127.0.0.1:39748/solr/oldindextest_shard1_replica2/&wt=javabin&version=2}{add=[1-6 (1557647520357679104)]} 0 0
[junit4] 2> 3263354 INFO (qtp943492118-27218) [n:127.0.0.1:39748_solr c:oldindextest s:shard1 r:core_node1 x:oldindextest_shard1_replica2] o.a.s.u.p.LogUpdateProcessorFactory [oldindextest_shard1_replica2] webapp=/solr path=/update params={wt=javabin&version=2}{add=[1-6 (1557647520357679104)]} 0 2
[junit4] 2> 3263357 INFO (qtp156991439-27201) [n:127.0.0.1:53806_solr c:oldindextest s:shard1 r:core_node2 x:oldindextest_shard1_replica1] o.a.s.u.p.LogUpdateProcessorFactory [oldindextest_shard1_replica1] webapp=/solr path=/update params={update.distrib=FROMLEADER&distrib.from=https://127.0.0.1:39748/solr/oldindextest_shard1_replica2/&wt=javabin&version=2}{add=[1-7 (1557647520361873408)]} 0 0
[junit4] 2> 3263357 INFO (qtp943492118-27215) [n:127.0.0.1:39748_solr c:oldindextest s:shard1 r:core_node1 x:oldindextest_shard1_replica2] o.a.s.u.p.LogUpdateProcessorFactory [oldindextest_shard1_replica2] webapp=/solr path=/update params={wt=javabin&version=2}{add=[1-7 (1557647520361873408)]} 0 2
[junit4] 2> 3263361 INFO (qtp156991439-27207) [n:127.0.0.1:53806_solr c:oldindextest s:shard1 r:core_node2 x:oldindextest_shard1_replica1] o.a.s.u.p.LogUpdateProcessorFactory [oldindextest_shard1_replica1] webapp=/solr path=/update params={update.distrib=FROMLEADER&distrib.from=https://127.0.0.1:39748/solr/oldindextest_shard1_replica2/&wt=javabin&version=2}{delete=[1-4 (-1557647520366067712)]} 0 0
[junit4] 2> 3263361 INFO (qtp943492118-27212) [n:127.0.0.1:39748_solr c:oldindextest s:shard1 r:core_node1 x:oldindextest_shard1_rep
[...truncated too long message...]
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stop(MetricsSourceAdapter.java:211)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stopSources(MetricsSystemImpl.java:463)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stop(MetricsSystemImpl.java:213)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.shutdown(MetricsSystemImpl.java:594)
[junit4] 2> at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdownInstance(DefaultMetricsSystem.java:72)
[junit4] 2> at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdown(DefaultMetricsSystem.java:68)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.metrics.NameNodeMetrics.shutdown(NameNodeMetrics.java:171)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.NameNode.stop(NameNode.java:872)
[junit4] 2> at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1726)
[junit4] 2> at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1705)
[junit4] 2> at org.apache.solr.cloud.hdfs.HdfsTestUtil.teardownClass(HdfsTestUtil.java:198)
[junit4] 2> at org.apache.solr.cloud.hdfs.StressHdfsTest.teardownClass(StressHdfsTest.java:77)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:498)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:870)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> Caused by: java.lang.NullPointerException
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlocksMap.size(BlocksMap.java:203)
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.getTotalBlocks(BlockManager.java:3370)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlocksTotal(FSNamesystem.java:5729)
[junit4] 2> ... 53 more
[junit4] 2> 5621543 INFO (SUITE-StressHdfsTest-seed#[807A1E143D26CFDB]-worker) [ ] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_807A1E143D26CFDB-001
[junit4] 2> Jan 27, 2017 4:19:52 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 34 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene62): {range_facet_l_dv=Lucene50(blocksize=128), _version_=PostingsFormat(name=LuceneVarGapFixedInterval), multiDefault=Lucene50(blocksize=128), intDefault=PostingsFormat(name=LuceneVarGapFixedInterval), id=Lucene50(blocksize=128), range_facet_i_dv=Lucene50(blocksize=128), text=FSTOrd50, range_facet_l=Lucene50(blocksize=128), timestamp=Lucene50(blocksize=128), txt_t=FSTOrd50}, docValues:{range_facet_l_dv=DocValuesFormat(name=Direct), _version_=DocValuesFormat(name=Lucene54), multiDefault=DocValuesFormat(name=Lucene54), intDefault=DocValuesFormat(name=Lucene54), range_facet_i_dv=DocValuesFormat(name=Lucene54), id=DocValuesFormat(name=Direct), text=DocValuesFormat(name=Asserting), timestamp=DocValuesFormat(name=Lucene54), range_facet_l=DocValuesFormat(name=Lucene54), txt_t=DocValuesFormat(name=Asserting)}, maxPointsInLeafNode=1072, maxMBSortInHeap=6.18985337701412, sim=RandomSimilarity(queryNorm=true,coord=no): {}, locale=en-GB, timezone=Pacific/Guam
[junit4] 2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_102 (64-bit)/cpus=4,threads=2,free=292758376,total=535298048
[junit4] 2> NOTE: All tests run in this JVM: [TestComponentsName, TestDynamicFieldCollectionResource, TestRestoreCore, BlobRepositoryCloudTest, TestConfigSetsAPIZkFailure, TestLeaderInitiatedRecoveryThread, LeaderElectionIntegrationTest, BitVectorTest, OutputWriterTest, TestConfigSets, TestOmitPositions, OutOfBoxZkACLAndCredentialsProvidersTest, DistributedFacetExistsSmallTest, CoreAdminRequestStatusTest, TestAtomicUpdateErrorCases, NumericFieldsTest, CursorPagingTest, TestMiniSolrCloudCluster, TestDocTermOrds, AlternateDirectoryTest, CollectionTooManyReplicasTest, SyncSliceTest, TestConfigOverlay, TestSolrQueryParserResource, TestDefaultStatsCache, ResponseHeaderTest, RequiredFieldsTest, ChaosMonkeyNothingIsSafeTest, TestCodecSupport, TestTrackingShardHandlerFactory, TestBadConfig, DateFieldTest, TestCollectionAPI, ReturnFieldsTest, EnumFieldTest, TestDocumentBuilder, TestPerFieldSimilarity, SpatialRPTFieldTypeTest, TestBinaryResponseWriter, TestJmxIntegration, DisMaxRequestHandlerTest, TestLazyCores, XsltUpdateRequestHandlerTest, UUIDUpdateProcessorFallbackTest, PolyFieldTest, TestDocSet, TestMacros, TestShardHandlerFactory, BasicZkTest, PeerSyncTest, DistributedFacetPivotSmallAdvancedTest, TestJsonFacetRefinement, TestUnifiedSolrHighlighter, RegexBoostProcessorTest, TestHighlightDedupGrouping, TestPerFieldSimilarityClassic, HttpPartitionTest, TestValueSourceCache, TestOverriddenPrefixQueryForCustomFieldType, SaslZkACLProviderTest, TestSolrXml, TestClassicSimilarityFactory, AddBlockUpdateTest, TestOrdValues, ClusterStateTest, ChangedSchemaMergeTest, TestReloadDeadlock, TestHighFrequencyDictionaryFactory, TestDistribDocBasedVersion, DistribDocExpirationUpdateProcessorTest, TestHdfsBackupRestoreCore, TestCrossCoreJoin, TestRebalanceLeaders, TestCollapseQParserPlugin, TestManagedResourceStorage, TestHdfsCloudBackupRestore, MetricUtilsTest, TestBinaryResponseWriter, ParsingFieldUpdateProcessorsTest, TestFieldResource, TestGraphTermsQParserPlugin, RequestLoggingTest, TestNumericTerms32, TestSmileRequest, TestOnReconnectListenerSupport, QueryEqualityTest, ConcurrentDeleteAndCreateCollectionTest, SolrCoreTest, TestFastWriter, UtilsToolTest, DefaultValueUpdateProcessorTest, TestDistributedStatsComponentCardinality, TestFastLRUCache, HdfsSyncSliceTest, TestJsonRequest, TestRuleBasedAuthorizationPlugin, TestQuerySenderNoQuery, TestPushWriter, PKIAuthenticationIntegrationTest, PathHierarchyTokenizerFactoryTest, TestSchemaVersionResource, DistributedSpellCheckComponentTest, SignatureUpdateProcessorFactoryTest, TestRequestStatusCollectionAPI, ResourceLoaderTest, TestCloudPseudoReturnFields, SolrCoreMetricManagerTest, HdfsRecoverLeaseTest, TestSolr4Spatial, TestStressRecovery, TestSubQueryTransformerCrossCore, ChaosMonkeySafeLeaderTest, CollectionsAPIDistributedZkTest, TestReplicationHandler, SearchHandlerTest, ResponseLogComponentTest, TestMergePolicyConfig, TestElisionMultitermQuery, ExternalFileFieldSortTest, TestPostingsSolrHighlighter, TestLuceneMatchVersion, TestCharFilters, TestXIncludeConfig, TestLMJelinekMercerSimilarityFactory, URLClassifyProcessorTest, PrimUtilsTest, TestSuggestSpellingConverter, SpellingQueryConverterTest, UUIDFieldTest, TestRTGBase, DistributedIntervalFacetingTest, CleanupOldIndexTest, CreateCollectionCleanupTest, DeleteLastCustomShardedReplicaTest, DeleteReplicaTest, DistribJoinFromCollectionTest, DocValuesNotIndexedTest, LeaderElectionContextKeyTest, LeaderFailureAfterFreshStartTest, MissingSegmentRecoveryTest, OverseerModifyCollectionTest, PeerSyncReplicationTest, RollingRestartTest, TestCloudRecovery, TestRequestForwarding, TestSSLRandomization, TestShortCircuitedRequests, TestSizeLimitedDistributedMap, TestSolrCloudWithDelegationTokens, TestSolrCloudWithKerberosAlt, TestStressCloudBlindAtomicUpdates, TriLevelCompositeIdRoutingTest, HdfsChaosMonkeySafeLeaderTest, HdfsRestartWhileUpdatingTest, HdfsWriteToMultipleCollectionsTest, StressHdfsTest]
[junit4] Completed [570/681 (4!)] on J0 in 266.17s, 1 test, 1 error <<< FAILURES!
[...truncated 62794 lines...]
[JENKINS] Lucene-Solr-NightlyTests-6.x - Build # 291 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.x/291/
5 tests failed.
FAILED: org.apache.solr.cloud.CdcrReplicationDistributedZkTest.testBatchAddsWithDelete
Error Message:
Timeout while trying to assert number of documents @ target_collection
Stack Trace:
java.lang.AssertionError: Timeout while trying to assert number of documents @ target_collection
at __randomizedtesting.SeedInfo.seed([9D4FB6EDFC038CA9:EA55CF49541A8D85]:0)
at org.apache.solr.cloud.BaseCdcrDistributedZkTest.assertNumDocs(BaseCdcrDistributedZkTest.java:271)
at org.apache.solr.cloud.CdcrReplicationDistributedZkTest.testBatchAddsWithDelete(CdcrReplicationDistributedZkTest.java:532)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.AssertionError: expected:<59> but was:<0>
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at org.apache.solr.cloud.BaseCdcrDistributedZkTest.assertNumDocs(BaseCdcrDistributedZkTest.java:262)
... 42 more
FAILED: org.apache.solr.cloud.HttpPartitionTest.test
Error Message:
Timeout occured while waiting response from server at: http://127.0.0.1:35230/l_/q/c8n_1x2_shard1_replica1
Stack Trace:
org.apache.solr.client.solrj.impl.CloudSolrClient$RouteException: Timeout occured while waiting response from server at: http://127.0.0.1:35230/l_/q/c8n_1x2_shard1_replica1
at __randomizedtesting.SeedInfo.seed([9D4FB6EDFC038CA9:151B893752FFE151]:0)
at org.apache.solr.client.solrj.impl.CloudSolrClient.directUpdate(CloudSolrClient.java:805)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1238)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:1109)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:1042)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
at org.apache.solr.cloud.HttpPartitionTest.sendDoc(HttpPartitionTest.java:609)
at org.apache.solr.cloud.HttpPartitionTest.sendDoc(HttpPartitionTest.java:595)
at org.apache.solr.cloud.HttpPartitionTest.testRf2(HttpPartitionTest.java:357)
at org.apache.solr.cloud.HttpPartitionTest.test(HttpPartitionTest.java:125)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:35230/l_/q/c8n_1x2_shard1_replica1
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:621)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:279)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:268)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:435)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:387)
at org.apache.solr.client.solrj.impl.CloudSolrClient.lambda$directUpdate$0(CloudSolrClient.java:780)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
... 1 more
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:171)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:515)
... 10 more
FAILED: org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates.test_dv
Error Message:
java.lang.RuntimeException: Error from server at http://127.0.0.1:43728/solr/test_col: Async exception during distributed update: Error from server at http://127.0.0.1:60007/solr/test_col_shard1_replica2: Server Error request: http://127.0.0.1:60007/solr/test_col_shard1_replica2/update?update.distrib=TOLEADER&distrib.from=http%3A%2F%2F127.0.0.1%3A43728%2Fsolr%2Ftest_col_shard4_replica1%2F&wt=javabin&version=2 Remote error message: Failed synchronous update on shard StdNode: http://127.0.0.1:57618/solr/test_col_shard1_replica1/ update: org.apache.solr.client.solrj.request.UpdateRequest@2748274d
Stack Trace:
java.util.concurrent.ExecutionException: java.lang.RuntimeException: Error from server at http://127.0.0.1:43728/solr/test_col: Async exception during distributed update: Error from server at http://127.0.0.1:60007/solr/test_col_shard1_replica2: Server Error
request: http://127.0.0.1:60007/solr/test_col_shard1_replica2/update?update.distrib=TOLEADER&distrib.from=http%3A%2F%2F127.0.0.1%3A43728%2Fsolr%2Ftest_col_shard4_replica1%2F&wt=javabin&version=2
Remote error message: Failed synchronous update on shard StdNode: http://127.0.0.1:57618/solr/test_col_shard1_replica1/ update: org.apache.solr.client.solrj.request.UpdateRequest@2748274d
at __randomizedtesting.SeedInfo.seed([9D4FB6EDFC038CA9:AB5BD4AB765EB6B8]:0)
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
at java.util.concurrent.FutureTask.get(FutureTask.java:192)
at org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates.checkField(TestStressCloudBlindAtomicUpdates.java:281)
at org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates.test_dv(TestStressCloudBlindAtomicUpdates.java:193)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: Error from server at http://127.0.0.1:43728/solr/test_col: Async exception during distributed update: Error from server at http://127.0.0.1:60007/solr/test_col_shard1_replica2: Server Error
request: http://127.0.0.1:60007/solr/test_col_shard1_replica2/update?update.distrib=TOLEADER&distrib.from=http%3A%2F%2F127.0.0.1%3A43728%2Fsolr%2Ftest_col_shard4_replica1%2F&wt=javabin&version=2
Remote error message: Failed synchronous update on shard StdNode: http://127.0.0.1:57618/solr/test_col_shard1_replica1/ update: org.apache.solr.client.solrj.request.UpdateRequest@2748274d
at org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates$Worker.run(TestStressCloudBlindAtomicUpdates.java:409)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
... 1 more
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:43728/solr/test_col: Async exception during distributed update: Error from server at http://127.0.0.1:60007/solr/test_col_shard1_replica2: Server Error
request: http://127.0.0.1:60007/solr/test_col_shard1_replica2/update?update.distrib=TOLEADER&distrib.from=http%3A%2F%2F127.0.0.1%3A43728%2Fsolr%2Ftest_col_shard4_replica1%2F&wt=javabin&version=2
Remote error message: Failed synchronous update on shard StdNode: http://127.0.0.1:57618/solr/test_col_shard1_replica1/ update: org.apache.solr.client.solrj.request.UpdateRequest@2748274d
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:610)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:279)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:268)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:160)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:177)
at org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates$Worker.doRandomAtomicUpdate(TestStressCloudBlindAtomicUpdates.java:368)
at org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates$Worker.run(TestStressCloudBlindAtomicUpdates.java:397)
... 6 more
FAILED: org.apache.solr.cloud.hdfs.StressHdfsTest.test
Error Message:
Timeout occured while waiting response from server at: http://127.0.0.1:56913/_ft
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:56913/_ft
at __randomizedtesting.SeedInfo.seed([9D4FB6EDFC038CA9:151B893752FFE151]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:621)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:279)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:268)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:435)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:387)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1358)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:1109)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:1042)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
at org.apache.solr.cloud.hdfs.StressHdfsTest.createAndDeleteCollection(StressHdfsTest.java:220)
at org.apache.solr.cloud.hdfs.StressHdfsTest.test(StressHdfsTest.java:103)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:171)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:515)
... 51 more
FAILED: org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest.test
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([9D4FB6EDFC038CA9:151B893752FFE151]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertTrue(Assert.java:54)
at org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest.test(HdfsWriteToMultipleCollectionsTest.java:137)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 12216 lines...]
[junit4] Suite: org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_9D4FB6EDFC038CA9-001/init-core-data-001
[junit4] 2> 1979448 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[9D4FB6EDFC038CA9]-worker) [ ] o.a.s.SolrTestCaseJ4 Using TrieFields
[junit4] 2> 1979449 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[9D4FB6EDFC038CA9]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
[junit4] 2> 1979449 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[9D4FB6EDFC038CA9]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /mh_bui/
[junit4] 1> Formatting using clusterid: testClusterID
[junit4] 2> 1979490 WARN (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[9D4FB6EDFC038CA9]-worker) [ ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
[junit4] 2> 1979500 WARN (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[9D4FB6EDFC038CA9]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 1979505 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[9D4FB6EDFC038CA9]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 1979514 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[9D4FB6EDFC038CA9]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.2-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_56605_hdfs____8v4mjo/webapp
[junit4] 2> 1980018 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[9D4FB6EDFC038CA9]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:56605
[junit4] 2> 1980110 WARN (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[9D4FB6EDFC038CA9]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 1980111 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[9D4FB6EDFC038CA9]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 1980120 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[9D4FB6EDFC038CA9]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.2-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_53575_datanode____.iyujvo/webapp
[junit4] 2> 1980476 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[9D4FB6EDFC038CA9]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:53575
[junit4] 2> 1980518 WARN (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[9D4FB6EDFC038CA9]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 1980519 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[9D4FB6EDFC038CA9]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 1980527 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[9D4FB6EDFC038CA9]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.2-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_40637_datanode____wnh5vp/webapp
[junit4] 2> 1980615 INFO (IPC Server handler 3 on 35403) [ ] BlockStateChange BLOCK* processReport: from storage DS-85f10f43-79f5-4781-b143-b635440e0b7f node DatanodeRegistration(127.0.0.1:52701, datanodeUuid=678558c5-3356-4b49-9cda-cdfbc43c0805, infoPort=60407, infoSecurePort=0, ipcPort=35281, storageInfo=lv=-56;cid=testClusterID;nsid=534316469;c=0), blocks: 0, hasStaleStorage: true, processing time: 0 msecs
[junit4] 2> 1980615 INFO (IPC Server handler 3 on 35403) [ ] BlockStateChange BLOCK* processReport: from storage DS-ea9b2689-58b8-4cb7-8934-9e91040ee592 node DatanodeRegistration(127.0.0.1:52701, datanodeUuid=678558c5-3356-4b49-9cda-cdfbc43c0805, infoPort=60407, infoSecurePort=0, ipcPort=35281, storageInfo=lv=-56;cid=testClusterID;nsid=534316469;c=0), blocks: 0, hasStaleStorage: false, processing time: 0 msecs
[junit4] 2> 1980943 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[9D4FB6EDFC038CA9]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40637
[junit4] 2> 1981058 INFO (IPC Server handler 8 on 35403) [ ] BlockStateChange BLOCK* processReport: from storage DS-b748533c-c26f-4550-937e-3e3bd4535912 node DatanodeRegistration(127.0.0.1:40636, datanodeUuid=01a70f14-e1c4-46aa-81f7-f1e1bd87b18c, infoPort=54402, infoSecurePort=0, ipcPort=37807, storageInfo=lv=-56;cid=testClusterID;nsid=534316469;c=0), blocks: 0, hasStaleStorage: true, processing time: 0 msecs
[junit4] 2> 1981058 INFO (IPC Server handler 8 on 35403) [ ] BlockStateChange BLOCK* processReport: from storage DS-79100624-ba46-49d3-a373-0f51864c8ad5 node DatanodeRegistration(127.0.0.1:40636, datanodeUuid=01a70f14-e1c4-46aa-81f7-f1e1bd87b18c, infoPort=54402, infoSecurePort=0, ipcPort=37807, storageInfo=lv=-56;cid=testClusterID;nsid=534316469;c=0), blocks: 0, hasStaleStorage: false, processing time: 0 msecs
[junit4] 2> 1981260 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1981261 INFO (Thread-8004) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1981261 INFO (Thread-8004) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1981361 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [ ] o.a.s.c.ZkTestServer start zk server on port:54666
[junit4] 2> 1981375 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 1981376 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 1981377 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1981377 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 1981378 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 1981378 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 1981379 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 1981380 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1981380 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1981381 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 1981381 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 1981452 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_9D4FB6EDFC038CA9-001/control-001/cores/collection1
[junit4] 2> 1981454 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 1981454 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@252ba6ce{/mh_bui,null,AVAILABLE}
[junit4] 2> 1981455 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@380e4c56{HTTP/1.1,[http/1.1]}{127.0.0.1:60431}
[junit4] 2> 1981455 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [ ] o.e.j.s.Server Started @1984505ms
[junit4] 2> 1981455 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:35403/hdfs__localhost_35403__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-6.x_checkout_solr_build_solr-core_test_J0_temp_solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_9D4FB6EDFC038CA9-001_tempDir-002_control_data, hostContext=/mh_bui, hostPort=60431, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_9D4FB6EDFC038CA9-001/control-001/cores}
[junit4] 2> 1981455 ERROR (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1981455 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 6.5.0
[junit4] 2> 1981455 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1981455 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1981455 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-02-22T14:40:38.364Z
[junit4] 2> 1981457 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1981457 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_9D4FB6EDFC038CA9-001/control-001/solr.xml
[junit4] 2> 1981462 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1981463 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:54666/solr
[junit4] 2> 1981476 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [n:127.0.0.1:60431_mh_bui ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1981476 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [n:127.0.0.1:60431_mh_bui ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:60431_mh_bui
[junit4] 2> 1981477 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [n:127.0.0.1:60431_mh_bui ] o.a.s.c.Overseer Overseer (id=97502785579974660-127.0.0.1:60431_mh_bui-n_0000000000) starting
[junit4] 2> 1981485 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [n:127.0.0.1:60431_mh_bui ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60431_mh_bui
[junit4] 2> 1981486 INFO (zkCallback-1700-thread-1-processing-n:127.0.0.1:60431_mh_bui) [n:127.0.0.1:60431_mh_bui ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1981606 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [n:127.0.0.1:60431_mh_bui ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_9D4FB6EDFC038CA9-001/control-001/cores
[junit4] 2> 1981606 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [n:127.0.0.1:60431_mh_bui ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 1981614 INFO (OverseerStateUpdate-97502785579974660-127.0.0.1:60431_mh_bui-n_0000000000) [n:127.0.0.1:60431_mh_bui ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 1981652 WARN (coreLoadExecutor-5472-thread-1-processing-n:127.0.0.1:60431_mh_bui) [n:127.0.0.1:60431_mh_bui c:control_collection x:collection1] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
[junit4] 2> 1981653 INFO (coreLoadExecutor-5472-thread-1-processing-n:127.0.0.1:60431_mh_bui) [n:127.0.0.1:60431_mh_bui c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
[junit4] 2> 1981667 INFO (coreLoadExecutor-5472-thread-1-processing-n:127.0.0.1:60431_mh_bui) [n:127.0.0.1:60431_mh_bui c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 1981724 WARN (coreLoadExecutor-5472-thread-1-processing-n:127.0.0.1:60431_mh_bui) [n:127.0.0.1:60431_mh_bui c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 1981725 INFO (coreLoadExecutor-5472-thread-1-processing-n:127.0.0.1:60431_mh_bui) [n:127.0.0.1:60431_mh_bui c:control_collection x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 1981736 INFO (coreLoadExecutor-5472-thread-1-processing-n:127.0.0.1:60431_mh_bui) [n:127.0.0.1:60431_mh_bui c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 1981736 INFO (coreLoadExecutor-5472-thread-1-processing-n:127.0.0.1:60431_mh_bui) [n:127.0.0.1:60431_mh_bui c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:35403/solr_hdfs_home
[junit4] 2> 1981736 INFO (coreLoadExecutor-5472-thread-1-processing-n:127.0.0.1:60431_mh_bui) [n:127.0.0.1:60431_mh_bui c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 1981737 INFO (coreLoadExecutor-5472-thread-1-processing-n:127.0.0.1:60431_mh_bui) [n:127.0.0.1:60431_mh_bui c:control_collection x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_9D4FB6EDFC038CA9-001/control-001/cores/collection1], dataDir=[hdfs://localhost:35403/solr_hdfs_home/control_collection/core_node1/data/]
[junit4] 2> 1981737 INFO (coreLoadExecutor-5472-thread-1-processing-n:127.0.0.1:60431_mh_bui) [n:127.0.0.1:60431_mh_bui c:control_collection x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@13ae72b3
[junit4] 2> 1981737 INFO (coreLoadExecutor-5472-thread-1-processing-n:127.0.0.1:60431_mh_bui) [n:127.0.0.1:60431_mh_bui c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:35403/solr_hdfs_home/control_collection/core_node1/data/snapshot_metadata
[junit4] 2> 1981743 INFO (coreLoadExecutor-5472-thread-1-processing-n:127.0.0.1:60431_mh_bui) [n:127.0.0.1:60431_mh_bui c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 1981743 INFO (coreLoadExecutor-5472-thread-1-processing-n:127.0.0.1:60431_mh_bui) [n:127.0.0.1:60431_mh_bui c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
[junit4] 2> 1981743 INFO (coreLoadExecutor-5472-thread-1-processing-n:127.0.0.1:60431_mh_bui) [n:127.0.0.1:60431_mh_bui c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Creating new single instance HDFS BlockCache
[junit4] 2> 1981757 INFO (coreLoadExecutor-5472-thread-1-processing-n:127.0.0.1:60431_mh_bui) [n:127.0.0.1:60431_mh_bui c:control_collection x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 1981760 INFO (coreLoadExecutor-5472-thread-1-processing-n:127.0.0.1:60431_mh_bui) [n:127.0.0.1:60431_mh_bui c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:35403/solr_hdfs_home/control_collection/core_node1/data
[junit4] 2> 1981776 INFO (coreLoadExecutor-5472-thread-1-processing-n:127.0.0.1:60431_mh_bui) [n:127.0.0.1:60431_mh_bui c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:35403/solr_hdfs_home/control_collection/core_node1/data/index
[junit4] 2> 1981781 INFO (coreLoadExecutor-5472-thread-1-processing-n:127.0.0.1:60431_mh_bui) [n:127.0.0.1:60431_mh_bui c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 1981781 INFO (coreLoadExecutor-5472-thread-1-processing-n:127.0.0.1:60431_mh_bui) [n:127.0.0.1:60431_mh_bui c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
[junit4] 2> 1981781 INFO (coreLoadExecutor-5472-thread-1-processing-n:127.0.0.1:60431_mh_bui) [n:127.0.0.1:60431_mh_bui c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Creating new single instance HDFS BlockCache
[junit4] 2> 1981785 INFO (coreLoadExecutor-5472-thread-1-processing-n:127.0.0.1:60431_mh_bui) [n:127.0.0.1:60431_mh_bui c:control_collection x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 1981785 INFO (coreLoadExecutor-5472-thread-1-processing-n:127.0.0.1:60431_mh_bui) [n:127.0.0.1:60431_mh_bui c:control_collection x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=29, maxMergeAtOnceExplicit=15, maxMergedSegmentMB=28.2001953125, floorSegmentMB=1.2451171875, forceMergeDeletesPctAllowed=9.986173529396838, segmentsPerTier=24.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 1981892 INFO (IPC Server handler 3 on 35403) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:40636 is added to blk_1073741825_1001{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-85f10f43-79f5-4781-b143-b635440e0b7f:NORMAL:127.0.0.1:52701|RBW], ReplicaUC[[DISK]DS-b748533c-c26f-4550-937e-3e3bd4535912:NORMAL:127.0.0.1:40636|FINALIZED]]} size 0
[junit4] 2> 1981893 INFO (IPC Server handler 4 on 35403) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52701 is added to blk_1073741825_1001{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-85f10f43-79f5-4781-b143-b635440e0b7f:NORMAL:127.0.0.1:52701|RBW], ReplicaUC[[DISK]DS-b748533c-c26f-4550-937e-3e3bd4535912:NORMAL:127.0.0.1:40636|FINALIZED]]} size 0
[junit4] 2> 1981908 WARN (coreLoadExecutor-5472-thread-1-processing-n:127.0.0.1:60431_mh_bui) [n:127.0.0.1:60431_mh_bui c:control_collection x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 1981961 INFO (coreLoadExecutor-5472-thread-1-processing-n:127.0.0.1:60431_mh_bui) [n:127.0.0.1:60431_mh_bui c:control_collection x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
[junit4] 2> 1981961 INFO (coreLoadExecutor-5472-thread-1-processing-n:127.0.0.1:60431_mh_bui) [n:127.0.0.1:60431_mh_bui c:control_collection x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1981961 INFO (coreLoadExecutor-5472-thread-1-processing-n:127.0.0.1:60431_mh_bui) [n:127.0.0.1:60431_mh_bui c:control_collection x:collection1] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=2
[junit4] 2> 1981968 INFO (coreLoadExecutor-5472-thread-1-processing-n:127.0.0.1:60431_mh_bui) [n:127.0.0.1:60431_mh_bui c:control_collection x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1981969 INFO (coreLoadExecutor-5472-thread-1-processing-n:127.0.0.1:60431_mh_bui) [n:127.0.0.1:60431_mh_bui c:control_collection x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1981978 INFO (coreLoadExecutor-5472-thread-1-processing-n:127.0.0.1:60431_mh_bui) [n:127.0.0.1:60431_mh_bui c:control_collection x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=42, maxMergeAtOnceExplicit=20, maxMergedSegmentMB=29.859375, floorSegmentMB=1.076171875, forceMergeDeletesPctAllowed=19.129815715157427, segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 1981990 INFO (coreLoadExecutor-5472-thread-1-processing-n:127.0.0.1:60431_mh_bui) [n:127.0.0.1:60431_mh_bui c:control_collection x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@5208efc5[collection1] main]
[junit4] 2> 1981991 INFO (coreLoadExecutor-5472-thread-1-processing-n:127.0.0.1:60431_mh_bui) [n:127.0.0.1:60431_mh_bui c:control_collection x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1981991 INFO (coreLoadExecutor-5472-thread-1-processing-n:127.0.0.1:60431_mh_bui) [n:127.0.0.1:60431_mh_bui c:control_collection x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1981991 INFO (coreLoadExecutor-5472-thread-1-processing-n:127.0.0.1:60431_mh_bui) [n:127.0.0.1:60431_mh_bui c:control_collection x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 1982013 INFO (searcherExecutor-5473-thread-1-processing-n:127.0.0.1:60431_mh_bui x:collection1 c:control_collection) [n:127.0.0.1:60431_mh_bui c:control_collection x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@5208efc5[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1982016 INFO (coreLoadExecutor-5472-thread-1-processing-n:127.0.0.1:60431_mh_bui) [n:127.0.0.1:60431_mh_bui c:control_collection x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1560044570070220800
[junit4] 2> 1982029 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1982030 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:54666/solr ready
[junit4] 2> 1982030 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 1982030 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with stateFormat=2
[junit4] 2> 1982031 INFO (coreZkRegister-5465-thread-1-processing-n:127.0.0.1:60431_mh_bui x:collection1 c:control_collection) [n:127.0.0.1:60431_mh_bui c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1982031 INFO (coreZkRegister-5465-thread-1-processing-n:127.0.0.1:60431_mh_bui x:collection1 c:control_collection) [n:127.0.0.1:60431_mh_bui c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1982031 INFO (coreZkRegister-5465-thread-1-processing-n:127.0.0.1:60431_mh_bui x:collection1 c:control_collection) [n:127.0.0.1:60431_mh_bui c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:60431/mh_bui/collection1/
[junit4] 2> 1982031 INFO (coreZkRegister-5465-thread-1-processing-n:127.0.0.1:60431_mh_bui x:collection1 c:control_collection) [n:127.0.0.1:60431_mh_bui c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1982031 INFO (coreZkRegister-5465-thread-1-processing-n:127.0.0.1:60431_mh_bui x:collection1 c:control_collection) [n:127.0.0.1:60431_mh_bui c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:60431/mh_bui/collection1/ has no replicas
[junit4] 2> 1982033 INFO (coreZkRegister-5465-thread-1-processing-n:127.0.0.1:60431_mh_bui x:collection1 c:control_collection) [n:127.0.0.1:60431_mh_bui c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:60431/mh_bui/collection1/ shard1
[junit4] 2> 1982084 INFO (coreZkRegister-5465-thread-1-processing-n:127.0.0.1:60431_mh_bui x:collection1 c:control_collection) [n:127.0.0.1:60431_mh_bui c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1982117 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_9D4FB6EDFC038CA9-001/shard-1-001/cores/collection1
[junit4] 2> 1982118 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_9D4FB6EDFC038CA9-001/shard-1-001
[junit4] 2> 1982118 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 1982120 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3ebddd93{/mh_bui,null,AVAILABLE}
[junit4] 2> 1982120 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@34dc1668{HTTP/1.1,[http/1.1]}{127.0.0.1:50107}
[junit4] 2> 1982120 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [ ] o.e.j.s.Server Started @1985171ms
[junit4] 2> 1982120 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:35403/hdfs__localhost_35403__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-6.x_checkout_solr_build_solr-core_test_J0_temp_solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_9D4FB6EDFC038CA9-001_tempDir-002_jetty1, solrconfig=solrconfig.xml, hostContext=/mh_bui, hostPort=50107, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_9D4FB6EDFC038CA9-001/shard-1-001/cores}
[junit4] 2> 1982120 ERROR (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1982120 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 6.5.0
[junit4] 2> 1982120 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1982120 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1982120 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-02-22T14:40:39.029Z
[junit4] 2> 1982122 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1982123 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_9D4FB6EDFC038CA9-001/shard-1-001/solr.xml
[junit4] 2> 1982127 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1982128 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:54666/solr
[junit4] 2> 1982134 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [n:127.0.0.1:50107_mh_bui ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1982135 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [n:127.0.0.1:50107_mh_bui ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1982137 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [n:127.0.0.1:50107_mh_bui ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50107_mh_bui
[junit4] 2> 1982138 INFO (zkCallback-1704-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1982138 INFO (zkCallback-1700-thread-1-processing-n:127.0.0.1:60431_mh_bui) [n:127.0.0.1:60431_mh_bui ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1982153 INFO (zkCallback-1710-thread-1-processing-n:127.0.0.1:50107_mh_bui) [n:127.0.0.1:50107_mh_bui ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1982197 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [n:127.0.0.1:50107_mh_bui ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_9D4FB6EDFC038CA9-001/shard-1-001/cores
[junit4] 2> 1982197 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [n:127.0.0.1:50107_mh_bui ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 1982202 INFO (OverseerStateUpdate-97502785579974660-127.0.0.1:60431_mh_bui-n_0000000000) [n:127.0.0.1:60431_mh_bui ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 1982303 INFO (zkCallback-1710-thread-1-processing-n:127.0.0.1:50107_mh_bui) [n:127.0.0.1:50107_mh_bui ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1983215 WARN (coreLoadExecutor-5483-thread-1-processing-n:127.0.0.1:50107_mh_bui) [n:127.0.0.1:50107_mh_bui c:collection1 x:collection1] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
[junit4] 2> 1983216 INFO (coreLoadExecutor-5483-thread-1-processing-n:127.0.0.1:50107_mh_bui) [n:127.0.0.1:50107_mh_bui c:collection1 x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
[junit4] 2> 1983225 INFO (coreLoadExecutor-5483-thread-1-processing-n:127.0.0.1:50107_mh_bui) [n:127.0.0.1:50107_mh_bui c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 1983272 WARN (coreLoadExecutor-5483-thread-1-processing-n:127.0.0.1:50107_mh_bui) [n:127.0.0.1:50107_mh_bui c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 1983273 INFO (coreLoadExecutor-5483-thread-1-processing-n:127.0.0.1:50107_mh_bui) [n:127.0.0.1:50107_mh_bui c:collection1 x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 1983296 INFO (coreLoadExecutor-5483-thread-1-processing-n:127.0.0.1:50107_mh_bui) [n:127.0.0.1:50107_mh_bui c:collection1 x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 1983297 INFO (coreLoadExecutor-5483-thread-1-processing-n:127.0.0.1:50107_mh_bui) [n:127.0.0.1:50107_mh_bui c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:35403/solr_hdfs_home
[junit4] 2> 1983297 INFO (coreLoadExecutor-5483-thread-1-processing-n:127.0.0.1:50107_mh_bui) [n:127.0.0.1:50107_mh_bui c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 1983297 INFO (coreLoadExecutor-5483-thread-1-processing-n:127.0.0.1:50107_mh_bui) [n:127.0.0.1:50107_mh_bui c:collection1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_9D4FB6EDFC038CA9-001/shard-1-001/cores/collection1], dataDir=[hdfs://localhost:35403/solr_hdfs_home/collection1/core_node1/data/]
[junit4] 2> 1983297 INFO (coreLoadExecutor-5483-thread-1-processing-n:127.0.0.1:50107_mh_bui) [n:127.0.0.1:50107_mh_bui c:collection1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@13ae72b3
[junit4] 2> 1983298 INFO (coreLoadExecutor-5483-thread-1-processing-n:127.0.0.1:50107_mh_bui) [n:127.0.0.1:50107_mh_bui c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:35403/solr_hdfs_home/collection1/core_node1/data/snapshot_metadata
[junit4] 2> 1983305 INFO (coreLoadExecutor-5483-thread-1-processing-n:127.0.0.1:50107_mh_bui) [n:127.0.0.1:50107_mh_bui c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 1983305 INFO (coreLoadExecutor-5483-thread-1-processing-n:127.0.0.1:50107_mh_bui) [n:127.0.0.1:50107_mh_bui c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
[junit4] 2> 1983305 INFO (coreLoadExecutor-5483-thread-1-processing-n:127.0.0.1:50107_mh_bui) [n:127.0.0.1:50107_mh_bui c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Creating new single instance HDFS BlockCache
[junit4] 2> 1983308 INFO (coreLoadExecutor-5483-thread-1-processing-n:127.0.0.1:50107_mh_bui) [n:127.0.0.1:50107_mh_bui c:collection1 x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 1983309 INFO (coreLoadExecutor-5483-thread-1-processing-n:127.0.0.1:50107_mh_bui) [n:127.0.0.1:50107_mh_bui c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:35403/solr_hdfs_home/collection1/core_node1/data
[junit4] 2> 1983323 INFO (coreLoadExecutor-5483-thread-1-processing-n:127.0.0.1:50107_mh_bui) [n:127.0.0.1:50107_mh_bui c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:35403/solr_hdfs_home/collection1/core_node1/data/index
[junit4] 2> 1983328 INFO (coreLoadExecutor-5483-thread-1-processing-n:127.0.0.1:50107_mh_bui) [n:127.0.0.1:50107_mh_bui c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 1983329 INFO (coreLoadExecutor-5483-thread-1-processing-n:127.0.0.1:50107_mh_bui) [n:127.0.0.1:50107_mh_bui c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
[junit4] 2> 1983329 INFO (coreLoadExecutor-5483-thread-1-processing-n:127.0.0.1:50107_mh_bui) [n:127.0.0.1:50107_mh_bui c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Creating new single instance HDFS BlockCache
[junit4] 2> 1983334 INFO (coreLoadExecutor-5483-thread-1-processing-n:127.0.0.1:50107_mh_bui) [n:127.0.0.1:50107_mh_bui c:collection1 x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 1983335 INFO (coreLoadExecutor-5483-thread-1-processing-n:127.0.0.1:50107_mh_bui) [n:127.0.0.1:50107_mh_bui c:collection1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=29, maxMergeAtOnceExplicit=15, maxMergedSegmentMB=28.2001953125, floorSegmentMB=1.2451171875, forceMergeDeletesPctAllowed=9.986173529396838, segmentsPerTier=24.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 1983362 INFO (IPC Server handler 1 on 35403) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52701 is added to blk_1073741826_1002{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-b748533c-c26f-4550-937e-3e3bd4535912:NORMAL:127.0.0.1:40636|RBW], ReplicaUC[[DISK]DS-ea9b2689-58b8-4cb7-8934-9e91040ee592:NORMAL:127.0.0.1:52701|FINALIZED]]} size 0
[junit4] 2> 1983362 INFO (IPC Server handler 0 on 35403) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:40636 is added to blk_1073741826_1002{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-ea9b2689-58b8-4cb7-8934-9e91040ee592:NORMAL:127.0.0.1:52701|FINALIZED], ReplicaUC[[DISK]DS-79100624-ba46-49d3-a373-0f51864c8ad5:NORMAL:127.0.0.1:40636|FINALIZED]]} size 0
[junit4] 2> 1983375 WARN (coreLoadExecutor-5483-thread-1-processing-n:127.0.0.1:50107_mh_bui) [n:127.0.0.1:50107_mh_bui c:collection1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 1983409 INFO (coreLoadExecutor-5483-thread-1-processing-n:127.0.0.1:50107_mh_bui) [n:127.0.0.1:50107_mh_bui c:collection1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
[junit4] 2> 1983409 INFO (coreLoadExecutor-5483-thread-1-processing-n:127.0.0.1:50107_mh_bui) [n:127.0.0.1:50107_mh_bui c:collection1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1983409 INFO (coreLoadExecutor-5483-thread-1-processing-n:127.0.0.1:50107_mh_bui) [n:127.0.0.1:50107_mh_bui c:collection1 x:collection1] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=2
[junit4] 2> 1983418 INFO (coreLoadExecutor-5483-thread-1-processing-n:127.0.0.1:50107_mh_bui) [n:127.0.0.1:50107_mh_bui c:collection1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1983418 INFO (coreLoadExecutor-5483-thread-1-processing-n:127.0.0.1:50107_mh_bui) [n:127.0.0.1:50107_mh_bui c:collection1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1983418 INFO (coreLoadExecutor-5483-thread-1-processing-n:127.0.0.1:50107_mh_bui) [n:127.0.0.1:50107_mh_bui c:collection1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=42, maxMergeAtOnceExplicit=20, maxMergedSegmentMB=29.859375, floorSegmentMB=1.076171875, forceMergeDeletesPctAllowed=19.129815715157427, segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 1983425 INFO (coreLoadExecutor-5483-thread-1-processing-n:127.0.0.1:50107_mh_bui) [n:127.0.0.1:50107_mh_bui c:collection1 x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@658a43b4[collection1] main]
[junit4] 2> 1983431 INFO (coreLoadExecutor-5483-thread-1-processing-n:127.0.0.1:50107_mh_bui) [n:127.0.0.1:50107_mh_bui c:collection1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1983432 INFO (coreLoadExecutor-5483-thread-1-processing-n:127.0.0.1:50107_mh_bui) [n:127.0.0.1:50107_mh_bui c:collection1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1983432 INFO (coreLoadExecutor-5483-thread-1-processing-n:127.0.0.1:50107_mh_bui) [n:127.0.0.1:50107_mh_bui c:collection1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 1983433 INFO (searcherExecutor-5484-thread-1-processing-n:127.0.0.1:50107_mh_bui x:collection1 c:collection1) [n:127.0.0.1:50107_mh_bui c:collection1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@658a43b4[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1983435 INFO (coreLoadExecutor-5483-thread-1-processing-n:127.0.0.1:50107_mh_bui) [n:127.0.0.1:50107_mh_bui c:collection1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1560044571558150144
[junit4] 2> 1983449 INFO (coreZkRegister-5478-thread-1-processing-n:127.0.0.1:50107_mh_bui x:collection1 c:collection1) [n:127.0.0.1:50107_mh_bui c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1983449 INFO (coreZkRegister-5478-thread-1-processing-n:127.0.0.1:50107_mh_bui x:collection1 c:collection1) [n:127.0.0.1:50107_mh_bui c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1983449 INFO (coreZkRegister-5478-thread-1-processing-n:127.0.0.1:50107_mh_bui x:collection1 c:collection1) [n:127.0.0.1:50107_mh_bui c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:50107/mh_bui/collection1/
[junit4] 2> 1983449 INFO (coreZkRegister-5478-thread-1-processing-n:127.0.0.1:50107_mh_bui x:collection1 c:collection1) [n:127.0.0.1:50107_mh_bui c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1983449 INFO (coreZkRegister-5478-thread-1-processing-n:127.0.0.1:50107_mh_bui x:collection1 c:collection1) [n:127.0.0.1:50107_mh_bui c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:50107/mh_bui/collection1/ has no replicas
[junit4] 2> 1983452 INFO (coreZkRegister-5478-thread-1-processing-n:127.0.0.1:50107_mh_bui x:collection1 c:collection1) [n:127.0.0.1:50107_mh_bui c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:50107/mh_bui/collection1/ shard1
[junit4] 2> 1983553 INFO (zkCallback-1710-thread-1-processing-n:127.0.0.1:50107_mh_bui) [n:127.0.0.1:50107_mh_bui ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1983596 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_9D4FB6EDFC038CA9-001/shard-2-001/cores/collection1
[junit4] 2> 1983596 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_9D4FB6EDFC038CA9-001/shard-2-001
[junit4] 2> 1983597 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 1983602 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@22f57401{/mh_bui,null,AVAILABLE}
[junit4] 2> 1983602 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@2414e96b{HTTP/1.1,[http/1.1]}{127.0.0.1:38618}
[junit4] 2> 1983602 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [ ] o.e.j.s.Server Started @1986652ms
[junit4] 2> 1983602 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:35403/hdfs__localhost_35403__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-6.x_checkout_solr_build_solr-core_test_J0_temp_solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_9D4FB6EDFC038CA9-001_tempDir-002_jetty2, solrconfig=solrconfig.xml, hostContext=/mh_bui, hostPort=38618, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_9D4FB6EDFC038CA9-001/shard-2-001/cores}
[junit4] 2> 1983602 ERROR (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1983602 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 6.5.0
[junit4] 2> 1983602 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1983602 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1983603 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-02-22T14:40:40.512Z
[junit4] 2> 1983604 INFO (coreZkRegister-5478-thread-1-processing-n:127.0.0.1:50107_mh_bui x:collection1 c:collection1) [n:127.0.0.1:50107_mh_bui c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1983606 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1983606 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_9D4FB6EDFC038CA9-001/shard-2-001/solr.xml
[junit4] 2> 1983611 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1983612 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:54666/solr
[junit4] 2> 1983643 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [n:127.0.0.1:38618_mh_bui ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1983644 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [n:127.0.0.1:38618_mh_bui ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1983645 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [n:127.0.0.1:38618_mh_bui ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38618_mh_bui
[junit4] 2> 1983646 INFO (zkCallback-1704-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1983647 INFO (zkCallback-1710-thread-1-processing-n:127.0.0.1:50107_mh_bui) [n:127.0.0.1:50107_mh_bui ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1983647 INFO (zkCallback-1710-thread-1-processing-n:127.0.0.1:50107_mh_bui) [n:127.0.0.1:50107_mh_bui ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 1983647 INFO (zkCallback-1700-thread-2-processing-n:127.0.0.1:60431_mh_bui) [n:127.0.0.1:60431_mh_bui ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1983654 INFO (zkCallback-1716-thread-1-processing-n:127.0.0.1:38618_mh_bui) [n:127.0.0.1:38618_mh_bui ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1983726 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [n:127.0.0.1:38618_mh_bui ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_9D4FB6EDFC038CA9-001/shard-2-001/cores
[junit4] 2> 1983726 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[9D4FB6EDFC038CA9]) [n:127.0.0.1:38618_mh_bui ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 1983741 INFO (OverseerStateUpdate-97502785579974660-127.0.0.1:60431_mh_bui-n_0000000000) [n:127.0.0.1:60431_mh_bui ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 1983842 WARN (OverseerStateUpdate-97502785579974660-127.0.0.1:60431_mh_bui-n_0000000000) [n:127.0.0.1:60431_mh_bui ] o.a.s.c.Overseer Bad version writing to ZK using compare-and-set, will force refresh cluster state: KeeperErrorCode = BadVersion for /collections/collection1/state.json
[junit4] 2> 1983844 INFO (zkCallback-1716-thread-2-processing-n:127.0.0.1:38618_mh_bui) [n:127.0.0.1:38618_mh_bui ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 1983845 INFO (zkCallback-1710-thread-1-processing-n:127.0.0.1:50107_mh_bui) [n:127.0.0.1:50107_mh_bui ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 1983845 INFO (OverseerStateUpdate-97502785579974660-127.0.0.1:60431_mh_bui-n_0000000000) [n:127.0.0.1:60431_mh_bui ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 1983846 INFO (zkCallback-1716-thread-2-processing-n:127.0.0.1:38618_mh_bui) [n:127.0.0.1:38618_mh_bui ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 1983846 INFO (zkCallback-1710-thread-1-processing-n:127.0.0.1:50107_mh_bui) [n:127.0.0.1:50107_mh_bui ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 1984760
[...truncated too long message...]
quired.java:53)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> Caused by: java.lang.NullPointerException
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlocksMap.size(BlocksMap.java:203)
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.getTotalBlocks(BlockManager.java:3370)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlocksTotal(FSNamesystem.java:5729)
[junit4] 2> ... 53 more
[junit4] 2> 4697106 INFO (SUITE-StressHdfsTest-seed#[9D4FB6EDFC038CA9]-worker) [ ] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.StressHdfsTest_9D4FB6EDFC038CA9-001
[junit4] 2> Feb 22, 2017 3:25:54 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 34 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene62): {range_facet_l_dv=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), multiDefault=PostingsFormat(name=LuceneFixedGap), intDefault=FSTOrd50, id=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), range_facet_i_dv=FSTOrd50, text=Lucene50(blocksize=128), range_facet_l=FSTOrd50, timestamp=FSTOrd50, txt_t=Lucene50(blocksize=128)}, docValues:{range_facet_l_dv=DocValuesFormat(name=Memory), _version_=DocValuesFormat(name=Direct), range_facet_i_dv=DocValuesFormat(name=Direct), intDvoDefault=DocValuesFormat(name=Asserting), timestamp=DocValuesFormat(name=Direct)}, maxPointsInLeafNode=481, maxMBSortInHeap=7.604129915618249, sim=RandomSimilarity(queryNorm=true,coord=crazy): {}, locale=es-DO, timezone=Etc/GMT+7
[junit4] 2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_121 (64-bit)/cpus=4,threads=1,free=159502544,total=535298048
[junit4] 2> NOTE: All tests run in this JVM: [SuggesterWFSTTest, TestIndexingPerformance, QueryParsingTest, DateRangeFieldTest, HighlighterMaxOffsetTest, TestWriterPerf, TestExtendedDismaxParser, BlobRepositoryCloudTest, SolrCoreCheckLockOnStartupTest, TestSortByMinMaxFunction, DistributedQueryComponentCustomSortTest, DocValuesNotIndexedTest, TestAnalyzedSuggestions, BasicDistributedZk2Test, TestCoreAdminApis, CircularListTest, FacetPivotSmallTest, TestCustomDocTransformer, TestCopyFieldCollectionResource, HdfsDirectoryFactoryTest, DirectUpdateHandlerTest, TestStressReorder, BlockJoinFacetRandomTest, TimeZoneUtilsTest, TestConfigSetsAPI, TestRandomFlRTGCloud, FieldAnalysisRequestHandlerTest, TestManagedSchemaAPI, TestPerFieldSimilarityWithDefaultOverride, TestInPlaceUpdatesStandalone, DeleteNodeTest, OverseerRolesTest, TestPostingsSolrHighlighter, DirectUpdateHandlerOptimizeTest, TestHashQParserPlugin, TestSubQueryTransformerDistrib, ReplaceNodeTest, TestRestManager, TestDFRSimilarityFactory, FieldMutatingUpdateProcessorTest, HdfsRecoverLeaseTest, TestSort, RequestLoggingTest, TestRawResponseWriter, CloudMLTQParserTest, SortSpecParsingTest, CoreMergeIndexesAdminHandlerTest, TestFileDictionaryLookup, TermVectorComponentDistributedTest, SmileWriterTest, MissingSegmentRecoveryTest, BlockCacheTest, TestXmlQParser, TestDFISimilarityFactory, TestSolrDeletionPolicy1, TestRecovery, LukeRequestHandlerTest, LeaderElectionTest, TestSolrConfigHandlerCloud, ShowFileRequestHandlerTest, TestFieldSortValues, HdfsSyncSliceTest, TestSolrCloudWithHadoopAuthPlugin, HardAutoCommitTest, DocExpirationUpdateProcessorFactoryTest, ConjunctionSolrSpellCheckerTest, StatelessScriptUpdateProcessorFactoryTest, SimpleFacetsTest, TestNamedUpdateProcessors, TestGroupingSearch, TestSolr4Spatial2, SolrGraphiteReporterTest, TestApiFramework, OverseerTest, DistribJoinFromCollectionTest, TestDistribIDF, SOLR749Test, OverriddenZkACLAndCredentialsProvidersTest, NoCacheHeaderTest, AliasIntegrationTest, PreAnalyzedFieldTest, SuggesterTest, UtilsToolTest, BitVectorTest, TestConfig, ShufflingReplicaListTransformerTest, TestShardHandlerFactory, TestHdfsBackupRestoreCore, TestReRankQParserPlugin, ManagedSchemaRoundRobinCloudTest, TestStandardQParsers, BinaryUpdateRequestHandlerTest, TestInitParams, TestPivotHelperCode, TestDistributedMissingSort, TestSearcherReuse, TestQueryWrapperFilter, DOMUtilTest, TestMergePolicyConfig, DocValuesMultiTest, LeaderInitiatedRecoveryOnCommitTest, PreAnalyzedUpdateProcessorTest, TestCryptoKeys, BadIndexSchemaTest, TestSolrXml, TestPhraseSuggestions, CoreAdminHandlerTest, TestNumericTerms64, SuggesterTSTTest, TestDynamicLoading, TestJmxMonitoredMap, TestCollationField, UnloadDistributedZkTest, CollectionsAPIDistributedZkTest, SyncSliceTest, LeaderElectionIntegrationTest, ShardRoutingTest, BasicZkTest, RecoveryZkTest, FullSolrCloudDistribCmdsTest, TestRandomFaceting, TestZkChroot, TestDistributedSearch, AutoCommitTest, TestDistributedGrouping, TestRealTimeGet, TestJoin, TestReload, TestSolr4Spatial, StatsComponentTest, TestFunctionQuery, BasicFunctionalityTest, TestIndexSearcher, CurrencyFieldOpenExchangeTest, DistributedQueryElevationComponentTest, CurrencyFieldXmlFileTest, SimplePostToolTest, TestCoreDiscovery, AnalysisAfterCoreReloadTest, SignatureUpdateProcessorFactoryTest, SpellCheckCollatorTest, SolrRequestParserTest, TestFoldingMultitermQuery, TestTrie, SchemaVersionSpecificBehaviorTest, TestAtomicUpdateErrorCases, TestWordDelimiterFilterFactory, QueryEqualityTest, TestRemoteStreaming, DebugComponentTest, CacheHeaderTest, IndexBasedSpellCheckerTest, TestSurroundQueryParser, StandardRequestHandlerTest, DirectSolrSpellCheckerTest, TestReversedWildcardFilterFactory, DocumentAnalysisRequestHandlerTest, PrimitiveFieldTypeTest, TestOmitPositions, FileBasedSpellCheckerTest, XmlUpdateRequestHandlerTest, RequestHandlersTest, PathHierarchyTokenizerFactoryTest, TermVectorComponentTest, RequiredFieldsTest, TestSolrQueryParser, FastVectorHighlighterTest, IndexSchemaRuntimeFieldTest, LoggingHandlerTest, SolrPluginUtilsTest, ReturnFieldsTest, UpdateRequestProcessorFactoryTest, JSONWriterTest, TestCSVResponseWriter, MBeansHandlerTest, UniqFieldsUpdateProcessorFactoryTest, JsonLoaderTest, TestPartialUpdateDeduplication, PingRequestHandlerTest, CSVRequestHandlerTest, TestBinaryResponseWriter, TestLFUCache, TestQuerySenderListener, UpdateParamsTest, AlternateDirectoryTest, ResponseLogComponentTest, TestSolrDeletionPolicy2, TestDocSet, TestSearchPerf, MinimalSchemaTest, DirectSolrConnectionTest, NotRequiredUniqueKeyTest, SynonymTokenizerTest, EchoParamsTest, TestLMJelinekMercerSimilarityFactory, OpenExchangeRatesOrgProviderTest, PluginInfoTest, TestSystemIdResolver, PrimUtilsTest, SpellingQueryConverterTest, TestSolrJ, TestLRUCache, TestUtils, TestDocumentBuilder, FileUtilsTest, TestRTGBase, CursorPagingTest, SolrTestCaseJ4Test, TestCrossCoreJoin, TestCursorMarkWithoutUniqueKey, TestTolerantSearch, TestPathTrie, TestEmbeddedSolrServerConstructors, TestJettySolrRunner, ConnectionReuseTest, AssignTest, AsyncCallRequestStatusResponseTest, BaseCdcrDistributedZkTest, CdcrReplicationHandlerTest, ConfigSetsAPITest, CustomCollectionTest, DeleteLastCustomShardedReplicaTest, DeleteStatusTest, DistribCursorPagingTest, DistributedQueueTest, DistributedVersionInfoTest, LeaderElectionContextKeyTest, LeaderFailoverAfterPartitionTest, LeaderFailureAfterFreshStartTest, LeaderInitiatedRecoveryOnShardRestartTest, MigrateRouteKeyTest, MultiThreadedOCPTest, OutOfBoxZkACLAndCredentialsProvidersTest, OverseerCollectionConfigSetProcessorTest, OverseerStatusTest, OverseerTaskQueueTest, PeerSyncReplicationTest, RemoteQueryErrorTest, RollingRestartTest, TestLeaderElectionZkExpiry, TestLeaderInitiatedRecoveryThread, TestMiniSolrCloudClusterSSL, TestRebalanceLeaders, TestStressLiveNodes, VMParamsZkACLAndCredentialsProvidersTest, HdfsBasicDistributedZk2Test, HdfsBasicDistributedZkTest, HdfsRecoveryZkTest, HdfsThreadLeakTest, StressHdfsTest]
[junit4] Completed [620/695 (5!)] on J2 in 185.80s, 1 test, 1 error <<< FAILURES!
[...truncated 62555 lines...]
changes-to-html:
[mkdir] Created dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/docs/changes
[exec] Section 'Optimizations' appears more than once under release '6.5.0' at /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/lucene/site/changes/changes2html.pl line 136.
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/build.xml:783: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/build.xml:101: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build.xml:654: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build.xml:629: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/lucene/common-build.xml:2518: exec returned: 25
Total time: 267 minutes 16 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-6.x - Build # 290 - Failure
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.x/290/
6 tests failed.
FAILED: org.apache.lucene.index.TestIndexingSequenceNumbers.testStressConcurrentCommit
Error Message:
this IndexWriter is closed
Stack Trace:
org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed
at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:753)
at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:767)
at org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:3214)
at org.apache.lucene.index.TestIndexingSequenceNumbers.testStressConcurrentCommit(TestIndexingSequenceNumbers.java:230)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.OutOfMemoryError: Java heap space
at org.apache.lucene.store.GrowableByteArrayDataOutput.<init>(GrowableByteArrayDataOutput.java:47)
at org.apache.lucene.codecs.compressing.CompressingStoredFieldsWriter.<init>(CompressingStoredFieldsWriter.java:108)
at org.apache.lucene.codecs.compressing.CompressingStoredFieldsFormat.fieldsWriter(CompressingStoredFieldsFormat.java:128)
at org.apache.lucene.codecs.lucene50.Lucene50StoredFieldsFormat.fieldsWriter(Lucene50StoredFieldsFormat.java:183)
at org.apache.lucene.codecs.asserting.AssertingStoredFieldsFormat.fieldsWriter(AssertingStoredFieldsFormat.java:48)
at org.apache.lucene.index.StoredFieldsConsumer.initStoredFieldsWriter(StoredFieldsConsumer.java:39)
at org.apache.lucene.index.StoredFieldsConsumer.startDocument(StoredFieldsConsumer.java:46)
at org.apache.lucene.index.DefaultIndexingChain.startStoredFields(DefaultIndexingChain.java:364)
at org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:398)
at org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:232)
at org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:478)
at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1579)
at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:210)
FAILED: org.apache.lucene.search.TestFuzzyQuery.testRandom
Error Message:
Test abandoned because suite timeout was reached.
Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
at __randomizedtesting.SeedInfo.seed([5E5720F22F1ABC04]:0)
FAILED: junit.framework.TestSuite.org.apache.lucene.search.TestFuzzyQuery
Error Message:
Suite timeout exceeded (>= 7200000 msec).
Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
at __randomizedtesting.SeedInfo.seed([5E5720F22F1ABC04]:0)
FAILED: org.apache.solr.cloud.CdcrReplicationDistributedZkTest.testReplicationAfterRestart
Error Message:
Timeout waiting for CDCR replication to complete @source_collection:shard1
Stack Trace:
java.lang.RuntimeException: Timeout waiting for CDCR replication to complete @source_collection:shard1
at __randomizedtesting.SeedInfo.seed([1CD4E002FDBBCDC6:40C90783339B79F0]:0)
at org.apache.solr.cloud.BaseCdcrDistributedZkTest.waitForReplicationToComplete(BaseCdcrDistributedZkTest.java:795)
at org.apache.solr.cloud.CdcrReplicationDistributedZkTest.testReplicationAfterRestart(CdcrReplicationDistributedZkTest.java:235)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.CdcrReplicationHandlerTest.testReplicationWithBufferedUpdates
Error Message:
Timeout while trying to assert number of documents @ https://127.0.0.1:44211/source_collection_shard1_replica1/
Stack Trace:
java.lang.AssertionError: Timeout while trying to assert number of documents @ https://127.0.0.1:44211/source_collection_shard1_replica1/
at __randomizedtesting.SeedInfo.seed([1CD4E002FDBBCDC6:CFDDB01CB8285151]:0)
at org.apache.solr.cloud.CdcrReplicationHandlerTest.assertNumDocs(CdcrReplicationHandlerTest.java:256)
at org.apache.solr.cloud.CdcrReplicationHandlerTest.testReplicationWithBufferedUpdates(CdcrReplicationHandlerTest.java:236)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.AssertionError: expected:<1570> but was:<1561>
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at org.apache.solr.cloud.CdcrReplicationHandlerTest.assertNumDocs(CdcrReplicationHandlerTest.java:247)
... 42 more
FAILED: org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest.test
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([1CD4E002FDBBCDC6:9480DFD85347A03E]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertTrue(Assert.java:54)
at org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest.test(HdfsWriteToMultipleCollectionsTest.java:137)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 497 lines...]
[junit4] Suite: org.apache.lucene.index.TestIndexingSequenceNumbers
[junit4] 2> Feb 22, 2017 7:13:39 AM com.carrotsearch.randomizedtesting.RandomizedRunner$QueueUncaughtExceptionsHandler uncaughtException
[junit4] 2> WARNING: Uncaught exception in thread: Thread[Thread-354,5,TGRP-TestIndexingSequenceNumbers]
[junit4] 2> java.lang.OutOfMemoryError: Java heap space
[junit4] 2> at __randomizedtesting.SeedInfo.seed([5E5720F22F1ABC04]:0)
[junit4] 2> at org.apache.lucene.util.ByteBlockPool$DirectTrackingAllocator.getByteBlock(ByteBlockPool.java:103)
[junit4] 2> at org.apache.lucene.util.ByteBlockPool.nextBuffer(ByteBlockPool.java:203)
[junit4] 2> at org.apache.lucene.util.BytesRefHash.add(BytesRefHash.java:266)
[junit4] 2> at org.apache.lucene.index.TermsHashPerField.add(TermsHashPerField.java:149)
[junit4] 2> at org.apache.lucene.index.DefaultIndexingChain$PerField.invert(DefaultIndexingChain.java:796)
[junit4] 2> at org.apache.lucene.index.DefaultIndexingChain.processField(DefaultIndexingChain.java:447)
[junit4] 2> at org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:403)
[junit4] 2> at org.apache.lucene.index.DocumentsWriterPerThread.updateDocuments(DocumentsWriterPerThread.java:273)
[junit4] 2> at org.apache.lucene.index.DocumentsWriter.updateDocuments(DocumentsWriter.java:433)
[junit4] 2> at org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1392)
[junit4] 2> at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:208)
[junit4] 2>
[junit4] 2> Feb 22, 2017 7:13:47 AM com.carrotsearch.randomizedtesting.RandomizedRunner$QueueUncaughtExceptionsHandler uncaughtException
[junit4] 2> WARNING: Uncaught exception in thread: Thread[Thread-357,5,TGRP-TestIndexingSequenceNumbers]
[junit4] 2> java.lang.RuntimeException: org.apache.lucene.store.AlreadyClosedException: refusing to delete any files: this IndexWriter hit an unrecoverable exception
[junit4] 2> at __randomizedtesting.SeedInfo.seed([5E5720F22F1ABC04]:0)
[junit4] 2> at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:218)
[junit4] 2> Caused by: org.apache.lucene.store.AlreadyClosedException: refusing to delete any files: this IndexWriter hit an unrecoverable exception
[junit4] 2> at org.apache.lucene.index.IndexFileDeleter.ensureOpen(IndexFileDeleter.java:345)
[junit4] 2> at org.apache.lucene.index.IndexFileDeleter.deleteFiles(IndexFileDeleter.java:696)
[junit4] 2> at org.apache.lucene.index.IndexFileDeleter.decRef(IndexFileDeleter.java:594)
[junit4] 2> at org.apache.lucene.index.IndexFileDeleter.decRef(IndexFileDeleter.java:647)
[junit4] 2> at org.apache.lucene.index.IndexWriter.rollbackInternalNoCommit(IndexWriter.java:2233)
[junit4] 2> at org.apache.lucene.index.IndexWriter.rollbackInternal(IndexWriter.java:2201)
[junit4] 2> at org.apache.lucene.index.IndexWriter.tragicEvent(IndexWriter.java:4841)
[junit4] 2> at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1594)
[junit4] 2> at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:210)
[junit4] 2> Caused by: java.lang.OutOfMemoryError: Java heap space
[junit4] 2> at org.apache.lucene.store.GrowableByteArrayDataOutput.<init>(GrowableByteArrayDataOutput.java:47)
[junit4] 2> at org.apache.lucene.codecs.compressing.CompressingStoredFieldsWriter.<init>(CompressingStoredFieldsWriter.java:108)
[junit4] 2> at org.apache.lucene.codecs.compressing.CompressingStoredFieldsFormat.fieldsWriter(CompressingStoredFieldsFormat.java:128)
[junit4] 2> at org.apache.lucene.codecs.lucene50.Lucene50StoredFieldsFormat.fieldsWriter(Lucene50StoredFieldsFormat.java:183)
[junit4] 2> at org.apache.lucene.codecs.asserting.AssertingStoredFieldsFormat.fieldsWriter(AssertingStoredFieldsFormat.java:48)
[junit4] 2> at org.apache.lucene.index.StoredFieldsConsumer.initStoredFieldsWriter(StoredFieldsConsumer.java:39)
[junit4] 2> at org.apache.lucene.index.StoredFieldsConsumer.startDocument(StoredFieldsConsumer.java:46)
[junit4] 2> at org.apache.lucene.index.DefaultIndexingChain.startStoredFields(DefaultIndexingChain.java:364)
[junit4] 2> at org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:398)
[junit4] 2> at org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:232)
[junit4] 2> at org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:478)
[junit4] 2> at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1579)
[junit4] 2> ... 1 more
[junit4] 2>
[junit4] 2> Feb 22, 2017 7:13:47 AM com.carrotsearch.randomizedtesting.RandomizedRunner$QueueUncaughtExceptionsHandler uncaughtException
[junit4] 2> WARNING: Uncaught exception in thread: Thread[Thread-353,5,TGRP-TestIndexingSequenceNumbers]
[junit4] 2> java.lang.RuntimeException: org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed
[junit4] 2> at __randomizedtesting.SeedInfo.seed([5E5720F22F1ABC04]:0)
[junit4] 2> at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:218)
[junit4] 2> Caused by: org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed
[junit4] 2> at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:753)
[junit4] 2> at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:767)
[junit4] 2> at org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1388)
[junit4] 2> at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:208)
[junit4] 2> Caused by: java.lang.OutOfMemoryError: Java heap space
[junit4] 2> at org.apache.lucene.store.GrowableByteArrayDataOutput.<init>(GrowableByteArrayDataOutput.java:47)
[junit4] 2> at org.apache.lucene.codecs.compressing.CompressingStoredFieldsWriter.<init>(CompressingStoredFieldsWriter.java:108)
[junit4] 2> at org.apache.lucene.codecs.compressing.CompressingStoredFieldsFormat.fieldsWriter(CompressingStoredFieldsFormat.java:128)
[junit4] 2> at org.apache.lucene.codecs.lucene50.Lucene50StoredFieldsFormat.fieldsWriter(Lucene50StoredFieldsFormat.java:183)
[junit4] 2> at org.apache.lucene.codecs.asserting.AssertingStoredFieldsFormat.fieldsWriter(AssertingStoredFieldsFormat.java:48)
[junit4] 2> at org.apache.lucene.index.StoredFieldsConsumer.initStoredFieldsWriter(StoredFieldsConsumer.java:39)
[junit4] 2> at org.apache.lucene.index.StoredFieldsConsumer.startDocument(StoredFieldsConsumer.java:46)
[junit4] 2> at org.apache.lucene.index.DefaultIndexingChain.startStoredFields(DefaultIndexingChain.java:364)
[junit4] 2> at org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:398)
[junit4] 2> at org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:232)
[junit4] 2> at org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:478)
[junit4] 2> at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1579)
[junit4] 2> at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:210)
[junit4] 2>
[junit4] 2> Feb 22, 2017 7:13:46 AM com.carrotsearch.randomizedtesting.RandomizedRunner$QueueUncaughtExceptionsHandler uncaughtException
[junit4] 2> WARNING: Uncaught exception in thread: Thread[Thread-355,5,TGRP-TestIndexingSequenceNumbers]
[junit4] 2> java.lang.RuntimeException: org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed
[junit4] 2> at __randomizedtesting.SeedInfo.seed([5E5720F22F1ABC04]:0)
[junit4] 2> at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:218)
[junit4] 2> Caused by: org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed
[junit4] 2> at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:753)
[junit4] 2> at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:767)
[junit4] 2> at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1575)
[junit4] 2> at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:210)
[junit4] 2> Caused by: java.lang.OutOfMemoryError: Java heap space
[junit4] 2> at org.apache.lucene.store.GrowableByteArrayDataOutput.<init>(GrowableByteArrayDataOutput.java:47)
[junit4] 2> at org.apache.lucene.codecs.compressing.CompressingStoredFieldsWriter.<init>(CompressingStoredFieldsWriter.java:108)
[junit4] 2> at org.apache.lucene.codecs.compressing.CompressingStoredFieldsFormat.fieldsWriter(CompressingStoredFieldsFormat.java:128)
[junit4] 2> at org.apache.lucene.codecs.lucene50.Lucene50StoredFieldsFormat.fieldsWriter(Lucene50StoredFieldsFormat.java:183)
[junit4] 2> at org.apache.lucene.codecs.asserting.AssertingStoredFieldsFormat.fieldsWriter(AssertingStoredFieldsFormat.java:48)
[junit4] 2> at org.apache.lucene.index.StoredFieldsConsumer.initStoredFieldsWriter(StoredFieldsConsumer.java:39)
[junit4] 2> at org.apache.lucene.index.StoredFieldsConsumer.startDocument(StoredFieldsConsumer.java:46)
[junit4] 2> at org.apache.lucene.index.DefaultIndexingChain.startStoredFields(DefaultIndexingChain.java:364)
[junit4] 2> at org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:398)
[junit4] 2> at org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:232)
[junit4] 2> at org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:478)
[junit4] 2> at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1579)
[junit4] 2> ... 1 more
[junit4] 2>
[junit4] 2> Feb 22, 2017 7:13:41 AM com.carrotsearch.randomizedtesting.RandomizedRunner$QueueUncaughtExceptionsHandler uncaughtException
[junit4] 2> WARNING: Uncaught exception in thread: Thread[Thread-358,5,TGRP-TestIndexingSequenceNumbers]
[junit4] 2> java.lang.RuntimeException: java.lang.IllegalStateException: this writer hit an unrecoverable error; cannot complete commit
[junit4] 2> at __randomizedtesting.SeedInfo.seed([5E5720F22F1ABC04]:0)
[junit4] 2> at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:218)
[junit4] 2> Caused by: java.lang.IllegalStateException: this writer hit an unrecoverable error; cannot complete commit
[junit4] 2> at org.apache.lucene.index.IndexWriter.finishCommit(IndexWriter.java:3282)
[junit4] 2> at org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:3260)
[junit4] 2> at org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:3215)
[junit4] 2> at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:186)
[junit4] 2> Caused by: java.lang.OutOfMemoryError: Java heap space
[junit4] 2> at org.apache.lucene.store.GrowableByteArrayDataOutput.<init>(GrowableByteArrayDataOutput.java:47)
[junit4] 2> at org.apache.lucene.codecs.compressing.CompressingStoredFieldsWriter.<init>(CompressingStoredFieldsWriter.java:108)
[junit4] 2> at org.apache.lucene.codecs.compressing.CompressingStoredFieldsFormat.fieldsWriter(CompressingStoredFieldsFormat.java:128)
[junit4] 2> at org.apache.lucene.codecs.lucene50.Lucene50StoredFieldsFormat.fieldsWriter(Lucene50StoredFieldsFormat.java:183)
[junit4] 2> at org.apache.lucene.codecs.asserting.AssertingStoredFieldsFormat.fieldsWriter(AssertingStoredFieldsFormat.java:48)
[junit4] 2> at org.apache.lucene.index.StoredFieldsConsumer.initStoredFieldsWriter(StoredFieldsConsumer.java:39)
[junit4] 2> at org.apache.lucene.index.StoredFieldsConsumer.startDocument(StoredFieldsConsumer.java:46)
[junit4] 2> at org.apache.lucene.index.DefaultIndexingChain.startStoredFields(DefaultIndexingChain.java:364)
[junit4] 2> at org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:398)
[junit4] 2> at org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:232)
[junit4] 2> at org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:478)
[junit4] 2> at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1579)
[junit4] 2> at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:210)
[junit4] 2>
[junit4] 2> Feb 22, 2017 7:13:44 AM com.carrotsearch.randomizedtesting.RandomizedRunner$QueueUncaughtExceptionsHandler uncaughtException
[junit4] 2> WARNING: Uncaught exception in thread: Thread[Thread-350,5,TGRP-TestIndexingSequenceNumbers]
[junit4] 2> java.lang.RuntimeException: org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed
[junit4] 2> at __randomizedtesting.SeedInfo.seed([5E5720F22F1ABC04]:0)
[junit4] 2> at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:218)
[junit4] 2> Caused by: org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed
[junit4] 2> at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:753)
[junit4] 2> at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:767)
[junit4] 2> at org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:3214)
[junit4] 2> at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:186)
[junit4] 2> Caused by: java.lang.OutOfMemoryError: Java heap space
[junit4] 2> at org.apache.lucene.store.GrowableByteArrayDataOutput.<init>(GrowableByteArrayDataOutput.java:47)
[junit4] 2> at org.apache.lucene.codecs.compressing.CompressingStoredFieldsWriter.<init>(CompressingStoredFieldsWriter.java:108)
[junit4] 2> at org.apache.lucene.codecs.compressing.CompressingStoredFieldsFormat.fieldsWriter(CompressingStoredFieldsFormat.java:128)
[junit4] 2> at org.apache.lucene.codecs.lucene50.Lucene50StoredFieldsFormat.fieldsWriter(Lucene50StoredFieldsFormat.java:183)
[junit4] 2> at org.apache.lucene.codecs.asserting.AssertingStoredFieldsFormat.fieldsWriter(AssertingStoredFieldsFormat.java:48)
[junit4] 2> at org.apache.lucene.index.StoredFieldsConsumer.initStoredFieldsWriter(StoredFieldsConsumer.java:39)
[junit4] 2> at org.apache.lucene.index.StoredFieldsConsumer.startDocument(StoredFieldsConsumer.java:46)
[junit4] 2> at org.apache.lucene.index.DefaultIndexingChain.startStoredFields(DefaultIndexingChain.java:364)
[junit4] 2> at org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:398)
[junit4] 2> at org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:232)
[junit4] 2> at org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:478)
[junit4] 2> at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1579)
[junit4] 2> at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:210)
[junit4] 2>
[junit4] 2> Feb 22, 2017 7:13:44 AM com.carrotsearch.randomizedtesting.RandomizedRunner$QueueUncaughtExceptionsHandler uncaughtException
[junit4] 2> WARNING: Uncaught exception in thread: Thread[Thread-356,5,TGRP-TestIndexingSequenceNumbers]
[junit4] 2> java.lang.RuntimeException: org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed
[junit4] 2> at __randomizedtesting.SeedInfo.seed([5E5720F22F1ABC04]:0)
[junit4] 2> at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:218)
[junit4] 2> Caused by: org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed
[junit4] 2> at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:753)
[junit4] 2> at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:767)
[junit4] 2> at org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:3214)
[junit4] 2> at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:186)
[junit4] 2> Caused by: java.lang.OutOfMemoryError: Java heap space
[junit4] 2> at org.apache.lucene.store.GrowableByteArrayDataOutput.<init>(GrowableByteArrayDataOutput.java:47)
[junit4] 2> at org.apache.lucene.codecs.compressing.CompressingStoredFieldsWriter.<init>(CompressingStoredFieldsWriter.java:108)
[junit4] 2> at org.apache.lucene.codecs.compressing.CompressingStoredFieldsFormat.fieldsWriter(CompressingStoredFieldsFormat.java:128)
[junit4] 2> at org.apache.lucene.codecs.lucene50.Lucene50StoredFieldsFormat.fieldsWriter(Lucene50StoredFieldsFormat.java:183)
[junit4] 2> at org.apache.lucene.codecs.asserting.AssertingStoredFieldsFormat.fieldsWriter(AssertingStoredFieldsFormat.java:48)
[junit4] 2> at org.apache.lucene.index.StoredFieldsConsumer.initStoredFieldsWriter(StoredFieldsConsumer.java:39)
[junit4] 2> at org.apache.lucene.index.StoredFieldsConsumer.startDocument(StoredFieldsConsumer.java:46)
[junit4] 2> at org.apache.lucene.index.DefaultIndexingChain.startStoredFields(DefaultIndexingChain.java:364)
[junit4] 2> at org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:398)
[junit4] 2> at org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:232)
[junit4] 2> at org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:478)
[junit4] 2> at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1579)
[junit4] 2> at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:210)
[junit4] 2>
[junit4] 2> Feb 22, 2017 7:13:41 AM com.carrotsearch.randomizedtesting.RandomizedRunner$QueueUncaughtExceptionsHandler uncaughtException
[junit4] 2> WARNING: Uncaught exception in thread: Thread[Thread-351,5,TGRP-TestIndexingSequenceNumbers]
[junit4] 2> java.lang.RuntimeException: org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed
[junit4] 2> at __randomizedtesting.SeedInfo.seed([5E5720F22F1ABC04]:0)
[junit4] 2> at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:218)
[junit4] 2> Caused by: org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed
[junit4] 2> at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:753)
[junit4] 2> at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:767)
[junit4] 2> at org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:3214)
[junit4] 2> at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:186)
[junit4] 2> Caused by: java.lang.OutOfMemoryError: Java heap space
[junit4] 2> at org.apache.lucene.store.GrowableByteArrayDataOutput.<init>(GrowableByteArrayDataOutput.java:47)
[junit4] 2> at org.apache.lucene.codecs.compressing.CompressingStoredFieldsWriter.<init>(CompressingStoredFieldsWriter.java:108)
[junit4] 2> at org.apache.lucene.codecs.compressing.CompressingStoredFieldsFormat.fieldsWriter(CompressingStoredFieldsFormat.java:128)
[junit4] 2> at org.apache.lucene.codecs.lucene50.Lucene50StoredFieldsFormat.fieldsWriter(Lucene50StoredFieldsFormat.java:183)
[junit4] 2> at org.apache.lucene.codecs.asserting.AssertingStoredFieldsFormat.fieldsWriter(AssertingStoredFieldsFormat.java:48)
[junit4] 2> at org.apache.lucene.index.StoredFieldsConsumer.initStoredFieldsWriter(StoredFieldsConsumer.java:39)
[junit4] 2> at org.apache.lucene.index.StoredFieldsConsumer.startDocument(StoredFieldsConsumer.java:46)
[junit4] 2> at org.apache.lucene.index.DefaultIndexingChain.startStoredFields(DefaultIndexingChain.java:364)
[junit4] 2> at org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:398)
[junit4] 2> at org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:232)
[junit4] 2> at org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:478)
[junit4] 2> at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1579)
[junit4] 2> at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:210)
[junit4] 2>
[junit4] 2> Feb 22, 2017 7:13:43 AM com.carrotsearch.randomizedtesting.RandomizedRunner$QueueUncaughtExceptionsHandler uncaughtException
[junit4] 2> WARNING: Uncaught exception in thread: Thread[Thread-352,5,TGRP-TestIndexingSequenceNumbers]
[junit4] 2> java.lang.RuntimeException: org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed
[junit4] 2> at __randomizedtesting.SeedInfo.seed([5E5720F22F1ABC04]:0)
[junit4] 2> at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:218)
[junit4] 2> Caused by: org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed
[junit4] 2> at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:753)
[junit4] 2> at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:767)
[junit4] 2> at org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:3214)
[junit4] 2> at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:186)
[junit4] 2> Caused by: java.lang.OutOfMemoryError: Java heap space
[junit4] 2> at org.apache.lucene.store.GrowableByteArrayDataOutput.<init>(GrowableByteArrayDataOutput.java:47)
[junit4] 2> at org.apache.lucene.codecs.compressing.CompressingStoredFieldsWriter.<init>(CompressingStoredFieldsWriter.java:108)
[junit4] 2> at org.apache.lucene.codecs.compressing.CompressingStoredFieldsFormat.fieldsWriter(CompressingStoredFieldsFormat.java:128)
[junit4] 2> at org.apache.lucene.codecs.lucene50.Lucene50StoredFieldsFormat.fieldsWriter(Lucene50StoredFieldsFormat.java:183)
[junit4] 2> at org.apache.lucene.codecs.asserting.AssertingStoredFieldsFormat.fieldsWriter(AssertingStoredFieldsFormat.java:48)
[junit4] 2> at org.apache.lucene.index.StoredFieldsConsumer.initStoredFieldsWriter(StoredFieldsConsumer.java:39)
[junit4] 2> at org.apache.lucene.index.StoredFieldsConsumer.startDocument(StoredFieldsConsumer.java:46)
[junit4] 2> at org.apache.lucene.index.DefaultIndexingChain.startStoredFields(DefaultIndexingChain.java:364)
[junit4] 2> at org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:398)
[junit4] 2> at org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:232)
[junit4] 2> at org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:478)
[junit4] 2> at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1579)
[junit4] 2> at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:210)
[junit4] 2>
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestIndexingSequenceNumbers -Dtests.method=testStressConcurrentCommit -Dtests.seed=5E5720F22F1ABC04 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/test-data/enwiki.random.lines.txt -Dtests.locale=en-CA -Dtests.timezone=Pacific/Enderbury -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[junit4] ERROR 462s J1 | TestIndexingSequenceNumbers.testStressConcurrentCommit <<<
[junit4] > Throwable #1: org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed
[junit4] > at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:753)
[junit4] > at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:767)
[junit4] > at org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:3214)
[junit4] > at org.apache.lucene.index.TestIndexingSequenceNumbers.testStressConcurrentCommit(TestIndexingSequenceNumbers.java:230)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > Caused by: java.lang.OutOfMemoryError: Java heap space
[junit4] > at org.apache.lucene.store.GrowableByteArrayDataOutput.<init>(GrowableByteArrayDataOutput.java:47)
[junit4] > at org.apache.lucene.codecs.compressing.CompressingStoredFieldsWriter.<init>(CompressingStoredFieldsWriter.java:108)
[junit4] > at org.apache.lucene.codecs.compressing.CompressingStoredFieldsFormat.fieldsWriter(CompressingStoredFieldsFormat.java:128)
[junit4] > at org.apache.lucene.codecs.lucene50.Lucene50StoredFieldsFormat.fieldsWriter(Lucene50StoredFieldsFormat.java:183)
[junit4] > at org.apache.lucene.codecs.asserting.AssertingStoredFieldsFormat.fieldsWriter(AssertingStoredFieldsFormat.java:48)
[junit4] > at org.apache.lucene.index.StoredFieldsConsumer.initStoredFieldsWriter(StoredFieldsConsumer.java:39)
[junit4] > at org.apache.lucene.index.StoredFieldsConsumer.startDocument(StoredFieldsConsumer.java:46)
[junit4] > at org.apache.lucene.index.DefaultIndexingChain.startStoredFields(DefaultIndexingChain.java:364)
[junit4] > at org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:398)
[junit4] > at org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:232)
[junit4] > at org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:478)
[junit4] > at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1579)
[junit4] > at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:210)Throwable #2: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=416, name=Thread-354, state=RUNNABLE, group=TGRP-TestIndexingSequenceNumbers]
[junit4] > Caused by: java.lang.OutOfMemoryError: Java heap space
[junit4] > at __randomizedtesting.SeedInfo.seed([5E5720F22F1ABC04]:0)
[junit4] > at org.apache.lucene.util.ByteBlockPool$DirectTrackingAllocator.getByteBlock(ByteBlockPool.java:103)
[junit4] > at org.apache.lucene.util.ByteBlockPool.nextBuffer(ByteBlockPool.java:203)
[junit4] > at org.apache.lucene.util.BytesRefHash.add(BytesRefHash.java:266)
[junit4] > at org.apache.lucene.index.TermsHashPerField.add(TermsHashPerField.java:149)
[junit4] > at org.apache.lucene.index.DefaultIndexingChain$PerField.invert(DefaultIndexingChain.java:796)
[junit4] > at org.apache.lucene.index.DefaultIndexingChain.processField(DefaultIndexingChain.java:447)
[junit4] > at org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:403)
[junit4] > at org.apache.lucene.index.DocumentsWriterPerThread.updateDocuments(DocumentsWriterPerThread.java:273)
[junit4] > at org.apache.lucene.index.DocumentsWriter.updateDocuments(DocumentsWriter.java:433)
[junit4] > at org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1392)
[junit4] > at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:208)Throwable #3: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=420, name=Thread-358, state=RUNNABLE, group=TGRP-TestIndexingSequenceNumbers]
[junit4] > Caused by: java.lang.RuntimeException: java.lang.IllegalStateException: this writer hit an unrecoverable error; cannot complete commit
[junit4] > at __randomizedtesting.SeedInfo.seed([5E5720F22F1ABC04]:0)
[junit4] > at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:218)
[junit4] > Caused by: java.lang.IllegalStateException: this writer hit an unrecoverable error; cannot complete commit
[junit4] > at org.apache.lucene.index.IndexWriter.finishCommit(IndexWriter.java:3282)
[junit4] > at org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:3260)
[junit4] > at org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:3215)
[junit4] > at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:186)
[junit4] > Caused by: java.lang.OutOfMemoryError: Java heap space
[junit4] > at org.apache.lucene.store.GrowableByteArrayDataOutput.<init>(GrowableByteArrayDataOutput.java:47)
[junit4] > at org.apache.lucene.codecs.compressing.CompressingStoredFieldsWriter.<init>(CompressingStoredFieldsWriter.java:108)
[junit4] > at org.apache.lucene.codecs.compressing.CompressingStoredFieldsFormat.fieldsWriter(CompressingStoredFieldsFormat.java:128)
[junit4] > at org.apache.lucene.codecs.lucene50.Lucene50StoredFieldsFormat.fieldsWriter(Lucene50StoredFieldsFormat.java:183)
[junit4] > at org.apache.lucene.codecs.asserting.AssertingStoredFieldsFormat.fieldsWriter(AssertingStoredFieldsFormat.java:48)
[junit4] > at org.apache.lucene.index.StoredFieldsConsumer.initStoredFieldsWriter(StoredFieldsConsumer.java:39)
[junit4] > at org.apache.lucene.index.StoredFieldsConsumer.startDocument(StoredFieldsConsumer.java:46)
[junit4] > at org.apache.lucene.index.DefaultIndexingChain.startStoredFields(DefaultIndexingChain.java:364)
[junit4] > at org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:398)
[junit4] > at org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:232)
[junit4] > at org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:478)
[junit4] > at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1579)
[junit4] > at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:210)Throwable #4: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=413, name=Thread-351, state=RUNNABLE, group=TGRP-TestIndexingSequenceNumbers]
[junit4] > Caused by: java.lang.RuntimeException: org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed
[junit4] > at __randomizedtesting.SeedInfo.seed([5E5720F22F1ABC04]:0)
[junit4] > at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:218)
[junit4] > Caused by: org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed
[junit4] > at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:753)
[junit4] > at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:767)
[junit4] > at org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:3214)
[junit4] > at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:186)
[junit4] > Caused by: java.lang.OutOfMemoryError: Java heap space
[junit4] > at org.apache.lucene.store.GrowableByteArrayDataOutput.<init>(GrowableByteArrayDataOutput.java:47)
[junit4] > at org.apache.lucene.codecs.compressing.CompressingStoredFieldsWriter.<init>(CompressingStoredFieldsWriter.java:108)
[junit4] > at org.apache.lucene.codecs.compressing.CompressingStoredFieldsFormat.fieldsWriter(CompressingStoredFieldsFormat.java:128)
[junit4] > at org.apache.lucene.codecs.lucene50.Lucene50StoredFieldsFormat.fieldsWriter(Lucene50StoredFieldsFormat.java:183)
[junit4] > at org.apache.lucene.codecs.asserting.AssertingStoredFieldsFormat.fieldsWriter(AssertingStoredFieldsFormat.java:48)
[junit4] > at org.apache.lucene.index.StoredFieldsConsumer.initStoredFieldsWriter(StoredFieldsConsumer.java:39)
[junit4] > at org.apache.lucene.index.StoredFieldsConsumer.startDocument(StoredFieldsConsumer.java:46)
[junit4] > at org.apache.lucene.index.DefaultIndexingChain.startStoredFields(DefaultIndexingChain.java:364)
[junit4] > at org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:398)
[junit4] > at org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:232)
[junit4] > at org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:478)
[junit4] > at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1579)
[junit4] > at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:210)Throwable #5: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=414, name=Thread-352, state=RUNNABLE, group=TGRP-TestIndexingSequenceNumbers]
[junit4] > Caused by: java.lang.RuntimeException: org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed
[junit4] > at __randomizedtesting.SeedInfo.seed([5E5720F22F1ABC04]:0)
[junit4] > at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:218)
[junit4] > Caused by: org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed
[junit4] > at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:753)
[junit4] > at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:767)
[junit4] > at org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:3214)
[junit4] > at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:186)
[junit4] > Caused by: java.lang.OutOfMemoryError: Java heap space
[junit4] > at org.apache.lucene.store.GrowableByteArrayDataOutput.<init>(GrowableByteArrayDataOutput.java:47)
[junit4] > at org.apache.lucene.codecs.compressing.CompressingStoredFieldsWriter.<init>(CompressingStoredFieldsWriter.java:108)
[junit4] > at org.apache.lucene.codecs.compressing.CompressingStoredFieldsFormat.fieldsWriter(CompressingStoredFieldsFormat.java:128)
[junit4] > at org.apache.lucene.codecs.lucene50.Lucene50StoredFieldsFormat.fieldsWriter(Lucene50StoredFieldsFormat.java:183)
[junit4] > at org.apache.lucene.codecs.asserting.AssertingStoredFieldsFormat.fieldsWriter(AssertingStoredFieldsFormat.java:48)
[junit4] > at org.apache.lucene.index.StoredFieldsConsumer.initStoredFieldsWriter(StoredFieldsConsumer.java:39)
[junit4] > at org.apache.lucene.index.StoredFieldsConsumer.startDocument(StoredFieldsConsumer.java:46)
[junit4] > at org.apache.lucene.index.DefaultIndexingChain.startStoredFields(DefaultIndexingChain.java:364)
[junit4] > at org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:398)
[junit4] > at org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:232)
[junit4] > at org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:478)
[junit4] > at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1579)
[junit4] > at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:210)Throwable #6: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=412, name=Thread-350, state=RUNNABLE, group=TGRP-TestIndexingSequenceNumbers]
[junit4] > Caused by: java.lang.RuntimeException: org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed
[junit4] > at __randomizedtesting.SeedInfo.seed([5E5720F22F1ABC04]:0)
[junit4] > at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:218)
[junit4] > Caused by: org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed
[junit4] > at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:753)
[junit4] > at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:767)
[junit4] > at org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:3214)
[junit4] > at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:186)
[junit4] > Caused by: java.lang.OutOfMemoryError: Java heap space
[junit4] > at org.apache.lucene.store.GrowableByteArrayDataOutput.<init>(GrowableByteArrayDataOutput.java:47)
[junit4] > at org.apache.lucene.codecs.compressing.CompressingStoredFieldsWriter.<init>(CompressingStoredFieldsWriter.java:108)
[junit4] > at org.apache.lucene.codecs.compressing.CompressingStoredFieldsFormat.fieldsWriter(CompressingStoredFieldsFormat.java:128)
[junit4] > at org.apache.lucene.codecs.lucene50.Lucene50StoredFieldsFormat.fieldsWriter(Lucene50StoredFieldsFormat.java:183)
[junit4] > at org.apache.lucene.codecs.asserting.AssertingStoredFieldsFormat.fieldsWriter(AssertingStoredFieldsFormat.java:48)
[junit4] > at org.apache.lucene.index.StoredFieldsConsumer.initStoredFieldsWriter(StoredFieldsConsumer.java:39)
[junit4] > at org.apache.lucene.index.StoredFieldsConsumer.startDocument(StoredFieldsConsumer.java:46)
[junit4] > at org.apache.lucene.index.DefaultIndexingChain.startStoredFields(DefaultIndexingChain.java:364)
[junit4] > at org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:398)
[junit4] > at org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:232)
[junit4] > at org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:478)
[junit4] > at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1579)
[junit4] > at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:210)Throwable #7: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=418, name=Thread-356, state=RUNNABLE, group=TGRP-TestIndexingSequenceNumbers]
[junit4] > Caused by: java.lang.RuntimeException: org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed
[junit4] > at __randomizedtesting.SeedInfo.seed([5E5720F22F1ABC04]:0)
[junit4] > at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:218)
[junit4] > Caused by: org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed
[junit4] > at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:753)
[junit4] > at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:767)
[junit4] > at org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:3214)
[junit4] > at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:186)
[junit4] > Caused by: java.lang.OutOfMemoryError: Java heap space
[junit4] > at org.apache.lucene.store.GrowableByteArrayDataOutput.<init>(GrowableByteArrayDataOutput.java:47)
[junit4] > at org.apache.lucene.codecs.compressing.CompressingStoredFieldsWriter.<init>(CompressingStoredFieldsWriter.java:108)
[junit4] > at org.apache.lucene.codecs.compressing.CompressingStoredFieldsFormat.fieldsWriter(CompressingStoredFieldsFormat.java:128)
[junit4] > at org.apache.lucene.codecs.lucene50.Lucene50StoredFieldsFormat.fieldsWriter(Lucene50StoredFieldsFormat.java:183)
[junit4] > at org.apache.lucene.codecs.asserting.AssertingStoredFieldsFormat.fieldsWriter(AssertingStoredFieldsFormat.java:48)
[junit4] > at org.apache.lucene.index.StoredFieldsConsumer.initStoredFieldsWriter(StoredFieldsConsumer.java:39)
[junit4] > at org.apache.lucene.index.StoredFieldsConsumer.startDocument(StoredFieldsConsumer.java:46)
[junit4] > at org.apache.lucene.index.DefaultIndexingChain.startStoredFields(DefaultIndexingChain.java:364)
[junit4] > at org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:398)
[junit4] > at org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:232)
[junit4] > at org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:478)
[junit4] > at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1579)
[junit4] > at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:210)Throwable #8: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=417, name=Thread-355, state=RUNNABLE, group=TGRP-TestIndexingSequenceNumbers]
[junit4] > Caused by: java.lang.RuntimeException: org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed
[junit4] > at __randomizedtesting.SeedInfo.seed([5E5720F22F1ABC04]:0)
[junit4] > at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:218)
[junit4] > Caused by: org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed
[junit4] > at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:753)
[junit4] > at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:767)
[junit4] > at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1575)
[junit4] > at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:210)
[junit4] > Caused by: java.lang.OutOfMemoryError: Java heap space
[junit4] > at org.apache.lucene.store.GrowableByteArrayDataOutput.<init>(GrowableByteArrayDataOutput.java:47)
[junit4] > at org.apache.lucene.codecs.compressing.CompressingStoredFieldsWriter.<init>(CompressingStoredFieldsWriter.java:108)
[junit4] > at org.apache.lucene.codecs.compressing.CompressingStoredFieldsFormat.fieldsWriter(CompressingStoredFieldsFormat.java:128)
[junit4] > at org.apache.lucene.codecs.lucene50.Lucene50StoredFieldsFormat.fieldsWriter(Lucene50StoredFieldsFormat.java:183)
[junit4] > at org.apache.lucene.codecs.asserting.AssertingStoredFieldsFormat.fieldsWriter(AssertingStoredFieldsFormat.java:48)
[junit4] > at org.apache.lucene.index.StoredFieldsConsumer.initStoredFieldsWriter(StoredFieldsConsumer.java:39)
[junit4] > at org.apache.lucene.index.StoredFieldsConsumer.startDocument(StoredFieldsConsumer.java:46)
[junit4] > at org.apache.lucene.index.DefaultIndexingChain.startStoredFields(DefaultIndexingChain.java:364)
[junit4] > at org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:398)
[junit4] > at org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:232)
[junit4] > at org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:478)
[junit4] > at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1579)
[junit4] > ... 1 moreThrowable #9: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=415, name=Thread-353, state=RUNNABLE, group=TGRP-TestIndexingSequenceNumbers]
[junit4] > Caused by: java.lang.RuntimeException: org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed
[junit4] > at __randomizedtesting.SeedInfo.seed([5E5720F22F1ABC04]:0)
[junit4] > at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:218)
[junit4] > Caused by: org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed
[junit4] > at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:753)
[junit4] > at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:767)
[junit4] > at org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1388)
[junit4] > at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:208)
[junit4] > Caused by: java.lang.OutOfMemoryError: Java heap space
[junit4] > at org.apache.lucene.store.GrowableByteArrayDataOutput.<init>(GrowableByteArrayDataOutput.java:47)
[junit4] > at org.apache.lucene.codecs.compressing.CompressingStoredFieldsWriter.<init>(CompressingStoredFieldsWriter.java:108)
[junit4] > at org.apache.lucene.codecs.compressing.CompressingStoredFieldsFormat.fieldsWriter(CompressingStoredFieldsFormat.java:128)
[junit4] > at org.apache.lucene.codecs.lucene50.Lucene50StoredFieldsFormat.fieldsWriter(Lucene50StoredFieldsFormat.java:183)
[junit4] > at org.apache.lucene.codecs.asserting.AssertingStoredFieldsFormat.fieldsWriter(AssertingStoredFieldsFormat.java:48)
[junit4] > at org.apache.lucene.index.StoredFieldsConsumer.initStoredFieldsWriter(StoredFieldsConsumer.java:39)
[junit4] > at org.apache.lucene.index.StoredFieldsConsumer.startDocument(StoredFieldsConsumer.java:46)
[junit4] > at org.apache.lucene.index.DefaultIndexingChain.startStoredFields(DefaultIndexingChain.java:364)
[junit4] > at org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:398)
[junit4] > at org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:232)
[junit4] > at org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:478)
[junit4] > at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1579)
[junit4] > at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:210)Throwable #10: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=419, name=Thread-357, state=RUNNABLE, group=TGRP-TestIndexingSequenceNumbers]
[junit4] > Caused by: java.lang.RuntimeException: org.apache.lucene.store.AlreadyClosedException: refusing to delete any files: this IndexWriter hit an unrecoverable exception
[junit4] > at __randomizedtesting.SeedInfo.seed([5E5720F22F1ABC04]:0)
[junit4] > at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:218)
[junit4] > Caused by: org.apache.lucene.store.AlreadyClosedException: refusing to delete any files: this IndexWriter hit an unrecoverable exception
[junit4] > at org.apache.lucene.index.IndexFileDeleter.ensureOpen(IndexFileDeleter.java:345)
[junit4] > at org.apache.lucene.index.IndexFileDeleter.deleteFiles(IndexFileDeleter.java:696)
[junit4] > at org.apache.lucene.index.IndexFileDeleter.decRef(IndexFileDeleter.java:594)
[junit4] > at org.apache.lucene.index.IndexFileDeleter.decRef(IndexFileDeleter.java:647)
[junit4] > at org.apache.lucene.index.IndexWriter.rollbackInternalNoCommit(IndexWriter.java:2233)
[junit4] > at org.apache.lucene.index.IndexWriter.rollbackInternal(IndexWriter.java:2201)
[junit4] > at org.apache.lucene.index.IndexWriter.tragicEvent(IndexWriter.java:4841)
[junit4] > at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1594)
[junit4] > at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:210)
[junit4] > Caused by: java.lang.OutOfMemoryError: Java heap space
[junit4] > at org.apache.lucene.store.GrowableByteArrayDataOutput.<init>(GrowableByteArrayDataOutput.java:47)
[junit4] > at org.apache.lucene.codecs.compressing.CompressingStoredFieldsWriter.<init>(CompressingStoredFieldsWriter.java:108)
[junit4] > at org.apache.lucene.codecs.compressing.CompressingStoredFieldsFormat.fieldsWriter(CompressingStoredFieldsFormat.java:128)
[junit4] > at org.apache.lucene.codecs.lucene50.Lucene50StoredFieldsFormat.fieldsWriter(Lucene50StoredFieldsFormat.java:183)
[junit4] > at org.apache.lucene.codecs.asserting.AssertingStoredFieldsFormat.fieldsWriter(AssertingStoredFieldsFormat.java:48)
[junit4] > at org.apache.lucene.index.StoredFieldsConsumer.initStoredFieldsWriter(StoredFieldsConsumer.java:39)
[junit4] > at org.apache.lucene.index.StoredFieldsConsumer.startDocument(StoredFieldsConsumer.java:46)
[junit4] > at org.apache.lucene.index.DefaultIndexingChain.startStoredFields(DefaultIndexingChain.java:364)
[junit4] > at org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:398)
[junit4] > at org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:232)
[junit4] > at org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:478)
[junit4] > at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1579)
[junit4] > ... 1 more
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/lucene/build/core/test/J1/temp/lucene.index.TestIndexingSequenceNumbers_5E5720F22F1ABC04-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene62): {id=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128)))}, docValues:{thread=DocValuesFormat(name=Memory)}, maxPointsInLeafNode=1331, maxMBSortInHeap=5.653067483172126, sim=RandomSimilarity(queryNorm=true,coord=crazy): {id=DFR I(ne)L3(800.0)}, locale=en-CA, timezone=Pacific/Enderbury
[junit4] 2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_121 (64-bit)/cpus=4,threads=1,free=135667136,total=505937920
[junit4] 2> NOTE: All tests run in this JVM: [TestIndexWriterMergePolicy, TestTerms, TestLucene60FieldInfoFormat, TestFieldCacheRewriteMethod, TestGraphTokenizers, TestOmitTf, TestReaderWrapperDVTypeCheck, Test4GBStoredFields, TestSubScorerFreqs, TestExternalCodecs, TestConcurrentMergeScheduler, TestDoc, TestDirectMonotonic, TestCharsRefBuilder, TestRegexpRandom, TestPerFieldPostingsFormat, TestGeoEncodingUtils, TestSpanBoostQuery, TestMultiset, TestIndexWriterLockRelease, TestPagedBytes, TestMultiTermQueryRewrites, TestSimilarityProvider, TestMinShouldMatch2, TestBytesRef, TestIndexingSequenceNumbers]
[junit4] Completed [79/453 (1!)] on J1 in 643.54s, 8 tests, 1 error <<< FAILURES!
[...truncated 1294 lines...]
[junit4] JVM J1: stdout was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/lucene/build/core/test/temp/junit4-J1-20170221_175632_2777426839116710334389.sysout
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] java.lang.OutOfMemoryError: Java heap space
[junit4] Dumping heap to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/heapdumps/java_pid12229.hprof ...
[junit4] Heap dump file created [493745149 bytes in 7.784 secs]
[junit4] <<< JVM J1: EOF ----
[...truncated 80 lines...]
[junit4] Suite: org.apache.lucene.search.TestFuzzyQuery
[junit4] 2> ?? 21, 2017 11:34:28 ?? com.carrotsearch.randomizedtesting.ThreadLeakControl$2 evaluate
[junit4] 2> WARNING: Suite execution timed out: org.apache.lucene.search.TestFuzzyQuery
[junit4] 2> 1) Thread[id=7580, name=SUITE-TestFuzzyQuery-seed#[5E5720F22F1ABC04], state=RUNNABLE, group=TGRP-TestFuzzyQuery]
[junit4] 2> at java.lang.Thread.getStackTrace(Thread.java:1556)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$4.run(ThreadLeakControl.java:696)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$4.run(ThreadLeakControl.java:693)
[junit4] 2> at java.security.AccessController.doPrivileged(Native Method)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.getStackTrace(ThreadLeakControl.java:693)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.getThreadsWithTraces(ThreadLeakControl.java:709)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.formatThreadStacksFull(ThreadLeakControl.java:689)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.access$1000(ThreadLeakControl.java:65)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$2.evaluate(ThreadLeakControl.java:415)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:678)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.access$200(RandomizedRunner.java:140)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:598)
[junit4] 2> 2) Thread[id=7581, name=TEST-TestFuzzyQuery.testRandom-seed#[5E5720F22F1ABC04], state=RUNNABLE, group=TGRP-TestFuzzyQuery]
[junit4] 2> at java.lang.Object.hashCode(Native Method)
[junit4] 2> at java.util.WeakHashMap.hash(WeakHashMap.java:298)
[junit4] 2> at java.util.WeakHashMap.get(WeakHashMap.java:396)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedContext.getPerThread(RandomizedContext.java:319)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedContext.getRandomness(RandomizedContext.java:92)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedContext.getRandom(RandomizedContext.java:114)
[junit4] 2> at org.apache.lucene.util.LuceneTestCase.random(LuceneTestCase.java:747)
[junit4] 2> at org.apache.lucene.search.TestFuzzyQuery.randomSimpleString(TestFuzzyQuery.java:506)
[junit4] 2> at org.apache.lucene.search.TestFuzzyQuery.testRandom(TestFuzzyQuery.java:517)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:498)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
[junit4] 2> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 3) Thread[id=1, name=main, state=WAITING, group=main]
[junit4] 2> at java.lang.Object.wait(Native Method)
[junit4] 2> at java.lang.Thread.join(Thread.java:1249)
[junit4] 2> at java.lang.Thread.join(Thread.java:1323)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:608)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.run(RandomizedRunner.java:457)
[junit4] 2> at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.execute(SlaveMain.java:244)
[junit4] 2> at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.main(SlaveMain.java:355)
[junit4] 2> at com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe.main(SlaveMainSafe.java:13)
[junit4] 2> 4) Thread[id=9, name=JUnit4-serializer-daemon, state=TIMED_WAITING, group=main]
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at com.carrotsearch.ant.tasks.junit4.events.Serializer$1.run(Serializer.java:50)
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestFuzzyQuery -Dtests.method=testRandom -Dtests.seed=5E5720F22F1ABC04 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/test-data/enwiki.random.lines.txt -Dtests.locale=zh -Dtests.timezone=Africa/Dar_es_Salaam -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[junit4] ERROR 7200s J0 | TestFuzzyQuery.testRandom <<<
[junit4] > Throwable #1: java.lang.Exception: Test abandoned because suite timeout was reached.
[junit4] > at __randomizedtesting.SeedInfo.seed([5E5720F22F1ABC04]:0)
[junit4] 2> ?? 21, 2017 11:34:28 ?? com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> ?? 21, 2017 11:34:48 ?? com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> SEVERE: 1 thread leaked from SUITE scope at org.apache.lucene.search.TestFuzzyQuery:
[junit4] 2> 1) Thread[id=7581, name=TEST-TestFuzzyQuery.testRandom-seed#[5E5720F22F1ABC04], state=RUNNABLE, group=TGRP-TestFuzzyQuery]
[junit4] 2> at java.util.WeakHashMap.getTable(WeakHashMap.java:350)
[junit4] 2> at java.util.WeakHashMap.getEntry(WeakHashMap.java:427)
[junit4] 2> at java.util.WeakHashMap.containsKey(WeakHashMap.java:417)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedContext.context(RandomizedContext.java:258)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedContext.current(RandomizedContext.java:134)
[junit4] 2> at org.apache.lucene.util.LuceneTestCase.random(LuceneTestCase.java:747)
[junit4] 2> at org.apache.lucene.search.TestFuzzyQuery.randomSimpleString(TestFuzzyQuery.java:506)
[junit4] 2> at org.apache.lucene.search.TestFuzzyQuery.testRandom(TestFuzzyQuery.java:517)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:498)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
[junit4] 2> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> ?? 21, 2017 11:34:48 ?? com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> INFO: Starting to interrupt leaked threads:
[junit4] 2> 1) Thread[id=7581, name=TEST-TestFuzzyQuery.testRandom-seed#[5E5720F22F1ABC04], state=RUNNABLE, group=TGRP-TestFuzzyQuery]
[junit4] 2> ?? 21, 2017 11:34:51 ?? com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> SEVERE: There are still zombie threads that couldn't be terminated:
[junit4] 2> 1) Thread[id=7581, name=TEST-TestFuzzyQuery.testRandom-seed#[5E5720F22F1ABC04], state=RUNNABLE, group=TGRP-TestFuzzyQuery]
[junit4] 2> at java.lang.Object.hashCode(Native Method)
[junit4] 2> at java.util.WeakHashMap.hash(WeakHashMap.java:298)
[junit4] 2> at java.util.WeakHashMap.getEntry(WeakHashMap.java:426)
[junit4] 2> at java.util.WeakHashMap.containsKey(WeakHashMap.java:417)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedContext.context(RandomizedContext.java:258)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedContext.current(RandomizedContext.java:134)
[junit4] 2> at org.apache.lucene.util.LuceneTestCase.random(LuceneTestCase.java:747)
[junit4] 2> at org.apache.lucene.search.TestFuzzyQuery.randomSimpleString(TestFuzzyQuery.java:506)
[junit4] 2> at org.apache.lucene.search.TestFuzzyQuery.testRandom(TestFuzzyQuery.java:517)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:498)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
[junit4] 2> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
[junit4] 2> at com.carrotsearch.ra
[...truncated too long message...]
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.checkMBeanPermission(DefaultMBeanServerInterceptor.java:1813)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.exclusiveUnregisterMBean(DefaultMBeanServerInterceptor.java:430)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.unregisterMBean(DefaultMBeanServerInterceptor.java:415)
[junit4] 2> at com.sun.jmx.mbeanserver.JmxMBeanServer.unregisterMBean(JmxMBeanServer.java:546)
[junit4] 2> at org.apache.hadoop.metrics2.util.MBeans.unregister(MBeans.java:81)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stopMBeans(MetricsSourceAdapter.java:226)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stop(MetricsSourceAdapter.java:211)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stopSources(MetricsSystemImpl.java:463)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stop(MetricsSystemImpl.java:213)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.shutdown(MetricsSystemImpl.java:594)
[junit4] 2> at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdownInstance(DefaultMetricsSystem.java:72)
[junit4] 2> at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdown(DefaultMetricsSystem.java:68)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.metrics.NameNodeMetrics.shutdown(NameNodeMetrics.java:171)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.NameNode.stop(NameNode.java:872)
[junit4] 2> at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1726)
[junit4] 2> at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1705)
[junit4] 2> at org.apache.solr.cloud.hdfs.HdfsTestUtil.teardownClass(HdfsTestUtil.java:198)
[junit4] 2> at org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest.teardownClass(HdfsWriteToMultipleCollectionsTest.java:73)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:498)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:870)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> Caused by: java.lang.NullPointerException
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlocksMap.size(BlocksMap.java:203)
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.getTotalBlocks(BlockManager.java:3370)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlocksTotal(FSNamesystem.java:5729)
[junit4] 2> ... 53 more
[junit4] 2> 4590044 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[1CD4E002FDBBCDC6]-worker) [ ] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_1CD4E002FDBBCDC6-001
[junit4] 2> Feb 21, 2017 11:37:06 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 35 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene62): {rnd_b=PostingsFormat(name=Memory doPackFST= false), a_t=PostingsFormat(name=LuceneVarGapDocFreqInterval), a_i=PostingsFormat(name=Memory doPackFST= false), id=PostingsFormat(name=Memory doPackFST= false)}, docValues:{_version_=DocValuesFormat(name=Lucene54)}, maxPointsInLeafNode=1420, maxMBSortInHeap=6.806182868555215, sim=RandomSimilarity(queryNorm=false,coord=no): {}, locale=uk, timezone=Africa/Tripoli
[junit4] 2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_121 (64-bit)/cpus=4,threads=2,free=112962928,total=526385152
[junit4] 2> NOTE: All tests run in this JVM: [CollectionsAPISolrJTest, BlockJoinFacetSimpleTest, DistributedDebugComponentTest, TestDefaultSearchFieldResource, TestPKIAuthenticationPlugin, SolrIndexMetricsTest, TestMinMaxOnMultiValuedField, TestManagedResource, HdfsRecoveryZkTest, DeleteReplicaTest, InfixSuggestersTest, InfoHandlerTest, JsonValidatorTest, TestSchemalessBufferedUpdates, CleanupOldIndexTest, TestAuthenticationFramework, MultiThreadedOCPTest, SSLMigrationTest, TestSolrConfigHandlerConcurrent, TestDocumentBuilder, RegexBoostProcessorTest, CacheHeaderTest, TestExactSharedStatsCache, TestLegacyFieldCache, TestNoOpRegenerator, TestFoldingMultitermQuery, ExplicitHLLTest, XsltUpdateRequestHandlerTest, TolerantUpdateProcessorTest, DefaultValueUpdateProcessorTest, TestExportWriter, ForceLeaderTest, SolrMetricsIntegrationTest, TestHighlightDedupGrouping, TestComponentsName, TestDistributedStatsComponentCardinality, QueryEqualityTest, AtomicUpdatesTest, UniqFieldsUpdateProcessorFactoryTest, ClassificationUpdateProcessorTest, MergeStrategyTest, TestRangeQuery, PolyFieldTest, TestFreeTextSuggestions, HighlighterConfigTest, DeleteInactiveReplicaTest, SegmentsInfoRequestHandlerTest, TestJavabinTupleStreamParser, TestReplicationHandlerBackup, TestFastWriter, ZkNodePropsTest, TestSolrCloudWithDelegationTokens, HdfsCollectionsAPIDistributedZkTest, FastVectorHighlighterTest, TestFaceting, DateFieldTest, TestReplicationHandler, SyncSliceTest, TestSolrConfigHandler, AssignTest, HLLUtilTest, TestLockTree, TestImplicitCoreProperties, CollectionStateFormat2Test, TestMiniSolrCloudClusterSSL, BasicAuthIntegrationTest, TestLeaderElectionZkExpiry, TestSolrQueryParserDefaultOperatorResource, SignatureUpdateProcessorFactoryTest, TestPerFieldSimilarity, TestNonDefinedSimilarityFactory, TestCodecSupport, TestOmitPositions, TestSQLHandler, ResourceLoaderTest, BasicDistributedZkTest, QueryResultKeyTest, CursorPagingTest, RuleEngineTest, DistribCursorPagingTest, TestScoreJoinQPScore, TestAtomicUpdateErrorCases, TestTrackingShardHandlerFactory, NotRequiredUniqueKeyTest, TestSimpleQParserPlugin, TestManagedSchemaThreadSafety, TestCollectionAPIs, TriLevelCompositeIdRoutingTest, DocumentAnalysisRequestHandlerTest, LeaderInitiatedRecoveryOnShardRestartTest, TestFieldCollectionResource, HdfsBasicDistributedZkTest, SolrCoreMetricManagerTest, ConnectionManagerTest, RecoveryAfterSoftCommitTest, TestCrossCoreJoin, TestRemoteStreaming, SmileWriterTest, FileBasedSpellCheckerTest, SolrCoreTest, TestDeleteCollectionOnDownNodes, ConnectionReuseTest, TestSolrCLIRunExample, TestDistributedSearch, TestStressUserVersions, DistributedQueueTest, TestRealTimeGet, IgnoreCommitOptimizeUpdateProcessorFactoryTest, OverseerCollectionConfigSetProcessorTest, PeerSyncTest, TestRecoveryHdfs, TestRandomDVFaceting, LeaderFailureAfterFreshStartTest, OverseerStatusTest, ReplicationFactorTest, RollingRestartTest, TestShortCircuitedRequests, TestSolrCloudWithKerberosAlt, TestStressLiveNodes, HdfsChaosMonkeySafeLeaderTest, HdfsRestartWhileUpdatingTest, HdfsWriteToMultipleCollectionsTest]
[junit4] Completed [549/695 (3!)] on J0 in 30.77s, 1 test, 1 failure <<< FAILURES!
[...truncated 12173 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/build.xml:783: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/build.xml:727: Some of the tests produced a heap dump, but did not fail. Maybe a suppressed OutOfMemoryError? Dumps created:
* java_pid12229.hprof
Total time: 359 minutes 28 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-6.x - Build # 289 - Still
unstable
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.x/289/
5 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.CdcrReplicationDistributedZkTest
Error Message:
ObjectTracker found 1 object(s) that were not released!!! [SolrZkClient] org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:184) at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:116) at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:106) at org.apache.solr.common.cloud.ZkStateReader.<init>(ZkStateReader.java:226) at org.apache.solr.client.solrj.impl.ZkClientClusterStateProvider.connect(ZkClientClusterStateProvider.java:121) at org.apache.solr.client.solrj.impl.CloudSolrClient.connect(CloudSolrClient.java:615) at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:1062) at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:1042) at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219) at org.apache.solr.handler.CdcrReplicatorManager.getCheckpoint(CdcrReplicatorManager.java:196) at org.apache.solr.handler.CdcrReplicatorManager.initLogReaders(CdcrReplicatorManager.java:159) at org.apache.solr.handler.CdcrReplicatorManager.stateUpdate(CdcrReplicatorManager.java:134) at org.apache.solr.handler.CdcrStateManager.callback(CdcrStateManager.java:36) at org.apache.solr.handler.CdcrLeaderStateManager.setAmILeader(CdcrLeaderStateManager.java:108) at org.apache.solr.handler.CdcrLeaderStateManager.checkIfIAmLeader(CdcrLeaderStateManager.java:95) at org.apache.solr.handler.CdcrLeaderStateManager.access$400(CdcrLeaderStateManager.java:40) at org.apache.solr.handler.CdcrLeaderStateManager$LeaderStateWatcher.process(CdcrLeaderStateManager.java:150) at org.apache.solr.common.cloud.SolrZkClient$3.lambda$process$0(SolrZkClient.java:268) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745)
Stack Trace:
java.lang.AssertionError: ObjectTracker found 1 object(s) that were not released!!! [SolrZkClient]
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException
at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:184)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:116)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:106)
at org.apache.solr.common.cloud.ZkStateReader.<init>(ZkStateReader.java:226)
at org.apache.solr.client.solrj.impl.ZkClientClusterStateProvider.connect(ZkClientClusterStateProvider.java:121)
at org.apache.solr.client.solrj.impl.CloudSolrClient.connect(CloudSolrClient.java:615)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:1062)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:1042)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
at org.apache.solr.handler.CdcrReplicatorManager.getCheckpoint(CdcrReplicatorManager.java:196)
at org.apache.solr.handler.CdcrReplicatorManager.initLogReaders(CdcrReplicatorManager.java:159)
at org.apache.solr.handler.CdcrReplicatorManager.stateUpdate(CdcrReplicatorManager.java:134)
at org.apache.solr.handler.CdcrStateManager.callback(CdcrStateManager.java:36)
at org.apache.solr.handler.CdcrLeaderStateManager.setAmILeader(CdcrLeaderStateManager.java:108)
at org.apache.solr.handler.CdcrLeaderStateManager.checkIfIAmLeader(CdcrLeaderStateManager.java:95)
at org.apache.solr.handler.CdcrLeaderStateManager.access$400(CdcrLeaderStateManager.java:40)
at org.apache.solr.handler.CdcrLeaderStateManager$LeaderStateWatcher.process(CdcrLeaderStateManager.java:150)
at org.apache.solr.common.cloud.SolrZkClient$3.lambda$process$0(SolrZkClient.java:268)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
at __randomizedtesting.SeedInfo.seed([C8BD79F319D22C35]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNull(Assert.java:551)
at org.apache.solr.SolrTestCaseJ4.teardownTestCases(SolrTestCaseJ4.java:301)
at sun.reflect.GeneratedMethodAccessor23.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:870)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.CdcrReplicationDistributedZkTest
Error Message:
2 threads leaked from SUITE scope at org.apache.solr.cloud.CdcrReplicationDistributedZkTest: 1) Thread[id=14880, name=zkCallback-2471-thread-3-processing-n:127.0.0.1:42838_y_ihk%2Fxm-EventThread, state=WAITING, group=TGRP-CdcrReplicationDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494) 2) Thread[id=14879, name=zkCallback-2471-thread-3-processing-n:127.0.0.1:42838_y_ihk%2Fxm-SendThread(127.0.0.1:59258), state=TIMED_WAITING, group=TGRP-CdcrReplicationDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:940) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.cloud.CdcrReplicationDistributedZkTest:
1) Thread[id=14880, name=zkCallback-2471-thread-3-processing-n:127.0.0.1:42838_y_ihk%2Fxm-EventThread, state=WAITING, group=TGRP-CdcrReplicationDistributedZkTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494)
2) Thread[id=14879, name=zkCallback-2471-thread-3-processing-n:127.0.0.1:42838_y_ihk%2Fxm-SendThread(127.0.0.1:59258), state=TIMED_WAITING, group=TGRP-CdcrReplicationDistributedZkTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:940)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003)
at __randomizedtesting.SeedInfo.seed([C8BD79F319D22C35]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.CdcrReplicationDistributedZkTest
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=14879, name=zkCallback-2471-thread-3-processing-n:127.0.0.1:42838_y_ihk%2Fxm-SendThread(127.0.0.1:59258), state=TIMED_WAITING, group=TGRP-CdcrReplicationDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:940) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=14879, name=zkCallback-2471-thread-3-processing-n:127.0.0.1:42838_y_ihk%2Fxm-SendThread(127.0.0.1:59258), state=TIMED_WAITING, group=TGRP-CdcrReplicationDistributedZkTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:940)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003)
at __randomizedtesting.SeedInfo.seed([C8BD79F319D22C35]:0)
FAILED: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.test
Error Message:
shard3 is not consistent. Got 79 from https://127.0.0.1:33901/collection1 (previous client) and got 81 from https://127.0.0.1:45956/collection1
Stack Trace:
java.lang.AssertionError: shard3 is not consistent. Got 79 from https://127.0.0.1:33901/collection1 (previous client) and got 81 from https://127.0.0.1:45956/collection1
at __randomizedtesting.SeedInfo.seed([C8BD79F319D22C35:40E94629B72E41CD]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1271)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1250)
at org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.test(ChaosMonkeySafeLeaderTest.java:162)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest.test
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([C8BD79F319D22C35:40E94629B72E41CD]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertTrue(Assert.java:54)
at org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest.test(HdfsWriteToMultipleCollectionsTest.java:137)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 12151 lines...]
[junit4] Suite: org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_C8BD79F319D22C35-001/init-core-data-001
[junit4] 2> 1030722 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[C8BD79F319D22C35]-worker) [ ] o.a.s.SolrTestCaseJ4 Using TrieFields
[junit4] 2> 1030723 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[C8BD79F319D22C35]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
[junit4] 2> 1030723 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[C8BD79F319D22C35]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /xxuy/pr
[junit4] 1> Formatting using clusterid: testClusterID
[junit4] 2> 1030751 WARN (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[C8BD79F319D22C35]-worker) [ ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
[junit4] 2> 1030764 WARN (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[C8BD79F319D22C35]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 1030766 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[C8BD79F319D22C35]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 1030775 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[C8BD79F319D22C35]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.2-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_42039_hdfs____.gv03y6/webapp
[junit4] 2> 1031504 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[C8BD79F319D22C35]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42039
[junit4] 2> 1031580 WARN (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[C8BD79F319D22C35]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 1031581 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[C8BD79F319D22C35]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 1031590 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[C8BD79F319D22C35]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.2-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_35704_datanode____wmk2m8/webapp
[junit4] 2> 1031955 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[C8BD79F319D22C35]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35704
[junit4] 2> 1031998 WARN (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[C8BD79F319D22C35]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 1031999 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[C8BD79F319D22C35]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 1032012 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[C8BD79F319D22C35]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.2-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_46711_datanode____.i9qbic/webapp
[junit4] 2> 1032091 INFO (IPC Server handler 3 on 43178) [ ] BlockStateChange BLOCK* processReport: from storage DS-770bc853-96e7-4339-8166-f21ace9b1e13 node DatanodeRegistration(127.0.0.1:41127, datanodeUuid=41a60b86-db4d-477d-9dd3-f7ed1dd43b77, infoPort=34114, infoSecurePort=0, ipcPort=36381, storageInfo=lv=-56;cid=testClusterID;nsid=1115533096;c=0), blocks: 0, hasStaleStorage: true, processing time: 0 msecs
[junit4] 2> 1032091 INFO (IPC Server handler 3 on 43178) [ ] BlockStateChange BLOCK* processReport: from storage DS-f0c8d3b1-0b65-44b9-95e1-99ff2a70fca1 node DatanodeRegistration(127.0.0.1:41127, datanodeUuid=41a60b86-db4d-477d-9dd3-f7ed1dd43b77, infoPort=34114, infoSecurePort=0, ipcPort=36381, storageInfo=lv=-56;cid=testClusterID;nsid=1115533096;c=0), blocks: 0, hasStaleStorage: false, processing time: 0 msecs
[junit4] 2> 1032470 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[C8BD79F319D22C35]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46711
[junit4] 2> 1032559 INFO (IPC Server handler 0 on 43178) [ ] BlockStateChange BLOCK* processReport: from storage DS-fbd2ff27-dcbc-4512-bee3-8714e9ce0425 node DatanodeRegistration(127.0.0.1:58440, datanodeUuid=0c78c166-215a-40f6-b1b3-51a3f12a3333, infoPort=40456, infoSecurePort=0, ipcPort=38918, storageInfo=lv=-56;cid=testClusterID;nsid=1115533096;c=0), blocks: 0, hasStaleStorage: true, processing time: 0 msecs
[junit4] 2> 1032559 INFO (IPC Server handler 0 on 43178) [ ] BlockStateChange BLOCK* processReport: from storage DS-926811d6-d0e8-43d3-bc09-87a4e719441d node DatanodeRegistration(127.0.0.1:58440, datanodeUuid=0c78c166-215a-40f6-b1b3-51a3f12a3333, infoPort=40456, infoSecurePort=0, ipcPort=38918, storageInfo=lv=-56;cid=testClusterID;nsid=1115533096;c=0), blocks: 0, hasStaleStorage: false, processing time: 0 msecs
[junit4] 2> 1032640 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1032641 INFO (Thread-2242) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1032641 INFO (Thread-2242) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1032741 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.a.s.c.ZkTestServer start zk server on port:50881
[junit4] 2> 1032757 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 1032759 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 1032761 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1032762 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 1032768 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 1032769 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 1032770 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 1032779 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1032780 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1032781 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 1032782 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 1032890 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_C8BD79F319D22C35-001/control-001/cores/collection1
[junit4] 2> 1032892 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 1032906 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@68382c20{/xxuy/pr,null,AVAILABLE}
[junit4] 2> 1032906 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@718d852f{HTTP/1.1,[http/1.1]}{127.0.0.1:42868}
[junit4] 2> 1032906 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.e.j.s.Server Started @1035804ms
[junit4] 2> 1032906 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:43178/hdfs__localhost_43178__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-6.x_checkout_solr_build_solr-core_test_J0_temp_solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_C8BD79F319D22C35-001_tempDir-002_control_data, hostContext=/xxuy/pr, hostPort=42868, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_C8BD79F319D22C35-001/control-001/cores}
[junit4] 2> 1032907 ERROR (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1032907 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 6.5.0
[junit4] 2> 1032907 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1032907 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1032907 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-02-20T09:30:45.943Z
[junit4] 2> 1032910 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1032910 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_C8BD79F319D22C35-001/control-001/solr.xml
[junit4] 2> 1032917 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1032917 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:50881/solr
[junit4] 2> 1032935 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [n:127.0.0.1:42868_xxuy%2Fpr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1032936 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [n:127.0.0.1:42868_xxuy%2Fpr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:42868_xxuy%2Fpr
[junit4] 2> 1032937 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [n:127.0.0.1:42868_xxuy%2Fpr ] o.a.s.c.Overseer Overseer (id=97490242481487876-127.0.0.1:42868_xxuy%2Fpr-n_0000000000) starting
[junit4] 2> 1032944 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [n:127.0.0.1:42868_xxuy%2Fpr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42868_xxuy%2Fpr
[junit4] 2> 1032953 INFO (OverseerStateUpdate-97490242481487876-127.0.0.1:42868_xxuy%2Fpr-n_0000000000) [n:127.0.0.1:42868_xxuy%2Fpr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1033013 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [n:127.0.0.1:42868_xxuy%2Fpr ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_C8BD79F319D22C35-001/control-001/cores
[junit4] 2> 1033013 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [n:127.0.0.1:42868_xxuy%2Fpr ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 1033019 INFO (OverseerStateUpdate-97490242481487876-127.0.0.1:42868_xxuy%2Fpr-n_0000000000) [n:127.0.0.1:42868_xxuy%2Fpr ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 1033035 INFO (coreLoadExecutor-2490-thread-1-processing-n:127.0.0.1:42868_xxuy%2Fpr) [n:127.0.0.1:42868_xxuy%2Fpr c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
[junit4] 2> 1033045 INFO (coreLoadExecutor-2490-thread-1-processing-n:127.0.0.1:42868_xxuy%2Fpr) [n:127.0.0.1:42868_xxuy%2Fpr c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 1033112 WARN (coreLoadExecutor-2490-thread-1-processing-n:127.0.0.1:42868_xxuy%2Fpr) [n:127.0.0.1:42868_xxuy%2Fpr c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 1033114 INFO (coreLoadExecutor-2490-thread-1-processing-n:127.0.0.1:42868_xxuy%2Fpr) [n:127.0.0.1:42868_xxuy%2Fpr c:control_collection x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 1033129 INFO (coreLoadExecutor-2490-thread-1-processing-n:127.0.0.1:42868_xxuy%2Fpr) [n:127.0.0.1:42868_xxuy%2Fpr c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 1033130 INFO (coreLoadExecutor-2490-thread-1-processing-n:127.0.0.1:42868_xxuy%2Fpr) [n:127.0.0.1:42868_xxuy%2Fpr c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:43178/solr_hdfs_home
[junit4] 2> 1033130 INFO (coreLoadExecutor-2490-thread-1-processing-n:127.0.0.1:42868_xxuy%2Fpr) [n:127.0.0.1:42868_xxuy%2Fpr c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 1033130 INFO (coreLoadExecutor-2490-thread-1-processing-n:127.0.0.1:42868_xxuy%2Fpr) [n:127.0.0.1:42868_xxuy%2Fpr c:control_collection x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_C8BD79F319D22C35-001/control-001/cores/collection1], dataDir=[hdfs://localhost:43178/solr_hdfs_home/control_collection/core_node1/data/]
[junit4] 2> 1033130 INFO (coreLoadExecutor-2490-thread-1-processing-n:127.0.0.1:42868_xxuy%2Fpr) [n:127.0.0.1:42868_xxuy%2Fpr c:control_collection x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2f775b2e
[junit4] 2> 1033130 INFO (coreLoadExecutor-2490-thread-1-processing-n:127.0.0.1:42868_xxuy%2Fpr) [n:127.0.0.1:42868_xxuy%2Fpr c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:43178/solr_hdfs_home/control_collection/core_node1/data/snapshot_metadata
[junit4] 2> 1033140 INFO (coreLoadExecutor-2490-thread-1-processing-n:127.0.0.1:42868_xxuy%2Fpr) [n:127.0.0.1:42868_xxuy%2Fpr c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 1033140 INFO (coreLoadExecutor-2490-thread-1-processing-n:127.0.0.1:42868_xxuy%2Fpr) [n:127.0.0.1:42868_xxuy%2Fpr c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
[junit4] 2> 1033147 INFO (coreLoadExecutor-2490-thread-1-processing-n:127.0.0.1:42868_xxuy%2Fpr) [n:127.0.0.1:42868_xxuy%2Fpr c:control_collection x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 1033148 INFO (coreLoadExecutor-2490-thread-1-processing-n:127.0.0.1:42868_xxuy%2Fpr) [n:127.0.0.1:42868_xxuy%2Fpr c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:43178/solr_hdfs_home/control_collection/core_node1/data
[junit4] 2> 1033173 INFO (coreLoadExecutor-2490-thread-1-processing-n:127.0.0.1:42868_xxuy%2Fpr) [n:127.0.0.1:42868_xxuy%2Fpr c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:43178/solr_hdfs_home/control_collection/core_node1/data/index
[junit4] 2> 1033178 INFO (coreLoadExecutor-2490-thread-1-processing-n:127.0.0.1:42868_xxuy%2Fpr) [n:127.0.0.1:42868_xxuy%2Fpr c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 1033178 INFO (coreLoadExecutor-2490-thread-1-processing-n:127.0.0.1:42868_xxuy%2Fpr) [n:127.0.0.1:42868_xxuy%2Fpr c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
[junit4] 2> 1033184 INFO (coreLoadExecutor-2490-thread-1-processing-n:127.0.0.1:42868_xxuy%2Fpr) [n:127.0.0.1:42868_xxuy%2Fpr c:control_collection x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 1033184 INFO (coreLoadExecutor-2490-thread-1-processing-n:127.0.0.1:42868_xxuy%2Fpr) [n:127.0.0.1:42868_xxuy%2Fpr c:control_collection x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=24, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=0.509765625, noCFSRatio=0.22900695798051826]
[junit4] 2> 1033207 INFO (IPC Server handler 3 on 43178) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:41127 is added to blk_1073741825_1001{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-fbd2ff27-dcbc-4512-bee3-8714e9ce0425:NORMAL:127.0.0.1:58440|RBW], ReplicaUC[[DISK]DS-f0c8d3b1-0b65-44b9-95e1-99ff2a70fca1:NORMAL:127.0.0.1:41127|FINALIZED]]} size 0
[junit4] 2> 1033209 INFO (IPC Server handler 4 on 43178) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:58440 is added to blk_1073741825_1001{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-f0c8d3b1-0b65-44b9-95e1-99ff2a70fca1:NORMAL:127.0.0.1:41127|FINALIZED], ReplicaUC[[DISK]DS-926811d6-d0e8-43d3-bc09-87a4e719441d:NORMAL:127.0.0.1:58440|FINALIZED]]} size 0
[junit4] 2> 1033218 WARN (coreLoadExecutor-2490-thread-1-processing-n:127.0.0.1:42868_xxuy%2Fpr) [n:127.0.0.1:42868_xxuy%2Fpr c:control_collection x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 1033267 INFO (coreLoadExecutor-2490-thread-1-processing-n:127.0.0.1:42868_xxuy%2Fpr) [n:127.0.0.1:42868_xxuy%2Fpr c:control_collection x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
[junit4] 2> 1033267 INFO (coreLoadExecutor-2490-thread-1-processing-n:127.0.0.1:42868_xxuy%2Fpr) [n:127.0.0.1:42868_xxuy%2Fpr c:control_collection x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1033267 INFO (coreLoadExecutor-2490-thread-1-processing-n:127.0.0.1:42868_xxuy%2Fpr) [n:127.0.0.1:42868_xxuy%2Fpr c:control_collection x:collection1] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=2
[junit4] 2> 1033279 INFO (coreLoadExecutor-2490-thread-1-processing-n:127.0.0.1:42868_xxuy%2Fpr) [n:127.0.0.1:42868_xxuy%2Fpr c:control_collection x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1033279 INFO (coreLoadExecutor-2490-thread-1-processing-n:127.0.0.1:42868_xxuy%2Fpr) [n:127.0.0.1:42868_xxuy%2Fpr c:control_collection x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1033280 INFO (coreLoadExecutor-2490-thread-1-processing-n:127.0.0.1:42868_xxuy%2Fpr) [n:127.0.0.1:42868_xxuy%2Fpr c:control_collection x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@59e660b8
[junit4] 2> 1033301 INFO (coreLoadExecutor-2490-thread-1-processing-n:127.0.0.1:42868_xxuy%2Fpr) [n:127.0.0.1:42868_xxuy%2Fpr c:control_collection x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@749b5244[collection1] main]
[junit4] 2> 1033302 INFO (coreLoadExecutor-2490-thread-1-processing-n:127.0.0.1:42868_xxuy%2Fpr) [n:127.0.0.1:42868_xxuy%2Fpr c:control_collection x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1033302 INFO (coreLoadExecutor-2490-thread-1-processing-n:127.0.0.1:42868_xxuy%2Fpr) [n:127.0.0.1:42868_xxuy%2Fpr c:control_collection x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1033302 INFO (coreLoadExecutor-2490-thread-1-processing-n:127.0.0.1:42868_xxuy%2Fpr) [n:127.0.0.1:42868_xxuy%2Fpr c:control_collection x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 1033305 INFO (searcherExecutor-2491-thread-1-processing-n:127.0.0.1:42868_xxuy%2Fpr x:collection1 c:control_collection) [n:127.0.0.1:42868_xxuy%2Fpr c:control_collection x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@749b5244[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1033307 INFO (coreLoadExecutor-2490-thread-1-processing-n:127.0.0.1:42868_xxuy%2Fpr) [n:127.0.0.1:42868_xxuy%2Fpr c:control_collection x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1559843880402157568
[junit4] 2> 1033319 INFO (coreZkRegister-2483-thread-1-processing-n:127.0.0.1:42868_xxuy%2Fpr x:collection1 c:control_collection) [n:127.0.0.1:42868_xxuy%2Fpr c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1033319 INFO (coreZkRegister-2483-thread-1-processing-n:127.0.0.1:42868_xxuy%2Fpr x:collection1 c:control_collection) [n:127.0.0.1:42868_xxuy%2Fpr c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1033320 INFO (coreZkRegister-2483-thread-1-processing-n:127.0.0.1:42868_xxuy%2Fpr x:collection1 c:control_collection) [n:127.0.0.1:42868_xxuy%2Fpr c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:42868/xxuy/pr/collection1/
[junit4] 2> 1033320 INFO (coreZkRegister-2483-thread-1-processing-n:127.0.0.1:42868_xxuy%2Fpr x:collection1 c:control_collection) [n:127.0.0.1:42868_xxuy%2Fpr c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1033320 INFO (coreZkRegister-2483-thread-1-processing-n:127.0.0.1:42868_xxuy%2Fpr x:collection1 c:control_collection) [n:127.0.0.1:42868_xxuy%2Fpr c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:42868/xxuy/pr/collection1/ has no replicas
[junit4] 2> 1033324 INFO (coreZkRegister-2483-thread-1-processing-n:127.0.0.1:42868_xxuy%2Fpr x:collection1 c:control_collection) [n:127.0.0.1:42868_xxuy%2Fpr c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:42868/xxuy/pr/collection1/ shard1
[junit4] 2> 1033475 INFO (coreZkRegister-2483-thread-1-processing-n:127.0.0.1:42868_xxuy%2Fpr x:collection1 c:control_collection) [n:127.0.0.1:42868_xxuy%2Fpr c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1033664 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1033665 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:50881/solr ready
[junit4] 2> 1033665 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 1033762 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_C8BD79F319D22C35-001/shard-1-001/cores/collection1
[junit4] 2> 1033762 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_C8BD79F319D22C35-001/shard-1-001
[junit4] 2> 1033763 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 1033764 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@209ea24a{/xxuy/pr,null,AVAILABLE}
[junit4] 2> 1033764 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@5551d84f{HTTP/1.1,[http/1.1]}{127.0.0.1:55777}
[junit4] 2> 1033764 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.e.j.s.Server Started @1036662ms
[junit4] 2> 1033764 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:43178/hdfs__localhost_43178__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-6.x_checkout_solr_build_solr-core_test_J0_temp_solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_C8BD79F319D22C35-001_tempDir-002_jetty1, solrconfig=solrconfig.xml, hostContext=/xxuy/pr, hostPort=55777, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_C8BD79F319D22C35-001/shard-1-001/cores}
[junit4] 2> 1033764 ERROR (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1033764 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 6.5.0
[junit4] 2> 1033765 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1033765 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1033765 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-02-20T09:30:46.801Z
[junit4] 2> 1033767 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1033767 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_C8BD79F319D22C35-001/shard-1-001/solr.xml
[junit4] 2> 1033771 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1033772 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:50881/solr
[junit4] 2> 1033780 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [n:127.0.0.1:55777_xxuy%2Fpr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1033781 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [n:127.0.0.1:55777_xxuy%2Fpr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1033783 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [n:127.0.0.1:55777_xxuy%2Fpr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55777_xxuy%2Fpr
[junit4] 2> 1033784 INFO (zkCallback-864-thread-4-processing-n:127.0.0.1:42868_xxuy%2Fpr) [n:127.0.0.1:42868_xxuy%2Fpr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1033784 INFO (zkCallback-868-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1033794 INFO (zkCallback-873-thread-1-processing-n:127.0.0.1:55777_xxuy%2Fpr) [n:127.0.0.1:55777_xxuy%2Fpr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1033821 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [n:127.0.0.1:55777_xxuy%2Fpr ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_C8BD79F319D22C35-001/shard-1-001/cores
[junit4] 2> 1033821 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [n:127.0.0.1:55777_xxuy%2Fpr ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 1033826 INFO (OverseerStateUpdate-97490242481487876-127.0.0.1:42868_xxuy%2Fpr-n_0000000000) [n:127.0.0.1:42868_xxuy%2Fpr ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 1034835 INFO (coreLoadExecutor-2501-thread-1-processing-n:127.0.0.1:55777_xxuy%2Fpr) [n:127.0.0.1:55777_xxuy%2Fpr c:collection1 x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
[junit4] 2> 1034845 INFO (coreLoadExecutor-2501-thread-1-processing-n:127.0.0.1:55777_xxuy%2Fpr) [n:127.0.0.1:55777_xxuy%2Fpr c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 1034901 WARN (coreLoadExecutor-2501-thread-1-processing-n:127.0.0.1:55777_xxuy%2Fpr) [n:127.0.0.1:55777_xxuy%2Fpr c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 1034903 INFO (coreLoadExecutor-2501-thread-1-processing-n:127.0.0.1:55777_xxuy%2Fpr) [n:127.0.0.1:55777_xxuy%2Fpr c:collection1 x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 1034913 INFO (coreLoadExecutor-2501-thread-1-processing-n:127.0.0.1:55777_xxuy%2Fpr) [n:127.0.0.1:55777_xxuy%2Fpr c:collection1 x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 1034913 INFO (coreLoadExecutor-2501-thread-1-processing-n:127.0.0.1:55777_xxuy%2Fpr) [n:127.0.0.1:55777_xxuy%2Fpr c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:43178/solr_hdfs_home
[junit4] 2> 1034913 INFO (coreLoadExecutor-2501-thread-1-processing-n:127.0.0.1:55777_xxuy%2Fpr) [n:127.0.0.1:55777_xxuy%2Fpr c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 1034913 INFO (coreLoadExecutor-2501-thread-1-processing-n:127.0.0.1:55777_xxuy%2Fpr) [n:127.0.0.1:55777_xxuy%2Fpr c:collection1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_C8BD79F319D22C35-001/shard-1-001/cores/collection1], dataDir=[hdfs://localhost:43178/solr_hdfs_home/collection1/core_node1/data/]
[junit4] 2> 1034913 INFO (coreLoadExecutor-2501-thread-1-processing-n:127.0.0.1:55777_xxuy%2Fpr) [n:127.0.0.1:55777_xxuy%2Fpr c:collection1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2f775b2e
[junit4] 2> 1034918 INFO (coreLoadExecutor-2501-thread-1-processing-n:127.0.0.1:55777_xxuy%2Fpr) [n:127.0.0.1:55777_xxuy%2Fpr c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:43178/solr_hdfs_home/collection1/core_node1/data/snapshot_metadata
[junit4] 2> 1034924 INFO (coreLoadExecutor-2501-thread-1-processing-n:127.0.0.1:55777_xxuy%2Fpr) [n:127.0.0.1:55777_xxuy%2Fpr c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 1034924 INFO (coreLoadExecutor-2501-thread-1-processing-n:127.0.0.1:55777_xxuy%2Fpr) [n:127.0.0.1:55777_xxuy%2Fpr c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
[junit4] 2> 1034926 INFO (coreLoadExecutor-2501-thread-1-processing-n:127.0.0.1:55777_xxuy%2Fpr) [n:127.0.0.1:55777_xxuy%2Fpr c:collection1 x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 1034933 INFO (coreLoadExecutor-2501-thread-1-processing-n:127.0.0.1:55777_xxuy%2Fpr) [n:127.0.0.1:55777_xxuy%2Fpr c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:43178/solr_hdfs_home/collection1/core_node1/data
[junit4] 2> 1034955 INFO (coreLoadExecutor-2501-thread-1-processing-n:127.0.0.1:55777_xxuy%2Fpr) [n:127.0.0.1:55777_xxuy%2Fpr c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:43178/solr_hdfs_home/collection1/core_node1/data/index
[junit4] 2> 1034963 INFO (coreLoadExecutor-2501-thread-1-processing-n:127.0.0.1:55777_xxuy%2Fpr) [n:127.0.0.1:55777_xxuy%2Fpr c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 1034963 INFO (coreLoadExecutor-2501-thread-1-processing-n:127.0.0.1:55777_xxuy%2Fpr) [n:127.0.0.1:55777_xxuy%2Fpr c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
[junit4] 2> 1034965 INFO (coreLoadExecutor-2501-thread-1-processing-n:127.0.0.1:55777_xxuy%2Fpr) [n:127.0.0.1:55777_xxuy%2Fpr c:collection1 x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 1034966 INFO (coreLoadExecutor-2501-thread-1-processing-n:127.0.0.1:55777_xxuy%2Fpr) [n:127.0.0.1:55777_xxuy%2Fpr c:collection1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=24, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=0.509765625, noCFSRatio=0.22900695798051826]
[junit4] 2> 1034988 INFO (IPC Server handler 0 on 43178) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:41127 is added to blk_1073741826_1002{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-926811d6-d0e8-43d3-bc09-87a4e719441d:NORMAL:127.0.0.1:58440|RBW], ReplicaUC[[DISK]DS-770bc853-96e7-4339-8166-f21ace9b1e13:NORMAL:127.0.0.1:41127|FINALIZED]]} size 0
[junit4] 2> 1034988 INFO (IPC Server handler 1 on 43178) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:58440 is added to blk_1073741826_1002{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-770bc853-96e7-4339-8166-f21ace9b1e13:NORMAL:127.0.0.1:41127|FINALIZED], ReplicaUC[[DISK]DS-fbd2ff27-dcbc-4512-bee3-8714e9ce0425:NORMAL:127.0.0.1:58440|FINALIZED]]} size 0
[junit4] 2> 1034997 WARN (coreLoadExecutor-2501-thread-1-processing-n:127.0.0.1:55777_xxuy%2Fpr) [n:127.0.0.1:55777_xxuy%2Fpr c:collection1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 1035024 INFO (coreLoadExecutor-2501-thread-1-processing-n:127.0.0.1:55777_xxuy%2Fpr) [n:127.0.0.1:55777_xxuy%2Fpr c:collection1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
[junit4] 2> 1035024 INFO (coreLoadExecutor-2501-thread-1-processing-n:127.0.0.1:55777_xxuy%2Fpr) [n:127.0.0.1:55777_xxuy%2Fpr c:collection1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1035024 INFO (coreLoadExecutor-2501-thread-1-processing-n:127.0.0.1:55777_xxuy%2Fpr) [n:127.0.0.1:55777_xxuy%2Fpr c:collection1 x:collection1] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=2
[junit4] 2> 1035033 INFO (coreLoadExecutor-2501-thread-1-processing-n:127.0.0.1:55777_xxuy%2Fpr) [n:127.0.0.1:55777_xxuy%2Fpr c:collection1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1035033 INFO (coreLoadExecutor-2501-thread-1-processing-n:127.0.0.1:55777_xxuy%2Fpr) [n:127.0.0.1:55777_xxuy%2Fpr c:collection1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1035034 INFO (coreLoadExecutor-2501-thread-1-processing-n:127.0.0.1:55777_xxuy%2Fpr) [n:127.0.0.1:55777_xxuy%2Fpr c:collection1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@1af89e2e
[junit4] 2> 1035040 INFO (coreLoadExecutor-2501-thread-1-processing-n:127.0.0.1:55777_xxuy%2Fpr) [n:127.0.0.1:55777_xxuy%2Fpr c:collection1 x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@197989a8[collection1] main]
[junit4] 2> 1035041 INFO (coreLoadExecutor-2501-thread-1-processing-n:127.0.0.1:55777_xxuy%2Fpr) [n:127.0.0.1:55777_xxuy%2Fpr c:collection1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1035042 INFO (coreLoadExecutor-2501-thread-1-processing-n:127.0.0.1:55777_xxuy%2Fpr) [n:127.0.0.1:55777_xxuy%2Fpr c:collection1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1035042 INFO (coreLoadExecutor-2501-thread-1-processing-n:127.0.0.1:55777_xxuy%2Fpr) [n:127.0.0.1:55777_xxuy%2Fpr c:collection1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 1035043 INFO (searcherExecutor-2502-thread-1-processing-n:127.0.0.1:55777_xxuy%2Fpr x:collection1 c:collection1) [n:127.0.0.1:55777_xxuy%2Fpr c:collection1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@197989a8[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1035046 INFO (coreLoadExecutor-2501-thread-1-processing-n:127.0.0.1:55777_xxuy%2Fpr) [n:127.0.0.1:55777_xxuy%2Fpr c:collection1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1559843882225631232
[junit4] 2> 1035052 INFO (coreZkRegister-2496-thread-1-processing-n:127.0.0.1:55777_xxuy%2Fpr x:collection1 c:collection1) [n:127.0.0.1:55777_xxuy%2Fpr c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1035052 INFO (coreZkRegister-2496-thread-1-processing-n:127.0.0.1:55777_xxuy%2Fpr x:collection1 c:collection1) [n:127.0.0.1:55777_xxuy%2Fpr c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1035052 INFO (coreZkRegister-2496-thread-1-processing-n:127.0.0.1:55777_xxuy%2Fpr x:collection1 c:collection1) [n:127.0.0.1:55777_xxuy%2Fpr c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:55777/xxuy/pr/collection1/
[junit4] 2> 1035052 INFO (coreZkRegister-2496-thread-1-processing-n:127.0.0.1:55777_xxuy%2Fpr x:collection1 c:collection1) [n:127.0.0.1:55777_xxuy%2Fpr c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1035052 INFO (coreZkRegister-2496-thread-1-processing-n:127.0.0.1:55777_xxuy%2Fpr x:collection1 c:collection1) [n:127.0.0.1:55777_xxuy%2Fpr c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:55777/xxuy/pr/collection1/ has no replicas
[junit4] 2> 1035055 INFO (coreZkRegister-2496-thread-1-processing-n:127.0.0.1:55777_xxuy%2Fpr x:collection1 c:collection1) [n:127.0.0.1:55777_xxuy%2Fpr c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:55777/xxuy/pr/collection1/ shard1
[junit4] 2> 1035206 INFO (coreZkRegister-2496-thread-1-processing-n:127.0.0.1:55777_xxuy%2Fpr x:collection1 c:collection1) [n:127.0.0.1:55777_xxuy%2Fpr c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1035604 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_C8BD79F319D22C35-001/shard-2-001/cores/collection1
[junit4] 2> 1035605 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_C8BD79F319D22C35-001/shard-2-001
[junit4] 2> 1035605 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 1035606 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2dacdcfb{/xxuy/pr,null,AVAILABLE}
[junit4] 2> 1035607 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@4740df7b{HTTP/1.1,[http/1.1]}{127.0.0.1:46637}
[junit4] 2> 1035607 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.e.j.s.Server Started @1038504ms
[junit4] 2> 1035607 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:43178/hdfs__localhost_43178__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-6.x_checkout_solr_build_solr-core_test_J0_temp_solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_C8BD79F319D22C35-001_tempDir-002_jetty2, solrconfig=solrconfig.xml, hostContext=/xxuy/pr, hostPort=46637, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_C8BD79F319D22C35-001/shard-2-001/cores}
[junit4] 2> 1035607 ERROR (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1035607 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 6.5.0
[junit4] 2> 1035607 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1035607 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1035607 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-02-20T09:30:48.643Z
[junit4] 2> 1035610 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1035610 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_C8BD79F319D22C35-001/shard-2-001/solr.xml
[junit4] 2> 1035617 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1035618 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:50881/solr
[junit4] 2> 1035627 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [n:127.0.0.1:46637_xxuy%2Fpr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1035630 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [n:127.0.0.1:46637_xxuy%2Fpr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1035634 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [n:127.0.0.1:46637_xxuy%2Fpr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46637_xxuy%2Fpr
[junit4] 2> 1035636 INFO (zkCallback-868-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1035636 INFO (zkCallback-873-thread-1-processing-n:127.0.0.1:55777_xxuy%2Fpr) [n:127.0.0.1:55777_xxuy%2Fpr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1035637 INFO (zkCallback-864-thread-4-processing-n:127.0.0.1:42868_xxuy%2Fpr) [n:127.0.0.1:42868_xxuy%2Fpr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1035637 INFO (zkCallback-879-thread-1-processing-n:127.0.0.1:46637_xxuy%2Fpr) [n:127.0.0.1:46637_xxuy%2Fpr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1035687 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [n:127.0.0.1:46637_xxuy%2Fpr ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_C8BD79F319D22C35-001/shard-2-001/cores
[junit4] 2> 1035687 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [n:127.0.0.1:46637_xxuy%2Fpr ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 1035689 INFO (OverseerStateUpdate-97490242481487876-127.0.0.1:42868_xxuy%2Fpr-n_0000000000) [n:127.0.0.1:42868_xxuy%2Fpr ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 1036712 INFO (coreLoadExecutor-2512-thread-1-processing-n:127.0.0.1:46637_xxuy%2Fpr) [n:127.0.0.1:46637_xxuy%2Fpr c:collection1 x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
[junit4] 2> 1036722 INFO (coreLoadExecutor-2512-thread-1-processing-n:127.0.0.1:46637_xxuy%2Fpr) [n:127.0.0.1:46637_xxuy%2Fpr c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 1036767 WARN (coreLoadExecutor-2512-thread-1-processing-n:127.0.0.1:46637_xxuy%2Fpr) [n:127.0.0.1:46637_xxuy%2Fpr c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 1036768 INFO (coreLoadExecutor-2512-thread-1-processing-n:127.0.0.1:46637_xxuy%2Fpr) [n:127.0.0.1:46637_xxuy%2Fpr c:collection1 x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 1037305 INFO (coreLoadExecutor-2512-thread-1-processing-n:127.0.0.1:46637_xxuy%2Fpr) [n:127.0.0.1:46637_xxuy%2Fpr c:collection1 x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 1037306 INFO (coreLoadExecutor-2512-thread-1-processing-n:127.0.0.1:46637_xxuy%2Fpr) [n:127.0.0.1:46637_xxuy%2Fpr c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:43178/solr_hdfs_home
[junit4] 2> 1037306 INFO (coreLoadExecutor-2512-thread-1-processing-n:127.0.0.1:46637_xxuy%2Fpr) [n:127.0.0.1:46637_xxuy%2Fpr c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 1037306 INFO (coreLoadExecutor-2512-thread-1-processing-n:127.0.0.1:46637_xxuy%2Fpr) [n:127.0.0.1:46637_xxuy%2Fpr c:collection1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_C8BD79F319D22C35-001/shard-2-001/cores/collection1], dataDir=[hdfs://localhost:43178/solr_hdfs_home/collection1/core_node2/data/]
[junit4] 2> 1037307 INFO (coreLoadExecutor-2512-thread-1-processing-n:127.0.0.1:46637_xxuy%2Fpr) [n:127.0.0.1:46637_xxuy%2Fpr c:collection1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2f775b2e
[junit4] 2> 1037307 INFO (coreLoadExecutor-2512-thread-1-processing-n:127.0.0.1:46637_xxuy%2Fpr) [n:127.0.0.1:46637_xxuy%2Fpr c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:43178/solr_hdfs_home/collection1/core_node2/data/snapshot_metadata
[junit4] 2> 1037314 INFO (coreLoadExecutor-2512-thread-1-processing-n:127.0.0.1:46637_xxuy%2Fpr) [n:127.0.0.1:46637_xxuy%2Fpr c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 1037314 INFO (coreLoadExecutor-2512-thread-1-processing-n:127.0.0.1:46637_xxuy%2Fpr) [n:127.0.0.1:46637_xxuy%2Fpr c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
[junit4] 2> 1037318 INFO (coreLoadExecutor-2512-thread-1-processing-n:127.0.0.1:46637_xxuy%2Fpr) [n:127.0.0.1:46637_xxuy%2Fpr c:collection1 x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 1037326 INFO (coreLoadExecutor-2512-thread-1-processing-n:127.0.0.1:46637_xxuy%2Fpr) [n:127.0.0.1:46637_xxuy%2Fpr c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:43178/solr_hdfs_home/collection1/core_node2/data
[junit4] 2> 1037351 INFO (coreLoadExecutor-2512-thread-1-processing-n:127.0.0.1:46637_xxuy%2Fpr) [n:127.0.0.1:46637_xxuy%2Fpr c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:43178/solr_hdfs_home/collection1/core_node2/data/index
[junit4] 2> 1037356 INFO (coreLoadExecutor-2512-thread-1-processing-n:127.0.0.1:46637_xxuy%2Fpr) [n:127.0.0.1:46637_xxuy%2Fpr c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 1037356 INFO (coreLoadExecutor-2512-thread-1-processing-n:127.0.0.1:46637_xxuy%2Fpr) [n:127.0.0.1:46637_xxuy%2Fpr c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
[junit4] 2> 1037357 INFO (coreLoadExecutor-2512-thread-1-processing-n:127.0.0.1:46637_xxuy%2Fpr) [n:127.0.0.1:46637_xxuy%2Fpr c:collection1 x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 1037358 INFO (coreLoadExecutor-2512-thread-1-processing-n:127.0.0.1:46637_xxuy%2Fpr) [n:127.0.0.1:46637_xxuy%2Fpr c:collection1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=24, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=0.509765625, noCFSRatio=0.22900695798051826]
[junit4] 2> 1037410 INFO (IPC Server handler 2 on 43178) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:58440 is added to blk_1073741827_1003{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-f0c8d3b1-0b65-44b9-95e1-99ff2a70fca1:NORMAL:127.0.0.1:41127|RBW], ReplicaUC[[DISK]DS-926811d6-d0e8-43d3-bc09-87a4e719441d:NORMAL:127.0.0.1:58440|FINALIZED]]} size 0
[junit4] 2> 1037412 INFO (IPC Server handler 0 on 43178) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:41127 is added to blk_1073741827_1003 size 71
[junit4] 2> 1037419 WARN (coreLoadExecutor-2512-thread-1-processing-n:127.0.0.1:46637_xxuy%2Fpr) [n:127.0.0.1:46637_xxuy%2Fpr c:collection1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 1037455 INFO (coreLoadExecutor-2512-thread-1-processing-n:127.0.0.1:46637_xxuy%2Fpr) [n:127.0.0.1:46637_xxuy%2Fpr c:collection1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
[junit4] 2> 1037455 INFO (coreLoadExecutor-2512-thread-1-processing-n:127.0.0.1:46637_xxuy%2Fpr) [n:127.0.0.1:46637_xxuy%2Fpr c:collection1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1037455 INFO (coreLoadExecutor-2512-thread-1-processing-n:127.0.0.1:46637_xxuy%2Fpr) [n:127.0.0.1:46637_xxuy%2Fpr c:collection1 x:collection1] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=2
[junit4] 2> 1037472 INFO (coreLoadExecutor-2512-thread-1-processing-n:127.0.0.1:46637_xxuy%2Fpr) [n:127.0.0.1:46637_xxuy%2Fpr c:collection1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1037473 INFO (coreLoadExecutor-2512-thread-1-processing-n:127.0.0.1:46637_xxuy%2Fpr) [n:127.0.0.1:46637_xxuy%2Fpr c:collection1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1037474 INFO (coreLoadExecutor-2512-thread-1-processing-n:127.0.0.1:46637_xxuy%2Fpr) [n:127.0.0.1:46637_xxuy%2Fpr c:collection1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@681eab15
[junit4] 2> 1037480 INFO (coreLoadExecutor-2512-thread-1-processing-n:127.0.0.1:46637_xxuy%2Fpr) [n:127.0.0.1:46637_xxuy%2Fpr c:collection1 x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@1164df4f[collection1] main]
[junit4] 2> 1037481 INFO (coreLoadExecutor-2512-thread-1-processing-n:127.0.0.1:46637_xxuy%2Fpr) [n:127.0.0.1:46637_xxuy%2Fpr c:collection1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1037482 INFO (coreLoadExecutor-2512-thread-1-processing-n:127.0.0.1:46637_xxuy%2Fpr) [n:127.0.0.1:46637_xxuy%2Fpr c:collection1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1037482 INFO (coreLoadExecutor-2512-thread-1-processing-n:127.0.0.1:46637_xxuy%2Fpr) [n:127.0.0.1:46637_xxuy%2Fpr c:collection1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 1037483 INFO (searcherExecutor-2513-thread-1-processing-n:127.0.0.1:46637_xxuy%2Fpr x:collection1 c:collection1) [n:127.0.0.1:46637_xxuy%2Fpr c:collection1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@1164df4f[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1037486 INFO (coreLoadExecutor-2512-thread-1-processing-n:127.0.0.1:46637_xxuy%2Fpr) [n:127.0.0.1:46637_xxuy%2Fpr c:collection1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1559843884784156672
[junit4] 2> 1037491 INFO (coreZkRegister-2507-thread-1-processing-n:127.0.0.1:46637_xxuy%2Fpr x:collection1 c:collection1) [n:127.0.0.1:46637_xxuy%2Fpr c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.ZkController Core needs to recover:collection1
[junit4] 2> 1037493 INFO (updateExecutor-876-thread-1-processing-n:127.0.0.1:46637_xxuy%2Fpr x:collection1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:46637_xxuy%2Fpr c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.u.DefaultSolrCoreState Running recovery
[junit4] 2> 1037494 INFO (recoveryExecutor-877-thread-1-processing-n:127.0.0.1:46637_xxuy%2Fpr x:collection1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:46637_xxuy%2Fpr c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=true
[junit4] 2> 1037494 INFO (recoveryExecutor-877-thread-1-processing-n:127.0.0.1:46637_xxuy%2Fpr x:collection1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:46637_xxuy%2Fpr c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.RecoveryStrategy ###### startupVersions=[[]]
[junit4] 2> 1037494 INFO (recoveryExecutor-877-thread-1-processing-n:127.0.0.1:46637_xxuy%2Fpr x:collection1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:46637_xxuy%2Fpr c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.RecoveryStrategy Begin buffering updates. core=[collection1]
[junit4] 2> 1037494 INFO (recoveryExecutor-877-thread-1-processing-n:127.0.0.1:46637_xxuy%2Fpr x:collection1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:46637_xxuy%2Fpr c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.u.UpdateLog Starting to buffer updates. HDFSUpdateLog{state=ACTIVE, tlog=null}
[junit4] 2> 1037494 INFO (recoveryExecutor-877-thread-1-processing-n:127.0.0.1:46637_xxuy%2Fpr x:collection1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:46637_xxuy%2Fpr c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.RecoveryStrategy Publishing state of core [collection1] as recovering, leader is [http://127.0.0.1:55777/xxuy/pr/collection1/] and I am [http://127.0.0.1:46637/xxuy/pr/collection1/]
[junit4] 2> 1037498 INFO (recoveryExecutor-877-thread-1-processing-n:127.0.0.1:46637_xxuy%2Fpr x:collection1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:46637_xxuy%2Fpr c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.RecoveryStrategy Sending prep recovery command to [http://127.0.0.1:55777/xxuy/pr]; [WaitForState: action=PREPRECOVERY&core=collection1&nodeName=127.0.0.1:46637_xxuy%252Fpr&coreNodeName=core_node2&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true]
[junit4] 2> 1037502 INFO (qtp567798657-6872) [n:127.0.0.1:55777_xxuy%2Fpr ] o.a.s.h.a.PrepRecoveryOp Going to wait for coreNodeName: core_node2, state: recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true
[junit4] 2> 1037503 INFO (qtp567798657-6872) [n:127.0.0.1:55777_xxuy%2Fpr ] o.a.s.h.a.PrepRecoveryOp Will wait a max of 183 seconds to see collection1 (shard1 of collection1) have state: recovering
[junit4] 2> 1037503 INFO (qtp567798657-6872) [n:127.0.0.1:55777_xxuy%2Fpr ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard1, thisCore=collection1, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=recovering, localState=active, nodeName=127.0.0.1:46637_xxuy%2Fpr, coreNodeName=core_node2, onlyIfActiveCheckResult=false, nodeProps: core_node2:{"core":"collection1","dataDir":"hdfs://localhost:43178/solr_hdfs_home/collection1/core_node2/data/","base_url":"http://127.0.0.1:46637/xxuy/pr","node_name":"127.0.0.1:46637_xxuy%2Fpr","state":"recovering","ulogDir":"hdfs://localhost:43178/solr_hdfs_home/collection1/core_node2/data/tlog"}
[junit4] 2> 1037503 INFO (qtp567798657-6872) [n:127.0.0.1:55777_xxuy%2Fpr ] o.a.s.h.a.PrepRecoveryOp Waited coreNodeName: core_node2, state: recovering, checkLive: true, onlyIfLeader: true for: 0 seconds.
[junit4] 2> 1037503 INFO (qtp567798657-6872) [n:127.0.0.1:55777_xxuy%2Fpr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={nodeName=127.0.0.1:46637_xxuy%252Fpr&onlyIfLeaderActive=true&core=collection1&coreNodeName=core_node2&action=PREPRECOVERY&checkLive=true&state=recovering&onlyIfLeader=true&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1037908 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_C8BD79F319D22C35-001/shard-3-001/cores/collection1
[junit4] 2> 1037909 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_C8BD79F319D22C35-001/shard-3-001
[junit4] 2> 1037910 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 1037911 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4d99bb42{/xxuy/pr,null,AVAILABLE}
[junit4] 2> 1037912 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@71dc9e9a{HTTP/1.1,[http/1.1]}{127.0.0.1:35340}
[junit4] 2> 1037912 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.e.j.s.Server Started @1040809ms
[junit4] 2> 1037912 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:43178/hdfs__localhost_43178__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-6.x_checkout_solr_build_solr-core_test_J0_temp_solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_C8BD79F319D22C35-001_tempDir-002_jetty3, solrconfig=solrconfig.xml, hostContext=/xxuy/pr, hostPort=35340, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_C8BD79F319D22C35-001/shard-3-001/cores}
[junit4] 2> 1037912 ERROR (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1037912 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 6.5.0
[junit4] 2> 1037912 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C35]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1037912 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[C8BD79F319D22C
[...truncated too long message...]
> java.net.ConnectException: Connection refused
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)
[junit4] 2> 2644875 WARN (zkCallback-2471-thread-3-processing-n:127.0.0.1:42838_y_ihk%2Fxm-SendThread(127.0.0.1:59258)) [n:127.0.0.1:42838_y_ihk%2Fxm ] o.a.z.ClientCnxn Unexpected exception
[junit4] 2> java.lang.InterruptedException: sleep interrupted
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:994)
[junit4] 2> Feb 20, 2017 9:57:38 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> SEVERE: There are still zombie threads that couldn't be terminated:
[junit4] 2> 1) Thread[id=14879, name=zkCallback-2471-thread-3-processing-n:127.0.0.1:42838_y_ihk%2Fxm-SendThread(127.0.0.1:59258), state=TIMED_WAITING, group=TGRP-CdcrReplicationDistributedZkTest]
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:940)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003)
[junit4] 2> NOTE: test params are: codec=DummyCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=DUMMY, chunkSize=13140, maxDocsPerChunk=205, blockSize=7), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=DUMMY, chunkSize=13140, blockSize=7)), sim=RandomSimilarity(queryNorm=true,coord=no): {}, locale=nl, timezone=America/Mexico_City
[junit4] 2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_121 (64-bit)/cpus=4,threads=2,free=244352632,total=527433728
[junit4] 2> NOTE: All tests run in this JVM: [TestSchemaNameResource, MoreLikeThisHandlerTest, TestSolrDynamicMBean, OutOfBoxZkACLAndCredentialsProvidersTest, TestTrie, CdcrVersionReplicationTest, ShardRoutingCustomTest, SharedFSAutoReplicaFailoverUtilsTest, BasicAuthIntegrationTest, TestCollectionAPI, TestReloadAndDeleteDocs, TestMinMaxOnMultiValuedField, TestFilteredDocIdSet, MetricsHandlerTest, DateMathParserTest, SolrSlf4jReporterTest, TestTolerantUpdateProcessorRandomCloud, TestSlowCompositeReaderWrapper, CloudExitableDirectoryReaderTest, TestFiltering, DocValuesTest, TermsComponentTest, SolrIndexMetricsTest, TestLuceneMatchVersion, TestSimpleTrackingShardHandler, TestNoOpRegenerator, TestFuzzyAnalyzedSuggestions, DeleteShardTest, OverseerTaskQueueTest, IndexSchemaRuntimeFieldTest, HttpSolrCallGetCoreTest, TestFieldCacheReopen, TestSystemCollAutoCreate, ZkSolrClientTest, TestUseDocValuesAsStored, TestSubQueryTransformerCrossCore, UpdateLogTest, ConvertedLegacyTest, RulesTest, SolrIndexConfigTest, MultiTermTest, DistribDocExpirationUpdateProcessorTest, JavabinLoaderTest, TestConfigsApi, CollectionTooManyReplicasTest, DistanceFunctionTest, TestElisionMultitermQuery, TestBackupRepositoryFactory, SpellingQueryConverterTest, ZkControllerTest, TestInfoStreamLogging, SpatialRPTFieldTypeTest, TestWordDelimiterFilterFactory, TestSuggestSpellingConverter, SpellCheckCollatorTest, TestDistributedGrouping, DistributedMLTComponentTest, TestRTGBase, TestRequestStatusCollectionAPI, DistributedIntervalFacetingTest, EnumFieldTest, LeaderFailureAfterFreshStartTest, TestOnReconnectListenerSupport, TestUpdate, TestFastOutputStream, TestSearchPerf, SolrMetricManagerTest, TermVectorComponentTest, TestSolrIndexConfig, CdcrReplicationDistributedZkTest]
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=CdcrReplicationDistributedZkTest -Dtests.seed=C8BD79F319D22C35 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/test-data/enwiki.random.lines.txt -Dtests.locale=nl -Dtests.timezone=America/Mexico_City -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[junit4] ERROR 0.00s J1 | CdcrReplicationDistributedZkTest (suite) <<<
[junit4] > Throwable #1: java.lang.AssertionError: ObjectTracker found 1 object(s) that were not released!!! [SolrZkClient]
[junit4] > org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException
[junit4] > at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
[junit4] > at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:184)
[junit4] > at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:116)
[junit4] > at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:106)
[junit4] > at org.apache.solr.common.cloud.ZkStateReader.<init>(ZkStateReader.java:226)
[junit4] > at org.apache.solr.client.solrj.impl.ZkClientClusterStateProvider.connect(ZkClientClusterStateProvider.java:121)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.connect(CloudSolrClient.java:615)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:1062)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:1042)
[junit4] > at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
[junit4] > at org.apache.solr.handler.CdcrReplicatorManager.getCheckpoint(CdcrReplicatorManager.java:196)
[junit4] > at org.apache.solr.handler.CdcrReplicatorManager.initLogReaders(CdcrReplicatorManager.java:159)
[junit4] > at org.apache.solr.handler.CdcrReplicatorManager.stateUpdate(CdcrReplicatorManager.java:134)
[junit4] > at org.apache.solr.handler.CdcrStateManager.callback(CdcrStateManager.java:36)
[junit4] > at org.apache.solr.handler.CdcrLeaderStateManager.setAmILeader(CdcrLeaderStateManager.java:108)
[junit4] > at org.apache.solr.handler.CdcrLeaderStateManager.checkIfIAmLeader(CdcrLeaderStateManager.java:95)
[junit4] > at org.apache.solr.handler.CdcrLeaderStateManager.access$400(CdcrLeaderStateManager.java:40)
[junit4] > at org.apache.solr.handler.CdcrLeaderStateManager$LeaderStateWatcher.process(CdcrLeaderStateManager.java:150)
[junit4] > at org.apache.solr.common.cloud.SolrZkClient$3.lambda$process$0(SolrZkClient.java:268)
[junit4] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[junit4] > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] > at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > at __randomizedtesting.SeedInfo.seed([C8BD79F319D22C35]:0)
[junit4] > at org.apache.solr.SolrTestCaseJ4.teardownTestCases(SolrTestCaseJ4.java:301)
[junit4] > at java.lang.Thread.run(Thread.java:745)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.cloud.CdcrReplicationDistributedZkTest:
[junit4] > 1) Thread[id=14880, name=zkCallback-2471-thread-3-processing-n:127.0.0.1:42838_y_ihk%2Fxm-EventThread, state=WAITING, group=TGRP-CdcrReplicationDistributedZkTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
[junit4] > at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494)
[junit4] > 2) Thread[id=14879, name=zkCallback-2471-thread-3-processing-n:127.0.0.1:42838_y_ihk%2Fxm-SendThread(127.0.0.1:59258), state=TIMED_WAITING, group=TGRP-CdcrReplicationDistributedZkTest]
[junit4] > at java.lang.Thread.sleep(Native Method)
[junit4] > at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:940)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003)
[junit4] > at __randomizedtesting.SeedInfo.seed([C8BD79F319D22C35]:0)Throwable #3: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
[junit4] > 1) Thread[id=14879, name=zkCallback-2471-thread-3-processing-n:127.0.0.1:42838_y_ihk%2Fxm-SendThread(127.0.0.1:59258), state=TIMED_WAITING, group=TGRP-CdcrReplicationDistributedZkTest]
[junit4] > at java.lang.Thread.sleep(Native Method)
[junit4] > at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:940)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003)
[junit4] > at __randomizedtesting.SeedInfo.seed([C8BD79F319D22C35]:0)
[junit4] Completed [365/696 (3!)] on J1 in 1908.93s, 11 tests, 1 failure, 2 errors <<< FAILURES!
[...truncated 63629 lines...]
[JENKINS] Lucene-Solr-NightlyTests-6.x - Build # 288 - Failure
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.x/288/
3 tests failed.
FAILED: org.apache.lucene.analysis.core.TestRandomChains.testRandomChainsWithLargeStrings
Error Message:
finalOffset expected:<80> but was:<76>
Stack Trace:
java.lang.AssertionError: finalOffset expected:<80> but was:<76>
at __randomizedtesting.SeedInfo.seed([23AD52513D34A04D:49F6ED40647A80BE]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.apache.lucene.analysis.BaseTokenStreamTestCase.assertTokenStreamContents(BaseTokenStreamTestCase.java:292)
at org.apache.lucene.analysis.BaseTokenStreamTestCase.assertTokenStreamContents(BaseTokenStreamTestCase.java:307)
at org.apache.lucene.analysis.BaseTokenStreamTestCase.assertTokenStreamContents(BaseTokenStreamTestCase.java:311)
at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkAnalysisConsistency(BaseTokenStreamTestCase.java:842)
at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:641)
at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:539)
at org.apache.lucene.analysis.core.TestRandomChains.testRandomChainsWithLargeStrings(TestRandomChains.java:880)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.handler.admin.TestApiFramework.testFramework
Error Message:
Stack Trace:
java.lang.NullPointerException
at __randomizedtesting.SeedInfo.seed([1869389B2B9DED3D:F1FF2BC2D490100]:0)
at org.apache.solr.api.V2HttpCall.getApiInfo(V2HttpCall.java:194)
at org.apache.solr.handler.admin.TestApiFramework.invoke(TestApiFramework.java:176)
at org.apache.solr.handler.admin.TestApiFramework.testFramework(TestApiFramework.java:123)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest.test
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([1869389B2B9DED3D:903D0741856180C5]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertTrue(Assert.java:54)
at org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest.test(HdfsWriteToMultipleCollectionsTest.java:137)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 3144 lines...]
[junit4] Suite: org.apache.lucene.analysis.core.TestRandomChains
[junit4] 2> TEST FAIL: useCharFilter=true text='Tullgren, 1910</small> \u2014 East Africa * ''[[Dolichognatha albida]]'' <small>(Simo'
[junit4] 2> Exception from random analyzer:
[junit4] 2> charfilters=
[junit4] 2> org.apache.lucene.analysis.MockCharFilter(java.io.StringReader@3116b09c)
[junit4] 2> org.apache.lucene.analysis.charfilter.HTMLStripCharFilter(org.apache.lucene.analysis.MockCharFilter@1aba8539)
[junit4] 2> tokenizer=
[junit4] 2> org.apache.lucene.analysis.pattern.SimplePatternTokenizer(org.apache.lucene.util.automaton.Automaton@53b0efdc)
[junit4] 2> filters=
[junit4] 2> org.apache.lucene.analysis.tr.TurkishLowerCaseFilter(ValidatingTokenFilter@5a4d527e term=,bytes=[],startOffset=0,endOffset=0,positionIncrement=1,positionLength=1,type=word)
[junit4] 2> offsetsAreCorrect=true
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestRandomChains -Dtests.method=testRandomChainsWithLargeStrings -Dtests.seed=23AD52513D34A04D -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/test-data/enwiki.random.lines.txt -Dtests.locale=und -Dtests.timezone=Europe/Zurich -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] FAILURE 24.0s J2 | TestRandomChains.testRandomChainsWithLargeStrings <<<
[junit4] > Throwable #1: java.lang.AssertionError: finalOffset expected:<80> but was:<76>
[junit4] > at __randomizedtesting.SeedInfo.seed([23AD52513D34A04D:49F6ED40647A80BE]:0)
[junit4] > at org.apache.lucene.analysis.BaseTokenStreamTestCase.assertTokenStreamContents(BaseTokenStreamTestCase.java:292)
[junit4] > at org.apache.lucene.analysis.BaseTokenStreamTestCase.assertTokenStreamContents(BaseTokenStreamTestCase.java:307)
[junit4] > at org.apache.lucene.analysis.BaseTokenStreamTestCase.assertTokenStreamContents(BaseTokenStreamTestCase.java:311)
[junit4] > at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkAnalysisConsistency(BaseTokenStreamTestCase.java:842)
[junit4] > at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:641)
[junit4] > at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:539)
[junit4] > at org.apache.lucene.analysis.core.TestRandomChains.testRandomChainsWithLargeStrings(TestRandomChains.java:880)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/lucene/build/analysis/common/test/J2/temp/lucene.analysis.core.TestRandomChains_23AD52513D34A04D-001
[junit4] 2> NOTE: test params are: codec=Lucene62, sim=RandomSimilarity(queryNorm=false,coord=crazy): {dummy=IB LL-D3(800.0)}, locale=und, timezone=Europe/Zurich
[junit4] 2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_121 (64-bit)/cpus=4,threads=1,free=99578048,total=286261248
[junit4] 2> NOTE: All tests run in this JVM: [TestEnglishMinimalStemFilterFactory, TestSerbianNormalizationFilterFactory, TestLimitTokenCountFilterFactory, TestSegmentingTokenizerBase, GreekAnalyzerTest, TestFrenchMinimalStemFilter, TestDelimitedPayloadTokenFilterFactory, TestPatternReplaceCharFilter, TestDictionary, TestTrimFilter, TestWordnetSynonymParser, TestCzechStemmer, TokenOffsetPayloadTokenFilterTest, TestSynonymFilterFactory, TestGermanLightStemFilterFactory, TestKeepCase, TestWordDelimiterGraphFilter, TestRemoveDuplicatesTokenFilterFactory, TestOptionalCondition, TestPatternReplaceFilter, NGramTokenFilterTest, TestIndonesianAnalyzer, TestScandinavianFoldingFilter, TestKStemmer, TestCJKWidthFilterFactory, TestPerFieldAnalyzerWrapper, TestMorphData, Test64kAffixes, TestFrenchLightStemFilter, TestStandardFactories, TestCondition2, TestPrefixAndSuffixAwareTokenFilter, TestCzechStemFilterFactory, TestSoraniNormalizationFilter, TestSoraniStemFilterFactory, TestCodepointCountFilterFactory, TestHindiAnalyzer, TestFlagLong, TestGermanStemFilter, TestWikipediaTokenizerFactory, TestPortugueseAnalyzer, TestKStemFilterFactory, HTMLStripCharFilterTest, TestBrazilianStemFilterFactory, TestKeywordRepeatFilter, DateRecognizerFilterTest, TestPatternReplaceFilterFactory, TestSnowball, TestRandomChains]
[junit4] Completed [151/278 (1!)] on J2 in 119.01s, 2 tests, 1 failure <<< FAILURES!
[...truncated 8284 lines...]
[junit4] Suite: org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_1869389B2B9DED3D-001/init-core-data-001
[junit4] 2> 37143 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[1869389B2B9DED3D]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields
[junit4] 2> 37144 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[1869389B2B9DED3D]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
[junit4] 2> 37145 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[1869389B2B9DED3D]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
[junit4] 2> 38057 WARN (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[1869389B2B9DED3D]-worker) [ ] o.a.h.u.NativeCodeLoader Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
[junit4] 1> Formatting using clusterid: testClusterID
[junit4] 2> 39004 WARN (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[1869389B2B9DED3D]-worker) [ ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
[junit4] 2> 39213 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[1869389B2B9DED3D]-worker) [ ] o.m.log Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
[junit4] 2> 39235 WARN (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[1869389B2B9DED3D]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 39353 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[1869389B2B9DED3D]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 39403 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[1869389B2B9DED3D]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.2-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_42085_hdfs____ffc3a1/webapp
[junit4] 2> 40297 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[1869389B2B9DED3D]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42085
[junit4] 2> 41918 WARN (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[1869389B2B9DED3D]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 41922 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[1869389B2B9DED3D]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 41931 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[1869389B2B9DED3D]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.2-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_42429_datanode____.zfxf8c/webapp
[junit4] 2> 42406 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[1869389B2B9DED3D]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42429
[junit4] 2> 43085 WARN (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[1869389B2B9DED3D]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 43112 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[1869389B2B9DED3D]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 43138 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[1869389B2B9DED3D]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.2-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_48147_datanode____.pur3c9/webapp
[junit4] 2> 43811 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[1869389B2B9DED3D]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:48147
[junit4] 2> 45605 INFO (IPC Server handler 5 on 55900) [ ] BlockStateChange BLOCK* processReport: from storage DS-44b8f2fe-2e8a-439a-9b05-08f0b018f746 node DatanodeRegistration(127.0.0.1:49046, datanodeUuid=eb06bd9b-9a0f-4a63-afae-9932d42f5665, infoPort=60790, infoSecurePort=0, ipcPort=37282, storageInfo=lv=-56;cid=testClusterID;nsid=967113967;c=0), blocks: 0, hasStaleStorage: true, processing time: 2 msecs
[junit4] 2> 45606 INFO (IPC Server handler 5 on 55900) [ ] BlockStateChange BLOCK* processReport: from storage DS-f59643f9-f9ff-43a4-beba-fd4afb09a804 node DatanodeRegistration(127.0.0.1:49046, datanodeUuid=eb06bd9b-9a0f-4a63-afae-9932d42f5665, infoPort=60790, infoSecurePort=0, ipcPort=37282, storageInfo=lv=-56;cid=testClusterID;nsid=967113967;c=0), blocks: 0, hasStaleStorage: false, processing time: 0 msecs
[junit4] 2> 45606 INFO (IPC Server handler 6 on 55900) [ ] BlockStateChange BLOCK* processReport: from storage DS-a41b2d8f-76a7-4e5a-912b-48090fc3250a node DatanodeRegistration(127.0.0.1:57984, datanodeUuid=a3aa134b-4f69-40db-852d-de670d59e3a5, infoPort=49107, infoSecurePort=0, ipcPort=43593, storageInfo=lv=-56;cid=testClusterID;nsid=967113967;c=0), blocks: 0, hasStaleStorage: true, processing time: 0 msecs
[junit4] 2> 45610 INFO (IPC Server handler 6 on 55900) [ ] BlockStateChange BLOCK* processReport: from storage DS-3cb5a2b1-88c3-44c9-a1ff-c115af7c0ab4 node DatanodeRegistration(127.0.0.1:57984, datanodeUuid=a3aa134b-4f69-40db-852d-de670d59e3a5, infoPort=49107, infoSecurePort=0, ipcPort=43593, storageInfo=lv=-56;cid=testClusterID;nsid=967113967;c=0), blocks: 0, hasStaleStorage: false, processing time: 0 msecs
[junit4] 2> 45961 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 45962 INFO (Thread-125) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 45962 INFO (Thread-125) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 46062 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.a.s.c.ZkTestServer start zk server on port:45728
[junit4] 2> 46084 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 46086 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 46090 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 46091 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 46093 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 46094 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 46096 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 46099 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 46100 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 46102 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 46103 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 46256 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_1869389B2B9DED3D-001/control-001/cores/collection1
[junit4] 2> 46258 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 46260 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@40e281de{/,null,AVAILABLE}
[junit4] 2> 46260 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@63575fa2{HTTP/1.1,[http/1.1]}{127.0.0.1:47753}
[junit4] 2> 46260 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.e.j.s.Server Started @49550ms
[junit4] 2> 46261 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:55900/hdfs__localhost_55900__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-6.x_checkout_solr_build_solr-core_test_J2_temp_solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_1869389B2B9DED3D-001_tempDir-002_control_data, hostContext=/, hostPort=47753, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_1869389B2B9DED3D-001/control-001/cores}
[junit4] 2> 46261 ERROR (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 46261 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 6.5.0
[junit4] 2> 46261 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 46261 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 46262 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-02-19T08:21:54.893Z
[junit4] 2> 46268 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 46268 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_1869389B2B9DED3D-001/control-001/solr.xml
[junit4] 2> 46276 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 46277 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:45728/solr
[junit4] 2> 46331 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [n:127.0.0.1:47753_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 46332 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [n:127.0.0.1:47753_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:47753_
[junit4] 2> 46333 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [n:127.0.0.1:47753_ ] o.a.s.c.Overseer Overseer (id=97484309436497924-127.0.0.1:47753_-n_0000000000) starting
[junit4] 2> 46349 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [n:127.0.0.1:47753_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47753_
[junit4] 2> 46362 INFO (zkCallback-21-thread-1-processing-n:127.0.0.1:47753_) [n:127.0.0.1:47753_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 46428 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [n:127.0.0.1:47753_ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_1869389B2B9DED3D-001/control-001/cores
[junit4] 2> 46428 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [n:127.0.0.1:47753_ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 46465 INFO (OverseerStateUpdate-97484309436497924-127.0.0.1:47753_-n_0000000000) [n:127.0.0.1:47753_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 47480 WARN (coreLoadExecutor-64-thread-1-processing-n:127.0.0.1:47753_) [n:127.0.0.1:47753_ c:control_collection x:collection1] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
[junit4] 2> 47506 INFO (coreLoadExecutor-64-thread-1-processing-n:127.0.0.1:47753_) [n:127.0.0.1:47753_ c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
[junit4] 2> 47631 INFO (coreLoadExecutor-64-thread-1-processing-n:127.0.0.1:47753_) [n:127.0.0.1:47753_ c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 47838 WARN (coreLoadExecutor-64-thread-1-processing-n:127.0.0.1:47753_) [n:127.0.0.1:47753_ c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 47855 INFO (coreLoadExecutor-64-thread-1-processing-n:127.0.0.1:47753_) [n:127.0.0.1:47753_ c:control_collection x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 47995 INFO (coreLoadExecutor-64-thread-1-processing-n:127.0.0.1:47753_) [n:127.0.0.1:47753_ c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 48029 INFO (coreLoadExecutor-64-thread-1-processing-n:127.0.0.1:47753_) [n:127.0.0.1:47753_ c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:55900/solr_hdfs_home
[junit4] 2> 48029 INFO (coreLoadExecutor-64-thread-1-processing-n:127.0.0.1:47753_) [n:127.0.0.1:47753_ c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 48036 INFO (coreLoadExecutor-64-thread-1-processing-n:127.0.0.1:47753_) [n:127.0.0.1:47753_ c:control_collection x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_1869389B2B9DED3D-001/control-001/cores/collection1], dataDir=[hdfs://localhost:55900/solr_hdfs_home/control_collection/core_node1/data/]
[junit4] 2> 48036 INFO (coreLoadExecutor-64-thread-1-processing-n:127.0.0.1:47753_) [n:127.0.0.1:47753_ c:control_collection x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5c74ca2c
[junit4] 2> 48037 INFO (coreLoadExecutor-64-thread-1-processing-n:127.0.0.1:47753_) [n:127.0.0.1:47753_ c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:55900/solr_hdfs_home/control_collection/core_node1/data/snapshot_metadata
[junit4] 2> 48078 INFO (coreLoadExecutor-64-thread-1-processing-n:127.0.0.1:47753_) [n:127.0.0.1:47753_ c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 48078 INFO (coreLoadExecutor-64-thread-1-processing-n:127.0.0.1:47753_) [n:127.0.0.1:47753_ c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
[junit4] 2> 48078 INFO (coreLoadExecutor-64-thread-1-processing-n:127.0.0.1:47753_) [n:127.0.0.1:47753_ c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Creating new global HDFS BlockCache
[junit4] 2> 49216 INFO (coreLoadExecutor-64-thread-1-processing-n:127.0.0.1:47753_) [n:127.0.0.1:47753_ c:control_collection x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 49232 INFO (coreLoadExecutor-64-thread-1-processing-n:127.0.0.1:47753_) [n:127.0.0.1:47753_ c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:55900/solr_hdfs_home/control_collection/core_node1/data
[junit4] 2> 49326 INFO (coreLoadExecutor-64-thread-1-processing-n:127.0.0.1:47753_) [n:127.0.0.1:47753_ c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:55900/solr_hdfs_home/control_collection/core_node1/data/index
[junit4] 2> 49338 INFO (coreLoadExecutor-64-thread-1-processing-n:127.0.0.1:47753_) [n:127.0.0.1:47753_ c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 49338 INFO (coreLoadExecutor-64-thread-1-processing-n:127.0.0.1:47753_) [n:127.0.0.1:47753_ c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
[junit4] 2> 49371 INFO (coreLoadExecutor-64-thread-1-processing-n:127.0.0.1:47753_) [n:127.0.0.1:47753_ c:control_collection x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 49372 INFO (coreLoadExecutor-64-thread-1-processing-n:127.0.0.1:47753_) [n:127.0.0.1:47753_ c:control_collection x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=12, maxMergeAtOnceExplicit=41, maxMergedSegmentMB=30.4580078125, floorSegmentMB=0.9482421875, forceMergeDeletesPctAllowed=7.656383864441519, segmentsPerTier=49.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.2626329900004277
[junit4] 2> 49837 INFO (IPC Server handler 8 on 55900) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:49046 is added to blk_1073741825_1001{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-44b8f2fe-2e8a-439a-9b05-08f0b018f746:NORMAL:127.0.0.1:49046|RBW], ReplicaUC[[DISK]DS-a41b2d8f-76a7-4e5a-912b-48090fc3250a:NORMAL:127.0.0.1:57984|RBW]]} size 71
[junit4] 2> 49842 INFO (IPC Server handler 2 on 55900) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:57984 is added to blk_1073741825_1001 size 71
[junit4] 2> 50584 WARN (coreLoadExecutor-64-thread-1-processing-n:127.0.0.1:47753_) [n:127.0.0.1:47753_ c:control_collection x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 50760 INFO (coreLoadExecutor-64-thread-1-processing-n:127.0.0.1:47753_) [n:127.0.0.1:47753_ c:control_collection x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
[junit4] 2> 50760 INFO (coreLoadExecutor-64-thread-1-processing-n:127.0.0.1:47753_) [n:127.0.0.1:47753_ c:control_collection x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 50760 INFO (coreLoadExecutor-64-thread-1-processing-n:127.0.0.1:47753_) [n:127.0.0.1:47753_ c:control_collection x:collection1] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=2
[junit4] 2> 50806 INFO (coreLoadExecutor-64-thread-1-processing-n:127.0.0.1:47753_) [n:127.0.0.1:47753_ c:control_collection x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 50806 INFO (coreLoadExecutor-64-thread-1-processing-n:127.0.0.1:47753_) [n:127.0.0.1:47753_ c:control_collection x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 50811 INFO (coreLoadExecutor-64-thread-1-processing-n:127.0.0.1:47753_) [n:127.0.0.1:47753_ c:control_collection x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=50, maxMergeAtOnceExplicit=12, maxMergedSegmentMB=91.953125, floorSegmentMB=0.9287109375, forceMergeDeletesPctAllowed=29.939285096133297, segmentsPerTier=17.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.2725521170725631
[junit4] 2> 51024 INFO (coreLoadExecutor-64-thread-1-processing-n:127.0.0.1:47753_) [n:127.0.0.1:47753_ c:control_collection x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@5d8d3363[collection1] main]
[junit4] 2> 51027 INFO (coreLoadExecutor-64-thread-1-processing-n:127.0.0.1:47753_) [n:127.0.0.1:47753_ c:control_collection x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 51029 INFO (coreLoadExecutor-64-thread-1-processing-n:127.0.0.1:47753_) [n:127.0.0.1:47753_ c:control_collection x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 51031 INFO (coreLoadExecutor-64-thread-1-processing-n:127.0.0.1:47753_) [n:127.0.0.1:47753_ c:control_collection x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 51040 INFO (searcherExecutor-65-thread-1-processing-n:127.0.0.1:47753_ x:collection1 c:control_collection) [n:127.0.0.1:47753_ c:control_collection x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@5d8d3363[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 51048 INFO (coreLoadExecutor-64-thread-1-processing-n:127.0.0.1:47753_) [n:127.0.0.1:47753_ c:control_collection x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1559748956314927104
[junit4] 2> 51072 INFO (coreZkRegister-57-thread-1-processing-n:127.0.0.1:47753_ x:collection1 c:control_collection) [n:127.0.0.1:47753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 51072 INFO (coreZkRegister-57-thread-1-processing-n:127.0.0.1:47753_ x:collection1 c:control_collection) [n:127.0.0.1:47753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 51072 INFO (coreZkRegister-57-thread-1-processing-n:127.0.0.1:47753_ x:collection1 c:control_collection) [n:127.0.0.1:47753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:47753/collection1/
[junit4] 2> 51072 INFO (coreZkRegister-57-thread-1-processing-n:127.0.0.1:47753_ x:collection1 c:control_collection) [n:127.0.0.1:47753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 51072 INFO (coreZkRegister-57-thread-1-processing-n:127.0.0.1:47753_ x:collection1 c:control_collection) [n:127.0.0.1:47753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:47753/collection1/ has no replicas
[junit4] 2> 51094 INFO (coreZkRegister-57-thread-1-processing-n:127.0.0.1:47753_ x:collection1 c:control_collection) [n:127.0.0.1:47753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:47753/collection1/ shard1
[junit4] 2> 51133 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 51134 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:45728/solr ready
[junit4] 2> 51136 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 51136 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with stateFormat=2
[junit4] 2> 51195 INFO (coreZkRegister-57-thread-1-processing-n:127.0.0.1:47753_ x:collection1 c:control_collection) [n:127.0.0.1:47753_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 51595 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_1869389B2B9DED3D-001/shard-1-001/cores/collection1
[junit4] 2> 51597 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_1869389B2B9DED3D-001/shard-1-001
[junit4] 2> 51601 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 51614 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@28ec9ddc{/,null,AVAILABLE}
[junit4] 2> 51615 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@78832145{HTTP/1.1,[http/1.1]}{127.0.0.1:51564}
[junit4] 2> 51615 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.e.j.s.Server Started @54904ms
[junit4] 2> 51615 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:55900/hdfs__localhost_55900__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-6.x_checkout_solr_build_solr-core_test_J2_temp_solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_1869389B2B9DED3D-001_tempDir-002_jetty1, solrconfig=solrconfig.xml, hostContext=/, hostPort=51564, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_1869389B2B9DED3D-001/shard-1-001/cores}
[junit4] 2> 51615 ERROR (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 51625 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 6.5.0
[junit4] 2> 51625 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 51625 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 51625 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-02-19T08:22:00.257Z
[junit4] 2> 51657 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 51657 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_1869389B2B9DED3D-001/shard-1-001/solr.xml
[junit4] 2> 51682 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 51693 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:45728/solr
[junit4] 2> 51740 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [n:127.0.0.1:51564_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 51743 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [n:127.0.0.1:51564_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 51760 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [n:127.0.0.1:51564_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51564_
[junit4] 2> 51767 INFO (zkCallback-25-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 51771 INFO (zkCallback-21-thread-4-processing-n:127.0.0.1:47753_) [n:127.0.0.1:47753_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 51774 INFO (zkCallback-31-thread-1-processing-n:127.0.0.1:51564_) [n:127.0.0.1:51564_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 52262 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [n:127.0.0.1:51564_ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_1869389B2B9DED3D-001/shard-1-001/cores
[junit4] 2> 52262 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [n:127.0.0.1:51564_ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 52635 INFO (OverseerStateUpdate-97484309436497924-127.0.0.1:47753_-n_0000000000) [n:127.0.0.1:47753_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 52743 INFO (zkCallback-31-thread-1-processing-n:127.0.0.1:51564_) [n:127.0.0.1:51564_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 53696 WARN (coreLoadExecutor-75-thread-1-processing-n:127.0.0.1:51564_) [n:127.0.0.1:51564_ c:collection1 x:collection1] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
[junit4] 2> 53696 INFO (coreLoadExecutor-75-thread-1-processing-n:127.0.0.1:51564_) [n:127.0.0.1:51564_ c:collection1 x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
[junit4] 2> 53755 INFO (coreLoadExecutor-75-thread-1-processing-n:127.0.0.1:51564_) [n:127.0.0.1:51564_ c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 53972 WARN (coreLoadExecutor-75-thread-1-processing-n:127.0.0.1:51564_) [n:127.0.0.1:51564_ c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 53990 INFO (coreLoadExecutor-75-thread-1-processing-n:127.0.0.1:51564_) [n:127.0.0.1:51564_ c:collection1 x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 54048 INFO (coreLoadExecutor-75-thread-1-processing-n:127.0.0.1:51564_) [n:127.0.0.1:51564_ c:collection1 x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 54050 INFO (coreLoadExecutor-75-thread-1-processing-n:127.0.0.1:51564_) [n:127.0.0.1:51564_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:55900/solr_hdfs_home
[junit4] 2> 54051 INFO (coreLoadExecutor-75-thread-1-processing-n:127.0.0.1:51564_) [n:127.0.0.1:51564_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 54051 INFO (coreLoadExecutor-75-thread-1-processing-n:127.0.0.1:51564_) [n:127.0.0.1:51564_ c:collection1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_1869389B2B9DED3D-001/shard-1-001/cores/collection1], dataDir=[hdfs://localhost:55900/solr_hdfs_home/collection1/core_node1/data/]
[junit4] 2> 54051 INFO (coreLoadExecutor-75-thread-1-processing-n:127.0.0.1:51564_) [n:127.0.0.1:51564_ c:collection1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5c74ca2c
[junit4] 2> 54055 INFO (coreLoadExecutor-75-thread-1-processing-n:127.0.0.1:51564_) [n:127.0.0.1:51564_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:55900/solr_hdfs_home/collection1/core_node1/data/snapshot_metadata
[junit4] 2> 54084 INFO (coreLoadExecutor-75-thread-1-processing-n:127.0.0.1:51564_) [n:127.0.0.1:51564_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 54084 INFO (coreLoadExecutor-75-thread-1-processing-n:127.0.0.1:51564_) [n:127.0.0.1:51564_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
[junit4] 2> 54120 INFO (coreLoadExecutor-75-thread-1-processing-n:127.0.0.1:51564_) [n:127.0.0.1:51564_ c:collection1 x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 54128 INFO (coreLoadExecutor-75-thread-1-processing-n:127.0.0.1:51564_) [n:127.0.0.1:51564_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:55900/solr_hdfs_home/collection1/core_node1/data
[junit4] 2> 54327 INFO (coreLoadExecutor-75-thread-1-processing-n:127.0.0.1:51564_) [n:127.0.0.1:51564_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:55900/solr_hdfs_home/collection1/core_node1/data/index
[junit4] 2> 54336 INFO (coreLoadExecutor-75-thread-1-processing-n:127.0.0.1:51564_) [n:127.0.0.1:51564_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 54336 INFO (coreLoadExecutor-75-thread-1-processing-n:127.0.0.1:51564_) [n:127.0.0.1:51564_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
[junit4] 2> 54494 INFO (coreLoadExecutor-75-thread-1-processing-n:127.0.0.1:51564_) [n:127.0.0.1:51564_ c:collection1 x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 54495 INFO (coreLoadExecutor-75-thread-1-processing-n:127.0.0.1:51564_) [n:127.0.0.1:51564_ c:collection1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=12, maxMergeAtOnceExplicit=41, maxMergedSegmentMB=30.4580078125, floorSegmentMB=0.9482421875, forceMergeDeletesPctAllowed=7.656383864441519, segmentsPerTier=49.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.2626329900004277
[junit4] 2> 54605 INFO (IPC Server handler 1 on 55900) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:57984 is added to blk_1073741826_1002{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-a41b2d8f-76a7-4e5a-912b-48090fc3250a:NORMAL:127.0.0.1:57984|RBW], ReplicaUC[[DISK]DS-f59643f9-f9ff-43a4-beba-fd4afb09a804:NORMAL:127.0.0.1:49046|RBW]]} size 0
[junit4] 2> 54608 INFO (IPC Server handler 6 on 55900) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:49046 is added to blk_1073741826_1002{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-a41b2d8f-76a7-4e5a-912b-48090fc3250a:NORMAL:127.0.0.1:57984|RBW], ReplicaUC[[DISK]DS-f59643f9-f9ff-43a4-beba-fd4afb09a804:NORMAL:127.0.0.1:49046|RBW]]} size 0
[junit4] 2> 54638 WARN (coreLoadExecutor-75-thread-1-processing-n:127.0.0.1:51564_) [n:127.0.0.1:51564_ c:collection1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 54759 INFO (coreLoadExecutor-75-thread-1-processing-n:127.0.0.1:51564_) [n:127.0.0.1:51564_ c:collection1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
[junit4] 2> 54759 INFO (coreLoadExecutor-75-thread-1-processing-n:127.0.0.1:51564_) [n:127.0.0.1:51564_ c:collection1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 54759 INFO (coreLoadExecutor-75-thread-1-processing-n:127.0.0.1:51564_) [n:127.0.0.1:51564_ c:collection1 x:collection1] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=2
[junit4] 2> 54782 INFO (coreLoadExecutor-75-thread-1-processing-n:127.0.0.1:51564_) [n:127.0.0.1:51564_ c:collection1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 54782 INFO (coreLoadExecutor-75-thread-1-processing-n:127.0.0.1:51564_) [n:127.0.0.1:51564_ c:collection1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 54792 INFO (coreLoadExecutor-75-thread-1-processing-n:127.0.0.1:51564_) [n:127.0.0.1:51564_ c:collection1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=50, maxMergeAtOnceExplicit=12, maxMergedSegmentMB=91.953125, floorSegmentMB=0.9287109375, forceMergeDeletesPctAllowed=29.939285096133297, segmentsPerTier=17.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.2725521170725631
[junit4] 2> 54819 INFO (coreLoadExecutor-75-thread-1-processing-n:127.0.0.1:51564_) [n:127.0.0.1:51564_ c:collection1 x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@34a1ef75[collection1] main]
[junit4] 2> 54823 INFO (coreLoadExecutor-75-thread-1-processing-n:127.0.0.1:51564_) [n:127.0.0.1:51564_ c:collection1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 54824 INFO (coreLoadExecutor-75-thread-1-processing-n:127.0.0.1:51564_) [n:127.0.0.1:51564_ c:collection1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 54824 INFO (coreLoadExecutor-75-thread-1-processing-n:127.0.0.1:51564_) [n:127.0.0.1:51564_ c:collection1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 54827 INFO (searcherExecutor-76-thread-1-processing-n:127.0.0.1:51564_ x:collection1 c:collection1) [n:127.0.0.1:51564_ c:collection1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@34a1ef75[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 54832 INFO (coreLoadExecutor-75-thread-1-processing-n:127.0.0.1:51564_) [n:127.0.0.1:51564_ c:collection1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1559748960283787264
[junit4] 2> 54840 INFO (coreZkRegister-70-thread-1-processing-n:127.0.0.1:51564_ x:collection1 c:collection1) [n:127.0.0.1:51564_ c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 54840 INFO (coreZkRegister-70-thread-1-processing-n:127.0.0.1:51564_ x:collection1 c:collection1) [n:127.0.0.1:51564_ c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 54840 INFO (coreZkRegister-70-thread-1-processing-n:127.0.0.1:51564_ x:collection1 c:collection1) [n:127.0.0.1:51564_ c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:51564/collection1/
[junit4] 2> 54840 INFO (coreZkRegister-70-thread-1-processing-n:127.0.0.1:51564_ x:collection1 c:collection1) [n:127.0.0.1:51564_ c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 54840 INFO (coreZkRegister-70-thread-1-processing-n:127.0.0.1:51564_ x:collection1 c:collection1) [n:127.0.0.1:51564_ c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:51564/collection1/ has no replicas
[junit4] 2> 54842 INFO (zkCallback-31-thread-1-processing-n:127.0.0.1:51564_) [n:127.0.0.1:51564_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 55021 INFO (coreZkRegister-70-thread-1-processing-n:127.0.0.1:51564_ x:collection1 c:collection1) [n:127.0.0.1:51564_ c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:51564/collection1/ shard1
[junit4] 2> 55138 INFO (zkCallback-31-thread-1-processing-n:127.0.0.1:51564_) [n:127.0.0.1:51564_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 55174 INFO (coreZkRegister-70-thread-1-processing-n:127.0.0.1:51564_ x:collection1 c:collection1) [n:127.0.0.1:51564_ c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 55287 INFO (zkCallback-31-thread-1-processing-n:127.0.0.1:51564_) [n:127.0.0.1:51564_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 55300 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_1869389B2B9DED3D-001/shard-2-001/cores/collection1
[junit4] 2> 55304 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_1869389B2B9DED3D-001/shard-2-001
[junit4] 2> 55305 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 55328 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2197847b{/,null,AVAILABLE}
[junit4] 2> 55329 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@24605722{HTTP/1.1,[http/1.1]}{127.0.0.1:52463}
[junit4] 2> 55329 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.e.j.s.Server Started @58618ms
[junit4] 2> 55329 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:55900/hdfs__localhost_55900__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-6.x_checkout_solr_build_solr-core_test_J2_temp_solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_1869389B2B9DED3D-001_tempDir-002_jetty2, solrconfig=solrconfig.xml, hostContext=/, hostPort=52463, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_1869389B2B9DED3D-001/shard-2-001/cores}
[junit4] 2> 55329 ERROR (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 55342 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 6.5.0
[junit4] 2> 55342 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 55342 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 55343 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-02-19T08:22:03.975Z
[junit4] 2> 55456 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 55456 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_1869389B2B9DED3D-001/shard-2-001/solr.xml
[junit4] 2> 55465 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 55470 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:45728/solr
[junit4] 2> 55545 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [n:127.0.0.1:52463_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 55547 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [n:127.0.0.1:52463_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 55549 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [n:127.0.0.1:52463_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52463_
[junit4] 2> 55573 INFO (zkCallback-37-thread-1-processing-n:127.0.0.1:52463_) [n:127.0.0.1:52463_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 55574 INFO (zkCallback-21-thread-3-processing-n:127.0.0.1:47753_) [n:127.0.0.1:47753_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 55573 INFO (zkCallback-25-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 55573 INFO (zkCallback-31-thread-1-processing-n:127.0.0.1:51564_) [n:127.0.0.1:51564_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 55680 INFO (zkCallback-31-thread-1-processing-n:127.0.0.1:51564_) [n:127.0.0.1:51564_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 56132 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [n:127.0.0.1:52463_ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_1869389B2B9DED3D-001/shard-2-001/cores
[junit4] 2> 56132 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [n:127.0.0.1:52463_ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 56194 INFO (OverseerStateUpdate-97484309436497924-127.0.0.1:47753_-n_0000000000) [n:127.0.0.1:47753_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 56298 INFO (zkCallback-37-thread-1-processing-n:127.0.0.1:52463_) [n:127.0.0.1:52463_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 56298 INFO (zkCallback-31-thread-1-processing-n:127.0.0.1:51564_) [n:127.0.0.1:51564_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 57259 WARN (coreLoadExecutor-86-thread-1-processing-n:127.0.0.1:52463_) [n:127.0.0.1:52463_ c:collection1 x:collection1] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
[junit4] 2> 57267 INFO (coreLoadExecutor-86-thread-1-processing-n:127.0.0.1:52463_) [n:127.0.0.1:52463_ c:collection1 x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
[junit4] 2> 57593 INFO (coreLoadExecutor-86-thread-1-processing-n:127.0.0.1:52463_) [n:127.0.0.1:52463_ c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 58156 WARN (coreLoadExecutor-86-thread-1-processing-n:127.0.0.1:52463_) [n:127.0.0.1:52463_ c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 58163 INFO (coreLoadExecutor-86-thread-1-processing-n:127.0.0.1:52463_) [n:127.0.0.1:52463_ c:collection1 x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 58247 INFO (coreLoadExecutor-86-thread-1-processing-n:127.0.0.1:52463_) [n:127.0.0.1:52463_ c:collection1 x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 58247 INFO (coreLoadExecutor-86-thread-1-processing-n:127.0.0.1:52463_) [n:127.0.0.1:52463_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:55900/solr_hdfs_home
[junit4] 2> 58247 INFO (coreLoadExecutor-86-thread-1-processing-n:127.0.0.1:52463_) [n:127.0.0.1:52463_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 58247 INFO (coreLoadExecutor-86-thread-1-processing-n:127.0.0.1:52463_) [n:127.0.0.1:52463_ c:collection1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_1869389B2B9DED3D-001/shard-2-001/cores/collection1], dataDir=[hdfs://localhost:55900/solr_hdfs_home/collection1/core_node2/data/]
[junit4] 2> 58248 INFO (coreLoadExecutor-86-thread-1-processing-n:127.0.0.1:52463_) [n:127.0.0.1:52463_ c:collection1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5c74ca2c
[junit4] 2> 58248 INFO (coreLoadExecutor-86-thread-1-processing-n:127.0.0.1:52463_) [n:127.0.0.1:52463_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:55900/solr_hdfs_home/collection1/core_node2/data/snapshot_metadata
[junit4] 2> 58310 INFO (coreLoadExecutor-86-thread-1-processing-n:127.0.0.1:52463_) [n:127.0.0.1:52463_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 58310 INFO (coreLoadExecutor-86-thread-1-processing-n:127.0.0.1:52463_) [n:127.0.0.1:52463_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
[junit4] 2> 58326 INFO (coreLoadExecutor-86-thread-1-processing-n:127.0.0.1:52463_) [n:127.0.0.1:52463_ c:collection1 x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 58328 INFO (coreLoadExecutor-86-thread-1-processing-n:127.0.0.1:52463_) [n:127.0.0.1:52463_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:55900/solr_hdfs_home/collection1/core_node2/data
[junit4] 2> 58651 INFO (coreLoadExecutor-86-thread-1-processing-n:127.0.0.1:52463_) [n:127.0.0.1:52463_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:55900/solr_hdfs_home/collection1/core_node2/data/index
[junit4] 2> 58735 INFO (coreLoadExecutor-86-thread-1-processing-n:127.0.0.1:52463_) [n:127.0.0.1:52463_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 58735 INFO (coreLoadExecutor-86-thread-1-processing-n:127.0.0.1:52463_) [n:127.0.0.1:52463_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
[junit4] 2> 58787 INFO (coreLoadExecutor-86-thread-1-processing-n:127.0.0.1:52463_) [n:127.0.0.1:52463_ c:collection1 x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 58787 INFO (coreLoadExecutor-86-thread-1-processing-n:127.0.0.1:52463_) [n:127.0.0.1:52463_ c:collection1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=12, maxMergeAtOnceExplicit=41, maxMergedSegmentMB=30.4580078125, floorSegmentMB=0.9482421875, forceMergeDeletesPctAllowed=7.656383864441519, segmentsPerTier=49.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.2626329900004277
[junit4] 2> 58900 INFO (IPC Server handler 3 on 55900) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:49046 is added to blk_1073741827_1003{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-a41b2d8f-76a7-4e5a-912b-48090fc3250a:NORMAL:127.0.0.1:57984|RBW], ReplicaUC[[DISK]DS-44b8f2fe-2e8a-439a-9b05-08f0b018f746:NORMAL:127.0.0.1:49046|FINALIZED]]} size 0
[junit4] 2> 58902 INFO (IPC Server handler 1 on 55900) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:57984 is added to blk_1073741827_1003{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-44b8f2fe-2e8a-439a-9b05-08f0b018f746:NORMAL:127.0.0.1:49046|FINALIZED], ReplicaUC[[DISK]DS-3cb5a2b1-88c3-44c9-a1ff-c115af7c0ab4:NORMAL:127.0.0.1:57984|FINALIZED]]} size 0
[junit4] 2> 58933 WARN (coreLoadExecutor-86-thread-1-processing-n:127.0.0.1:52463_) [n:127.0.0.1:52463_ c:collection1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 59123 INFO (coreLoadExecutor-86-thread-1-processing-n:127.0.0.1:52463_) [n:127.0.0.1:52463_ c:collection1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
[junit4] 2> 59123 INFO (coreLoadExecutor-86-thread-1-processing-n:127.0.0.1:52463_) [n:127.0.0.1:52463_ c:collection1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 59123 INFO (coreLoadExecutor-86-thread-1-processing-n:127.0.0.1:52463_) [n:127.0.0.1:52463_ c:collection1 x:collection1] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=2
[junit4] 2> 59137 INFO (coreLoadExecutor-86-thread-1-processing-n:127.0.0.1:52463_) [n:127.0.0.1:52463_ c:collection1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 59137 INFO (coreLoadExecutor-86-thread-1-processing-n:127.0.0.1:52463_) [n:127.0.0.1:52463_ c:collection1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 59141 INFO (coreLoadExecutor-86-thread-1-processing-n:127.0.0.1:52463_) [n:127.0.0.1:52463_ c:collection1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=50, maxMergeAtOnceExplicit=12, maxMergedSegmentMB=91.953125, floorSegmentMB=0.9287109375, forceMergeDeletesPctAllowed=29.939285096133297, segmentsPerTier=17.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.2725521170725631
[junit4] 2> 59175 INFO (coreLoadExecutor-86-thread-1-processing-n:127.0.0.1:52463_) [n:127.0.0.1:52463_ c:collection1 x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@13689fc9[collection1] main]
[junit4] 2> 59177 INFO (coreLoadExecutor-86-thread-1-processing-n:127.0.0.1:52463_) [n:127.0.0.1:52463_ c:collection1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 59177 INFO (coreLoadExecutor-86-thread-1-processing-n:127.0.0.1:52463_) [n:127.0.0.1:52463_ c:collection1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 59177 INFO (coreLoadExecutor-86-thread-1-processing-n:127.0.0.1:52463_) [n:127.0.0.1:52463_ c:collection1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 59180 INFO (searcherExecutor-87-thread-1-processing-n:127.0.0.1:52463_ x:collection1 c:collection1) [n:127.0.0.1:52463_ c:collection1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@13689fc9[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 59186 INFO (coreLoadExecutor-86-thread-1-processing-n:127.0.0.1:52463_) [n:127.0.0.1:52463_ c:collection1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1559748964849287168
[junit4] 2> 59197 INFO (coreZkRegister-81-thread-1-processing-n:127.0.0.1:52463_ x:collection1 c:collection1) [n:127.0.0.1:52463_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.ZkController Core needs to recover:collection1
[junit4] 2> 59200 INFO (updateExecutor-34-thread-1-processing-n:127.0.0.1:52463_ x:collection1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:52463_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.u.DefaultSolrCoreState Running recovery
[junit4] 2> 59218 INFO (recoveryExecutor-35-thread-1-processing-n:127.0.0.1:52463_ x:collection1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:52463_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=true
[junit4] 2> 59218 INFO (recoveryExecutor-35-thread-1-processing-n:127.0.0.1:52463_ x:collection1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:52463_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.RecoveryStrategy ###### startupVersions=[[]]
[junit4] 2> 59219 INFO (recoveryExecutor-35-thread-1-processing-n:127.0.0.1:52463_ x:collection1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:52463_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.RecoveryStrategy Begin buffering updates. core=[collection1]
[junit4] 2> 59219 INFO (recoveryExecutor-35-thread-1-processing-n:127.0.0.1:52463_ x:collection1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:52463_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.u.UpdateLog Starting to buffer updates. HDFSUpdateLog{state=ACTIVE, tlog=null}
[junit4] 2> 59219 INFO (recoveryExecutor-35-thread-1-processing-n:127.0.0.1:52463_ x:collection1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:52463_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.RecoveryStrategy Publishing state of core [collection1] as recovering, leader is [http://127.0.0.1:51564/collection1/] and I am [http://127.0.0.1:52463/collection1/]
[junit4] 2> 59227 INFO (zkCallback-31-thread-1-processing-n:127.0.0.1:51564_) [n:127.0.0.1:51564_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 59227 INFO (zkCallback-37-thread-1-processing-n:127.0.0.1:52463_) [n:127.0.0.1:52463_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 59238 INFO (recoveryExecutor-35-thread-1-processing-n:127.0.0.1:52463_ x:collection1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:52463_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.RecoveryStrategy Sending prep recovery command to [http://127.0.0.1:51564]; [WaitForState: action=PREPRECOVERY&core=collection1&nodeName=127.0.0.1:52463_&coreNodeName=core_node2&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true]
[junit4] 2> 59275 INFO (qtp1266166898-329) [n:127.0.0.1:51564_ ] o.a.s.h.a.PrepRecoveryOp Going to wait for coreNodeName: core_node2, state: recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true
[junit4] 2> 59277 INFO (qtp1266166898-329) [n:127.0.0.1:51564_ ] o.a.s.h.a.PrepRecoveryOp Will wait a max of 183 seconds to see collection1 (shard1 of collection1) have state: recovering
[junit4] 2> 59277 INFO (qtp1266166898-329) [n:127.0.0.1:51564_ ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard1, thisCore=collection1, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=recovering, localState=active, nodeName=127.0.0.1:52463_, coreNodeName=core_node2, onlyIfActiveCheckResult=false, nodeProps: core_node2:{"core":"collection1","dataDir":"hdfs://localhost:55900/solr_hdfs_home/collection1/core_node2/data/","base_url":"http://127.0.0.1:52463","node_name":"127.0.0.1:52463_","state":"recovering","ulogDir":"hdfs://localhost:55900/solr_hdfs_home/collection1/core_node2/data/tlog"}
[junit4] 2> 59277 INFO (qtp1266166898-329) [n:127.0.0.1:51564_ ] o.a.s.h.a.PrepRecoveryOp Waited coreNodeName: core_node2, state: recovering, checkLive: true, onlyIfLeader: true for: 0 seconds.
[junit4] 2> 59278 INFO (qtp1266166898-329) [n:127.0.0.1:51564_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={nodeName=127.0.0.1:52463_&onlyIfLeaderActive=true&core=collection1&coreNodeName=core_node2&action=PREPRECOVERY&checkLive=true&state=recovering&onlyIfLeader=true&wt=javabin&version=2} status=0 QTime=3
[junit4] 2> 59750 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_1869389B2B9DED3D-001/shard-3-001/cores/collection1
[junit4] 2> 59758 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_1869389B2B9DED3D-001/shard-3-001
[junit4] 2> 59780 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 59971 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7114760c{/,null,AVAILABLE}
[junit4] 2> 59996 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@248a316c{HTTP/1.1,[http/1.1]}{127.0.0.1:60411}
[junit4] 2> 59996 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.e.j.s.Server Started @63286ms
[junit4] 2> 59996 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:55900/hdfs__localhost_55900__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-6.x_checkout_solr_build_solr-core_test_J2_temp_solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_1869389B2B9DED3D-001_tempDir-002_jetty3, solrconfig=solrconfig.xml, hostContext=/, hostPort=60411, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_1869389B2B9DED3D-001/shard-3-001/cores}
[junit4] 2> 59996 ERROR (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 59997 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 6.5.0
[junit4] 2> 59997 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 59997 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 59997 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-02-19T08:22:08.629Z
[junit4] 2> 60028 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[1869389B2B9DED3D]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 60028 INFO (TEST-HdfsWriteToMultipleCollectionsTe
[...truncated too long message...]
)
[junit4] 2> ... 53 more
[junit4] 2> 278031 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[1869389B2B9DED3D]-worker) [ ] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_1869389B2B9DED3D-001
[junit4] 2> Feb 19, 2017 8:25:46 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 35 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene62): {rnd_b=PostingsFormat(name=LuceneFixedGap), _version_=PostingsFormat(name=Memory doPackFST= false), a_t=PostingsFormat(name=Memory doPackFST= false), a_i=PostingsFormat(name=LuceneFixedGap), id=PostingsFormat(name=LuceneFixedGap)}, docValues:{}, maxPointsInLeafNode=701, maxMBSortInHeap=5.609873712501604, sim=RandomSimilarity(queryNorm=false,coord=yes): {}, locale=es-SV, timezone=Europe/Zaporozhye
[junit4] 2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_121 (64-bit)/cpus=4,threads=6,free=74038824,total=388497408
[junit4] 2> NOTE: All tests run in this JVM: [LeaderElectionContextKeyTest, AutoCommitTest, HdfsWriteToMultipleCollectionsTest]
[junit4] Completed [14/692 (1!)] on J2 in 250.84s, 1 test, 1 failure <<< FAILURES!
[...truncated 1722 lines...]
[junit4] Suite: org.apache.solr.handler.admin.TestApiFramework
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.admin.TestApiFramework_1869389B2B9DED3D-001/init-core-data-001
[junit4] 2> 4406078 INFO (SUITE-TestApiFramework-seed#[1869389B2B9DED3D]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields
[junit4] 2> 4406080 INFO (SUITE-TestApiFramework-seed#[1869389B2B9DED3D]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 2> 4406082 INFO (TEST-TestApiFramework.testTrailingTemplatePaths-seed#[1869389B2B9DED3D]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testTrailingTemplatePaths
[junit4] 2> 4406083 INFO (TEST-TestApiFramework.testTrailingTemplatePaths-seed#[1869389B2B9DED3D]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testTrailingTemplatePaths
[junit4] 2> 4406091 INFO (TEST-TestApiFramework.testFramework-seed#[1869389B2B9DED3D]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testFramework
[junit4] 2> 4406173 INFO (TEST-TestApiFramework.testFramework-seed#[1869389B2B9DED3D]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testFramework
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestApiFramework -Dtests.method=testFramework -Dtests.seed=1869389B2B9DED3D -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/test-data/enwiki.random.lines.txt -Dtests.locale=mk-MK -Dtests.timezone=Africa/Accra -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[junit4] ERROR 0.10s J1 | TestApiFramework.testFramework <<<
[junit4] > Throwable #1: java.lang.NullPointerException
[junit4] > at __randomizedtesting.SeedInfo.seed([1869389B2B9DED3D:F1FF2BC2D490100]:0)
[junit4] > at org.apache.solr.api.V2HttpCall.getApiInfo(V2HttpCall.java:194)
[junit4] > at org.apache.solr.handler.admin.TestApiFramework.invoke(TestApiFramework.java:176)
[junit4] > at org.apache.solr.handler.admin.TestApiFramework.testFramework(TestApiFramework.java:123)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 4406183 INFO (SUITE-TestApiFramework-seed#[1869389B2B9DED3D]-worker) [ ] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.admin.TestApiFramework_1869389B2B9DED3D-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene62), sim=RandomSimilarity(queryNorm=true,coord=yes): {}, locale=mk-MK, timezone=Africa/Accra
[junit4] 2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_121 (64-bit)/cpus=4,threads=1,free=147352128,total=532152320
[junit4] 2> NOTE: All tests run in this JVM: [HighlighterMaxOffsetTest, TestNumericTerms32, SparseHLLTest, TestFastOutputStream, DistributedVersionInfoTest, TestSerializedLuceneMatchVersion, TestSystemIdResolver, TestGraphTermsQParserPlugin, TestRebalanceLeaders, TlogReplayBufferedWhileIndexingTest, HdfsRecoverLeaseTest, TestRequestStatusCollectionAPI, TestCloudDeleteByQuery, HdfsChaosMonkeySafeLeaderTest, AddBlockUpdateTest, BasicFunctionalityTest, MoreLikeThisHandlerTest, TermsComponentTest, CollectionTooManyReplicasTest, TestCloudSchemaless, TestCollectionAPI, RAMDirectoryFactoryTest, TestRestoreCore, CollectionsAPIDistributedZkTest, ChaosMonkeySafeLeaderTest, ClusterStateUpdateTest, TestBlendedInfixSuggestions, CursorMarkTest, CloudExitableDirectoryReaderTest, TestCollapseQParserPlugin, TermVectorComponentTest, ManagedSchemaRoundRobinCloudTest, TestQuerySenderListener, SharedFSAutoReplicaFailoverUtilsTest, TestFiltering, DistributedFacetExistsSmallTest, FileUtilsTest, TestSurroundQueryParser, TestCSVResponseWriter, TestSimpleTrackingShardHandler, HighlighterTest, DateMathParserTest, TestShardHandlerFactory, ConvertedLegacyTest, TestQueryTypes, TestSubQueryTransformerDistrib, IndexSchemaTest, UUIDUpdateProcessorFallbackTest, TestReloadDeadlock, HdfsUnloadDistributedZkTest, SpellingQueryConverterTest, DirectSolrSpellCheckerTest, TestManagedSchemaAPI, ConcurrentDeleteAndCreateCollectionTest, TestDefaultStatsCache, TestOrdValues, DistributedIntervalFacetingTest, WrapperMergePolicyFactoryTest, CoreSorterTest, CreateCollectionCleanupTest, SpellCheckCollatorTest, LeaderFailureAfterFreshStartTest, MultiTermTest, JsonLoaderTest, HdfsBasicDistributedZk2Test, RestartWhileUpdatingTest, DistanceFunctionTest, TestExactStatsCache, BufferStoreTest, TestUseDocValuesAsStored2, TestUpdate, TestDynamicFieldResource, GraphQueryTest, TestUniqueKeyFieldResource, TestLMDirichletSimilarityFactory, LoggingHandlerTest, TestOnReconnectListenerSupport, WordBreakSolrSpellCheckerTest, TestMiniSolrCloudCluster, TestJsonFacetRefinement, TestLeaderInitiatedRecoveryThread, RequestLoggingTest, ShufflingReplicaListTransformerTest, TestSearchPerf, TestConfigSets, OverseerTaskQueueTest, TestInitParams, ActionThrottleTest, OutOfBoxZkACLAndCredentialsProvidersTest, TestSchemaResource, DistributedFacetPivotSmallAdvancedTest, TestCursorMarkWithoutUniqueKey, TestObjectReleaseTracker, TestRTGBase, TestBulkSchemaConcurrent, TestLuceneMatchVersion, TestRuleBasedAuthorizationPlugin, DistribDocExpirationUpdateProcessorTest, HttpPartitionTest, TestClassicSimilarityFactory, SolrInfoMBeanTest, TestCopyFieldCollectionResource, DataDrivenBlockJoinTest, SampleTest, TestTrie, TestPivotHelperCode, TestRawResponseWriter, ZkSolrClientTest, BlockJoinFacetDistribTest, RemoteQueryErrorTest, TestElisionMultitermQuery, TestConfigOverlay, TestDocTermOrds, SoftAutoCommitTest, LeaderElectionIntegrationTest, ShardRoutingTest, BasicZkTest, FullSolrCloudDistribCmdsTest, TestReplicationHandler, LeaderInitiatedRecoveryOnCommitTest, MissingSegmentRecoveryTest, MultiThreadedOCPTest, SaslZkACLProviderTest, ShardSplitTest, SolrCloudExampleTest, SolrXmlInZkTest, TestCloudInspectUtil, TestCloudPivotFacet, TestCloudPseudoReturnFields, TestCloudRecovery, TestDistribDocBasedVersion, TestLeaderElectionWithEmptyReplica, TestLeaderElectionZkExpiry, TestReplicaProperties, TestSSLRandomization, TestShortCircuitedRequests, TestSolrCloudWithDelegationTokens, TestSolrCloudWithKerberosAlt, TestTolerantUpdateProcessorRandomCloud, TriLevelCompositeIdRoutingTest, HdfsNNFailoverTest, HdfsThreadLeakTest, StressHdfsTest, HdfsDirectoryFactoryTest, TestConfigSetImmutable, TestConfigSetProperties, TestDynamicLoading, TestBlobHandler, TestReplicationHandlerBackup, TestSolrConfigHandlerCloud, TestApiFramework]
[junit4] Completed [551/692 (2!)] on J1 in 0.12s, 2 tests, 1 error <<< FAILURES!
[...truncated 38921 lines...]
check-lib-versions:
[echo] Lib versions check under: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/lucene/..
[libversions] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/lucene/top-level-ivy-settings.xml
[libversions] ORPHAN coordinate key '/cglib/cglib-nodep' in ivy-versions.properties is not found in any ivy.xml file.
[libversions] Checked that ivy-versions.properties and ivy-ignore-conflicts.properties have lexically sorted '/org/name' keys and no duplicates or orphans.
[libversions] Scanned 49 ivy.xml files for rev="${/org/name}" format.
[libversions] Found 0 indirect dependency version conflicts.
[libversions] Completed in 0.88s., 1 error(s).
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/build.xml:783: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/build.xml:122: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/lucene/build.xml:108: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/lucene/tools/custom-tasks.xml:108: Lib versions check failed. Check the logs.
Total time: 248 minutes 57 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-6.x - Build # 287 - Still
unstable
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.x/287/
2 tests failed.
FAILED: org.apache.solr.handler.TestReplicationHandler.doTestReplicateAfterCoreReload
Error Message:
expected:<[{indexVersion=1487427264903,generation=2,filelist=[_14jh.fdt, _14jh.fdx, _14jh.fnm, _14jh.nvd, _14jh.nvm, _14jh.si, _14jh_Lucene50_0.doc, _14jh_Lucene50_0.tim, _14jh_Lucene50_0.tip, _14l5.cfe, _14l5.cfs, _14l5.si, _14l6.cfe, _14l6.cfs, _14l6.si, _14l7.cfe, _14l7.cfs, _14l7.si, _14l8.cfe, _14l8.cfs, _14l8.si, _14l9.cfe, _14l9.cfs, _14l9.si, _14la.cfe, _14la.cfs, _14la.si, _14lb.cfe, _14lb.cfs, _14lb.si, _14lc.cfe, _14lc.cfs, _14lc.si, _14ld.cfe, _14ld.cfs, _14ld.si, _14le.cfe, _14le.cfs, _14le.si, _14lf.cfe, _14lf.cfs, _14lf.si, _14lg.cfe, _14lg.cfs, _14lg.si, _14lh.cfe, _14lh.cfs, _14lh.si, _14li.cfe, _14li.cfs, _14li.si, _14lj.cfe, _14lj.cfs, _14lj.si, _14lk.cfe, _14lk.cfs, _14lk.si, _14ll.cfe, _14ll.cfs, _14ll.si, _14lm.cfe, _14lm.cfs, _14lm.si, _14ln.cfe, _14ln.cfs, _14ln.si, _14lo.cfe, _14lo.cfs, _14lo.si, _14lq.cfe, _14lq.cfs, _14lq.si, _14lr.cfe, _14lr.cfs, _14lr.si, _14ls.cfe, _14ls.cfs, _14ls.si, _14lt.cfe, _14lt.cfs, _14lt.si, _14lu.cfe, _14lu.cfs, _14lu.si, _14lv.cfe, _14lv.cfs, _14lv.si, _14lw.cfe, _14lw.cfs, _14lw.si, _14lx.cfe, _14lx.cfs, _14lx.si, _14ly.cfe, _14ly.cfs, _14ly.si, segments_2]}]> but was:<[{indexVersion=1487427264903,generation=2,filelist=[_14jh.fdt, _14jh.fdx, _14jh.fnm, _14jh.nvd, _14jh.nvm, _14jh.si, _14jh_Lucene50_0.doc, _14jh_Lucene50_0.tim, _14jh_Lucene50_0.tip, _14l5.cfe, _14l5.cfs, _14l5.si, _14l6.cfe, _14l6.cfs, _14l6.si, _14l7.cfe, _14l7.cfs, _14l7.si, _14l8.cfe, _14l8.cfs, _14l8.si, _14l9.cfe, _14l9.cfs, _14l9.si, _14la.cfe, _14la.cfs, _14la.si, _14lb.cfe, _14lb.cfs, _14lb.si, _14lc.cfe, _14lc.cfs, _14lc.si, _14ld.cfe, _14ld.cfs, _14ld.si, _14le.cfe, _14le.cfs, _14le.si, _14lf.cfe, _14lf.cfs, _14lf.si, _14lg.cfe, _14lg.cfs, _14lg.si, _14lh.cfe, _14lh.cfs, _14lh.si, _14li.cfe, _14li.cfs, _14li.si, _14lj.cfe, _14lj.cfs, _14lj.si, _14lk.cfe, _14lk.cfs, _14lk.si, _14ll.cfe, _14ll.cfs, _14ll.si, _14lm.cfe, _14lm.cfs, _14lm.si, _14ln.cfe, _14ln.cfs, _14ln.si, _14lo.cfe, _14lo.cfs, _14lo.si, _14lq.cfe, _14lq.cfs, _14lq.si, _14lr.cfe, _14lr.cfs, _14lr.si, _14ls.cfe, _14ls.cfs, _14ls.si, _14lt.cfe, _14lt.cfs, _14lt.si, _14lu.cfe, _14lu.cfs, _14lu.si, _14lv.cfe, _14lv.cfs, _14lv.si, _14lw.cfe, _14lw.cfs, _14lw.si, _14lx.cfe, _14lx.cfs, _14lx.si, _14ly.cfe, _14ly.cfs, _14ly.si, segments_2]}, {indexVersion=1487427264903,generation=3,filelist=[_14lo.cfe, _14lo.cfs, _14lo.si, _14lp.fdt, _14lp.fdx, _14lp.fnm, _14lp.nvd, _14lp.nvm, _14lp.si, _14lp_Lucene50_0.doc, _14lp_Lucene50_0.tim, _14lp_Lucene50_0.tip, _14lq.cfe, _14lq.cfs, _14lq.si, _14lr.cfe, _14lr.cfs, _14lr.si, _14ls.cfe, _14ls.cfs, _14ls.si, _14lt.cfe, _14lt.cfs, _14lt.si, _14lu.cfe, _14lu.cfs, _14lu.si, _14lv.cfe, _14lv.cfs, _14lv.si, _14lw.cfe, _14lw.cfs, _14lw.si, _14lx.cfe, _14lx.cfs, _14lx.si, _14ly.cfe, _14ly.cfs, _14ly.si, segments_3]}]>
Stack Trace:
java.lang.AssertionError: expected:<[{indexVersion=1487427264903,generation=2,filelist=[_14jh.fdt, _14jh.fdx, _14jh.fnm, _14jh.nvd, _14jh.nvm, _14jh.si, _14jh_Lucene50_0.doc, _14jh_Lucene50_0.tim, _14jh_Lucene50_0.tip, _14l5.cfe, _14l5.cfs, _14l5.si, _14l6.cfe, _14l6.cfs, _14l6.si, _14l7.cfe, _14l7.cfs, _14l7.si, _14l8.cfe, _14l8.cfs, _14l8.si, _14l9.cfe, _14l9.cfs, _14l9.si, _14la.cfe, _14la.cfs, _14la.si, _14lb.cfe, _14lb.cfs, _14lb.si, _14lc.cfe, _14lc.cfs, _14lc.si, _14ld.cfe, _14ld.cfs, _14ld.si, _14le.cfe, _14le.cfs, _14le.si, _14lf.cfe, _14lf.cfs, _14lf.si, _14lg.cfe, _14lg.cfs, _14lg.si, _14lh.cfe, _14lh.cfs, _14lh.si, _14li.cfe, _14li.cfs, _14li.si, _14lj.cfe, _14lj.cfs, _14lj.si, _14lk.cfe, _14lk.cfs, _14lk.si, _14ll.cfe, _14ll.cfs, _14ll.si, _14lm.cfe, _14lm.cfs, _14lm.si, _14ln.cfe, _14ln.cfs, _14ln.si, _14lo.cfe, _14lo.cfs, _14lo.si, _14lq.cfe, _14lq.cfs, _14lq.si, _14lr.cfe, _14lr.cfs, _14lr.si, _14ls.cfe, _14ls.cfs, _14ls.si, _14lt.cfe, _14lt.cfs, _14lt.si, _14lu.cfe, _14lu.cfs, _14lu.si, _14lv.cfe, _14lv.cfs, _14lv.si, _14lw.cfe, _14lw.cfs, _14lw.si, _14lx.cfe, _14lx.cfs, _14lx.si, _14ly.cfe, _14ly.cfs, _14ly.si, segments_2]}]> but was:<[{indexVersion=1487427264903,generation=2,filelist=[_14jh.fdt, _14jh.fdx, _14jh.fnm, _14jh.nvd, _14jh.nvm, _14jh.si, _14jh_Lucene50_0.doc, _14jh_Lucene50_0.tim, _14jh_Lucene50_0.tip, _14l5.cfe, _14l5.cfs, _14l5.si, _14l6.cfe, _14l6.cfs, _14l6.si, _14l7.cfe, _14l7.cfs, _14l7.si, _14l8.cfe, _14l8.cfs, _14l8.si, _14l9.cfe, _14l9.cfs, _14l9.si, _14la.cfe, _14la.cfs, _14la.si, _14lb.cfe, _14lb.cfs, _14lb.si, _14lc.cfe, _14lc.cfs, _14lc.si, _14ld.cfe, _14ld.cfs, _14ld.si, _14le.cfe, _14le.cfs, _14le.si, _14lf.cfe, _14lf.cfs, _14lf.si, _14lg.cfe, _14lg.cfs, _14lg.si, _14lh.cfe, _14lh.cfs, _14lh.si, _14li.cfe, _14li.cfs, _14li.si, _14lj.cfe, _14lj.cfs, _14lj.si, _14lk.cfe, _14lk.cfs, _14lk.si, _14ll.cfe, _14ll.cfs, _14ll.si, _14lm.cfe, _14lm.cfs, _14lm.si, _14ln.cfe, _14ln.cfs, _14ln.si, _14lo.cfe, _14lo.cfs, _14lo.si, _14lq.cfe, _14lq.cfs, _14lq.si, _14lr.cfe, _14lr.cfs, _14lr.si, _14ls.cfe, _14ls.cfs, _14ls.si, _14lt.cfe, _14lt.cfs, _14lt.si, _14lu.cfe, _14lu.cfs, _14lu.si, _14lv.cfe, _14lv.cfs, _14lv.si, _14lw.cfe, _14lw.cfs, _14lw.si, _14lx.cfe, _14lx.cfs, _14lx.si, _14ly.cfe, _14ly.cfs, _14ly.si, segments_2]}, {indexVersion=1487427264903,generation=3,filelist=[_14lo.cfe, _14lo.cfs, _14lo.si, _14lp.fdt, _14lp.fdx, _14lp.fnm, _14lp.nvd, _14lp.nvm, _14lp.si, _14lp_Lucene50_0.doc, _14lp_Lucene50_0.tim, _14lp_Lucene50_0.tip, _14lq.cfe, _14lq.cfs, _14lq.si, _14lr.cfe, _14lr.cfs, _14lr.si, _14ls.cfe, _14ls.cfs, _14ls.si, _14lt.cfe, _14lt.cfs, _14lt.si, _14lu.cfe, _14lu.cfs, _14lu.si, _14lv.cfe, _14lv.cfs, _14lv.si, _14lw.cfe, _14lw.cfs, _14lw.si, _14lx.cfe, _14lx.cfs, _14lx.si, _14ly.cfe, _14ly.cfs, _14ly.si, segments_3]}]>
at __randomizedtesting.SeedInfo.seed([B80E20719F2ADC89:9DD93B41EF62D28A]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:147)
at org.apache.solr.handler.TestReplicationHandler.doTestReplicateAfterCoreReload(TestReplicationHandler.java:1288)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest.test
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([B80E20719F2ADC89:305A1FAB31D6B171]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertTrue(Assert.java:54)
at org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest.test(HdfsWriteToMultipleCollectionsTest.java:137)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 12902 lines...]
[junit4] Suite: org.apache.solr.handler.TestReplicationHandler
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_B80E20719F2ADC89-001/init-core-data-001
[junit4] 2> 1802671 INFO (SUITE-TestReplicationHandler-seed#[B80E20719F2ADC89]-worker) [ ] o.a.s.SolrTestCaseJ4 Using TrieFields
[junit4] 2> 1802672 INFO (SUITE-TestReplicationHandler-seed#[B80E20719F2ADC89]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=None)
[junit4] 2> 1802673 INFO (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.a.s.SolrTestCaseJ4 ###Starting doTestStressReplication
[junit4] 2> 1802673 INFO (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_B80E20719F2ADC89-001/solr-instance-001/collection1
[junit4] 2> 1802676 INFO (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 1802680 INFO (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2d059d89{/solr,null,AVAILABLE}
[junit4] 2> 1802681 INFO (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@52ad36f{HTTP/1.1,[http/1.1]}{127.0.0.1:40331}
[junit4] 2> 1802681 INFO (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.e.j.s.Server Started @1806259ms
[junit4] 2> 1802681 INFO (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_B80E20719F2ADC89-001/solr-instance-001/collection1/data, hostContext=/solr, hostPort=40331}
[junit4] 2> 1802681 ERROR (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1802681 INFO (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 6.5.0
[junit4] 2> 1802681 INFO (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in standalone mode on port null
[junit4] 2> 1802681 INFO (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1802681 INFO (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-02-18T14:00:52.439Z
[junit4] 2> 1802682 INFO (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_B80E20719F2ADC89-001/solr-instance-001/solr.xml
[junit4] 2> 1802690 INFO (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1802707 INFO (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_B80E20719F2ADC89-001/solr-instance-001/.
[junit4] 2> 1802707 INFO (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 1802719 INFO (coreLoadExecutor-4641-thread-1) [ x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
[junit4] 2> 1802725 INFO (coreLoadExecutor-4641-thread-1) [ x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 1802727 INFO (coreLoadExecutor-4641-thread-1) [ x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.2 with uniqueid field id
[junit4] 2> 1802728 INFO (coreLoadExecutor-4641-thread-1) [ x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_B80E20719F2ADC89-001/solr-instance-001/./collection1
[junit4] 2> 1802728 INFO (coreLoadExecutor-4641-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_B80E20719F2ADC89-001/solr-instance-001/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_B80E20719F2ADC89-001/solr-instance-001/./collection1/data/]
[junit4] 2> 1802729 INFO (coreLoadExecutor-4641-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@6cc96596
[junit4] 2> 1802761 INFO (coreLoadExecutor-4641-thread-1) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1802761 INFO (coreLoadExecutor-4641-thread-1) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1802761 INFO (coreLoadExecutor-4641-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=20, maxMergeAtOnceExplicit=46, maxMergedSegmentMB=60.859375, floorSegmentMB=0.861328125, forceMergeDeletesPctAllowed=28.202737596991053, segmentsPerTier=31.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7372125534119868
[junit4] 2> 1802761 INFO (coreLoadExecutor-4641-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@4cf8a48d[collection1] main]
[junit4] 2> 1802762 INFO (coreLoadExecutor-4641-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_B80E20719F2ADC89-001/solr-instance-001/collection1/conf
[junit4] 2> 1802762 INFO (coreLoadExecutor-4641-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Replication enabled for following config files: schema.xml,xslt/dummy.xsl
[junit4] 2> 1802762 INFO (coreLoadExecutor-4641-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 1802762 INFO (searcherExecutor-4642-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@4cf8a48d[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1802981 INFO (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_B80E20719F2ADC89-001/solr-instance-002/collection1
[junit4] 2> 1802984 INFO (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 1802985 INFO (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@516e6021{/solr,null,AVAILABLE}
[junit4] 2> 1802985 INFO (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@5b42b36e{HTTP/1.1,[http/1.1]}{127.0.0.1:37966}
[junit4] 2> 1802989 INFO (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.e.j.s.Server Started @1806567ms
[junit4] 2> 1802989 INFO (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_B80E20719F2ADC89-001/solr-instance-002/collection1/data, hostContext=/solr, hostPort=37966}
[junit4] 2> 1802989 ERROR (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1802990 INFO (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 6.5.0
[junit4] 2> 1802990 INFO (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in standalone mode on port null
[junit4] 2> 1802990 INFO (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1802990 INFO (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-02-18T14:00:52.748Z
[junit4] 2> 1802990 INFO (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_B80E20719F2ADC89-001/solr-instance-002/solr.xml
[junit4] 2> 1802994 INFO (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1803011 INFO (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_B80E20719F2ADC89-001/solr-instance-002/.
[junit4] 2> 1803011 INFO (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 1803018 INFO (coreLoadExecutor-4651-thread-1) [ x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
[junit4] 2> 1803025 INFO (coreLoadExecutor-4651-thread-1) [ x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 1803027 INFO (coreLoadExecutor-4651-thread-1) [ x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.2 with uniqueid field id
[junit4] 2> 1803028 INFO (coreLoadExecutor-4651-thread-1) [ x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_B80E20719F2ADC89-001/solr-instance-002/./collection1
[junit4] 2> 1803028 INFO (coreLoadExecutor-4651-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_B80E20719F2ADC89-001/solr-instance-002/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_B80E20719F2ADC89-001/solr-instance-002/./collection1/data/]
[junit4] 2> 1803029 INFO (coreLoadExecutor-4651-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@2331a598
[junit4] 2> 1803062 INFO (coreLoadExecutor-4651-thread-1) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1803062 INFO (coreLoadExecutor-4651-thread-1) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1803062 INFO (coreLoadExecutor-4651-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=20, maxMergeAtOnceExplicit=46, maxMergedSegmentMB=60.859375, floorSegmentMB=0.861328125, forceMergeDeletesPctAllowed=28.202737596991053, segmentsPerTier=31.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7372125534119868
[junit4] 2> 1803062 INFO (coreLoadExecutor-4651-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@a3cab8a[collection1] main]
[junit4] 2> 1803062 INFO (coreLoadExecutor-4651-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_B80E20719F2ADC89-001/solr-instance-002/collection1/conf
[junit4] 2> 1803064 INFO (coreLoadExecutor-4651-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 1000ms
[junit4] 2> 1803064 INFO (searcherExecutor-4652-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@a3cab8a[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1803076 INFO (qtp1867534839-17824) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
[junit4] 2> 1803080 INFO (indexFetcher-4656-thread-1) [ x:collection1] o.a.s.h.IndexFetcher Master's generation: 1
[junit4] 2> 1803080 INFO (indexFetcher-4656-thread-1) [ x:collection1] o.a.s.h.IndexFetcher Master's version: 0
[junit4] 2> 1803080 INFO (indexFetcher-4656-thread-1) [ x:collection1] o.a.s.h.IndexFetcher Slave's generation: 1
[junit4] 2> 1803080 INFO (indexFetcher-4656-thread-1) [ x:collection1] o.a.s.h.IndexFetcher Slave's version: 0
[junit4] 2> 1803285 INFO (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@5b42b36e{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 1803285 INFO (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=633026028
[junit4] 2> 1803287 INFO (coreCloseExecutor-4657-thread-1) [ x:collection1] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@435e68d3
[junit4] 2> 1803288 INFO (coreCloseExecutor-4657-thread-1) [ x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.core.collection1
[junit4] 2> 1803288 INFO (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.node
[junit4] 2> 1803289 INFO (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@516e6021{/solr,null,UNAVAILABLE}
[junit4] 2> 1803290 INFO (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 1803291 INFO (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@58aa5f12{/solr,null,AVAILABLE}
[junit4] 2> 1803291 INFO (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@15180e55{HTTP/1.1,[http/1.1]}{127.0.0.1:60907}
[junit4] 2> 1803291 INFO (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.e.j.s.Server Started @1806869ms
[junit4] 2> 1803291 INFO (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_B80E20719F2ADC89-001/solr-instance-002/collection1/data, hostContext=/solr, hostPort=60907}
[junit4] 2> 1803291 ERROR (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1803291 INFO (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 6.5.0
[junit4] 2> 1803292 INFO (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in standalone mode on port null
[junit4] 2> 1803292 INFO (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1803292 INFO (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-02-18T14:00:53.050Z
[junit4] 2> 1803292 INFO (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_B80E20719F2ADC89-001/solr-instance-002/solr.xml
[junit4] 2> 1803296 INFO (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1803314 INFO (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_B80E20719F2ADC89-001/solr-instance-002/.
[junit4] 2> 1803314 INFO (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 1803321 INFO (coreLoadExecutor-4664-thread-1) [ x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
[junit4] 2> 1803327 INFO (coreLoadExecutor-4664-thread-1) [ x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 1803328 INFO (coreLoadExecutor-4664-thread-1) [ x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.2 with uniqueid field id
[junit4] 2> 1803329 INFO (coreLoadExecutor-4664-thread-1) [ x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_B80E20719F2ADC89-001/solr-instance-002/./collection1
[junit4] 2> 1803330 INFO (coreLoadExecutor-4664-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_B80E20719F2ADC89-001/solr-instance-002/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_B80E20719F2ADC89-001/solr-instance-002/./collection1/data/]
[junit4] 2> 1803330 INFO (coreLoadExecutor-4664-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@15a40baa
[junit4] 2> 1803363 INFO (coreLoadExecutor-4664-thread-1) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1803363 INFO (coreLoadExecutor-4664-thread-1) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1803364 INFO (coreLoadExecutor-4664-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=20, maxMergeAtOnceExplicit=46, maxMergedSegmentMB=60.859375, floorSegmentMB=0.861328125, forceMergeDeletesPctAllowed=28.202737596991053, segmentsPerTier=31.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7372125534119868
[junit4] 2> 1803364 INFO (coreLoadExecutor-4664-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@79803fd0[collection1] main]
[junit4] 2> 1803364 INFO (coreLoadExecutor-4664-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_B80E20719F2ADC89-001/solr-instance-002/collection1/conf
[junit4] 2> 1803364 INFO (coreLoadExecutor-4664-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 1803365 INFO (searcherExecutor-4665-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@79803fd0[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1803603 INFO (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@52ad36f{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 1803603 INFO (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=288900492
[junit4] 2> 1803604 INFO (coreCloseExecutor-4669-thread-1) [ x:collection1] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@295086e0
[junit4] 2> 1803608 INFO (coreCloseExecutor-4669-thread-1) [ x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.core.collection1
[junit4] 2> 1803608 INFO (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.node
[junit4] 2> 1803609 INFO (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@2d059d89{/solr,null,UNAVAILABLE}
[junit4] 2> 1803610 INFO (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 1803611 INFO (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@456af520{/solr,null,AVAILABLE}
[junit4] 2> 1803611 INFO (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@1609207f{HTTP/1.1,[http/1.1]}{127.0.0.1:43514}
[junit4] 2> 1803611 INFO (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.e.j.s.Server Started @1807189ms
[junit4] 2> 1803611 INFO (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_B80E20719F2ADC89-001/solr-instance-001/collection1/data, hostContext=/solr, hostPort=43514}
[junit4] 2> 1803611 ERROR (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1803612 INFO (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 6.5.0
[junit4] 2> 1803612 INFO (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in standalone mode on port null
[junit4] 2> 1803612 INFO (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1803612 INFO (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-02-18T14:00:53.370Z
[junit4] 2> 1803612 INFO (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_B80E20719F2ADC89-001/solr-instance-001/solr.xml
[junit4] 2> 1803616 INFO (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1803633 INFO (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_B80E20719F2ADC89-001/solr-instance-001/.
[junit4] 2> 1803633 INFO (TEST-TestReplicationHandler.doTestStressReplication-seed#[B80E20719F2ADC89]) [ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 1803640 INFO (coreLoadExecutor-4676-thread-1) [ x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
[junit4] 2> 1803646 INFO (coreLoadExecutor-4676-thread-1) [ x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 1803648 INFO (coreLoadExecutor-4676-thread-1) [ x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.2 with uniqueid field id
[junit4] 2> 1803649 INFO (coreLoadExecutor-4676-thread-1) [ x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_B80E20719F2ADC89-001/solr-instance-001/./collection1
[junit4] 2> 1803650 INFO (coreLoadExecutor-4676-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_B80E20719F2ADC89-001/solr-instance-001/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_B80E20719F2ADC89-001/solr-instance-001/./collection1/data/]
[junit4] 2> 1803650 INFO (coreLoadExecutor-4676-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@37132a40
[junit4] 2> 1803684 INFO (coreLoadExecutor-4676-thread-1) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1803684 INFO (coreLoadExecutor-4676-thread-1) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1803684 INFO (coreLoadExecutor-4676-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=20, maxMergeAtOnceExplicit=46, maxMergedSegmentMB=60.859375, floorSegmentMB=0.861328125, forceMergeDeletesPctAllowed=28.202737596991053, segmentsPerTier=31.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7372125534119868
[junit4] 2> 1803684 INFO (coreLoadExecutor-4676-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@34ddccc9[collection1] main]
[junit4] 2> 1803684 INFO (coreLoadExecutor-4676-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_B80E20719F2ADC89-001/solr-instance-001/collection1/conf
[junit4] 2> 1803685 INFO (coreLoadExecutor-4676-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Replication enabled for following config files: schema.xml
[junit4] 2> 1803685 INFO (coreLoadExecutor-4676-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 1803685 INFO (searcherExecutor-4677-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@34ddccc9[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1803908 INFO (qtp256046693-17882) [ x:collection1] o.a.s.u.DirectUpdateHandler2 [collection1] REMOVING ALL DOCUMENTS FROM INDEX
[junit4] 2> 1803908 INFO (qtp256046693-17882) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{deleteByQuery=*:*} 0 0
[junit4] 2> 1803909 INFO (qtp580693440-17863) [ x:collection1] o.a.s.u.DirectUpdateHandler2 [collection1] REMOVING ALL DOCUMENTS FROM INDEX
[junit4] 2> 1803909 INFO (qtp580693440-17863) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{deleteByQuery=*:*} 0 0
[junit4] 2> 1803910 INFO (qtp580693440-17863) [ x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 1803910 INFO (qtp580693440-17863) [ x:collection1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@4ddd218
[junit4] 2> 1803911 INFO (qtp580693440-17863) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@4b2736c8[collection1] main]
[junit4] 2> 1803911 INFO (qtp580693440-17863) [ x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 1803911 INFO (searcherExecutor-4665-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@4b2736c8[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1803912 INFO (qtp580693440-17863) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 1
[junit4] 2> 1803914 INFO (qtp256046693-17883) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[0]} 0 0
[junit4] 2> 1803916 INFO (qtp256046693-17884) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[1]} 0 0
[junit4] 2> 1803917 INFO (qtp256046693-17885) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[2]} 0 0
[junit4] 2> 1803920 INFO (qtp256046693-17886) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[3]} 0 1
[junit4] 2> 1803922 INFO (qtp256046693-17879) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[4]} 0 0
[junit4] 2> 1803923 INFO (qtp256046693-17882) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[5]} 0 0
[junit4] 2> 1803924 INFO (qtp256046693-17883) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[6]} 0 0
[junit4] 2> 1803926 INFO (qtp256046693-17884) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[7]} 0 0
[junit4] 2> 1803928 INFO (qtp256046693-17885) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[8]} 0 0
[junit4] 2> 1803930 INFO (qtp256046693-17886) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[9]} 0 0
[junit4] 2> 1803931 INFO (qtp256046693-17879) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[10]} 0 0
[junit4] 2> 1803933 INFO (qtp256046693-17882) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[11]} 0 0
[junit4] 2> 1803935 INFO (qtp256046693-17883) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[12]} 0 0
[junit4] 2> 1803936 INFO (qtp256046693-17884) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[13]} 0 0
[junit4] 2> 1803937 INFO (qtp256046693-17885) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[14]} 0 0
[junit4] 2> 1803939 INFO (qtp256046693-17886) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[15]} 0 0
[junit4] 2> 1803941 INFO (qtp256046693-17879) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[16]} 0 0
[junit4] 2> 1803942 INFO (qtp256046693-17882) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[17]} 0 0
[junit4] 2> 1803944 INFO (qtp256046693-17883) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[18]} 0 0
[junit4] 2> 1803999 INFO (qtp256046693-17884) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[19]} 0 53
[junit4] 2> 1804000 INFO (qtp256046693-17885) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[20]} 0 0
[junit4] 2> 1804002 INFO (qtp256046693-17886) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[21]} 0 0
[junit4] 2> 1804003 INFO (qtp256046693-17879) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[22]} 0 0
[junit4] 2> 1804005 INFO (qtp256046693-17882) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[23]} 0 0
[junit4] 2> 1804007 INFO (qtp256046693-17883) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[24]} 0 0
[junit4] 2> 1804008 INFO (qtp256046693-17884) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[25]} 0 0
[junit4] 2> 1804010 INFO (qtp256046693-17885) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[26]} 0 0
[junit4] 2> 1804012 INFO (qtp256046693-17886) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[27]} 0 0
[junit4] 2> 1804014 INFO (qtp256046693-17879) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[28]} 0 0
[junit4] 2> 1804015 INFO (qtp256046693-17879) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[29]} 0 0
[junit4] 2> 1804017 INFO (qtp256046693-17883) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[30]} 0 0
[junit4] 2> 1804019 INFO (qtp256046693-17884) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[31]} 0 0
[junit4] 2> 1804020 INFO (qtp256046693-17885) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[32]} 0 0
[junit4] 2> 1804022 INFO (qtp256046693-17886) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[33]} 0 0
[junit4] 2> 1804023 INFO (qtp256046693-17882) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[34]} 0 0
[junit4] 2> 1804025 INFO (qtp256046693-17882) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[35]} 0 0
[junit4] 2> 1804027 INFO (qtp256046693-17883) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[36]} 0 0
[junit4] 2> 1804028 INFO (qtp256046693-17884) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[37]} 0 0
[junit4] 2> 1804030 INFO (qtp256046693-17884) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[38]} 0 0
[junit4] 2> 1804032 INFO (qtp256046693-17886) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[39]} 0 0
[junit4] 2> 1804033 INFO (qtp256046693-17879) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[40]} 0 0
[junit4] 2> 1804035 INFO (qtp256046693-17882) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[41]} 0 0
[junit4] 2> 1804036 INFO (qtp256046693-17883) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[42]} 0 0
[junit4] 2> 1804040 INFO (qtp256046693-17885) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[43]} 0 1
[junit4] 2> 1804041 INFO (qtp256046693-17884) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[44]} 0 0
[junit4] 2> 1804043 INFO (qtp256046693-17886) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[45]} 0 0
[junit4] 2> 1804044 INFO (qtp256046693-17879) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[46]} 0 0
[junit4] 2> 1804046 INFO (qtp256046693-17882) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[47]} 0 0
[junit4] 2> 1804048 INFO (qtp256046693-17883) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[48]} 0 0
[junit4] 2> 1804049 INFO (qtp256046693-17885) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[49]} 0 0
[junit4] 2> 1804050 INFO (qtp256046693-17885) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[50]} 0 0
[junit4] 2> 1804052 INFO (qtp256046693-17886) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[51]} 0 0
[junit4] 2> 1804054 INFO (qtp256046693-17879) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[52]} 0 0
[junit4] 2> 1804056 INFO (qtp256046693-17882) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[53]} 0 0
[junit4] 2> 1804057 INFO (qtp256046693-17883) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[54]} 0 0
[junit4] 2> 1804060 INFO (qtp256046693-17884) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[55]} 0 1
[junit4] 2> 1804062 INFO (qtp256046693-17885) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[56]} 0 0
[junit4] 2> 1804063 INFO (qtp256046693-17886) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[57]} 0 0
[junit4] 2> 1804064 INFO (qtp256046693-17879) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[58]} 0 0
[junit4] 2> 1804066 INFO (qtp256046693-17882) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[59]} 0 0
[junit4] 2> 1804068 INFO (qtp256046693-17883) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[60]} 0 0
[junit4] 2> 1804069 INFO (qtp256046693-17884) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[61]} 0 0
[junit4] 2> 1804071 INFO (qtp256046693-17885) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[62]} 0 0
[junit4] 2> 1804073 INFO (qtp256046693-17886) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[63]} 0 0
[junit4] 2> 1804074 INFO (qtp256046693-17879) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[64]} 0 0
[junit4] 2> 1804076 INFO (qtp256046693-17882) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[65]} 0 0
[junit4] 2> 1804077 INFO (qtp256046693-17883) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[66]} 0 0
[junit4] 2> 1804079 INFO (qtp256046693-17884) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[67]} 0 0
[junit4] 2> 1804081 INFO (qtp256046693-17885) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[68]} 0 0
[junit4] 2> 1804082 INFO (qtp256046693-17886) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[69]} 0 0
[junit4] 2> 1804084 INFO (qtp256046693-17879) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[70]} 0 0
[junit4] 2> 1804086 INFO (qtp256046693-17882) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[71]} 0 0
[junit4] 2> 1804088 INFO (qtp256046693-17883) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[72]} 0 0
[junit4] 2> 1804089 INFO (qtp256046693-17884) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[73]} 0 0
[junit4] 2> 1804090 INFO (qtp256046693-17885) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[74]} 0 0
[junit4] 2> 1804093 INFO (qtp256046693-17886) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[75]} 0 0
[junit4] 2> 1804094 INFO (qtp256046693-17879) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[76]} 0 0
[junit4] 2> 1804095 INFO (qtp256046693-17882) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[77]} 0 0
[junit4] 2> 1804097 INFO (qtp256046693-17883) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[78]} 0 0
[junit4] 2> 1804099 INFO (qtp256046693-17884) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[79]} 0 1
[junit4] 2> 1804101 INFO (qtp256046693-17885) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[80]} 0 0
[junit4] 2> 1804102 INFO (qtp256046693-17886) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[81]} 0 0
[junit4] 2> 1804104 INFO (qtp256046693-17886) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[82]} 0 0
[junit4] 2> 1804106 INFO (qtp256046693-17886) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[83]} 0 0
[junit4] 2> 1804107 INFO (qtp256046693-17883) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[84]} 0 0
[junit4] 2> 1804109 INFO (qtp256046693-17884) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[85]} 0 0
[junit4] 2> 1804110 INFO (qtp256046693-17885) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[86]} 0 0
[junit4] 2> 1804115 INFO (qtp256046693-17879) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[87]} 0 3
[junit4] 2> 1804117 INFO (qtp256046693-17882) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[88]} 0 0
[junit4] 2> 1804118 INFO (qtp256046693-17886) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[89]} 0 0
[junit4] 2> 1804120 INFO (qtp256046693-17883) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[90]} 0 0
[junit4] 2> 1804122 INFO (qtp256046693-17884) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[91]} 0 0
[junit4] 2> 1804123 INFO (qtp256046693-17885) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[92]} 0 0
[junit4] 2> 1804125 INFO (qtp256046693-17879) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[93]} 0 0
[junit4] 2> 1804126 INFO (qtp256046693-17879) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[94]} 0 0
[junit4] 2> 1804128 INFO (qtp256046693-17886) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[95]} 0 0
[junit4] 2> 1804130 INFO (qtp256046693-17883) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[96]} 0 0
[junit4] 2> 1804131 INFO (qtp256046693-17884) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[97]} 0 0
[junit4] 2> 1804133 INFO (qtp256046693-17885) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[98]} 0 0
[junit4] 2> 1804135 INFO (qtp256046693-17885) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[99]} 0 0
[junit4] 2> 1804136 INFO (qtp256046693-17879) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[100]} 0 0
[junit4] 2> 1804138 INFO (qtp256046693-17886) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[101]} 0 0
[junit4] 2> 1804139 INFO (qtp256046693-17883) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[102]} 0 0
[junit4] 2> 1804141 INFO (qtp256046693-17884) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[103]} 0 0
[junit4] 2> 1804143 INFO (qtp256046693-17882) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[104]} 0 0
[junit4] 2> 1804144 INFO (qtp256046693-17882) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[105]} 0 0
[junit4] 2> 1804145 INFO (qtp256046693-17882) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[106]} 0 0
[junit4] 2> 1804147 INFO (qtp256046693-17886) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[107]} 0 0
[junit4] 2> 1804149 INFO (qtp256046693-17883) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[108]} 0 0
[junit4] 2> 1804150 INFO (qtp256046693-17884) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[109]} 0 0
[junit4] 2> 1804152 INFO (qtp256046693-17885) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[110]} 0 0
[junit4] 2> 1804154 INFO (qtp256046693-17885) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[111]} 0 0
[junit4] 2> 1804155 INFO (qtp256046693-17882) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[112]} 0 0
[junit4] 2> 1804157 INFO (qtp256046693-17886) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[113]} 0 0
[junit4] 2> 1804158 INFO (qtp256046693-17883) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[114]} 0 0
[junit4] 2> 1804160 INFO (qtp256046693-17884) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[115]} 0 0
[junit4] 2> 1804162 INFO (qtp256046693-17879) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[116]} 0 0
[junit4] 2> 1804163 INFO (qtp256046693-17885) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[117]} 0 0
[junit4] 2> 1804165 INFO (qtp256046693-17885) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[118]} 0 0
[junit4] 2> 1804167 INFO (qtp256046693-17886) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[119]} 0 0
[junit4] 2> 1804168 INFO (qtp256046693-17883) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[120]} 0 0
[junit4] 2> 1804170 INFO (qtp256046693-17884) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[121]} 0 0
[junit4] 2> 1804171 INFO (qtp256046693-17879) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[122]} 0 0
[junit4] 2> 1804173 INFO (qtp256046693-17879) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[123]} 0 0
[junit4] 2> 1804175 INFO (qtp256046693-17885) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[124]} 0 0
[junit4] 2> 1804176 INFO (qtp256046693-17886) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[125]} 0 0
[junit4] 2> 1804178 INFO (qtp256046693-17883) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[126]} 0 0
[junit4] 2> 1804180 INFO (qtp256046693-17884) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[127]} 0 0
[junit4] 2> 1804181 INFO (qtp256046693-17882) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[128]} 0 0
[junit4] 2> 1804183 INFO (qtp256046693-17879) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[129]} 0 0
[junit4] 2> 1804184 INFO (qtp256046693-17879) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[130]} 0 0
[junit4] 2> 1804186 INFO (qtp256046693-17886) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[131]} 0 0
[junit4] 2> 1804188 INFO (qtp256046693-17883) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[132]} 0 0
[junit4] 2> 1804189 INFO (qtp256046693-17884) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[133]} 0 0
[junit4] 2> 1804191 INFO (qtp256046693-17882) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[134]} 0 0
[junit4] 2> 1804193 INFO (qtp256046693-17885) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[135]} 0 0
[junit4] 2> 1804195 INFO (qtp256046693-17879) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[136]} 0 0
[junit4] 2> 1804196 INFO (qtp256046693-17886) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[137]} 0 0
[junit4] 2> 1804198 INFO (qtp256046693-17883) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[138]} 0 0
[junit4] 2> 1804200 INFO (qtp256046693-17884) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[139]} 0 0
[junit4] 2> 1804201 INFO (qtp256046693-17882) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[140]} 0 0
[junit4] 2> 1804203 INFO (qtp256046693-17885) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[141]} 0 0
[junit4] 2> 1804204 INFO (qtp256046693-17879) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[142]} 0 0
[junit4] 2> 1804206 INFO (qtp256046693-17886) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[143]} 0 0
[junit4] 2> 1804208 INFO (qtp256046693-17883) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[144]} 0 0
[junit4] 2> 1804209 INFO (qtp256046693-17884) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[145]} 0 0
[junit4] 2> 1804211 INFO (qtp256046693-17884) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[146]} 0 0
[junit4] 2> 1804213 INFO (qtp256046693-17885) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[147]} 0 0
[junit4] 2> 1804214 INFO (qtp256046693-17879) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[148]} 0 0
[junit4] 2> 1804216 INFO (qtp256046693-17886) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[149]} 0 0
[junit4] 2> 1804217 INFO (qtp256046693-17886) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[150]} 0 0
[junit4] 2> 1804219 INFO (qtp256046693-17886) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[151]} 0 0
[junit4] 2> 1804221 INFO (qtp256046693-17884) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[152]} 0 0
[junit4] 2> 1804222 INFO (qtp256046693-17885) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[153]} 0 0
[junit4] 2> 1804223 INFO (qtp256046693-17885) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[154]} 0 0
[junit4] 2> 1804226 INFO (qtp256046693-17883) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[155]} 0 0
[junit4] 2> 1804227 INFO (qtp256046693-17882) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[156]} 0 0
[junit4] 2> 1804229 INFO (qtp256046693-17886) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[157]} 0 0
[junit4] 2> 1804230 INFO (qtp256046693-17884) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[158]} 0 0
[junit4] 2> 1804232 INFO (qtp256046693-17884) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[159]} 0 0
[junit4] 2> 1804234 INFO (qtp256046693-17885) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[160]} 0 0
[junit4] 2> 1804235 INFO (qtp256046693-17883) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[161]} 0 0
[junit4] 2> 1804237 INFO (qtp256046693-17882) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[162]} 0 0
[junit4] 2> 1804239 INFO (qtp256046693-17886) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[163]} 0 0
[junit4] 2> 1804241 INFO (qtp256046693-17879) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[164]} 0 0
[junit4] 2> 1804242 INFO (qtp256046693-17884) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[165]} 0 0
[junit4] 2> 1804244 INFO (qtp256046693-17885) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[166]} 0 0
[junit4] 2> 1804246 INFO (qtp256046693-17883) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[167]} 0 0
[junit4] 2> 1804247 INFO (qtp256046693-17882) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[168]} 0 0
[junit4] 2> 1804249 INFO (qtp256046693-17886) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[169]} 0 0
[junit4] 2> 1804250 INFO (qtp256046693-17886) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[170]} 0 0
[junit4] 2> 1804255 INFO (qtp256046693-17886) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[171]} 0 3
[junit4] 2> 1804257 INFO (qtp256046693-17885) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[172]} 0 0
[junit4] 2> 1804258 INFO (qtp256046693-17883) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[173]} 0 0
[junit4] 2> 1804260 INFO (qtp256046693-17883) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[174]} 0 0
[junit4] 2> 1804262 INFO (qtp256046693-17883) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[175]} 0 0
[junit4] 2> 1804263 INFO (qtp256046693-17884) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[176]} 0 0
[junit4] 2> 1804265 INFO (qtp256046693-17886) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[177]} 0 0
[junit4] 2> 1804266 INFO (qtp256046693-17885) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[178]} 0 0
[junit4] 2> 1804268 INFO (qtp256046693-17882) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[179]} 0 0
[junit4] 2> 1804270 INFO (qtp256046693-17879) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[180]} 0 0
[junit4] 2> 1804271 INFO (qtp256046693-17883) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[181]} 0 0
[junit4] 2> 1804273 INFO (qtp256046693-17883) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[182]} 0 0
[junit4] 2> 1804275 INFO (qtp256046693-17883) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[183]} 0 0
[junit4] 2> 1804276 INFO (qtp256046693-17885) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[184]} 0 0
[junit4] 2> 1804278 INFO (qtp256046693-17882) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[185]} 0 0
[junit4] 2> 1804279 INFO (qtp256046693-17879) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[186]} 0 0
[junit4] 2> 1804281 INFO (qtp256046693-17884) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[187]} 0 0
[junit4] 2> 1804283 INFO (qtp256046693-17886) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[188]} 0 0
[junit4] 2> 1804284 INFO (qtp256046693-17886) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[189]} 0 0
[junit4] 2> 1804286 INFO (qtp256046693-17885) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[190]} 0 0
[junit4] 2> 1804288 INFO (qtp256046693-17882) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[191]} 0 0
[junit4] 2> 1804289 INFO (qtp256046693-17879) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[192]} 0 0
[junit4] 2> 1804291 INFO (qtp256046693-17884) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[193]} 0 0
[junit4] 2> 1804292 INFO (qtp256046693-17884) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[194]} 0 0
[junit4] 2> 1804294 INFO (qtp256046693-17884) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[195]} 0 0
[junit4] 2> 1804296 INFO (qtp256046693-17885) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[196]} 0 0
[junit4] 2> 1804297 INFO (qtp256046693-17882) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[197]} 0 0
[junit4] 2> 1804299 INFO (qtp256046693-17879) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[198]} 0 0
[junit4] 2> 1804301 INFO (qtp256046693-17883) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[199]} 0 0
[junit4] 2> 1804302 INFO (qtp256046693-17886) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[200]} 0 0
[junit4] 2> 1804304 INFO (qtp256046693-17884) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[201]} 0 0
[junit4] 2> 1804305 INFO (qtp256046693-17885) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[202]} 0 0
[junit4] 2> 1804307 INFO (qtp256046693-17882) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[203]} 0 0
[junit4] 2> 1804309 INFO (qtp256046693-17879) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[204]} 0 0
[junit4] 2> 1804310 INFO (qtp256046693-17883) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[205]} 0 0
[junit4] 2> 1804312 INFO (qtp256046693-17883) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[206]} 0 0
[junit4] 2> 1804314 INFO (qtp256046693-17883) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[207]} 0 0
[junit4] 2> 1804315 INFO (qtp256046693-17885) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[208]} 0 0
[junit4] 2> 1804317 INFO (qtp256046693-17882) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[209]} 0 0
[junit4] 2> 1804318 INFO (qtp256046693-17879) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[210]} 0 0
[junit4] 2> 1804320 INFO (qtp256046693-17886) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[211]} 0 0
[junit4] 2> 1804322 INFO (qtp256046693-17884) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[212]} 0 0
[junit4] 2> 1804323 INFO (qtp256046693-17883) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[213]} 0 0
[junit4] 2> 1804325 INFO (qtp256046693-17885) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[214]} 0 0
[junit4] 2> 1804327 INFO (qtp256046693-17882) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[215]} 0 0
[junit4] 2> 1804328 INFO (qtp256046693-17879) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[216]} 0 0
[junit4] 2> 1804330 INFO (qtp256046693-17886) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[217]} 0 0
[junit4] 2> 1804331 INFO (qtp256046693-17884) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[218]} 0 0
[junit4] 2> 1804336 INFO (qtp256046693-17883) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[219]} 0 3
[junit4] 2> 1804338 INFO (qtp256046693-17885) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabi
[...truncated too long message...]
] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stop(MetricsSourceAdapter.java:211)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stopSources(MetricsSystemImpl.java:463)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stop(MetricsSystemImpl.java:213)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.shutdown(MetricsSystemImpl.java:594)
[junit4] 2> at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdownInstance(DefaultMetricsSystem.java:72)
[junit4] 2> at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdown(DefaultMetricsSystem.java:68)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.metrics.NameNodeMetrics.shutdown(NameNodeMetrics.java:171)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.NameNode.stop(NameNode.java:872)
[junit4] 2> at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1726)
[junit4] 2> at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1705)
[junit4] 2> at org.apache.solr.cloud.hdfs.HdfsTestUtil.teardownClass(HdfsTestUtil.java:198)
[junit4] 2> at org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest.teardownClass(HdfsWriteToMultipleCollectionsTest.java:73)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:498)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:870)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> Caused by: java.lang.NullPointerException
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlocksMap.size(BlocksMap.java:203)
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.getTotalBlocks(BlockManager.java:3370)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlocksTotal(FSNamesystem.java:5729)
[junit4] 2> ... 53 more
[junit4] 2> 3924881 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[B80E20719F2ADC89]-worker) [ ] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_B80E20719F2ADC89-001
[junit4] 2> Feb 18, 2017 2:36:14 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 34 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene62): {rnd_b=PostingsFormat(name=Asserting), _version_=FSTOrd50, a_t=PostingsFormat(name=Direct), a_i=PostingsFormat(name=Asserting), id=PostingsFormat(name=Asserting)}, docValues:{}, maxPointsInLeafNode=429, maxMBSortInHeap=6.658212259845719, sim=RandomSimilarity(queryNorm=true,coord=yes): {}, locale=es-PE, timezone=Europe/Warsaw
[junit4] 2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_121 (64-bit)/cpus=4,threads=2,free=261480584,total=535298048
[junit4] 2> NOTE: All tests run in this JVM: [TestDynamicFieldCollectionResource, TestHighlightDedupGrouping, ChaosMonkeyNothingIsSafeTest, TestAuthenticationFramework, SharedFSAutoReplicaFailoverTest, FastVectorHighlighterTest, TestRandomFaceting, TestBinaryResponseWriter, TestComplexPhraseQParserPlugin, XsltUpdateRequestHandlerTest, DistributedExpandComponentTest, TestScoreJoinQPScore, CursorPagingTest, TestNoOpRegenerator, HdfsLockFactoryTest, TestDocumentBuilder, JsonValidatorTest, AnalysisAfterCoreReloadTest, TestJmxIntegration, StatsReloadRaceTest, TestManagedSynonymFilterFactory, TestAnalyzeInfixSuggestions, SignatureUpdateProcessorFactoryTest, TestNonDefinedSimilarityFactory, TestSQLHandlerNonCloud, TestFieldResource, TestStressRecovery, TestMiniSolrCloudClusterSSL, TestReloadAndDeleteDocs, HLLUtilTest, TestFreeTextSuggestions, CoreAdminRequestStatusTest, TestSolrQueryParserResource, TestSolrCloudWithDelegationTokens, TestSolrCLIRunExample, TestRandomDVFaceting, TestStressUserVersions, TestLeaderElectionZkExpiry, BasicAuthIntegrationTest, TestSolrCoreProperties, TestFieldCacheReopen, TestDistributedSearch, ExitableDirectoryReaderTest, BigEndianAscendingWordDeserializerTest, BasicZkTest, CleanupOldIndexTest, TestSchemaNameResource, SolrSlf4jReporterTest, ClassificationUpdateProcessorTest, TestMinMaxOnMultiValuedField, RulesTest, TestCodecSupport, TestMacros, RegexBoostProcessorTest, RecoveryAfterSoftCommitTest, SolrCoreTest, SpatialRPTFieldTypeTest, SolrCLIZkUtilsTest, TestSubQueryTransformerCrossCore, TestPKIAuthenticationPlugin, TestHdfsUpdateLog, VMParamsZkACLAndCredentialsProvidersTest, AnalyticsQueryTest, AtomicUpdatesTest, ZkStateWriterTest, NotRequiredUniqueKeyTest, TestDocSet, TestLegacyFieldCache, BJQParserTest, TestRangeQuery, TestManagedResourceStorage, TestCSVLoader, TestPushWriter, LeaderElectionIntegrationTest, DistributedFacetPivotLongTailTest, TestIBSimilarityFactory, TestSchemaVersionResource, DateFieldTest, TestPointFields, TestConfigSetsAPIExclusivity, TestRandomRequestDistribution, TestAtomicUpdateErrorCases, SuggestComponentContextFilterQueryTest, TestBackupRepositoryFactory, DefaultValueUpdateProcessorTest, TestUninvertingReader, PathHierarchyTokenizerFactoryTest, BlockDirectoryTest, TestExclusionRuleCollectionAccess, TestClusterProperties, PeerSyncTest, JavabinLoaderTest, TestFoldingMultitermQuery, SolrMetricManagerTest, UniqFieldsUpdateProcessorFactoryTest, TestSolrDeletionPolicy2, TestPerFieldSimilarity, HdfsChaosMonkeyNothingIsSafeTest, StandardRequestHandlerTest, TestRemoteStreaming, SSLMigrationTest, MultiThreadedOCPTest, TestCustomStream, HighlighterConfigTest, AlternateDirectoryTest, TestConfigsApi, BasicDistributedZkTest, SyncSliceTest, OverseerTest, ZkCLITest, ShardRoutingCustomTest, TestFaceting, TestRecovery, TestHashPartitioner, ZkControllerTest, TestRealTimeGet, TestStressReorder, TestStressVersions, HardAutoCommitTest, TestSolr4Spatial, TestGroupingSearch, TestFiltering, TestBadConfig, HighlighterTest, SoftAutoCommitTest, TestStressLucene, SpatialFilterTest, PolyFieldTest, WordBreakSolrSpellCheckerTest, TestPseudoReturnFields, TestWordDelimiterFilterFactory, QueryEqualityTest, SortByFunctionTest, DistanceFunctionTest, TestSolrDeletionPolicy1, CacheHeaderTest, TestSurroundQueryParser, LukeRequestHandlerTest, TestQueryUtils, PrimitiveFieldTypeTest, TestOmitPositions, TermsComponentTest, RequestHandlersTest, TestValueSourceCache, RequiredFieldsTest, TestSolrQueryParser, TestCollationField, ReturnFieldsTest, JSONWriterTest, MBeansHandlerTest, JsonLoaderTest, TestPHPSerializedResponseWriter, TestComponentsName, SearchHandlerTest, SOLR749Test, TestQuerySenderListener, TestQuerySenderNoQuery, SolrIndexConfigTest, TestBinaryField, NumericFieldsTest, OutputWriterTest, ExternalFileFieldSortTest, TestPostingsSolrHighlighter, TestLuceneMatchVersion, SynonymTokenizerTest, TestSweetSpotSimilarityFactory, TestLMDirichletSimilarityFactory, TestFastWriter, TimeZoneUtilsTest, ResourceLoaderTest, ScriptEngineTest, OpenExchangeRatesOrgProviderTest, PluginInfoTest, TestFastLRUCache, DateMathParserTest, DOMUtilTest, ClusterStateTest, ZkNodePropsTest, UUIDFieldTest, FileUtilsTest, DistributedMLTComponentTest, TestRTGBase, DistributedIntervalFacetingTest, TestSimpleTrackingShardHandler, TestTolerantSearch, TestPathTrie, TestEmbeddedSolrServerConstructors, ConnectionReuseTest, CdcrReplicationDistributedZkTest, HdfsRestartWhileUpdatingTest, HdfsWriteToMultipleCollectionsTest]
[junit4] Completed [539/692 (2!)] on J0 in 64.56s, 1 test, 1 failure <<< FAILURES!
[...truncated 63123 lines...]
[JENKINS] Lucene-Solr-NightlyTests-6.x - Build # 286 - Failure
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.x/286/
7 tests failed.
FAILED: org.apache.lucene.index.TestIndexSorting.testRandom3
Error Message:
Java heap space
Stack Trace:
java.lang.OutOfMemoryError: Java heap space
at __randomizedtesting.SeedInfo.seed([EC890CB51E00F414:4E51426F7AF2DD12]:0)
at org.apache.lucene.util.packed.Packed64.<init>(Packed64.java:73)
at org.apache.lucene.util.packed.PackedInts.getMutable(PackedInts.java:972)
at org.apache.lucene.util.packed.PackedInts.getMutable(PackedInts.java:939)
at org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWriter.java:80)
at org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:88)
at org.apache.lucene.util.packed.AbstractPagedMutable.set(AbstractPagedMutable.java:98)
at org.apache.lucene.util.fst.NodeHash.addNew(NodeHash.java:152)
at org.apache.lucene.util.fst.NodeHash.rehash(NodeHash.java:169)
at org.apache.lucene.util.fst.NodeHash.add(NodeHash.java:133)
at org.apache.lucene.util.fst.Builder.compileNode(Builder.java:214)
at org.apache.lucene.util.fst.Builder.freezeTail(Builder.java:310)
at org.apache.lucene.util.fst.Builder.add(Builder.java:414)
at org.apache.lucene.codecs.memory.MemoryDocValuesConsumer.writeFST(MemoryDocValuesConsumer.java:367)
at org.apache.lucene.codecs.memory.MemoryDocValuesConsumer.addSortedField(MemoryDocValuesConsumer.java:404)
at org.apache.lucene.codecs.perfield.PerFieldDocValuesFormat$FieldsWriter.addSortedField(PerFieldDocValuesFormat.java:121)
at org.apache.lucene.index.SortedDocValuesWriter.flush(SortedDocValuesWriter.java:130)
at org.apache.lucene.index.DefaultIndexingChain.writeDocValues(DefaultIndexingChain.java:258)
at org.apache.lucene.index.DefaultIndexingChain.flush(DefaultIndexingChain.java:142)
at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:444)
at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:539)
at org.apache.lucene.index.DocumentsWriter.postUpdate(DocumentsWriter.java:396)
at org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:499)
at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1579)
at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1324)
at org.apache.lucene.index.TestIndexSorting.testRandom3(TestIndexSorting.java:2230)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
FAILED: org.apache.lucene.search.TestFuzzyQuery.testRandom
Error Message:
Test abandoned because suite timeout was reached.
Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
at __randomizedtesting.SeedInfo.seed([EC890CB51E00F414]:0)
FAILED: junit.framework.TestSuite.org.apache.lucene.search.TestFuzzyQuery
Error Message:
Suite timeout exceeded (>= 7200000 msec).
Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
at __randomizedtesting.SeedInfo.seed([EC890CB51E00F414]:0)
FAILED: org.apache.solr.cloud.hdfs.StressHdfsTest.test
Error Message:
Timeout occured while waiting response from server at: http://127.0.0.1:45628
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:45628
at __randomizedtesting.SeedInfo.seed([C98063D373201AE6:41D45C09DDDC771E]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:621)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:279)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:268)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:435)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:387)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1358)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:1109)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:1042)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
at org.apache.solr.cloud.hdfs.StressHdfsTest.createAndDeleteCollection(StressHdfsTest.java:220)
at org.apache.solr.cloud.hdfs.StressHdfsTest.test(StressHdfsTest.java:103)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:171)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:515)
... 51 more
FAILED: org.apache.solr.search.TestRecoveryHdfs.testTruncatedLog
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([C98063D373201AE6:ADBA9BAB7A196795]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertTrue(Assert.java:54)
at org.apache.solr.search.TestRecoveryHdfs.testTruncatedLog(TestRecoveryHdfs.java:849)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.search.TestRecoveryHdfs.testRemoveOldLogs
Error Message:
org.apache.solr.common.SolrException: SolrCore 'collection1' is not available due to init failure: Error opening new searcher
Stack Trace:
java.lang.RuntimeException: org.apache.solr.common.SolrException: SolrCore 'collection1' is not available due to init failure: Error opening new searcher
at __randomizedtesting.SeedInfo.seed([C98063D373201AE6:E81CA278BB1A931E]:0)
at org.apache.solr.SolrTestCaseJ4.clearIndex(SolrTestCaseJ4.java:1267)
at org.apache.solr.search.TestRecoveryHdfs.testRemoveOldLogs(TestRecoveryHdfs.java:716)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.solr.common.SolrException: SolrCore 'collection1' is not available due to init failure: Error opening new searcher
at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:1255)
at org.apache.solr.util.TestHarness.getCore(TestHarness.java:244)
at org.apache.solr.SolrTestCaseJ4.updateJ(SolrTestCaseJ4.java:1273)
at org.apache.solr.SolrTestCaseJ4.deleteByQueryAndGetVersion(SolrTestCaseJ4.java:1460)
at org.apache.solr.SolrTestCaseJ4.clearIndex(SolrTestCaseJ4.java:1264)
... 40 more
Caused by: org.apache.solr.common.SolrException: Error opening new searcher
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:947)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:811)
at org.apache.solr.core.CoreContainer.create(CoreContainer.java:904)
at org.apache.solr.core.CoreContainer.lambda$load$3(CoreContainer.java:555)
at com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:197)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
... 1 more
Caused by: org.apache.solr.common.SolrException: Error opening new searcher
at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:1985)
at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:2105)
at org.apache.solr.core.SolrCore.initSearcher(SolrCore.java:1036)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:920)
... 9 more
Caused by: java.lang.RuntimeException: The max direct memory is likely too low. Either increase it (by adding -XX:MaxDirectMemorySize=<size>g -XX:+UseLargePages to your containers startup args) or disable direct allocation using solr.hdfs.blockcache.direct.memory.allocation=false in solrconfig.xml. If you are putting the block cache on the heap, your java heap size might not be large enough. Failed allocating ~8.388608 MB.
at org.apache.solr.core.HdfsDirectoryFactory.createBlockCache(HdfsDirectoryFactory.java:310)
at org.apache.solr.core.HdfsDirectoryFactory.getBlockDirectoryCache(HdfsDirectoryFactory.java:286)
at org.apache.solr.core.HdfsDirectoryFactory.create(HdfsDirectoryFactory.java:226)
at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:346)
at org.apache.solr.core.MetricsDirectoryFactory.get(MetricsDirectoryFactory.java:214)
at org.apache.solr.update.SolrIndexWriter.create(SolrIndexWriter.java:98)
at org.apache.solr.update.DefaultSolrCoreState.createMainIndexWriter(DefaultSolrCoreState.java:240)
at org.apache.solr.update.DefaultSolrCoreState.getIndexWriter(DefaultSolrCoreState.java:114)
at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:1946)
... 12 more
Caused by: java.lang.OutOfMemoryError: Direct buffer memory
at java.nio.Bits.reserveMemory(Bits.java:693)
at java.nio.DirectByteBuffer.<init>(DirectByteBuffer.java:123)
at java.nio.ByteBuffer.allocateDirect(ByteBuffer.java:311)
at org.apache.solr.store.blockcache.BlockCache.<init>(BlockCache.java:70)
at org.apache.solr.core.HdfsDirectoryFactory.createBlockCache(HdfsDirectoryFactory.java:308)
... 20 more
FAILED: org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest.test
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([C98063D373201AE6:41D45C09DDDC771E]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertTrue(Assert.java:54)
at org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest.test(HdfsWriteToMultipleCollectionsTest.java:137)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 1419 lines...]
[junit4] Suite: org.apache.lucene.index.TestIndexSorting
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestIndexSorting -Dtests.method=testRandom3 -Dtests.seed=EC890CB51E00F414 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/test-data/enwiki.random.lines.txt -Dtests.locale=de-LU -Dtests.timezone=America/Santiago -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[junit4] ERROR 163s J2 | TestIndexSorting.testRandom3 <<<
[junit4] > Throwable #1: java.lang.OutOfMemoryError: Java heap space
[junit4] > at __randomizedtesting.SeedInfo.seed([EC890CB51E00F414:4E51426F7AF2DD12]:0)
[junit4] > at org.apache.lucene.util.packed.Packed64.<init>(Packed64.java:73)
[junit4] > at org.apache.lucene.util.packed.PackedInts.getMutable(PackedInts.java:972)
[junit4] > at org.apache.lucene.util.packed.PackedInts.getMutable(PackedInts.java:939)
[junit4] > at org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWriter.java:80)
[junit4] > at org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:88)
[junit4] > at org.apache.lucene.util.packed.AbstractPagedMutable.set(AbstractPagedMutable.java:98)
[junit4] > at org.apache.lucene.util.fst.NodeHash.addNew(NodeHash.java:152)
[junit4] > at org.apache.lucene.util.fst.NodeHash.rehash(NodeHash.java:169)
[junit4] > at org.apache.lucene.util.fst.NodeHash.add(NodeHash.java:133)
[junit4] > at org.apache.lucene.util.fst.Builder.compileNode(Builder.java:214)
[junit4] > at org.apache.lucene.util.fst.Builder.freezeTail(Builder.java:310)
[junit4] > at org.apache.lucene.util.fst.Builder.add(Builder.java:414)
[junit4] > at org.apache.lucene.codecs.memory.MemoryDocValuesConsumer.writeFST(MemoryDocValuesConsumer.java:367)
[junit4] > at org.apache.lucene.codecs.memory.MemoryDocValuesConsumer.addSortedField(MemoryDocValuesConsumer.java:404)
[junit4] > at org.apache.lucene.codecs.perfield.PerFieldDocValuesFormat$FieldsWriter.addSortedField(PerFieldDocValuesFormat.java:121)
[junit4] > at org.apache.lucene.index.SortedDocValuesWriter.flush(SortedDocValuesWriter.java:130)
[junit4] > at org.apache.lucene.index.DefaultIndexingChain.writeDocValues(DefaultIndexingChain.java:258)
[junit4] > at org.apache.lucene.index.DefaultIndexingChain.flush(DefaultIndexingChain.java:142)
[junit4] > at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:444)
[junit4] > at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:539)
[junit4] > at org.apache.lucene.index.DocumentsWriter.postUpdate(DocumentsWriter.java:396)
[junit4] > at org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:499)
[junit4] > at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1579)
[junit4] > at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1324)
[junit4] > at org.apache.lucene.index.TestIndexSorting.testRandom3(TestIndexSorting.java:2230)
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/lucene/build/core/test/J2/temp/lucene.index.TestIndexSorting_EC890CB51E00F414-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene62): {docs=PostingsFormat(name=LuceneVarGapDocFreqInterval), norms=PostingsFormat(name=LuceneVarGapDocFreqInterval), positions=BlockTreeOrds(blocksize=128), id=PostingsFormat(name=LuceneVarGapDocFreqInterval), term_vectors=PostingsFormat(name=LuceneVarGapDocFreqInterval)}, docValues:{multi_valued_long=DocValuesFormat(name=Direct), double=DocValuesFormat(name=Memory), foo=DocValuesFormat(name=Direct), numeric=DocValuesFormat(name=Memory), positions=DocValuesFormat(name=Direct), multi_valued_numeric=DocValuesFormat(name=Memory), float=DocValuesFormat(name=Asserting), int=DocValuesFormat(name=Memory), long=DocValuesFormat(name=Asserting), points=DocValuesFormat(name=Lucene54), sorted=DocValuesFormat(name=Memory), bar=DocValuesFormat(name=Memory), multi_valued_double=DocValuesFormat(name=Memory), docs=DocValuesFormat(name=Memory), multi_valued_string=DocValuesFormat(name=Memory), norms=DocValuesFormat(name=Memory), bytes=DocValuesFormat(name=Memory), binary=DocValuesFormat(name=Memory), id=DocValuesFormat(name=Memory), multi_valued_int=DocValuesFormat(name=Lucene54), multi_valued_bytes=DocValuesFormat(name=Memory), multi_valued_float=DocValuesFormat(name=Direct), term_vectors=DocValuesFormat(name=Memory)}, maxPointsInLeafNode=230, maxMBSortInHeap=7.490773914337661, sim=RandomSimilarity(queryNorm=true,coord=no): {positions=DFR I(n)L1, id=DFR I(F)L2, term_vectors=DFR I(n)BZ(0.3)}, locale=de-LU, timezone=America/Santiago
[junit4] 2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_121 (64-bit)/cpus=4,threads=1,free=350343920,total=427819008
[junit4] 2> NOTE: All tests run in this JVM: [TestPayloads, TestFilterCodecReader, TestPhraseQuery, TestDocIdsWriter, TestRateLimiter, TestAtomicUpdate, TestBufferedChecksum, TestCharacterUtils, TestPayloadsOnVectors, TestTimSorter, TestSetOnce, TestDocsAndPositions, TermInSetQueryTest, TestBufferedIndexInput, TestBoolean2ScorerSupplier, TestPointQueries, TestBytesRefArray, TestBytesStore, TestSegmentTermDocs, TestFilterWeight, TestBooleanScorer, TestIndexSearcher, TestIndexWriterFromReader, TestSameTokenSamePosition, TestBM25Similarity, TestBinaryDocValuesUpdates, Test2BPostingsBytes, TestDocument, TestForUtil, TestMultiFields, TestPrefixInBooleanQuery, TestSnapshotDeletionPolicy, TestTopDocsMerge, TestCrash, TestBoostQuery, TestIntroSorter, MultiCollectorTest, TestPrefixRandom, TestSearcherManager, TestSimilarity, TestBooleanQuery, TestLucene62SegmentInfoFormat, TestTermVectorsWriter, TestIndexWriterOutOfFileDescriptors, TestRegExp, TestBlockPostingsFormat, TestShardSearching, TestWeakIdentityMap, TestMSBRadixSorter, TestSpanOrQuery, TestMatchAllDocsQuery, TestToken, TestDocInverterPerFieldErrorInfo, TestCodecs, TestTermQuery, TestSmallFloat, TestAssertions, LimitedFiniteStringsIteratorTest, TestDeterminizeLexicon, TestRecyclingIntBlockAllocator, TestQueryBuilder, TestDisjunctionMaxQuery, TestMaxPosition, TestComplexExplanations, TestLucene53NormsFormat, TestTermdocPerf, TestByteArrayDataInput, TestSegmentTermEnum, TestScorerPerf, TestScoreCachingWrappingScorer, TestUTF32ToUTF8, TestSparseFixedBitSet, TestNotDocIdSet, TestGeoUtils, TestNumericRangeQuery32, TestIndexWriter, TestIndexWriterReader, TestIndexWriterMerging, TestFSTs, TestNumericRangeQuery64, TestIndexWriterWithThreads, TestGraphTokenizers, TestAddIndexes, TestIndexWriterExceptions, TestBasics, TestFlushByRamOrCountsPolicy, TestSloppyPhraseQuery, TestIndexWriterDelete, TestStandardAnalyzer, TestHighCompressionMode, TestNeverDelete, TestStressIndexing, TestMinimize, TestIndexWriterUnicode, TestLevenshteinAutomata, TestConsistentFieldNumbers, TestSimpleExplanations, TestFixedBitSet, TestPagedBytes, TestPerFieldPostingsFormat2, TestFieldsReader, TestSimpleSearchEquivalence, TestBooleanMinShouldMatch, TestMixedCodecs, TestLazyProxSkipping, TestOmitPositions, TestIndexInput, TestSloppyPhraseQuery2, TestSimilarity2, TestFieldMaskingSpanQuery, TestExternalCodecs, TestSimpleExplanationsOfNonMatches, TestRegexpQuery, TestPerSegmentDeletes, TestIntBlockPool, TestTopDocsCollector, TestComplexExplanationsOfNonMatches, TestUnicodeUtil, TestPrefixCodedTerms, TestAllFilesHaveCodecHeader, TestParallelReaderEmptyIndex, TestMaxTermFrequency, TestTermScorer, TestTopFieldCollector, TestFileSwitchDirectory, TestIndexableField, TestSentinelIntSet, TestWildcardRandom, TestMultiLevelSkipList, TestSpanMultiTermQueryWrapper, TestBooleanQueryVisitSubscorers, TestCompiledAutomaton, TestConstantScoreQuery, TestParallelTermEnum, TestElevationComparator, TestSubScorerFreqs, TestPositionIncrement, TestDateSort, TestSpanExplanationsOfNonMatches, TestVirtualMethod, TestRollingBuffer, TestSimilarityProvider, TestNumericTokenStream, TestFilterLeafReader, TestSearch, TestCachingTokenFilter, TestCharsRef, TestPriorityQueue, Test2BPostings, TestExceedMaxTermLength, TestExitableDirectoryReader, TestFilterDirectoryReader, TestIndexReaderClose, TestIndexSorting]
[junit4] Completed [353/452 (1!)] on J2 in 201.46s, 48 tests, 1 error <<< FAILURES!
[...truncated 206 lines...]
[junit4] JVM J2: stdout was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/lucene/build/core/test/temp/junit4-J2-20170217_150140_1174814549075487237335.sysout
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] java.lang.OutOfMemoryError: Java heap space
[junit4] Dumping heap to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/heapdumps/java_pid29287.hprof ...
[junit4] Heap dump file created [462488251 bytes in 1.694 secs]
[junit4] <<< JVM J2: EOF ----
[...truncated 83 lines...]
[junit4] Suite: org.apache.lucene.search.TestFuzzyQuery
[junit4] 2> feb 17, 2017 2:18:36 PM com.carrotsearch.randomizedtesting.ThreadLeakControl$2 evaluate
[junit4] 2> WARNING: Suite execution timed out: org.apache.lucene.search.TestFuzzyQuery
[junit4] 2> 1) Thread[id=3965, name=SUITE-TestFuzzyQuery-seed#[EC890CB51E00F414], state=RUNNABLE, group=TGRP-TestFuzzyQuery]
[junit4] 2> at java.lang.Thread.getStackTrace(Thread.java:1556)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$4.run(ThreadLeakControl.java:696)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$4.run(ThreadLeakControl.java:693)
[junit4] 2> at java.security.AccessController.doPrivileged(Native Method)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.getStackTrace(ThreadLeakControl.java:693)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.getThreadsWithTraces(ThreadLeakControl.java:709)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.formatThreadStacksFull(ThreadLeakControl.java:689)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.access$1000(ThreadLeakControl.java:65)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$2.evaluate(ThreadLeakControl.java:415)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:678)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.access$200(RandomizedRunner.java:140)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:598)
[junit4] 2> 2) Thread[id=3966, name=TEST-TestFuzzyQuery.testRandom-seed#[EC890CB51E00F414], state=RUNNABLE, group=TGRP-TestFuzzyQuery]
[junit4] 2> at java.lang.Object.hashCode(Native Method)
[junit4] 2> at java.util.WeakHashMap.hash(WeakHashMap.java:298)
[junit4] 2> at java.util.WeakHashMap.getEntry(WeakHashMap.java:426)
[junit4] 2> at java.util.WeakHashMap.containsKey(WeakHashMap.java:417)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedContext.context(RandomizedContext.java:258)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedContext.current(RandomizedContext.java:134)
[junit4] 2> at org.apache.lucene.util.LuceneTestCase.random(LuceneTestCase.java:747)
[junit4] 2> at org.apache.lucene.search.TestFuzzyQuery.randomSimpleString(TestFuzzyQuery.java:506)
[junit4] 2> at org.apache.lucene.search.TestFuzzyQuery.testRandom(TestFuzzyQuery.java:517)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:498)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
[junit4] 2> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 3) Thread[id=9, name=JUnit4-serializer-daemon, state=TIMED_WAITING, group=main]
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at com.carrotsearch.ant.tasks.junit4.events.Serializer$1.run(Serializer.java:50)
[junit4] 2> 4) Thread[id=1, name=main, state=WAITING, group=main]
[junit4] 2> at java.lang.Object.wait(Native Method)
[junit4] 2> at java.lang.Thread.join(Thread.java:1249)
[junit4] 2> at java.lang.Thread.join(Thread.java:1323)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:608)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.run(RandomizedRunner.java:457)
[junit4] 2> at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.execute(SlaveMain.java:244)
[junit4] 2> at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.main(SlaveMain.java:355)
[junit4] 2> at com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe.main(SlaveMainSafe.java:13)
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestFuzzyQuery -Dtests.method=testRandom -Dtests.seed=EC890CB51E00F414 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/test-data/enwiki.random.lines.txt -Dtests.locale=es-NI -Dtests.timezone=America/Godthab -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[junit4] ERROR 7200s J0 | TestFuzzyQuery.testRandom <<<
[junit4] > Throwable #1: java.lang.Exception: Test abandoned because suite timeout was reached.
[junit4] > at __randomizedtesting.SeedInfo.seed([EC890CB51E00F414]:0)
[junit4] 2> feb 17, 2017 2:18:36 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> feb 17, 2017 2:18:56 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> SEVERE: 1 thread leaked from SUITE scope at org.apache.lucene.search.TestFuzzyQuery:
[junit4] 2> 1) Thread[id=3966, name=TEST-TestFuzzyQuery.testRandom-seed#[EC890CB51E00F414], state=RUNNABLE, group=TGRP-TestFuzzyQuery]
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedContext.getRandomness(RandomizedContext.java:92)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedContext.getRandom(RandomizedContext.java:114)
[junit4] 2> at org.apache.lucene.util.LuceneTestCase.random(LuceneTestCase.java:747)
[junit4] 2> at org.apache.lucene.search.TestFuzzyQuery.randomSimpleString(TestFuzzyQuery.java:506)
[junit4] 2> at org.apache.lucene.search.TestFuzzyQuery.testRandom(TestFuzzyQuery.java:517)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:498)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
[junit4] 2> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> feb 17, 2017 2:18:56 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> INFO: Starting to interrupt leaked threads:
[junit4] 2> 1) Thread[id=3966, name=TEST-TestFuzzyQuery.testRandom-seed#[EC890CB51E00F414], state=RUNNABLE, group=TGRP-TestFuzzyQuery]
[junit4] 2> feb 17, 2017 2:18:59 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> SEVERE: There are still zombie threads that couldn't be terminated:
[junit4] 2> 1) Thread[id=3966, name=TEST-TestFuzzyQuery.testRandom-seed#[EC890CB51E00F414], state=RUNNABLE, group=TGRP-TestFuzzyQuery]
[junit4] 2> at java.lang.Object.hashCode(Native Method)
[junit4] 2> at java.util.WeakHashMap.hash(WeakHashMap.java:298)
[junit4] 2> at java.util.WeakHashMap.getEntry(WeakHashMap.java:426)
[junit4] 2> at java.util.WeakHashMap.containsKey(WeakHashMap.java:417)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedContext.context(RandomizedContext.java:258)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedContext.current(RandomizedContext.java:134)
[junit4] 2> at org.apache.lucene.util.LuceneTestCase.random(LuceneTestCase.java:747)
[junit4] 2> at org.apache.lucene.search.TestFuzzyQuery.randomSimpleString(TestFuzzyQuery.java:503)
[junit4] 2> at org.apache.lucene.search.TestFuzzyQuery.testRandom(TestFuzzyQuery.java:517)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:498)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
[junit4] 2> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene62): {field=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128)))}, docValues:{}, maxPointsInLeafNode=129, maxMBSortInHeap=7.718645511259313, sim=RandomSimilarity(queryNorm=true,coord=crazy): {field=DFR I(ne)3(800.0)}, locale=es-NI, timezone=America/Godthab
[junit4] 2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_121 (64-bit)/cpus=4,threads=2,free=123385464,total=203948032
[junit4] 2> NOTE: All tests run in this JVM: [Test2BSortedDocValuesFixedSorted, TestField, TestReaderWrapperDVTypeCheck, TestMultiset, TestRegexpRandom2, TestWordlistLoader, TestMultiValuedNumericRangeQuery, TestTermsEnum2, TestSortedSetSortField, TestQueryRescorer, TestNRTThreads, TestUniqueTermCount, TestNumericUtils, TestDocValues, TestStringHelper, TestMergePolicyWrapper, TestSort, TestTieredMergePolicy, TestStressDeletes, TestSearchForDuplicates, TestSpanFirstQuery, TestFastCompressionMode, TestDeletionPolicy, TestNot, TestNoMergeScheduler, Test2BPositions, TestDirectMonotonic, TestMultiTermsEnum, TestBagOfPositions, TestMathUtil, TestLogMergePolicy, TestCustomNorms, TestLucene54DocValuesFormat, TestUsageTrackingFilterCachingPolicy, TestThreadedForceMerge, TestBagOfPostings, TestCrashCausesCorruptIndex, TestTimeLimitingCollector, TestFuzzyQuery]
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestFuzzyQuery -Dtests.seed=EC890CB51E00F414 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/test-data/enwiki.random.lines.txt -Dtests.locale=es-NI -Dtests.timezone=America/Godthab -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[junit4] ERROR 0.00s J0 | TestFuzzyQuery (suite) <<<
[junit4] > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
[junit4] > at __randomizedtesting.SeedInfo.seed([EC890CB51E00F414]:0)
[junit4] Completed [416/452 (2!)] on J0 in 7223.16s, 3 tests, 2 errors <<< FAILURES!
[...truncated 9863 lines...]
[junit4] Suite: org.apache.solr.cloud.hdfs.StressHdfsTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_C98063D373201AE6-001/init-core-data-001
[junit4] 2> 15385 INFO (SUITE-StressHdfsTest-seed#[C98063D373201AE6]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields
[junit4] 2> 15387 INFO (SUITE-StressHdfsTest-seed#[C98063D373201AE6]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
[junit4] 2> 15387 INFO (SUITE-StressHdfsTest-seed#[C98063D373201AE6]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
[junit4] 2> 17056 WARN (SUITE-StressHdfsTest-seed#[C98063D373201AE6]-worker) [ ] o.a.h.u.NativeCodeLoader Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
[junit4] 1> Formatting using clusterid: testClusterID
[junit4] 2> 18633 WARN (SUITE-StressHdfsTest-seed#[C98063D373201AE6]-worker) [ ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
[junit4] 2> 19066 INFO (SUITE-StressHdfsTest-seed#[C98063D373201AE6]-worker) [ ] o.m.log Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
[junit4] 2> 19100 WARN (SUITE-StressHdfsTest-seed#[C98063D373201AE6]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 19275 INFO (SUITE-StressHdfsTest-seed#[C98063D373201AE6]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 19340 INFO (SUITE-StressHdfsTest-seed#[C98063D373201AE6]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.2-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_35384_hdfs____.wkvvrd/webapp
[junit4] 2> 20293 INFO (SUITE-StressHdfsTest-seed#[C98063D373201AE6]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35384
[junit4] 2> 20965 WARN (SUITE-StressHdfsTest-seed#[C98063D373201AE6]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 20969 INFO (SUITE-StressHdfsTest-seed#[C98063D373201AE6]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 20982 INFO (SUITE-StressHdfsTest-seed#[C98063D373201AE6]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.2-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_40615_datanode____.by9um3/webapp
[junit4] 2> 21350 INFO (SUITE-StressHdfsTest-seed#[C98063D373201AE6]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40615
[junit4] 2> 21879 WARN (SUITE-StressHdfsTest-seed#[C98063D373201AE6]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 21881 INFO (SUITE-StressHdfsTest-seed#[C98063D373201AE6]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 21890 INFO (SUITE-StressHdfsTest-seed#[C98063D373201AE6]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.2-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_47610_datanode____o8jsk9/webapp
[junit4] 2> 22626 INFO (SUITE-StressHdfsTest-seed#[C98063D373201AE6]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:47610
[junit4] 2> 24625 INFO (IPC Server handler 4 on 40693) [ ] BlockStateChange BLOCK* processReport: from storage DS-d8b8becc-093a-4119-8b07-f37da58bbe06 node DatanodeRegistration(127.0.0.1:53071, datanodeUuid=11f98dda-8219-4369-9f24-c4c8fdc66b22, infoPort=37529, infoSecurePort=0, ipcPort=58349, storageInfo=lv=-56;cid=testClusterID;nsid=1680825423;c=0), blocks: 0, hasStaleStorage: true, processing time: 2 msecs
[junit4] 2> 24625 INFO (IPC Server handler 3 on 40693) [ ] BlockStateChange BLOCK* processReport: from storage DS-9a5ea1b7-c517-422f-b58f-ede79c62c813 node DatanodeRegistration(127.0.0.1:39495, datanodeUuid=698f9de4-d167-4cf4-b27f-092f6f4aaccd, infoPort=45825, infoSecurePort=0, ipcPort=48780, storageInfo=lv=-56;cid=testClusterID;nsid=1680825423;c=0), blocks: 0, hasStaleStorage: true, processing time: 1 msecs
[junit4] 2> 24625 INFO (IPC Server handler 4 on 40693) [ ] BlockStateChange BLOCK* processReport: from storage DS-bdc223d5-2f8f-45a3-a4c8-bd5b91e54d42 node DatanodeRegistration(127.0.0.1:53071, datanodeUuid=11f98dda-8219-4369-9f24-c4c8fdc66b22, infoPort=37529, infoSecurePort=0, ipcPort=58349, storageInfo=lv=-56;cid=testClusterID;nsid=1680825423;c=0), blocks: 0, hasStaleStorage: false, processing time: 0 msecs
[junit4] 2> 24638 INFO (IPC Server handler 3 on 40693) [ ] BlockStateChange BLOCK* processReport: from storage DS-2b825fa5-d448-4eb8-a5f2-b07b58563806 node DatanodeRegistration(127.0.0.1:39495, datanodeUuid=698f9de4-d167-4cf4-b27f-092f6f4aaccd, infoPort=45825, infoSecurePort=0, ipcPort=48780, storageInfo=lv=-56;cid=testClusterID;nsid=1680825423;c=0), blocks: 0, hasStaleStorage: false, processing time: 0 msecs
[junit4] 2> 25110 INFO (TEST-StressHdfsTest.test-seed#[C98063D373201AE6]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 25114 INFO (Thread-124) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 25115 INFO (Thread-124) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 25291 INFO (TEST-StressHdfsTest.test-seed#[C98063D373201AE6]) [ ] o.a.s.c.ZkTestServer start zk server on port:50061
[junit4] 2> 25467 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15a4d7c4c6b0000, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 25551 INFO (TEST-StressHdfsTest.test-seed#[C98063D373201AE6]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 25554 INFO (TEST-StressHdfsTest.test-seed#[C98063D373201AE6]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 25557 INFO (TEST-StressHdfsTest.test-seed#[C98063D373201AE6]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 25560 INFO (TEST-StressHdfsTest.test-seed#[C98063D373201AE6]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 25562 INFO (TEST-StressHdfsTest.test-seed#[C98063D373201AE6]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 25564 INFO (TEST-StressHdfsTest.test-seed#[C98063D373201AE6]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 25568 INFO (TEST-StressHdfsTest.test-seed#[C98063D373201AE6]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 25572 INFO (TEST-StressHdfsTest.test-seed#[C98063D373201AE6]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 25573 INFO (TEST-StressHdfsTest.test-seed#[C98063D373201AE6]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 25575 INFO (TEST-StressHdfsTest.test-seed#[C98063D373201AE6]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 25577 INFO (TEST-StressHdfsTest.test-seed#[C98063D373201AE6]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 25898 INFO (TEST-StressHdfsTest.test-seed#[C98063D373201AE6]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_C98063D373201AE6-001/control-001/cores/collection1
[junit4] 2> 25900 INFO (TEST-StressHdfsTest.test-seed#[C98063D373201AE6]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 25904 INFO (TEST-StressHdfsTest.test-seed#[C98063D373201AE6]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@48ff67dc{/,null,AVAILABLE}
[junit4] 2> 25904 INFO (TEST-StressHdfsTest.test-seed#[C98063D373201AE6]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@2307f038{HTTP/1.1,[http/1.1]}{127.0.0.1:36183}
[junit4] 2> 25905 INFO (TEST-StressHdfsTest.test-seed#[C98063D373201AE6]) [ ] o.e.j.s.Server Started @29525ms
[junit4] 2> 25905 INFO (TEST-StressHdfsTest.test-seed#[C98063D373201AE6]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:40693/hdfs__localhost_40693__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-6.x_checkout_solr_build_solr-core_test_J0_temp_solr.cloud.hdfs.StressHdfsTest_C98063D373201AE6-001_tempDir-002_control_data, hostContext=/, hostPort=36183, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_C98063D373201AE6-001/control-001/cores}
[junit4] 2> 25905 ERROR (TEST-StressHdfsTest.test-seed#[C98063D373201AE6]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 25905 INFO (TEST-StressHdfsTest.test-seed#[C98063D373201AE6]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 6.5.0
[junit4] 2> 25905 INFO (TEST-StressHdfsTest.test-seed#[C98063D373201AE6]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 25905 INFO (TEST-StressHdfsTest.test-seed#[C98063D373201AE6]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 25905 INFO (TEST-StressHdfsTest.test-seed#[C98063D373201AE6]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-02-17T19:11:16.825Z
[junit4] 2> 25906 INFO (TEST-StressHdfsTest.test-seed#[C98063D373201AE6]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 25960 INFO (TEST-StressHdfsTest.test-seed#[C98063D373201AE6]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 25960 INFO (TEST-StressHdfsTest.test-seed#[C98063D373201AE6]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_C98063D373201AE6-001/control-001/solr.xml
[junit4] 2> 25981 INFO (TEST-StressHdfsTest.test-seed#[C98063D373201AE6]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 25982 INFO (TEST-StressHdfsTest.test-seed#[C98063D373201AE6]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:50061/solr
[junit4] 2> 26156 INFO (TEST-StressHdfsTest.test-seed#[C98063D373201AE6]) [n:127.0.0.1:36183_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 26158 INFO (TEST-StressHdfsTest.test-seed#[C98063D373201AE6]) [n:127.0.0.1:36183_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:36183_
[junit4] 2> 26160 INFO (TEST-StressHdfsTest.test-seed#[C98063D373201AE6]) [n:127.0.0.1:36183_ ] o.a.s.c.Overseer Overseer (id=97475538195251204-127.0.0.1:36183_-n_0000000000) starting
[junit4] 2> 26267 INFO (TEST-StressHdfsTest.test-seed#[C98063D373201AE6]) [n:127.0.0.1:36183_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36183_
[junit4] 2> 26286 INFO (zkCallback-11-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 26408 INFO (TEST-StressHdfsTest.test-seed#[C98063D373201AE6]) [n:127.0.0.1:36183_ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_C98063D373201AE6-001/control-001/cores
[junit4] 2> 26408 INFO (TEST-StressHdfsTest.test-seed#[C98063D373201AE6]) [n:127.0.0.1:36183_ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 26502 INFO (OverseerStateUpdate-97475538195251204-127.0.0.1:36183_-n_0000000000) [n:127.0.0.1:36183_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 27531 WARN (coreLoadExecutor-35-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection x:collection1] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
[junit4] 2> 27567 INFO (coreLoadExecutor-35-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
[junit4] 2> 27695 INFO (coreLoadExecutor-35-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 28084 WARN (coreLoadExecutor-35-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 28099 INFO (coreLoadExecutor-35-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 28144 INFO (coreLoadExecutor-35-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 28150 INFO (coreLoadExecutor-35-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:40693/solr_hdfs_home
[junit4] 2> 28150 INFO (coreLoadExecutor-35-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 28151 INFO (coreLoadExecutor-35-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_C98063D373201AE6-001/control-001/cores/collection1], dataDir=[hdfs://localhost:40693/solr_hdfs_home/control_collection/core_node1/data/]
[junit4] 2> 28151 INFO (coreLoadExecutor-35-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2f475310
[junit4] 2> 28151 INFO (coreLoadExecutor-35-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:40693/solr_hdfs_home/control_collection/core_node1/data/snapshot_metadata
[junit4] 2> 28196 INFO (coreLoadExecutor-35-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 28196 INFO (coreLoadExecutor-35-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
[junit4] 2> 28197 INFO (coreLoadExecutor-35-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Creating new single instance HDFS BlockCache
[junit4] 2> 30200 INFO (coreLoadExecutor-35-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 30207 INFO (coreLoadExecutor-35-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:40693/solr_hdfs_home/control_collection/core_node1/data
[junit4] 2> 30305 INFO (coreLoadExecutor-35-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:40693/solr_hdfs_home/control_collection/core_node1/data/index
[junit4] 2> 30327 INFO (coreLoadExecutor-35-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 30327 INFO (coreLoadExecutor-35-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
[junit4] 2> 30327 INFO (coreLoadExecutor-35-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Creating new single instance HDFS BlockCache
[junit4] 2> 30357 INFO (coreLoadExecutor-35-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 30357 INFO (coreLoadExecutor-35-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=25, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 30767 INFO (IPC Server handler 5 on 40693) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:39495 is added to blk_1073741825_1001{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-bdc223d5-2f8f-45a3-a4c8-bd5b91e54d42:NORMAL:127.0.0.1:53071|RBW], ReplicaUC[[DISK]DS-2b825fa5-d448-4eb8-a5f2-b07b58563806:NORMAL:127.0.0.1:39495|RBW]]} size 71
[junit4] 2> 30767 INFO (IPC Server handler 6 on 40693) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:53071 is added to blk_1073741825_1001 size 71
[junit4] 2> 31454 WARN (coreLoadExecutor-35-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 31586 INFO (coreLoadExecutor-35-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
[junit4] 2> 31586 INFO (coreLoadExecutor-35-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 31586 INFO (coreLoadExecutor-35-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection x:collection1] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=2
[junit4] 2> 31618 INFO (coreLoadExecutor-35-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 31618 INFO (coreLoadExecutor-35-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 31622 INFO (coreLoadExecutor-35-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@1e7c8108
[junit4] 2> 32160 INFO (coreLoadExecutor-35-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@4b439163[collection1] main]
[junit4] 2> 32163 INFO (coreLoadExecutor-35-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 32170 INFO (coreLoadExecutor-35-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 32172 INFO (coreLoadExecutor-35-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 32175 INFO (searcherExecutor-36-thread-1-processing-n:127.0.0.1:36183_ x:collection1 c:control_collection) [n:127.0.0.1:36183_ c:control_collection x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@4b439163[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 32193 INFO (coreLoadExecutor-35-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1559608618503897088
[junit4] 2> 32355 INFO (coreZkRegister-28-thread-1-processing-n:127.0.0.1:36183_ x:collection1 c:control_collection) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 32355 INFO (coreZkRegister-28-thread-1-processing-n:127.0.0.1:36183_ x:collection1 c:control_collection) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 32355 INFO (coreZkRegister-28-thread-1-processing-n:127.0.0.1:36183_ x:collection1 c:control_collection) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:36183/collection1/
[junit4] 2> 32355 INFO (coreZkRegister-28-thread-1-processing-n:127.0.0.1:36183_ x:collection1 c:control_collection) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 32356 INFO (coreZkRegister-28-thread-1-processing-n:127.0.0.1:36183_ x:collection1 c:control_collection) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:36183/collection1/ has no replicas
[junit4] 2> 32407 INFO (coreZkRegister-28-thread-1-processing-n:127.0.0.1:36183_ x:collection1 c:control_collection) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:36183/collection1/ shard1
[junit4] 2> 32563 INFO (coreZkRegister-28-thread-1-processing-n:127.0.0.1:36183_ x:collection1 c:control_collection) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 32762 INFO (TEST-StressHdfsTest.test-seed#[C98063D373201AE6]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 32763 INFO (TEST-StressHdfsTest.test-seed#[C98063D373201AE6]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:50061/solr ready
[junit4] 2> 32765 INFO (TEST-StressHdfsTest.test-seed#[C98063D373201AE6]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 32931 INFO (TEST-StressHdfsTest.test-seed#[C98063D373201AE6]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_C98063D373201AE6-001/shard-1-001/cores/collection1
[junit4] 2> 32932 INFO (TEST-StressHdfsTest.test-seed#[C98063D373201AE6]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_C98063D373201AE6-001/shard-1-001
[junit4] 2> 32934 INFO (TEST-StressHdfsTest.test-seed#[C98063D373201AE6]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 32938 INFO (TEST-StressHdfsTest.test-seed#[C98063D373201AE6]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1fc212d5{/,null,AVAILABLE}
[junit4] 2> 32939 INFO (TEST-StressHdfsTest.test-seed#[C98063D373201AE6]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@7e4de3f4{HTTP/1.1,[http/1.1]}{127.0.0.1:45628}
[junit4] 2> 32939 INFO (TEST-StressHdfsTest.test-seed#[C98063D373201AE6]) [ ] o.e.j.s.Server Started @36559ms
[junit4] 2> 32939 INFO (TEST-StressHdfsTest.test-seed#[C98063D373201AE6]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:40693/hdfs__localhost_40693__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-6.x_checkout_solr_build_solr-core_test_J0_temp_solr.cloud.hdfs.StressHdfsTest_C98063D373201AE6-001_tempDir-002_jetty1, solrconfig=solrconfig.xml, hostContext=/, hostPort=45628, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_C98063D373201AE6-001/shard-1-001/cores}
[junit4] 2> 32939 ERROR (TEST-StressHdfsTest.test-seed#[C98063D373201AE6]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 32940 INFO (TEST-StressHdfsTest.test-seed#[C98063D373201AE6]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 6.5.0
[junit4] 2> 32940 INFO (TEST-StressHdfsTest.test-seed#[C98063D373201AE6]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 32940 INFO (TEST-StressHdfsTest.test-seed#[C98063D373201AE6]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 32940 INFO (TEST-StressHdfsTest.test-seed#[C98063D373201AE6]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-02-17T19:11:23.860Z
[junit4] 2> 33071 INFO (TEST-StressHdfsTest.test-seed#[C98063D373201AE6]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 33071 INFO (TEST-StressHdfsTest.test-seed#[C98063D373201AE6]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_C98063D373201AE6-001/shard-1-001/solr.xml
[junit4] 2> 33084 INFO (TEST-StressHdfsTest.test-seed#[C98063D373201AE6]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 33085 INFO (TEST-StressHdfsTest.test-seed#[C98063D373201AE6]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:50061/solr
[junit4] 2> 33115 INFO (TEST-StressHdfsTest.test-seed#[C98063D373201AE6]) [n:127.0.0.1:45628_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 33117 INFO (TEST-StressHdfsTest.test-seed#[C98063D373201AE6]) [n:127.0.0.1:45628_ ] o.a.s.c.Overseer Overseer (id=null) closing
[ju
[...truncated too long message...]
apshot(MethodMetric.java:144)
[junit4] 2> at org.apache.hadoop.metrics2.lib.MetricsRegistry.snapshot(MetricsRegistry.java:401)
[junit4] 2> at org.apache.hadoop.metrics2.lib.MetricsSourceBuilder$1.getMetrics(MetricsSourceBuilder.java:79)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.getMetrics(MetricsSourceAdapter.java:194)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.updateJmxCache(MetricsSourceAdapter.java:172)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.getMBeanInfo(MetricsSourceAdapter.java:151)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getClassName(DefaultMBeanServerInterceptor.java:1804)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.safeGetClassName(DefaultMBeanServerInterceptor.java:1595)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.checkMBeanPermission(DefaultMBeanServerInterceptor.java:1813)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.exclusiveUnregisterMBean(DefaultMBeanServerInterceptor.java:430)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.unregisterMBean(DefaultMBeanServerInterceptor.java:415)
[junit4] 2> at com.sun.jmx.mbeanserver.JmxMBeanServer.unregisterMBean(JmxMBeanServer.java:546)
[junit4] 2> at org.apache.hadoop.metrics2.util.MBeans.unregister(MBeans.java:81)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stopMBeans(MetricsSourceAdapter.java:226)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stop(MetricsSourceAdapter.java:211)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stopSources(MetricsSystemImpl.java:463)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stop(MetricsSystemImpl.java:213)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.shutdown(MetricsSystemImpl.java:594)
[junit4] 2> at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdownInstance(DefaultMetricsSystem.java:72)
[junit4] 2> at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdown(DefaultMetricsSystem.java:68)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.metrics.NameNodeMetrics.shutdown(NameNodeMetrics.java:171)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.NameNode.stop(NameNode.java:872)
[junit4] 2> at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1726)
[junit4] 2> at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1705)
[junit4] 2> at org.apache.solr.cloud.hdfs.HdfsTestUtil.teardownClass(HdfsTestUtil.java:198)
[junit4] 2> at org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest.teardownClass(HdfsWriteToMultipleCollectionsTest.java:73)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:498)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:870)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> Caused by: java.lang.NullPointerException
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlocksMap.size(BlocksMap.java:203)
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.getTotalBlocks(BlockManager.java:3370)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlocksTotal(FSNamesystem.java:5729)
[junit4] 2> ... 53 more
[junit4] 2> 2017287 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[C98063D373201AE6]-worker) [ ] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_C98063D373201AE6-001
[junit4] 2> Feb 17, 2017 7:44:28 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 34 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene62): {rnd_b=PostingsFormat(name=Memory doPackFST= true), _version_=PostingsFormat(name=Direct), a_t=PostingsFormat(name=Direct), a_i=PostingsFormat(name=Memory doPackFST= true), id=PostingsFormat(name=Memory doPackFST= true)}, docValues:{}, maxPointsInLeafNode=513, maxMBSortInHeap=6.948638494401105, sim=RandomSimilarity(queryNorm=true,coord=crazy): {}, locale=ar-SA, timezone=America/Danmarkshavn
[junit4] 2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_121 (64-bit)/cpus=4,threads=2,free=105912016,total=528482304
[junit4] 2> NOTE: All tests run in this JVM: [ShowFileRequestHandlerTest, SOLR749Test, ConfigSetsAPITest, TestManagedSchemaThreadSafety, TestImplicitCoreProperties, FieldMutatingUpdateProcessorTest, PeerSyncReplicationTest, CustomCollectionTest, DirectoryFactoryTest, TestSortByMinMaxFunction, TestSolrConfigHandlerConcurrent, AddSchemaFieldsUpdateProcessorFactoryTest, TestDefaultSearchFieldResource, TestJsonFacets, TestReRankQParserPlugin, TestBulkSchemaAPI, BooleanFieldTest, TestExtendedDismaxParser, TestIndexingPerformance, TestLFUCache, TestUtils, MinimalSchemaTest, MergeStrategyTest, TestSolrJ, CollectionReloadTest, TestCloudRecovery, BasicDistributedZk2Test, LeaderElectionTest, TestSSLRandomization, RuleEngineTest, TestRecovery, TestExceedMaxTermLength, TestScoreJoinQPNoScore, PreAnalyzedFieldManagedSchemaCloudTest, PrimitiveFieldTypeTest, DocValuesMissingTest, StatsComponentTest, HdfsBasicDistributedZkTest, TestDFISimilarityFactory, UpdateParamsTest, TestDistributedStatsComponentCardinality, CurrencyFieldXmlFileTest, AutoCommitTest, TestAnalyzedSuggestions, TestXIncludeConfig, TestFieldCacheWithThreads, FieldAnalysisRequestHandlerTest, TestSchemalessBufferedUpdates, TestSolrCloudWithSecureImpersonation, LeaderElectionContextKeyTest, PluginInfoTest, TestDownShardTolerantSearch, DistributedFacetPivotLargeTest, TestComplexPhraseLeadingWildcard, ShardSplitTest, OverseerTest, TestLeaderElectionWithEmptyReplica, StatelessScriptUpdateProcessorFactoryTest, TestFieldCacheSort, TestReload, TestCloudManagedSchema, HardAutoCommitTest, TestSolrCloudWithHadoopAuthPlugin, ClassificationUpdateProcessorIntegrationTest, TestNRTOpen, FullSolrCloudDistribCmdsTest, TimeZoneUtilsTest, DeleteNodeTest, LeaderInitiatedRecoveryOnCommitTest, TestPostingsSolrHighlighter, DirectUpdateHandlerTest, DocExpirationUpdateProcessorFactoryTest, TestLMJelinekMercerSimilarityFactory, ZkStateReaderTest, TermVectorComponentDistributedTest, TestCloudInspectUtil, SmileWriterTest, BaseCdcrDistributedZkTest, HdfsThreadLeakTest, TestManagedResource, TestFieldTypeResource, SolrMetricsIntegrationTest, TestFieldCollectionResource, UnloadDistributedZkTest, TestCollationFieldDocValues, SolrJmxReporterTest, HdfsWriteToMultipleCollectionsTest]
[junit4] Completed [260/692 (3!)] on J2 in 38.58s, 1 test, 1 failure <<< FAILURES!
[...truncated 13106 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/build.xml:783: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/build.xml:727: Some of the tests produced a heap dump, but did not fail. Maybe a suppressed OutOfMemoryError? Dumps created:
* java_pid29287.hprof
Total time: 339 minutes 56 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-6.x - Build # 285 - Still
Unstable
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.x/285/
2 tests failed.
FAILED: org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.testCollectionsAPI
Error Message:
Expected to see collection awhollynewcollection_0 null Last available state: DocCollection(awhollynewcollection_0//collections/awhollynewcollection_0/state.json/8)={ "replicationFactor":"3", "shards":{ "shard1":{ "range":"80000000-b332ffff", "state":"active", "replicas":{}}, "shard2":{ "range":"b3330000-e665ffff", "state":"active", "replicas":{}}, "shard3":{ "range":"e6660000-1998ffff", "state":"active", "replicas":{}}, "shard4":{ "range":"19990000-4ccbffff", "state":"active", "replicas":{}}, "shard5":{ "range":"4ccc0000-7fffffff", "state":"active", "replicas":{}}}, "router":{"name":"compositeId"}, "maxShardsPerNode":"4", "autoAddReplicas":"false"}
Stack Trace:
java.lang.AssertionError: Expected to see collection awhollynewcollection_0
null
Last available state: DocCollection(awhollynewcollection_0//collections/awhollynewcollection_0/state.json/8)={
"replicationFactor":"3",
"shards":{
"shard1":{
"range":"80000000-b332ffff",
"state":"active",
"replicas":{}},
"shard2":{
"range":"b3330000-e665ffff",
"state":"active",
"replicas":{}},
"shard3":{
"range":"e6660000-1998ffff",
"state":"active",
"replicas":{}},
"shard4":{
"range":"19990000-4ccbffff",
"state":"active",
"replicas":{}},
"shard5":{
"range":"4ccc0000-7fffffff",
"state":"active",
"replicas":{}}},
"router":{"name":"compositeId"},
"maxShardsPerNode":"4",
"autoAddReplicas":"false"}
at __randomizedtesting.SeedInfo.seed([D11027C0F5C87423:99655374F3FB5BB6]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.SolrCloudTestCase.waitForState(SolrCloudTestCase.java:265)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:502)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest.test
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([D11027C0F5C87423:5944181A5B3419DB]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertTrue(Assert.java:54)
at org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest.test(HdfsWriteToMultipleCollectionsTest.java:137)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 13082 lines...]
[junit4] Suite: org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_D11027C0F5C87423-001/init-core-data-001
[junit4] 2> 4179573 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[D11027C0F5C87423]-worker) [ ] o.a.s.SolrTestCaseJ4 Using TrieFields
[junit4] 2> 4179574 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[D11027C0F5C87423]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 2> 4179575 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[D11027C0F5C87423]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_D11027C0F5C87423-001/tempDir-001
[junit4] 2> 4179575 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[D11027C0F5C87423]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 4179575 INFO (Thread-90109) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 4179575 INFO (Thread-90109) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 4179675 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[D11027C0F5C87423]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:39924
[junit4] 2> 4179679 INFO (jetty-launcher-3990-thread-1) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 4179679 INFO (jetty-launcher-3990-thread-2) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 4179680 INFO (jetty-launcher-3990-thread-3) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 4179680 INFO (jetty-launcher-3990-thread-4) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 4179682 INFO (jetty-launcher-3990-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@22f06e17{/solr,null,AVAILABLE}
[junit4] 2> 4179682 INFO (jetty-launcher-3990-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4bed32f9{/solr,null,AVAILABLE}
[junit4] 2> 4179682 INFO (jetty-launcher-3990-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@7a88ceec{HTTP/1.1,[http/1.1]}{127.0.0.1:38765}
[junit4] 2> 4179682 INFO (jetty-launcher-3990-thread-2) [ ] o.e.j.s.Server Started @4182630ms
[junit4] 2> 4179682 INFO (jetty-launcher-3990-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@1cbb30c8{HTTP/1.1,[http/1.1]}{127.0.0.1:45824}
[junit4] 2> 4179682 INFO (jetty-launcher-3990-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=38765}
[junit4] 2> 4179682 INFO (jetty-launcher-3990-thread-1) [ ] o.e.j.s.Server Started @4182630ms
[junit4] 2> 4179683 INFO (jetty-launcher-3990-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=45824}
[junit4] 2> 4179683 ERROR (jetty-launcher-3990-thread-2) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 4179683 ERROR (jetty-launcher-3990-thread-1) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 4179683 INFO (jetty-launcher-3990-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 6.5.0
[junit4] 2> 4179683 INFO (jetty-launcher-3990-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 6.5.0
[junit4] 2> 4179683 INFO (jetty-launcher-3990-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 4179683 INFO (jetty-launcher-3990-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 4179684 INFO (jetty-launcher-3990-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 4179684 INFO (jetty-launcher-3990-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-02-16T14:09:10.376Z
[junit4] 2> 4179684 INFO (jetty-launcher-3990-thread-3) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2806e037{/solr,null,AVAILABLE}
[junit4] 2> 4179684 INFO (jetty-launcher-3990-thread-3) [ ] o.e.j.s.AbstractConnector Started ServerConnector@1cfd3e3e{HTTP/1.1,[http/1.1]}{127.0.0.1:59544}
[junit4] 2> 4179684 INFO (jetty-launcher-3990-thread-3) [ ] o.e.j.s.Server Started @4182632ms
[junit4] 2> 4179684 INFO (jetty-launcher-3990-thread-3) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=59544}
[junit4] 2> 4179684 ERROR (jetty-launcher-3990-thread-3) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 4179684 INFO (jetty-launcher-3990-thread-3) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 6.5.0
[junit4] 2> 4179685 INFO (jetty-launcher-3990-thread-3) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 4179685 INFO (jetty-launcher-3990-thread-3) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 4179685 INFO (jetty-launcher-3990-thread-3) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-02-16T14:09:10.377Z
[junit4] 2> 4179683 INFO (jetty-launcher-3990-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 4179685 INFO (jetty-launcher-3990-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-02-16T14:09:10.377Z
[junit4] 2> 4179687 INFO (jetty-launcher-3990-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 4179687 INFO (jetty-launcher-3990-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 4179687 INFO (jetty-launcher-3990-thread-4) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@86720e6{/solr,null,AVAILABLE}
[junit4] 2> 4179687 INFO (jetty-launcher-3990-thread-4) [ ] o.e.j.s.AbstractConnector Started ServerConnector@dd8b408{HTTP/1.1,[http/1.1]}{127.0.0.1:52392}
[junit4] 2> 4179687 INFO (jetty-launcher-3990-thread-4) [ ] o.e.j.s.Server Started @4182635ms
[junit4] 2> 4179687 INFO (jetty-launcher-3990-thread-4) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=52392}
[junit4] 2> 4179688 ERROR (jetty-launcher-3990-thread-4) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 4179688 INFO (jetty-launcher-3990-thread-4) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 6.5.0
[junit4] 2> 4179688 INFO (jetty-launcher-3990-thread-4) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 4179688 INFO (jetty-launcher-3990-thread-4) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 4179688 INFO (jetty-launcher-3990-thread-4) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-02-16T14:09:10.380Z
[junit4] 2> 4179695 INFO (jetty-launcher-3990-thread-3) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 4179697 INFO (jetty-launcher-3990-thread-1) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 4179697 INFO (jetty-launcher-3990-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39924/solr
[junit4] 2> 4179698 INFO (jetty-launcher-3990-thread-4) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 4179698 INFO (jetty-launcher-3990-thread-2) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 4179698 INFO (jetty-launcher-3990-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39924/solr
[junit4] 2> 4179700 INFO (jetty-launcher-3990-thread-3) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 4179701 INFO (jetty-launcher-3990-thread-3) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39924/solr
[junit4] 2> 4179706 INFO (jetty-launcher-3990-thread-4) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 4179706 INFO (jetty-launcher-3990-thread-4) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39924/solr
[junit4] 2> 4179714 INFO (jetty-launcher-3990-thread-1) [n:127.0.0.1:45824_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 4179714 INFO (jetty-launcher-3990-thread-3) [n:127.0.0.1:59544_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 4179714 INFO (jetty-launcher-3990-thread-2) [n:127.0.0.1:38765_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 4179714 INFO (jetty-launcher-3990-thread-1) [n:127.0.0.1:45824_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:45824_solr
[junit4] 2> 4179715 INFO (jetty-launcher-3990-thread-3) [n:127.0.0.1:59544_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59544_solr
[junit4] 2> 4179715 INFO (jetty-launcher-3990-thread-2) [n:127.0.0.1:38765_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38765_solr
[junit4] 2> 4179715 INFO (jetty-launcher-3990-thread-1) [n:127.0.0.1:45824_solr ] o.a.s.c.Overseer Overseer (id=97468687991963655-127.0.0.1:45824_solr-n_0000000000) starting
[junit4] 2> 4179718 INFO (zkCallback-4002-thread-1-processing-n:127.0.0.1:45824_solr) [n:127.0.0.1:45824_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 4179718 INFO (zkCallback-4006-thread-1-processing-n:127.0.0.1:38765_solr) [n:127.0.0.1:38765_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 4179722 INFO (zkCallback-4006-thread-1-processing-n:127.0.0.1:38765_solr) [n:127.0.0.1:38765_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 4179722 INFO (zkCallback-4002-thread-1-processing-n:127.0.0.1:45824_solr) [n:127.0.0.1:45824_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 4179730 INFO (zkCallback-4007-thread-1-processing-n:127.0.0.1:59544_solr) [n:127.0.0.1:59544_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 4179735 INFO (zkCallback-4007-thread-2-processing-n:127.0.0.1:59544_solr) [n:127.0.0.1:59544_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 4179741 INFO (zkCallback-4013-thread-1-processing-n:127.0.0.1:52392_solr) [n:127.0.0.1:52392_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 4179741 INFO (jetty-launcher-3990-thread-4) [n:127.0.0.1:52392_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 4179745 INFO (jetty-launcher-3990-thread-1) [n:127.0.0.1:45824_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45824_solr
[junit4] 2> 4179746 INFO (zkCallback-4006-thread-1-processing-n:127.0.0.1:38765_solr) [n:127.0.0.1:38765_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 4179746 INFO (zkCallback-4002-thread-1-processing-n:127.0.0.1:45824_solr) [n:127.0.0.1:45824_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 4179750 INFO (zkCallback-4007-thread-2-processing-n:127.0.0.1:59544_solr) [n:127.0.0.1:59544_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 4179750 INFO (zkCallback-4013-thread-1-processing-n:127.0.0.1:52392_solr) [n:127.0.0.1:52392_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 4179750 INFO (jetty-launcher-3990-thread-4) [n:127.0.0.1:52392_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52392_solr
[junit4] 2> 4179751 INFO (zkCallback-4006-thread-1-processing-n:127.0.0.1:38765_solr) [n:127.0.0.1:38765_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 4179751 INFO (zkCallback-4007-thread-2-processing-n:127.0.0.1:59544_solr) [n:127.0.0.1:59544_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 4179751 INFO (zkCallback-4002-thread-1-processing-n:127.0.0.1:45824_solr) [n:127.0.0.1:45824_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 4179752 INFO (zkCallback-4013-thread-1-processing-n:127.0.0.1:52392_solr) [n:127.0.0.1:52392_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 4179801 INFO (jetty-launcher-3990-thread-1) [n:127.0.0.1:45824_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_D11027C0F5C87423-001/tempDir-001/node1/.
[junit4] 2> 4179840 INFO (jetty-launcher-3990-thread-3) [n:127.0.0.1:59544_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_D11027C0F5C87423-001/tempDir-001/node3/.
[junit4] 2> 4179870 INFO (jetty-launcher-3990-thread-4) [n:127.0.0.1:52392_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_D11027C0F5C87423-001/tempDir-001/node4/.
[junit4] 2> 4179870 INFO (jetty-launcher-3990-thread-2) [n:127.0.0.1:38765_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_D11027C0F5C87423-001/tempDir-001/node2/.
[junit4] 2> 4181763 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[D11027C0F5C87423]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 4181764 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[D11027C0F5C87423]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:39924/solr ready
[junit4] 1> Formatting using clusterid: testClusterID
[junit4] 2> 4181791 WARN (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[D11027C0F5C87423]-worker) [ ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
[junit4] 2> 4181795 WARN (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[D11027C0F5C87423]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 4181796 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[D11027C0F5C87423]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 4181806 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[D11027C0F5C87423]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.2-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_50899_hdfs____w71xj/webapp
[junit4] 2> 4182112 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[D11027C0F5C87423]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:50899
[junit4] 2> 4182160 WARN (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[D11027C0F5C87423]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 4182161 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[D11027C0F5C87423]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 4182173 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[D11027C0F5C87423]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.2-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_41705_datanode____cwbkna/webapp
[junit4] 2> 4182565 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[D11027C0F5C87423]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41705
[junit4] 2> 4182594 WARN (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[D11027C0F5C87423]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 4182595 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[D11027C0F5C87423]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 4182604 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[D11027C0F5C87423]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.2-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_45717_datanode____w38dwj/webapp
[junit4] 2> 4182662 INFO (IPC Server handler 4 on 59396) [ ] BlockStateChange BLOCK* processReport: from storage DS-3e27ac0a-6af1-42c5-9a18-6bbd69ef2122 node DatanodeRegistration(127.0.0.1:53137, datanodeUuid=ac06de47-a857-418c-8586-7b3ee1ec5aed, infoPort=39751, infoSecurePort=0, ipcPort=52587, storageInfo=lv=-56;cid=testClusterID;nsid=1430597033;c=0), blocks: 0, hasStaleStorage: true, processing time: 0 msecs
[junit4] 2> 4182662 INFO (IPC Server handler 4 on 59396) [ ] BlockStateChange BLOCK* processReport: from storage DS-ecd879b9-2aaa-4d80-a72d-1b3d8bd2db21 node DatanodeRegistration(127.0.0.1:53137, datanodeUuid=ac06de47-a857-418c-8586-7b3ee1ec5aed, infoPort=39751, infoSecurePort=0, ipcPort=52587, storageInfo=lv=-56;cid=testClusterID;nsid=1430597033;c=0), blocks: 0, hasStaleStorage: false, processing time: 0 msecs
[junit4] 2> 4182986 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[D11027C0F5C87423]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45717
[junit4] 2> 4183060 INFO (IPC Server handler 9 on 59396) [ ] BlockStateChange BLOCK* processReport: from storage DS-746d4adb-571b-4d6d-b6df-228df3ce989b node DatanodeRegistration(127.0.0.1:52777, datanodeUuid=2544de36-9217-4c9e-9c16-596ef9ed5ac6, infoPort=33867, infoSecurePort=0, ipcPort=60199, storageInfo=lv=-56;cid=testClusterID;nsid=1430597033;c=0), blocks: 0, hasStaleStorage: true, processing time: 0 msecs
[junit4] 2> 4183060 INFO (IPC Server handler 9 on 59396) [ ] BlockStateChange BLOCK* processReport: from storage DS-8fca66e0-ff1c-489c-abad-3eca886e1181 node DatanodeRegistration(127.0.0.1:52777, datanodeUuid=2544de36-9217-4c9e-9c16-596ef9ed5ac6, infoPort=33867, infoSecurePort=0, ipcPort=60199, storageInfo=lv=-56;cid=testClusterID;nsid=1430597033;c=0), blocks: 0, hasStaleStorage: false, processing time: 0 msecs
[junit4] 2> 4183180 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.testMaxNodesPerShard-seed#[D11027C0F5C87423]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testMaxNodesPerShard
[junit4] 2> 4183181 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.testMaxNodesPerShard-seed#[D11027C0F5C87423]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 4183185 INFO (qtp380572432-107442) [n:127.0.0.1:59544_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=2&collection.configName=conf&name=oversharded&action=CREATE&numShards=3&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 4183187 INFO (OverseerThreadFactory-9005-thread-1-processing-n:127.0.0.1:45824_solr) [n:127.0.0.1:45824_solr ] o.a.s.c.CreateCollectionCmd Create collection oversharded
[junit4] 2> 4183187 ERROR (OverseerThreadFactory-9005-thread-1-processing-n:127.0.0.1:45824_solr) [n:127.0.0.1:45824_solr ] o.a.s.c.OverseerCollectionMessageHandler Collection: oversharded operation: create failed:org.apache.solr.common.SolrException: Cannot create collection oversharded. Value of maxShardsPerNode is 1, and the number of nodes currently live or live and part of your createNodeSet is 4. This allows a maximum of 4 to be created. Value of numShards is 3 and value of replicationFactor is 2. This requires 6 shards to be created (higher than the allowed number)
[junit4] 2> at org.apache.solr.cloud.CreateCollectionCmd.call(CreateCollectionCmd.java:155)
[junit4] 2> at org.apache.solr.cloud.OverseerCollectionMessageHandler.processMessage(OverseerCollectionMessageHandler.java:224)
[junit4] 2> at org.apache.solr.cloud.OverseerTaskProcessor$Runner.run(OverseerTaskProcessor.java:463)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 4183190 INFO (qtp380572432-107442) [n:127.0.0.1:59544_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=2&collection.configName=conf&name=oversharded&action=CREATE&numShards=3&wt=javabin&version=2} status=400 QTime=4
[junit4] 2> 4183190 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.testMaxNodesPerShard-seed#[D11027C0F5C87423]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testMaxNodesPerShard
[junit4] 2> 4183271 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.testCreateShouldFailOnExistingCore-seed#[D11027C0F5C87423]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testCreateShouldFailOnExistingCore
[junit4] 2> 4183272 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.testCreateShouldFailOnExistingCore-seed#[D11027C0F5C87423]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 4183275 INFO (qtp1495300344-107454) [n:127.0.0.1:52392_solr ] o.a.s.h.a.CoreAdminOperation core create command dataDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_D11027C0F5C87423-001/tempDir-003&collection.configName=conf&name=halfcollection_shard1_replica1&action=CREATE&numShards=1&collection=halfcollectionblocker&wt=javabin&version=2
[junit4] 2> 4183277 INFO (OverseerStateUpdate-97468687991963655-127.0.0.1:45824_solr-n_0000000000) [n:127.0.0.1:45824_solr ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 4184284 INFO (qtp1495300344-107454) [n:127.0.0.1:52392_solr c:halfcollectionblocker x:halfcollection_shard1_replica1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
[junit4] 2> 4184290 INFO (qtp1495300344-107454) [n:127.0.0.1:52392_solr c:halfcollectionblocker x:halfcollection_shard1_replica1] o.a.s.s.IndexSchema [halfcollection_shard1_replica1] Schema name=minimal
[junit4] 2> 4184292 INFO (qtp1495300344-107454) [n:127.0.0.1:52392_solr c:halfcollectionblocker x:halfcollection_shard1_replica1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 4184293 INFO (qtp1495300344-107454) [n:127.0.0.1:52392_solr c:halfcollectionblocker x:halfcollection_shard1_replica1] o.a.s.c.CoreContainer Creating SolrCore 'halfcollection_shard1_replica1' using configuration from collection halfcollectionblocker
[junit4] 2> 4184297 INFO (qtp1495300344-107454) [n:127.0.0.1:52392_solr c:halfcollectionblocker x:halfcollection_shard1_replica1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:59396/data
[junit4] 2> 4184297 INFO (qtp1495300344-107454) [n:127.0.0.1:52392_solr c:halfcollectionblocker x:halfcollection_shard1_replica1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 4184297 INFO (qtp1495300344-107454) [n:127.0.0.1:52392_solr c:halfcollectionblocker x:halfcollection_shard1_replica1] o.a.s.c.SolrCore [[halfcollection_shard1_replica1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_D11027C0F5C87423-001/tempDir-001/node4/halfcollection_shard1_replica1], dataDir=[hdfs://localhost:59396/data/halfcollectionblocker/core_node1//x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_D11027C0F5C87423-001/tempDir-003/]
[junit4] 2> 4184298 INFO (qtp1495300344-107454) [n:127.0.0.1:52392_solr c:halfcollectionblocker x:halfcollection_shard1_replica1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1f7fe27c
[junit4] 2> 4184298 INFO (qtp1495300344-107454) [n:127.0.0.1:52392_solr c:halfcollectionblocker x:halfcollection_shard1_replica1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:59396/data/halfcollectionblocker/core_node1//x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_D11027C0F5C87423-001/tempDir-003/snapshot_metadata
[junit4] 2> 4184304 INFO (qtp1495300344-107454) [n:127.0.0.1:52392_solr c:halfcollectionblocker x:halfcollection_shard1_replica1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 4184304 INFO (qtp1495300344-107454) [n:127.0.0.1:52392_solr c:halfcollectionblocker x:halfcollection_shard1_replica1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [16777216] will allocate [1] slabs and use ~[16777216] bytes
[junit4] 2> 4184304 INFO (qtp1495300344-107454) [n:127.0.0.1:52392_solr c:halfcollectionblocker x:halfcollection_shard1_replica1] o.a.s.c.HdfsDirectoryFactory Creating new single instance HDFS BlockCache
[junit4] 2> 4184315 INFO (qtp1495300344-107454) [n:127.0.0.1:52392_solr c:halfcollectionblocker x:halfcollection_shard1_replica1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 4184315 INFO (qtp1495300344-107454) [n:127.0.0.1:52392_solr c:halfcollectionblocker x:halfcollection_shard1_replica1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:59396/data/halfcollectionblocker/core_node1//x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_D11027C0F5C87423-001/tempDir-003
[junit4] 2> 4184330 INFO (qtp1495300344-107454) [n:127.0.0.1:52392_solr c:halfcollectionblocker x:halfcollection_shard1_replica1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:59396/data/halfcollectionblocker/core_node1//x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_D11027C0F5C87423-001/tempDir-003/index
[junit4] 2> 4184338 INFO (qtp1495300344-107454) [n:127.0.0.1:52392_solr c:halfcollectionblocker x:halfcollection_shard1_replica1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 4184338 INFO (qtp1495300344-107454) [n:127.0.0.1:52392_solr c:halfcollectionblocker x:halfcollection_shard1_replica1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [16777216] will allocate [1] slabs and use ~[16777216] bytes
[junit4] 2> 4184339 INFO (qtp1495300344-107454) [n:127.0.0.1:52392_solr c:halfcollectionblocker x:halfcollection_shard1_replica1] o.a.s.c.HdfsDirectoryFactory Creating new single instance HDFS BlockCache
[junit4] 2> 4184351 INFO (qtp1495300344-107454) [n:127.0.0.1:52392_solr c:halfcollectionblocker x:halfcollection_shard1_replica1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 4184364 INFO (IPC Server handler 6 on 59396) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:53137 is added to blk_1073741825_1001{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-746d4adb-571b-4d6d-b6df-228df3ce989b:NORMAL:127.0.0.1:52777|RBW], ReplicaUC[[DISK]DS-3e27ac0a-6af1-42c5-9a18-6bbd69ef2122:NORMAL:127.0.0.1:53137|FINALIZED]]} size 0
[junit4] 2> 4184364 INFO (IPC Server handler 7 on 59396) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52777 is added to blk_1073741825_1001{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-746d4adb-571b-4d6d-b6df-228df3ce989b:NORMAL:127.0.0.1:52777|RBW], ReplicaUC[[DISK]DS-3e27ac0a-6af1-42c5-9a18-6bbd69ef2122:NORMAL:127.0.0.1:53137|FINALIZED]]} size 0
[junit4] 2> 4184397 INFO (qtp1495300344-107454) [n:127.0.0.1:52392_solr c:halfcollectionblocker x:halfcollection_shard1_replica1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
[junit4] 2> 4184397 INFO (qtp1495300344-107454) [n:127.0.0.1:52392_solr c:halfcollectionblocker x:halfcollection_shard1_replica1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 4184397 INFO (qtp1495300344-107454) [n:127.0.0.1:52392_solr c:halfcollectionblocker x:halfcollection_shard1_replica1] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=3
[junit4] 2> 4184406 INFO (qtp1495300344-107454) [n:127.0.0.1:52392_solr c:halfcollectionblocker x:halfcollection_shard1_replica1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 4184406 INFO (qtp1495300344-107454) [n:127.0.0.1:52392_solr c:halfcollectionblocker x:halfcollection_shard1_replica1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 4184411 INFO (qtp1495300344-107454) [n:127.0.0.1:52392_solr c:halfcollectionblocker x:halfcollection_shard1_replica1] o.a.s.s.SolrIndexSearcher Opening [Searcher@47c85e99[halfcollection_shard1_replica1] main]
[junit4] 2> 4184412 INFO (qtp1495300344-107454) [n:127.0.0.1:52392_solr c:halfcollectionblocker x:halfcollection_shard1_replica1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 4184412 INFO (qtp1495300344-107454) [n:127.0.0.1:52392_solr c:halfcollectionblocker x:halfcollection_shard1_replica1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 4184413 INFO (qtp1495300344-107454) [n:127.0.0.1:52392_solr c:halfcollectionblocker x:halfcollection_shard1_replica1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 4184414 INFO (searcherExecutor-9014-thread-1-processing-n:127.0.0.1:52392_solr x:halfcollection_shard1_replica1 c:halfcollectionblocker) [n:127.0.0.1:52392_solr c:halfcollectionblocker x:halfcollection_shard1_replica1] o.a.s.c.SolrCore [halfcollection_shard1_replica1] Registered new searcher Searcher@47c85e99[halfcollection_shard1_replica1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 4184416 INFO (qtp1495300344-107454) [n:127.0.0.1:52392_solr c:halfcollectionblocker x:halfcollection_shard1_replica1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1559499012946526208
[junit4] 2> 4184421 INFO (qtp1495300344-107454) [n:127.0.0.1:52392_solr c:halfcollectionblocker x:halfcollection_shard1_replica1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 4184421 INFO (qtp1495300344-107454) [n:127.0.0.1:52392_solr c:halfcollectionblocker x:halfcollection_shard1_replica1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 4184421 INFO (qtp1495300344-107454) [n:127.0.0.1:52392_solr c:halfcollectionblocker x:halfcollection_shard1_replica1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:52392/solr/halfcollection_shard1_replica1/
[junit4] 2> 4184422 INFO (qtp1495300344-107454) [n:127.0.0.1:52392_solr c:halfcollectionblocker x:halfcollection_shard1_replica1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 4184422 INFO (qtp1495300344-107454) [n:127.0.0.1:52392_solr c:halfcollectionblocker x:halfcollection_shard1_replica1] o.a.s.c.SyncStrategy http://127.0.0.1:52392/solr/halfcollection_shard1_replica1/ has no replicas
[junit4] 2> 4184424 INFO (qtp1495300344-107454) [n:127.0.0.1:52392_solr c:halfcollectionblocker x:halfcollection_shard1_replica1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:52392/solr/halfcollection_shard1_replica1/ shard1
[junit4] 2> 4184577 INFO (qtp1495300344-107454) [n:127.0.0.1:52392_solr c:halfcollectionblocker x:halfcollection_shard1_replica1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 4184578 INFO (qtp1495300344-107454) [n:127.0.0.1:52392_solr c:halfcollectionblocker x:halfcollection_shard1_replica1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={dataDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_D11027C0F5C87423-001/tempDir-003&collection.configName=conf&name=halfcollection_shard1_replica1&action=CREATE&numShards=1&collection=halfcollectionblocker&wt=javabin&version=2} status=0 QTime=1303
[junit4] 2> 4184581 INFO (qtp93065815-107434) [n:127.0.0.1:38765_solr ] o.a.s.h.a.CoreAdminOperation core create command dataDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_D11027C0F5C87423-001/tempDir-004&collection.configName=conf&name=halfcollection_shard1_replica1&action=CREATE&numShards=1&collection=halfcollectionblocker2&wt=javabin&version=2
[junit4] 2> 4184582 INFO (OverseerStateUpdate-97468687991963655-127.0.0.1:45824_solr-n_0000000000) [n:127.0.0.1:45824_solr ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 4185189 INFO (OverseerCollectionConfigSetProcessor-97468687991963655-127.0.0.1:45824_solr-n_0000000000) [n:127.0.0.1:45824_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 4185592 INFO (qtp93065815-107434) [n:127.0.0.1:38765_solr c:halfcollectionblocker2 x:halfcollection_shard1_replica1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
[junit4] 2> 4185598 INFO (qtp93065815-107434) [n:127.0.0.1:38765_solr c:halfcollectionblocker2 x:halfcollection_shard1_replica1] o.a.s.s.IndexSchema [halfcollection_shard1_replica1] Schema name=minimal
[junit4] 2> 4185612 INFO (qtp93065815-107434) [n:127.0.0.1:38765_solr c:halfcollectionblocker2 x:halfcollection_shard1_replica1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 4185613 INFO (qtp93065815-107434) [n:127.0.0.1:38765_solr c:halfcollectionblocker2 x:halfcollection_shard1_replica1] o.a.s.c.CoreContainer Creating SolrCore 'halfcollection_shard1_replica1' using configuration from collection halfcollectionblocker2
[junit4] 2> 4185613 INFO (qtp93065815-107434) [n:127.0.0.1:38765_solr c:halfcollectionblocker2 x:halfcollection_shard1_replica1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:59396/data
[junit4] 2> 4185613 INFO (qtp93065815-107434) [n:127.0.0.1:38765_solr c:halfcollectionblocker2 x:halfcollection_shard1_replica1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 4185613 INFO (qtp93065815-107434) [n:127.0.0.1:38765_solr c:halfcollectionblocker2 x:halfcollection_shard1_replica1] o.a.s.c.SolrCore [[halfcollection_shard1_replica1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_D11027C0F5C87423-001/tempDir-001/node2/halfcollection_shard1_replica1], dataDir=[hdfs://localhost:59396/data/halfcollectionblocker2/core_node1//x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_D11027C0F5C87423-001/tempDir-004/]
[junit4] 2> 4185613 INFO (qtp93065815-107434) [n:127.0.0.1:38765_solr c:halfcollectionblocker2 x:halfcollection_shard1_replica1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1f7fe27c
[junit4] 2> 4185613 INFO (qtp93065815-107434) [n:127.0.0.1:38765_solr c:halfcollectionblocker2 x:halfcollection_shard1_replica1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:59396/data/halfcollectionblocker2/core_node1//x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_D11027C0F5C87423-001/tempDir-004/snapshot_metadata
[junit4] 2> 4185619 INFO (qtp93065815-107434) [n:127.0.0.1:38765_solr c:halfcollectionblocker2 x:halfcollection_shard1_replica1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 4185619 INFO (qtp93065815-107434) [n:127.0.0.1:38765_solr c:halfcollectionblocker2 x:halfcollection_shard1_replica1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [16777216] will allocate [1] slabs and use ~[16777216] bytes
[junit4] 2> 4185619 INFO (qtp93065815-107434) [n:127.0.0.1:38765_solr c:halfcollectionblocker2 x:halfcollection_shard1_replica1] o.a.s.c.HdfsDirectoryFactory Creating new single instance HDFS BlockCache
[junit4] 2> 4185627 INFO (qtp93065815-107434) [n:127.0.0.1:38765_solr c:halfcollectionblocker2 x:halfcollection_shard1_replica1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 4185628 INFO (qtp93065815-107434) [n:127.0.0.1:38765_solr c:halfcollectionblocker2 x:halfcollection_shard1_replica1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:59396/data/halfcollectionblocker2/core_node1//x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_D11027C0F5C87423-001/tempDir-004
[junit4] 2> 4185640 INFO (qtp93065815-107434) [n:127.0.0.1:38765_solr c:halfcollectionblocker2 x:halfcollection_shard1_replica1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:59396/data/halfcollectionblocker2/core_node1//x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_D11027C0F5C87423-001/tempDir-004/index
[junit4] 2> 4185646 INFO (qtp93065815-107434) [n:127.0.0.1:38765_solr c:halfcollectionblocker2 x:halfcollection_shard1_replica1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 4185646 INFO (qtp93065815-107434) [n:127.0.0.1:38765_solr c:halfcollectionblocker2 x:halfcollection_shard1_replica1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [16777216] will allocate [1] slabs and use ~[16777216] bytes
[junit4] 2> 4185646 INFO (qtp93065815-107434) [n:127.0.0.1:38765_solr c:halfcollectionblocker2 x:halfcollection_shard1_replica1] o.a.s.c.HdfsDirectoryFactory Creating new single instance HDFS BlockCache
[junit4] 2> 4185655 INFO (qtp93065815-107434) [n:127.0.0.1:38765_solr c:halfcollectionblocker2 x:halfcollection_shard1_replica1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 4185672 INFO (IPC Server handler 6 on 59396) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:53137 is added to blk_1073741826_1002{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-746d4adb-571b-4d6d-b6df-228df3ce989b:NORMAL:127.0.0.1:52777|RBW], ReplicaUC[[DISK]DS-ecd879b9-2aaa-4d80-a72d-1b3d8bd2db21:NORMAL:127.0.0.1:53137|RBW]]} size 0
[junit4] 2> 4185673 INFO (IPC Server handler 7 on 59396) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52777 is added to blk_1073741826_1002{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-ecd879b9-2aaa-4d80-a72d-1b3d8bd2db21:NORMAL:127.0.0.1:53137|RBW], ReplicaUC[[DISK]DS-8fca66e0-ff1c-489c-abad-3eca886e1181:NORMAL:127.0.0.1:52777|FINALIZED]]} size 0
[junit4] 2> 4185712 INFO (qtp93065815-107434) [n:127.0.0.1:38765_solr c:halfcollectionblocker2 x:halfcollection_shard1_replica1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
[junit4] 2> 4185712 INFO (qtp93065815-107434) [n:127.0.0.1:38765_solr c:halfcollectionblocker2 x:halfcollection_shard1_replica1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 4185712 INFO (qtp93065815-107434) [n:127.0.0.1:38765_solr c:halfcollectionblocker2 x:halfcollection_shard1_replica1] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=3
[junit4] 2> 4185720 INFO (qtp93065815-107434) [n:127.0.0.1:38765_solr c:halfcollectionblocker2 x:halfcollection_shard1_replica1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 4185720 INFO (qtp93065815-107434) [n:127.0.0.1:38765_solr c:halfcollectionblocker2 x:halfcollection_shard1_replica1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 4185729 INFO (qtp93065815-107434) [n:127.0.0.1:38765_solr c:halfcollectionblocker2 x:halfcollection_shard1_replica1] o.a.s.s.SolrIndexSearcher Opening [Searcher@6dcfc118[halfcollection_shard1_replica1] main]
[junit4] 2> 4185730 INFO (qtp93065815-107434) [n:127.0.0.1:38765_solr c:halfcollectionblocker2 x:halfcollection_shard1_replica1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 4185730 INFO (qtp93065815-107434) [n:127.0.0.1:38765_solr c:halfcollectionblocker2 x:halfcollection_shard1_replica1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 4185730 INFO (qtp93065815-107434) [n:127.0.0.1:38765_solr c:halfcollectionblocker2 x:halfcollection_shard1_replica1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 4185730 INFO (searcherExecutor-9019-thread-1-processing-n:127.0.0.1:38765_solr x:halfcollection_shard1_replica1 c:halfcollectionblocker2) [n:127.0.0.1:38765_solr c:halfcollectionblocker2 x:halfcollection_shard1_replica1] o.a.s.c.SolrCore [halfcollection_shard1_replica1] Registered new searcher Searcher@6dcfc118[halfcollection_shard1_replica1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 4185733 INFO (qtp93065815-107434) [n:127.0.0.1:38765_solr c:halfcollectionblocker2 x:halfcollection_shard1_replica1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1559499014327500800
[junit4] 2> 4185737 INFO (qtp93065815-107434) [n:127.0.0.1:38765_solr c:halfcollectionblocker2 x:halfcollection_shard1_replica1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 4185737 INFO (qtp93065815-107434) [n:127.0.0.1:38765_solr c:halfcollectionblocker2 x:halfcollection_shard1_replica1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 4185737 INFO (qtp93065815-107434) [n:127.0.0.1:38765_solr c:halfcollectionblocker2 x:halfcollection_shard1_replica1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:38765/solr/halfcollection_shard1_replica1/
[junit4] 2> 4185737 INFO (qtp93065815-107434) [n:127.0.0.1:38765_solr c:halfcollectionblocker2 x:halfcollection_shard1_replica1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 4185737 INFO (qtp93065815-107434) [n:127.0.0.1:38765_solr c:halfcollectionblocker2 x:halfcollection_shard1_replica1] o.a.s.c.SyncStrategy http://127.0.0.1:38765/solr/halfcollection_shard1_replica1/ has no replicas
[junit4] 2> 4185739 INFO (qtp93065815-107434) [n:127.0.0.1:38765_solr c:halfcollectionblocker2 x:halfcollection_shard1_replica1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:38765/solr/halfcollection_shard1_replica1/ shard1
[junit4] 2> 4185890 INFO (qtp93065815-107434) [n:127.0.0.1:38765_solr c:halfcollectionblocker2 x:halfcollection_shard1_replica1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 4185892 INFO (qtp93065815-107434) [n:127.0.0.1:38765_solr c:halfcollectionblocker2 x:halfcollection_shard1_replica1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={dataDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_D11027C0F5C87423-001/tempDir-004&collection.configName=conf&name=halfcollection_shard1_replica1&action=CREATE&numShards=1&collection=halfcollectionblocker2&wt=javabin&version=2} status=0 QTime=1311
[junit4] 2> 4185894 INFO (qtp380572432-107444) [n:127.0.0.1:59544_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf&name=halfcollection&action=CREATE&numShards=2&createNodeSet=127.0.0.1:52392_solr,127.0.0.1:38765_solr&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 4185895 INFO (OverseerThreadFactory-9005-thread-2-processing-n:127.0.0.1:45824_solr) [n:127.0.0.1:45824_solr ] o.a.s.c.CreateCollectionCmd Create collection halfcollection
[junit4] 2> 4186099 INFO (qtp1495300344-107441) [n:127.0.0.1:52392_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf&newCollection=true&name=halfcollection_shard1_replica1&action=CREATE&numShards=2&collection=halfcollection&shard=shard1&wt=javabin&version=2
[junit4] 2> 4186099 INFO (qtp93065815-107438) [n:127.0.0.1:38765_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf&newCollection=true&name=halfcollection_shard2_replica1&action=CREATE&numShards=2&collection=halfcollection&shard=shard2&wt=javabin&version=2
[junit4] 2> 4186100 WARN (qtp1495300344-107441) [n:127.0.0.1:52392_solr ] o.a.s.c.CoreContainer Creating a core with existing name is not allowed
[junit4] 2> 4186100 ERROR (qtp1495300344-107441) [n:127.0.0.1:52392_solr ] o.a.s.h.RequestHandlerBase org.apache.solr.common.SolrException: Core with name 'halfcollection_shard1_replica1' already exists.
[junit4] 2> at org.apache.solr.core.CoreContainer.create(CoreContainer.java:825)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:88)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:378)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:388)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:174)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:171)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:748)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:729)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:510)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:347)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:298)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1699)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:110)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1699)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
[junit4] 2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:395)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:534)
[junit4] 2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
[junit4] 2> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:273)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)
[junit4] 2> at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.execute(ExecuteProduceConsume.java:100)
[junit4] 2> at org.eclipse.jetty.io.ManagedSelector.run(ManagedSelector.java:147)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 4186100 INFO (qtp1495300344-107441) [n:127.0.0.1:52392_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf&newCollection=true&name=halfcollection_shard1_replica1&action=CREATE&numShards=2&collection=halfcollection&shard=shard1&wt=javabin&version=2} status=500 QTime=1
[junit4] 2> 4186100 ERROR (qtp1495300344-107441) [n:127.0.0.1:52392_solr ] o.a.s.s.HttpSolrCall null:org.apache.solr.common.SolrException: Core with name 'halfcollection_shard1_replica1' already exists.
[junit4] 2> at org.apache.solr.core.CoreContainer.create(CoreContainer.java:825)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:88)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:378)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:388)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:174)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:171)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:748)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:729)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:510)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:347)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:298)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1699)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:110)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1699)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
[junit4] 2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:395)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:534)
[junit4] 2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
[junit4] 2> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:273)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)
[junit4] 2> at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.execute(ExecuteProduceConsume.java:100)
[junit4] 2> at org.eclipse.jetty.io.ManagedSelector.run(ManagedSelector.java:147)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 4186101 ERROR (OverseerThreadFactory-9005-thread-2-processing-n:127.0.0.1:45824_solr) [n:127.0.0.1:45824_solr ] o.a.s.c.OverseerCollectionMessageHandler Error from shard: http://127.0.0.1:52392/solr
[junit4] 2> org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:52392/solr: Core with name 'halfcollection_shard1_replica1' already exists.
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:610)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:279)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:268)
[junit4] 2> at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
[junit4] 2> at org.apache.solr.handler.component.HttpShardHandler.lambda$submit$0(HttpShardHandler.java:163)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] 2> at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 4186203 INFO (zkCallback-4006-thread-1-processing-n:127.0.0.1:38765_solr) [n:127.0.0.1:38765_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/halfcollection/state.json] for collection [halfcollection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 4187106 INFO (qtp93065815-107438) [n:127.0.0.1:38765_solr c:halfcollection s:shard2 x:halfcollection_shard2_replica1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
[junit4] 2> 4187113 INFO (qtp93065815-107438) [n:127.0.0.1:38765_solr c:halfcollection s:shard2 x:halfcollection_shard2_replica1] o.a.s.s.IndexSchema [halfcollection_shard2_replica1] Schema name=minimal
[junit4] 2> 4187116 INFO (qtp93065815-107438) [n:127.0.0.1:38765_solr c:halfcollection s:shard2 x:halfcollection_shard2_replica1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 4187116 INFO (qtp93065815-107438) [n:127.0.0.1:38765_solr c:halfcollection s:shard2 x:halfcollection_shard2_replica1] o.a.s.c.CoreContainer Creating SolrCore 'halfcollection_shard2_replica1' using configuration from collection halfcollection
[junit4] 2> 4187117 INFO (qtp93065815-107438) [n:127.0.0.1:38765_solr c:halfcollection s:shard2 x:halfcollection_shard2_replica1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:59396/data
[junit4] 2> 4187117 INFO (qtp93065815-107438) [n:127.0.0.1:38765_solr c:halfcollection s:shard2 x:halfcollection_shard2_replica1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 4187117 INFO (qtp93065815-107438) [n:127.0.0.1:38765_solr c:halfcollection s:shard2 x:halfcollection_shard2_replica1] o.a.s.c.SolrCore [[halfcollection_shard2_replica1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_D11027C0F5C87423-001/tempDir-001/node2/halfcollection_shard2_replica1], dataDir=[hdfs://localhost:59396/data/halfcollection/core_node1/data/]
[junit4] 2> 4187117 INFO (qtp93065815-107438) [n:127.0.0.1:38765_solr c:halfcollection s:shard2 x:halfcollection_shard2_replica1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1f7fe27c
[junit4] 2> 4187117 INFO (qtp93065815-107438) [n:127.0.0.1:38765_solr c:halfcollection s:shard2 x:halfcollection_shard2_replica1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:59396/data/halfcollection/core_node1/data/snapshot_metadata
[junit4] 2> 4187123 INFO (qtp93065815-107438) [n:127.0.0.1:38765_solr c:halfcollection s:shard2 x:halfcollection_shard2_replica1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 4187123 INFO (qtp93065815-107438) [n:127.0.0.1:38765_solr c:halfcollection s:shard2 x:halfcollection_shard2_replica1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [16777216] will allocate [1] slabs and use ~[16777216] bytes
[junit4] 2> 4187123 INFO (qtp93065815-107438) [n:127.0.0.1:38765_solr c:halfcollection s:shard2 x:halfcollection_shard2_replica1] o.a.s.c.HdfsDirectoryFactory Creating new single instance HDFS BlockCache
[junit4] 2> 4187136 INFO (qtp93065815-107438) [n:127.0.0.1:38765_solr c:halfcollection s:shard2 x:halfcollection_shard2_replica1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 4187137 INFO (qtp93065815-107438) [n:127.0.0.1:38765_solr c:halfcollection s:shard2 x:halfcollection_shard2_replica1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:59396/data/halfcollection/core_node1/data
[junit4] 2> 4187150 INFO (qtp93065815-107438) [n:127.0.0.1:38765_solr c:halfcollection s:shard2 x:halfcollection_shard2_replica1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:59396/data/halfcollection/core_node1/data/index
[junit4] 2> 4187155 INFO (qtp93065815-107438) [n:127.0.0.1:38765_solr c:halfcollection s:shard2 x:halfcollection_shard2_replica1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 4187155 INFO (qtp93065815-107438) [n:127.0.0.1:38765_solr c:halfcollection s:shard2 x:halfcollection_shard2_replica1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [16777216] will allocate [1] slabs and use ~[16777216] bytes
[junit4] 2> 4187156 INFO (qtp93065815-107438) [n:127.0.0.1:38765_solr c:halfcollection s:shard2 x:halfcollection_shard2_replica1] o.a.s.c.HdfsDirectoryFactory Creating new single instance HDFS BlockCache
[junit4] 2> 4187165 INFO (qtp93065815-107438) [n:127.0.0.1:38765_solr c:halfcollection s:shard2 x:halfcollection_shard2_replica1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 4187173 INFO (IPC Server handler 0 on 59396) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:53137 is added to blk_1073741827_1003{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-746d4adb-571b-4d6d-b6df-228df3ce989b:NORMAL:127.0.0.1:52777|RBW], ReplicaUC[[DISK]DS-3e27ac0a-6af1-42c5-9a18-6bbd69ef2122:NORMAL:127.0.0.1:53137|FINALIZED]]} size 0
[junit4] 2> 4187173 INFO (IPC Server handler 1 on 59396) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52777 is added to blk_1073741827_1003{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-746d4adb-571b-4d6d-b6df-228df3ce989b:NORMAL:127.0.0.1:52777|RBW], ReplicaUC[[DISK]DS-3e27ac0a-6af1-42c5-9a18-6bbd69ef2122:NORMAL:127.0.0.1:53137|FINALIZED]]} size 0
[junit4] 2> 4187209 INFO (qtp93065815-107438) [n:127.0.0.1:38765_solr c:halfcollection s:shard2 x:halfcollection_shard2_replica1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
[junit4] 2> 4187209 INFO (qtp93065815-107438) [n:127.0.0.1:38765_solr c:halfcollection s:shard2 x:halfcollection_shard2_replica1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 4187210 INFO (qtp93065815-107438) [n:127.0.0.1:38765_solr c:halfcollection s:shard2 x:halfcollection_shard2_replica1] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=3
[junit4] 2> 4187219 INFO (qtp93065815-107438) [n:127.0.0.1:38765_solr c:halfcollection s:shard2 x:halfcollection_shard2_replica1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 4187219 INFO (qtp93065815-107438) [n:127.0.0.1:38765_solr c:halfcollection s:shard2 x:halfcollection_shard2_replica1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 4187223 INFO (qtp93065815-107438) [n:127.0.0.1:38765_solr c:halfcollection s:shard2 x:halfcollection_shard2_replica1] o.a.s.s.SolrIndexSearcher Opening [Searcher@7b46b98[halfcollection_shard2_replica1] main]
[junit4] 2> 4187224 INFO (qtp93065815-107438) [n:127.0.0.1:38765_solr c:halfcollection s:shard2 x:halfcollection_shard2_replica1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 4187224 INFO (qtp93065815-107438) [n:127.0.0.1:38765_solr c:halfcollection s:shard2 x:halfcollection_shard2_replica1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 4187224 INFO (qtp93065815-107438) [n:127.0.0.1:38765_solr c:halfcollection s:shard2 x:halfcollection_shard2_replica1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 4187225 INFO (searcherExecutor-9024-thread-1-processing-n:127.0.0.1:38765_solr x:halfcollection_shard2_replica1 s:shard2 c:halfcollection) [n:127.0.0.1:38765_solr c:halfcollection s:shard2 x:halfcollection_shard2_replica1] o.a.s.c.SolrCore [halfcollection_shard2_replica1] Registered new searcher Searcher@7b46b98[halfcollection_shard2_replica1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 4187227 INFO (qtp93065815-107438) [n:127.0.0.1:38765_solr c:halfcollection s:shard2 x:halfcollection_shard2_replica1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1559499015894073344
[junit4] 2> 4187231 INFO (qtp93065815-107438) [n:127.0.0.1:38765_solr c:halfcollection s:shard2 x:halfcollection_shard2_replica1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 4187231 INFO (qtp93065815-107438) [n:127.0.0.1:38765_solr c:halfcollection s:shard2 x:halfcollection_shard2_replica1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 4187231 INFO (qtp93065815-107438) [n:127.0.0.1:38765_solr c:halfcollection s:shard2 x:halfcollection_shard2_replica1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:38765/solr/halfcollection_shard2_replica1/
[junit4] 2> 4187231 INFO (qtp93065815-107438) [n:127.0.0.1:38765_solr c:halfcollection s:shard2 x:halfcollection_shard2_replica1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 4187231 INFO (qtp93065815-107438) [n:127.0.0.1:38765_solr c:halfcollection s:shard2 x:halfcollection_shard2_replica1] o.a.s.c.SyncStrategy http://127.0.0.1:38765/solr/halfcollection_shard2_replica1/ has no replicas
[junit4] 2> 4187233 INFO (qtp93065815-107438) [n:127.0.0.1:38765_solr c:halfcollection s:shard2 x:halfcollection_shard2_replica1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:38765/solr/halfcollection_shard2_replica1/ shard2
[junit4] 2> 4187335 INFO (zkCallback-4006-thread-1-processing-n:127.0.0.1:38765_solr) [n:127.0.0.1:38765_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/halfcollection/state.json] for collection [halfcollection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 4187384 INFO (qtp93065815-107438) [n:127.0.0.1:38765_solr c:halfcollection s:shard2 x:halfcollection_shard2_replica1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 4187385 INFO (qtp93065815-107438) [n:127.0.0.1:38765_solr c:halfcollection s:shard2 x:halfcollection_shard2_replica1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf&newCollection=true&name=halfcollection_shard2_replica1&action=CREATE&numShards=2&collection=halfcollection&shard=shard2&wt=javabin&version=2} status=0 QTime=1286
[junit4] 2> 4187386 ERROR (OverseerThreadFactory-9005-thread-2-processing-n:127.0.0.1:45824_solr) [n:127.0.0.1:45824_solr ] o.a.s.c.OverseerCollectionMessageHandler Cleaning up collection [halfcollection].
[junit4] 2> 4187386 INFO (OverseerThreadFactory-9005-thread-2-processing-n:127.0.0.1:45824_solr) [n:127.0.0.1:45824_solr ] o.a.s.c.OverseerCollectionMessageHandler Executing Collection Cmd : action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true
[junit4] 2> 4187388 INFO (qtp93065815-107443) [n:127.0.0.1:38765_solr ] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.core.halfcollection.shard2.replica1
[junit4] 2> 4187389 INFO (qtp93065815-107443) [n:127.0.0.1:38765_solr ] o.a.s.c.SolrCore [halfcollection_shard2_replica1] CLOSING SolrCore org.apache.solr.core.SolrCore@3e69a350
[junit4] 2> 4187481 INFO (qtp93065815-107443) [n:127.0.0.1:38765_solr ] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.core.halfcollection.shard2.replica1
[junit4] 2> 4187482 INFO (qtp93065815-107443) [n:127.0.0.1:38765_solr ] o.a.s.s.h.HdfsDirectory Closing hdfs directory hdfs://localhost:59396/data/halfcollection/core_node1/data/index
[junit4] 2> 4187482 INFO (qtp93065815-107443) [n:127.0.0.1:38765_solr ] o.a.s.s.h.HdfsDirectory Closing hdfs directory hdfs://localhost:59396/data/halfcollection/core_node1/data/snapshot_metadata
[junit4] 2> 4187482 INFO (qtp93065815-107443) [n:127.0.0.1:38765_solr ] o.a.s.s.h.HdfsDirectory Closing hdfs directory hdfs://localhost:59396/data/halfcollection/core_node1/data
[junit4] 2> 4187487 INFO (zkCallback-4006-thread-1-processing-n:127.0.0.1:38765_solr) [n:127.0.0.1:38765_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/halfcollection/state.json] for collection [halfcollection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 4187488 INFO (IPC Server handler 5 on 59396) [ ] BlockStateChange BLOCK* addToInvalidates: blk_1073741827_1003 127.0.0.1:52777 127.0.0.1:53137
[junit4] 2> 4187488 ERROR (OldIndexDirectoryCleanupThreadForCore-halfcollection_shard2_replica1) [n:127.0.0.1:38765_solr ] o.a.s.c.HdfsDirectoryFactory Error checking if path hdfs://localhost:59396/data/halfcollection/core_node1/data/snapshot_metadata is an old index directory, caused by: java.io.IOException: Filesystem closed
[junit4] 2> 4187489 ERROR (OldIndexDirectoryCleanupThreadForCore-halfcollection_shard2_replica1) [n:127.0.0.1:38765_solr ] o.a.s.c.HdfsDirectoryFactory Error checking if path hdfs://localhost:59396/data/halfcollection/core_node1/data/tlog is an old index directory, caused by: java.io.IOException: Filesystem closed
[junit4] 2> 4187490 INFO (qtp93065815-107443) [n:127.0.0.1:38765_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={deleteInstanceDir=true&core=halfcollection_shard2_replica1&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2} status=0 QTime=101
[junit4] 2> 4188144 INFO (org.apache.hadoop.hdfs.server.blockmanagement.BlockManager$ReplicationMonitor@7d67b318) [ ] BlockStateChange BLOCK* BlockManager: ask 127.0.0.1:52777 to delete [blk_1073741827_1003]
[junit4] 2> 4188192 INFO (OverseerThreadFactory-9005-thread-2-processing-n:127.0.0.1:45824_solr) [n:127.0.0.1:45824_solr ] o.a.s.c.CreateCollectionCmd Cleaned up artifacts for failed create collection for [halfcollection]
[junit4] 2> 4188193 INFO (qtp380572432-107444) [n:127.0.0.1:59544_solr ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 4189897 INFO (OverseerCollectionConfigSetProcessor-97468687991963655-127.0.0.1:45824_solr-n_0000000000) [n:127.0.0.1:45824_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 4191144 INFO (org.apache.hadoop.hdfs.server.blockmanagement.BlockManager$ReplicationMonitor@7d67b318) [ ] BlockStateChange BLOCK* BlockManager: ask 127.0.0.1:53137 to delete [blk_1073741827_1003]
[junit4] 2> 4218196 ERROR (qtp380572432-107444) [n:127.0.0.1:59544_solr ] o.a.s.h.a.CollectionsHandler Timed out waiting for new collection's replicas to become ACTIVE with timeout=30
[junit4] 2> 4218196 INFO (qtp380572432-107444) [n:127.0.0.1:59544_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf&name=halfcollection&action=CREATE&numShards=2&createNodeSet=127.0.0.1:52392_solr,127.0.0.1:38765_solr&wt=javabin&version=2} status=0 QTime=32302
[junit4] 2> 4218196 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.testCreateShouldFailOnExistingCore-seed#[D11027C0F5C87423]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testCreateShouldFailOnExistingCore
[junit4] 2> 4218261 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.testZeroNumShards-seed#[D11027C0F5C87423]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testZeroNumShards
[junit4] 2> 4218261 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.testZeroNumShards-seed#[D11027C0F5C87423]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 4218264 INFO (qtp380572432-107428) [n:127.0.0.1:59544_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :delete with params name=halfcollectionblocker2&action=DELETE&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 4218266 INFO (OverseerThreadFactory-9005-thread-3-processing-n:127.0.0.1:45824_solr) [n:127.0.0.1:45824_solr ] o.a.s.c.OverseerCollectionMessageHandler Executing Collection Cmd : action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true
[junit4] 2> 4218266 INFO (qtp93065815-107437) [n:127.0.0.1:38765_solr ] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.core.halfcollection_shard1_replica1
[junit4] 2> 4218267 INFO (qtp93065815-107437) [n:127.0.0.1:38765_solr ] o.a.s.c.SolrCore [halfcollection_shard1_replica1] CLOSING SolrCore org.apache.solr.core.SolrCore@19652138
[junit4] 2> 4218315 INFO (qtp93065815-107437) [n:127.0.0.1:38765_solr ] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.core.halfcollection_shard1_replica1
[junit4] 2> 4218316 INFO (qtp93065815-107437) [n:127.0.0.1:38765_solr ] o.a.s.s.h.HdfsDirectory Closing hdfs directory hdfs://localhost:59396/data/halfcollectionblocker2/core_node1/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_D11027C0F5C87423-001/tempDir-004/index
[junit4] 2> 4218316 INFO (qtp93065815-107437) [n:127.0.0.1:38765_solr ] o.a.s.s.h.HdfsDirectory Closing hdfs directory hdfs://localhost:59396/data/halfcollectionblocker2/core_node1/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_D11027C0F5C87423-001/tempDir-004/snapshot_metadata
[junit4] 2> 4218316 INFO (qtp93065815-107437) [n:127.0.0.1:38765_solr ] o.a.s.s.h.HdfsDirectory Closing hdfs directory hdfs://localhost:59396/data/halfcollectionblocker2/core_node1/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_D11027C0F5C87423-001/tempDir-004
[junit4] 2> 4218323 INFO (IPC Server handler 3 on 59396) [ ] BlockStateChange BLOCK* addToInvalidates: blk_1073741826_1002 127.0.0.1:52777 127.0.0.1:53137
[junit4] 2> 4218324 ERROR (OldIndexDirectoryCleanupThreadForCore-halfcollection_shard1_replica1) [n:127.0.0.1:38765_solr ] o.a.s.c.HdfsDirectoryFactory Error checking if path hdfs://localhost:59396/data/halfcollectionblocker2/core_node1/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_D11027C0F5C87423-001/tempDir-004/snapshot_metadata is an old index directory, caused by: java.io.IOException: Filesystem closed
[junit4] 2> 4218324 ERROR (OldIndexDirectoryCleanupThreadForCore-halfcollection_shard1_replica1) [n:127.0.0.1:38765_solr ] o.a.s.c.HdfsDirectoryFactory Error checking if path hdfs://localhost:59396/data/halfcollectionblocker2/core_node1/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_D11027C0F5C87423-001/tempDir-004/tlog is an old index directory, caused by: java.io.IOException: Filesystem closed
[junit4] 2> 4218326 INFO (qtp93065815-107437) [n:127.0.0.1:38765_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={deleteInstanceDir=true&core=halfcollection_shard1_replica1&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2} status=0 QTime=60
[junit4] 2> 4219031 INFO (qtp380572432-107428) [n:127.0.0.1:59544_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={name=halfcollectionblocker2&action=DELETE&wt=javabin&version=2} status=0 QTime=767
[junit4] 2> 4219033 INFO (qtp380572432-107445) [n:127.0.0.1:59544_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :delete with params name=halfcollectionblocker&action=DELETE&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 4219035 INFO (OverseerThreadFactory-9005-thread-4-processing-n:127.0.0.1:45824_solr) [n:127.0.0.1:45824_solr ] o.a.s.c.OverseerCollectionMessageHandler Executing Collection Cmd : action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true
[junit4] 2> 4219035 INFO (OverseerCollectionConfigSetProcessor-97468687991963655-127.0.0.1:45824_solr-n_0000000000) [n:127.0.0.1:45824_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 4219036 INFO (qtp1495300344-107458) [n:127.0.0.1:52392_solr ] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.core.halfcollection_shard1_replica1
[junit4] 2> 4219036 INFO (qtp1495300344-107458) [n:127.0.0.1:52392_solr ] o.a.s.c.SolrCore [
[...truncated too long message...]
ver.JmxMBeanServer.unregisterMBean(JmxMBeanServer.java:546)
[junit4] 2> at org.apache.hadoop.metrics2.util.MBeans.unregister(MBeans.java:81)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stopMBeans(MetricsSourceAdapter.java:226)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stop(MetricsSourceAdapter.java:211)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stopSources(MetricsSystemImpl.java:463)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stop(MetricsSystemImpl.java:213)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.shutdown(MetricsSystemImpl.java:594)
[junit4] 2> at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdownInstance(DefaultMetricsSystem.java:72)
[junit4] 2> at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdown(DefaultMetricsSystem.java:68)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.metrics.NameNodeMetrics.shutdown(NameNodeMetrics.java:171)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.NameNode.stop(NameNode.java:872)
[junit4] 2> at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1726)
[junit4] 2> at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1705)
[junit4] 2> at org.apache.solr.cloud.hdfs.HdfsTestUtil.teardownClass(HdfsTestUtil.java:198)
[junit4] 2> at org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest.teardownClass(HdfsWriteToMultipleCollectionsTest.java:73)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:498)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:870)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> Caused by: java.lang.NullPointerException
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlocksMap.size(BlocksMap.java:203)
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.getTotalBlocks(BlockManager.java:3370)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlocksTotal(FSNamesystem.java:5729)
[junit4] 2> ... 53 more
[junit4] 2> 4560612 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[D11027C0F5C87423]-worker) [ ] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_D11027C0F5C87423-001
[junit4] 2> Feb 16, 2017 2:15:31 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 34 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=CheapBastard, sim=RandomSimilarity(queryNorm=false,coord=crazy): {}, locale=es-UY, timezone=Asia/Gaza
[junit4] 2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_121 (64-bit)/cpus=4,threads=2,free=162418680,total=526385152
[junit4] 2> NOTE: All tests run in this JVM: [TestFaceting, CursorPagingTest, TestIBSimilarityFactory, TestPathTrie, TestInitQParser, TestFreeTextSuggestions, TestFieldCacheReopen, TestPointFields, SolrCLIZkUtilsTest, LeaderInitiatedRecoveryOnShardRestartTest, TestNonDefinedSimilarityFactory, FileBasedSpellCheckerTest, TestJmxIntegration, DefaultValueUpdateProcessorTest, ZkStateWriterTest, TestDelegationWithHadoopAuth, ChangedSchemaMergeTest, SynonymTokenizerTest, TestSQLHandlerNonCloud, TestPushWriter, ClassificationUpdateProcessorTest, BlockDirectoryTest, TestPKIAuthenticationPlugin, OverseerCollectionConfigSetProcessorTest, DateFieldTest, TestSolrQueryResponse, SolrIndexMetricsTest, TestRandomDVFaceting, VMParamsZkACLAndCredentialsProvidersTest, TestComplexPhraseQParserPlugin, TestMiniSolrCloudClusterSSL, ClusterStateTest, TestHdfsUpdateLog, DistributedQueryElevationComponentTest, CdcrBootstrapTest, TestJoin, HdfsTlogReplayBufferedWhileIndexingTest, TestLazyCores, TestDynamicFieldCollectionResource, TestExpandComponent, SSLMigrationTest, DistributedSpellCheckComponentTest, TestNoOpRegenerator, TestPHPSerializedResponseWriter, LeaderElectionIntegrationTest, RegexBoostProcessorTest, TestAuthenticationFramework, HLLUtilTest, DisMaxRequestHandlerTest, SpatialRPTFieldTypeTest, TestReloadAndDeleteDocs, TestSolrCoreSnapshots, TestExactSharedStatsCache, RulesTest, AtomicUpdatesTest, TestRecoveryHdfs, QueryElevationComponentTest, TestBadConfig, TestRandomRequestDistribution, SolrSlf4jReporterTest, OverseerStatusTest, UUIDFieldTest, PolyFieldTest, TestSubQueryTransformerCrossCore, SignatureUpdateProcessorFactoryTest, AlternateDirectoryTest, TestFunctionQuery, SuggestComponentContextFilterQueryTest, ForceLeaderTest, ScriptEngineTest, TestDocSet, TestBinaryResponseWriter, XsltUpdateRequestHandlerTest, CollectionStateFormat2Test, BlockJoinFacetSimpleTest, TestCSVLoader, DistributedFacetPivotLongTailTest, TestRemoteStreaming, IgnoreCommitOptimizeUpdateProcessorFactoryTest, DistributedSuggestComponentTest, TestInfoStreamLogging, CollectionsAPISolrJTest, TestUseDocValuesAsStored, SharedFSAutoReplicaFailoverTest, ReplicationFactorTest, AnalyticsQueryTest, TestDistributedSearch, TestSolrDeletionPolicy2, HdfsRestartWhileUpdatingTest, SyncSliceTest, ConnectionManagerTest, TestOmitPositions, TestManagedResourceStorage, DeleteInactiveReplicaTest, TestGeoJSONResponseWriter, DeleteReplicaTest, DocumentAnalysisRequestHandlerTest, SolrGangliaReporterTest, ZkNodePropsTest, StandardRequestHandlerTest, TestExclusionRuleCollectionAccess, TolerantUpdateProcessorTest, MultiThreadedOCPTest, TestLeaderElectionZkExpiry, ResourceLoaderTest, HdfsLockFactoryTest, DistributedQueueTest, TestMacros, BasicZkTest, FullSolrCloudDistribCmdsTest, TestRandomFaceting, ShardRoutingCustomTest, TestDistributedGrouping, TestRecovery, TestHashPartitioner, ZkControllerTest, TestRealTimeGet, TestStressReorder, HardAutoCommitTest, TestRangeQuery, HighlighterConfigTest, SOLR749Test, TestQuerySenderListener, UpdateParamsTest, TestQuerySenderNoQuery, CopyFieldTest, TestStressRecovery, TestMergePolicyConfig, MultiTermTest, TestBinaryField, TestSearchPerf, NumericFieldsTest, MinimalSchemaTest, TestElisionMultitermQuery, OutputWriterTest, TestFuzzyAnalyzedSuggestions, ExternalFileFieldSortTest, TestSolrCoreProperties, TestPostingsSolrHighlighter, DirectSolrConnectionTest, NotRequiredUniqueKeyTest, TestLuceneMatchVersion, TestCharFilters, TestCodecSupport, TestXIncludeConfig, TestSweetSpotSimilarityFactory, TestDFRSimilarityFactory, TestPerFieldSimilarity, TestLMDirichletSimilarityFactory, TestLMJelinekMercerSimilarityFactory, TestBM25SimilarityFactory, TestFastWriter, TestJmxMonitoredMap, TimeZoneUtilsTest, URLClassifyProcessorTest, PluginInfoTest, TestFastLRUCache, ChaosMonkeyNothingIsSafeTest, CdcrReplicationHandlerTest, CdcrRequestHandlerTest, ConfigSetsAPITest, CustomCollectionTest, DeleteLastCustomShardedReplicaTest, DeleteNodeTest, DeleteShardTest, DistribCursorPagingTest, LeaderElectionContextKeyTest, LeaderFailoverAfterPartitionTest, LeaderFailureAfterFreshStartTest, RecoveryAfterSoftCommitTest, RemoteQueryErrorTest, SaslZkACLProviderTest, ShardSplitTest, TestTolerantUpdateProcessorRandomCloud, TriLevelCompositeIdRoutingTest, HdfsBasicDistributedZk2Test, HdfsChaosMonkeyNothingIsSafeTest, HdfsCollectionsAPIDistributedZkTest, HdfsNNFailoverTest, HdfsRecoveryZkTest, HdfsSyncSliceTest, HdfsWriteToMultipleCollectionsTest]
[junit4] Completed [536/692 (2!)] on J0 in 34.05s, 1 test, 1 failure <<< FAILURES!
[...truncated 63105 lines...]
[JENKINS] Lucene-Solr-NightlyTests-6.x - Build # 284 - Still
Unstable
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.x/284/
6 tests failed.
FAILED: org.apache.lucene.search.TestFuzzyQuery.testRandom
Error Message:
Test abandoned because suite timeout was reached.
Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
at __randomizedtesting.SeedInfo.seed([47D1D58C4825005F]:0)
FAILED: junit.framework.TestSuite.org.apache.lucene.search.TestFuzzyQuery
Error Message:
Suite timeout exceeded (>= 7200000 msec).
Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
at __randomizedtesting.SeedInfo.seed([47D1D58C4825005F]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.DeleteInactiveReplicaTest
Error Message:
ObjectTracker found 1 object(s) that were not released!!! [Overseer] org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.cloud.Overseer.start(Overseer.java:523) at org.apache.solr.cloud.OverseerElectionContext.runLeaderProcess(ElectionContext.java:747) at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:170) at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:135) at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:56) at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:348) at org.apache.solr.common.cloud.SolrZkClient$3.lambda$process$0(SolrZkClient.java:268) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745)
Stack Trace:
java.lang.AssertionError: ObjectTracker found 1 object(s) that were not released!!! [Overseer]
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException
at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
at org.apache.solr.cloud.Overseer.start(Overseer.java:523)
at org.apache.solr.cloud.OverseerElectionContext.runLeaderProcess(ElectionContext.java:747)
at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:170)
at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:135)
at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:56)
at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:348)
at org.apache.solr.common.cloud.SolrZkClient$3.lambda$process$0(SolrZkClient.java:268)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
at __randomizedtesting.SeedInfo.seed([60BC73E0E73B44EE]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNull(Assert.java:551)
at org.apache.solr.SolrTestCaseJ4.teardownTestCases(SolrTestCaseJ4.java:301)
at sun.reflect.GeneratedMethodAccessor133.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:870)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.DeleteInactiveReplicaTest
Error Message:
1 thread leaked from SUITE scope at org.apache.solr.cloud.DeleteInactiveReplicaTest: 1) Thread[id=234363, name=OverseerHdfsCoreFailoverThread-97464219946188811-127.0.0.1:43049_solr-n_0000000003, state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.] at java.lang.Thread.sleep(Native Method) at org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:139) at java.lang.Thread.run(Thread.java:745)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.DeleteInactiveReplicaTest:
1) Thread[id=234363, name=OverseerHdfsCoreFailoverThread-97464219946188811-127.0.0.1:43049_solr-n_0000000003, state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.]
at java.lang.Thread.sleep(Native Method)
at org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:139)
at java.lang.Thread.run(Thread.java:745)
at __randomizedtesting.SeedInfo.seed([60BC73E0E73B44EE]:0)
FAILED: org.apache.solr.cloud.SharedFSAutoReplicaFailoverTest.test
Error Message:
Timeout waiting for all live and active
Stack Trace:
java.lang.AssertionError: Timeout waiting for all live and active
at __randomizedtesting.SeedInfo.seed([60BC73E0E73B44EE:E8E84C3A49C72916]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.cloud.SharedFSAutoReplicaFailoverTest.testBasics(SharedFSAutoReplicaFailoverTest.java:309)
at org.apache.solr.cloud.SharedFSAutoReplicaFailoverTest.test(SharedFSAutoReplicaFailoverTest.java:127)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest.test
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([60BC73E0E73B44EE:E8E84C3A49C72916]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertTrue(Assert.java:54)
at org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest.test(HdfsWriteToMultipleCollectionsTest.java:137)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 1864 lines...]
[junit4] Suite: org.apache.lucene.search.TestFuzzyQuery
[junit4] 2> feb 15, 2017 4:15:58 PM com.carrotsearch.randomizedtesting.ThreadLeakControl$2 evaluate
[junit4] 2> WARNING: Suite execution timed out: org.apache.lucene.search.TestFuzzyQuery
[junit4] 2> 1) Thread[id=9, name=JUnit4-serializer-daemon, state=TIMED_WAITING, group=main]
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at com.carrotsearch.ant.tasks.junit4.events.Serializer$1.run(Serializer.java:50)
[junit4] 2> 2) Thread[id=4632, name=SUITE-TestFuzzyQuery-seed#[47D1D58C4825005F], state=RUNNABLE, group=TGRP-TestFuzzyQuery]
[junit4] 2> at java.lang.Thread.getStackTrace(Thread.java:1556)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$4.run(ThreadLeakControl.java:696)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$4.run(ThreadLeakControl.java:693)
[junit4] 2> at java.security.AccessController.doPrivileged(Native Method)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.getStackTrace(ThreadLeakControl.java:693)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.getThreadsWithTraces(ThreadLeakControl.java:709)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.formatThreadStacksFull(ThreadLeakControl.java:689)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.access$1000(ThreadLeakControl.java:65)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$2.evaluate(ThreadLeakControl.java:415)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:678)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.access$200(RandomizedRunner.java:140)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:598)
[junit4] 2> 3) Thread[id=4633, name=TEST-TestFuzzyQuery.testRandom-seed#[47D1D58C4825005F], state=RUNNABLE, group=TGRP-TestFuzzyQuery]
[junit4] 2> at java.util.WeakHashMap.getTable(WeakHashMap.java:350)
[junit4] 2> at java.util.WeakHashMap.getEntry(WeakHashMap.java:427)
[junit4] 2> at java.util.WeakHashMap.containsKey(WeakHashMap.java:417)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedContext.context(RandomizedContext.java:258)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedContext.current(RandomizedContext.java:134)
[junit4] 2> at org.apache.lucene.util.LuceneTestCase.random(LuceneTestCase.java:747)
[junit4] 2> at org.apache.lucene.search.TestFuzzyQuery.randomSimpleString(TestFuzzyQuery.java:506)
[junit4] 2> at org.apache.lucene.search.TestFuzzyQuery.testRandom(TestFuzzyQuery.java:517)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:498)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
[junit4] 2> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 4) Thread[id=1, name=main, state=WAITING, group=main]
[junit4] 2> at java.lang.Object.wait(Native Method)
[junit4] 2> at java.lang.Thread.join(Thread.java:1249)
[junit4] 2> at java.lang.Thread.join(Thread.java:1323)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:608)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.run(RandomizedRunner.java:457)
[junit4] 2> at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.execute(SlaveMain.java:244)
[junit4] 2> at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.main(SlaveMain.java:355)
[junit4] 2> at com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe.main(SlaveMainSafe.java:13)
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestFuzzyQuery -Dtests.method=testRandom -Dtests.seed=47D1D58C4825005F -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/test-data/enwiki.random.lines.txt -Dtests.locale=es-PY -Dtests.timezone=Africa/Bissau -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] ERROR 7200s J1 | TestFuzzyQuery.testRandom <<<
[junit4] > Throwable #1: java.lang.Exception: Test abandoned because suite timeout was reached.
[junit4] > at __randomizedtesting.SeedInfo.seed([47D1D58C4825005F]:0)
[junit4] 2> feb 15, 2017 4:15:58 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> feb 15, 2017 4:16:18 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> SEVERE: 1 thread leaked from SUITE scope at org.apache.lucene.search.TestFuzzyQuery:
[junit4] 2> 1) Thread[id=4633, name=TEST-TestFuzzyQuery.testRandom-seed#[47D1D58C4825005F], state=RUNNABLE, group=TGRP-TestFuzzyQuery]
[junit4] 2> at java.util.WeakHashMap.getTable(WeakHashMap.java:350)
[junit4] 2> at java.util.WeakHashMap.get(WeakHashMap.java:397)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedContext.getPerThread(RandomizedContext.java:319)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedContext.getRandomness(RandomizedContext.java:92)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedContext.getRandom(RandomizedContext.java:114)
[junit4] 2> at org.apache.lucene.util.LuceneTestCase.random(LuceneTestCase.java:747)
[junit4] 2> at org.apache.lucene.search.TestFuzzyQuery.randomSimpleString(TestFuzzyQuery.java:506)
[junit4] 2> at org.apache.lucene.search.TestFuzzyQuery.testRandom(TestFuzzyQuery.java:517)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:498)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
[junit4] 2> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> feb 15, 2017 4:16:18 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> INFO: Starting to interrupt leaked threads:
[junit4] 2> 1) Thread[id=4633, name=TEST-TestFuzzyQuery.testRandom-seed#[47D1D58C4825005F], state=RUNNABLE, group=TGRP-TestFuzzyQuery]
[junit4] 2> feb 15, 2017 4:16:21 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> SEVERE: There are still zombie threads that couldn't be terminated:
[junit4] 2> 1) Thread[id=4633, name=TEST-TestFuzzyQuery.testRandom-seed#[47D1D58C4825005F], state=RUNNABLE, group=TGRP-TestFuzzyQuery]
[junit4] 2> at java.lang.Object.hashCode(Native Method)
[junit4] 2> at java.util.WeakHashMap.hash(WeakHashMap.java:298)
[junit4] 2> at java.util.WeakHashMap.getEntry(WeakHashMap.java:426)
[junit4] 2> at java.util.WeakHashMap.containsKey(WeakHashMap.java:417)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedContext.context(RandomizedContext.java:258)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedContext.current(RandomizedContext.java:134)
[junit4] 2> at org.apache.lucene.util.LuceneTestCase.random(LuceneTestCase.java:747)
[junit4] 2> at org.apache.lucene.search.TestFuzzyQuery.randomSimpleString(TestFuzzyQuery.java:506)
[junit4] 2> at org.apache.lucene.search.TestFuzzyQuery.testRandom(TestFuzzyQuery.java:517)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:498)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
[junit4] 2> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> NOTE: test params are: codec=FastDecompressionCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST_DECOMPRESSION, chunkSize=7, maxDocsPerChunk=383, blockSize=913), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST_DECOMPRESSION, chunkSize=7, blockSize=913)), sim=RandomSimilarity(queryNorm=false,coord=crazy): {field=IB SPL-DZ(0.3)}, locale=es-PY, timezone=Africa/Bissau
[junit4] 2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_121 (64-bit)/cpus=4,threads=2,free=255010944,total=404750336
[junit4] 2> NOTE: All tests run in this JVM: [TestBooleanQueryVisitSubscorers, TestDoubleValuesSource, TestPriorityQueue, TestNRTReaderCleanup, TestReaderClosed, TestBinaryDocument, TestDocCount, TestFieldValueQuery, TestFieldCacheRewriteMethod, TestReusableStringReader, TestFixedBitSet, TestLucene60FieldInfoFormat, TestForTooMuchCloning, TestIndexingSequenceNumbers, TestGrowableByteArrayDataOutput, Test2BSortedDocValuesOrds, TestBooleanOr, TestTrackingDirectoryWrapper, TestConcurrentMergeScheduler, TestNGramPhraseQuery, TestCheckIndex, TestFieldReuse, TestTransactionRollback, TestDuelingCodecsAtNight, TestDocValuesIndexing, TestCharFilter, TestDirectPacked, TestIndexReaderClose, TestTermVectorsReader, TestSpansEnum, TestSimilarityProvider, TestLongValuesSource, TestControlledRealTimeReopenThread, TestNeedsScores, TestBytesRefAttImpl, TestConstantScoreQuery, Test2BTerms, TestSparseFixedBitDocIdSet, TestNRTReaderWithThreads, TestStressNRT, TestUnicodeUtil, TestBytesRef, TestCloseableThreadLocal, TestGraphTokenStreamFiniteStrings, TestDuelingCodecs, TestDirectoryReader, TestDoc, TestTerm, TestLegacyNumericUtils, TestBinaryTerms, TestIndexWriterCommit, TestLucene60PointsFormat, TestOperations, TestFSTs, TestReqExclBulkScorer, TestSpanNotQuery, TestFrequencyTrackingRingBuffer, TestNoMergePolicy, TestPagedBytes, TestSortedNumericSortField, TestNeverDelete, TestIndexWriterMergePolicy, TestGraphTokenizers, TestRegexpRandom, TestWildcard, TestNorms, TestDateSort, TestBooleanRewrites, TestSameScoresWithThreads, TestCodecUtil, TestTragicIndexWriterDeadlock, TestIntBlockPool, TestManyFields, TestNativeFSLockFactory, TestIndexOrDocValuesQuery, TestForceMergeForever, TestTermRangeQuery, TestDocumentWriter, TestLiveFieldValues, TestFuzzyQuery]
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestFuzzyQuery -Dtests.seed=47D1D58C4825005F -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/test-data/enwiki.random.lines.txt -Dtests.locale=es-PY -Dtests.timezone=Africa/Bissau -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] ERROR 0.00s J1 | TestFuzzyQuery (suite) <<<
[junit4] > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
[junit4] > at __randomizedtesting.SeedInfo.seed([47D1D58C4825005F]:0)
[junit4] Completed [452/452 (1!)] on J1 in 7223.14s, 2 tests, 2 errors <<< FAILURES!
[...truncated 10375 lines...]
[junit4] Suite: org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_60BC73E0E73B44EE-001/init-core-data-001
[junit4] 2> 1799175 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[60BC73E0E73B44EE]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields
[junit4] 2> 1799176 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[60BC73E0E73B44EE]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
[junit4] 2> 1799176 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[60BC73E0E73B44EE]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /e/
[junit4] 1> Formatting using clusterid: testClusterID
[junit4] 2> 1799208 WARN (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[60BC73E0E73B44EE]-worker) [ ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
[junit4] 2> 1799216 WARN (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[60BC73E0E73B44EE]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 1799218 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[60BC73E0E73B44EE]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 1799228 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[60BC73E0E73B44EE]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.2-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_44077_hdfs____y6xg6y/webapp
[junit4] 2> 1799624 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[60BC73E0E73B44EE]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44077
[junit4] 2> 1799682 WARN (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[60BC73E0E73B44EE]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 1799683 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[60BC73E0E73B44EE]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 1799694 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[60BC73E0E73B44EE]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.2-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_51193_datanode____x8fv4m/webapp
[junit4] 2> 1800109 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[60BC73E0E73B44EE]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:51193
[junit4] 2> 1800169 WARN (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[60BC73E0E73B44EE]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 1800172 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[60BC73E0E73B44EE]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 1800189 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[60BC73E0E73B44EE]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.2-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_37380_datanode____aleg32/webapp
[junit4] 2> 1800231 INFO (IPC Server handler 3 on 45595) [ ] BlockStateChange BLOCK* processReport: from storage DS-9e05c745-d3c4-4648-8792-d0729b4e77f9 node DatanodeRegistration(127.0.0.1:56720, datanodeUuid=a6e32f02-8110-4e45-9a38-40696ed770ef, infoPort=40935, infoSecurePort=0, ipcPort=44116, storageInfo=lv=-56;cid=testClusterID;nsid=1189656718;c=0), blocks: 0, hasStaleStorage: true, processing time: 0 msecs
[junit4] 2> 1800231 INFO (IPC Server handler 3 on 45595) [ ] BlockStateChange BLOCK* processReport: from storage DS-a676840f-e799-4673-ac5e-0135fde5d295 node DatanodeRegistration(127.0.0.1:56720, datanodeUuid=a6e32f02-8110-4e45-9a38-40696ed770ef, infoPort=40935, infoSecurePort=0, ipcPort=44116, storageInfo=lv=-56;cid=testClusterID;nsid=1189656718;c=0), blocks: 0, hasStaleStorage: false, processing time: 0 msecs
[junit4] 2> 1800654 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[60BC73E0E73B44EE]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37380
[junit4] 2> 1800725 INFO (IPC Server handler 3 on 45595) [ ] BlockStateChange BLOCK* processReport: from storage DS-67f40981-438d-4c2b-b750-72574e5d69c3 node DatanodeRegistration(127.0.0.1:56075, datanodeUuid=17e93c06-5005-451f-b53d-12d49526c61d, infoPort=53126, infoSecurePort=0, ipcPort=51036, storageInfo=lv=-56;cid=testClusterID;nsid=1189656718;c=0), blocks: 0, hasStaleStorage: true, processing time: 0 msecs
[junit4] 2> 1800725 INFO (IPC Server handler 3 on 45595) [ ] BlockStateChange BLOCK* processReport: from storage DS-fc0c43fd-09b2-448b-8a24-af4cbb446aa7 node DatanodeRegistration(127.0.0.1:56075, datanodeUuid=17e93c06-5005-451f-b53d-12d49526c61d, infoPort=53126, infoSecurePort=0, ipcPort=51036, storageInfo=lv=-56;cid=testClusterID;nsid=1189656718;c=0), blocks: 0, hasStaleStorage: false, processing time: 0 msecs
[junit4] 2> 1800920 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1800921 INFO (Thread-209848) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1800921 INFO (Thread-209848) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1801021 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [ ] o.a.s.c.ZkTestServer start zk server on port:33113
[junit4] 2> 1801033 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 1801035 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 1801036 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1801037 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 1801037 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 1801038 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 1801039 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 1801040 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1801041 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1801042 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 1801043 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 1801121 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_60BC73E0E73B44EE-001/control-001/cores/collection1
[junit4] 2> 1801123 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 1801124 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@17d54744{/e,null,AVAILABLE}
[junit4] 2> 1801124 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@3ca723de{HTTP/1.1,[http/1.1]}{127.0.0.1:47804}
[junit4] 2> 1801124 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [ ] o.e.j.s.Server Started @1804702ms
[junit4] 2> 1801124 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:45595/hdfs__localhost_45595__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-6.x_checkout_solr_build_solr-core_test_J2_temp_solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_60BC73E0E73B44EE-001_tempDir-002_control_data, hostContext=/e, hostPort=47804, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_60BC73E0E73B44EE-001/control-001/cores}
[junit4] 2> 1801124 ERROR (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1801125 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 6.5.0
[junit4] 2> 1801125 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1801125 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1801125 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-02-15T18:45:21.070Z
[junit4] 2> 1801134 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1801134 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_60BC73E0E73B44EE-001/control-001/solr.xml
[junit4] 2> 1801139 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1801139 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:33113/solr
[junit4] 2> 1801157 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [n:127.0.0.1:47804_e ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1801157 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [n:127.0.0.1:47804_e ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:47804_e
[junit4] 2> 1801158 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [n:127.0.0.1:47804_e ] o.a.s.c.Overseer Overseer (id=97464111652274180-127.0.0.1:47804_e-n_0000000000) starting
[junit4] 2> 1801166 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [n:127.0.0.1:47804_e ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47804_e
[junit4] 2> 1801167 INFO (zkCallback-1453-thread-1-processing-n:127.0.0.1:47804_e) [n:127.0.0.1:47804_e ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1801223 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [n:127.0.0.1:47804_e ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_60BC73E0E73B44EE-001/control-001/cores
[junit4] 2> 1801223 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [n:127.0.0.1:47804_e ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 1801230 INFO (OverseerStateUpdate-97464111652274180-127.0.0.1:47804_e-n_0000000000) [n:127.0.0.1:47804_e ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 1801240 WARN (coreLoadExecutor-3585-thread-1-processing-n:127.0.0.1:47804_e) [n:127.0.0.1:47804_e c:control_collection x:collection1] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
[junit4] 2> 1801240 INFO (coreLoadExecutor-3585-thread-1-processing-n:127.0.0.1:47804_e) [n:127.0.0.1:47804_e c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
[junit4] 2> 1801250 INFO (coreLoadExecutor-3585-thread-1-processing-n:127.0.0.1:47804_e) [n:127.0.0.1:47804_e c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 1801311 WARN (coreLoadExecutor-3585-thread-1-processing-n:127.0.0.1:47804_e) [n:127.0.0.1:47804_e c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 1801312 INFO (coreLoadExecutor-3585-thread-1-processing-n:127.0.0.1:47804_e) [n:127.0.0.1:47804_e c:control_collection x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 1801321 INFO (coreLoadExecutor-3585-thread-1-processing-n:127.0.0.1:47804_e) [n:127.0.0.1:47804_e c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 1801321 INFO (coreLoadExecutor-3585-thread-1-processing-n:127.0.0.1:47804_e) [n:127.0.0.1:47804_e c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:45595/solr_hdfs_home
[junit4] 2> 1801321 INFO (coreLoadExecutor-3585-thread-1-processing-n:127.0.0.1:47804_e) [n:127.0.0.1:47804_e c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 1801321 INFO (coreLoadExecutor-3585-thread-1-processing-n:127.0.0.1:47804_e) [n:127.0.0.1:47804_e c:control_collection x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_60BC73E0E73B44EE-001/control-001/cores/collection1], dataDir=[hdfs://localhost:45595/solr_hdfs_home/control_collection/core_node1/data/]
[junit4] 2> 1801321 INFO (coreLoadExecutor-3585-thread-1-processing-n:127.0.0.1:47804_e) [n:127.0.0.1:47804_e c:control_collection x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@43950fe7
[junit4] 2> 1801322 INFO (coreLoadExecutor-3585-thread-1-processing-n:127.0.0.1:47804_e) [n:127.0.0.1:47804_e c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:45595/solr_hdfs_home/control_collection/core_node1/data/snapshot_metadata
[junit4] 2> 1801328 INFO (coreLoadExecutor-3585-thread-1-processing-n:127.0.0.1:47804_e) [n:127.0.0.1:47804_e c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 1801328 INFO (coreLoadExecutor-3585-thread-1-processing-n:127.0.0.1:47804_e) [n:127.0.0.1:47804_e c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
[junit4] 2> 1801337 INFO (coreLoadExecutor-3585-thread-1-processing-n:127.0.0.1:47804_e) [n:127.0.0.1:47804_e c:control_collection x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 1801338 INFO (coreLoadExecutor-3585-thread-1-processing-n:127.0.0.1:47804_e) [n:127.0.0.1:47804_e c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:45595/solr_hdfs_home/control_collection/core_node1/data
[junit4] 2> 1801350 INFO (coreLoadExecutor-3585-thread-1-processing-n:127.0.0.1:47804_e) [n:127.0.0.1:47804_e c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:45595/solr_hdfs_home/control_collection/core_node1/data/index
[junit4] 2> 1801355 INFO (coreLoadExecutor-3585-thread-1-processing-n:127.0.0.1:47804_e) [n:127.0.0.1:47804_e c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 1801355 INFO (coreLoadExecutor-3585-thread-1-processing-n:127.0.0.1:47804_e) [n:127.0.0.1:47804_e c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
[junit4] 2> 1801358 INFO (coreLoadExecutor-3585-thread-1-processing-n:127.0.0.1:47804_e) [n:127.0.0.1:47804_e c:control_collection x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 1801359 INFO (coreLoadExecutor-3585-thread-1-processing-n:127.0.0.1:47804_e) [n:127.0.0.1:47804_e c:control_collection x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=46, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.2680767545100851]
[junit4] 2> 1801382 INFO (IPC Server handler 6 on 45595) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:56075 is added to blk_1073741825_1001{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-9e05c745-d3c4-4648-8792-d0729b4e77f9:NORMAL:127.0.0.1:56720|RBW], ReplicaUC[[DISK]DS-fc0c43fd-09b2-448b-8a24-af4cbb446aa7:NORMAL:127.0.0.1:56075|FINALIZED]]} size 0
[junit4] 2> 1801383 INFO (IPC Server handler 7 on 45595) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:56720 is added to blk_1073741825_1001{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-9e05c745-d3c4-4648-8792-d0729b4e77f9:NORMAL:127.0.0.1:56720|RBW], ReplicaUC[[DISK]DS-fc0c43fd-09b2-448b-8a24-af4cbb446aa7:NORMAL:127.0.0.1:56075|FINALIZED]]} size 0
[junit4] 2> 1801389 WARN (coreLoadExecutor-3585-thread-1-processing-n:127.0.0.1:47804_e) [n:127.0.0.1:47804_e c:control_collection x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 1801423 INFO (coreLoadExecutor-3585-thread-1-processing-n:127.0.0.1:47804_e) [n:127.0.0.1:47804_e c:control_collection x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
[junit4] 2> 1801423 INFO (coreLoadExecutor-3585-thread-1-processing-n:127.0.0.1:47804_e) [n:127.0.0.1:47804_e c:control_collection x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1801423 INFO (coreLoadExecutor-3585-thread-1-processing-n:127.0.0.1:47804_e) [n:127.0.0.1:47804_e c:control_collection x:collection1] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=2
[junit4] 2> 1801431 INFO (coreLoadExecutor-3585-thread-1-processing-n:127.0.0.1:47804_e) [n:127.0.0.1:47804_e c:control_collection x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1801431 INFO (coreLoadExecutor-3585-thread-1-processing-n:127.0.0.1:47804_e) [n:127.0.0.1:47804_e c:control_collection x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1801432 INFO (coreLoadExecutor-3585-thread-1-processing-n:127.0.0.1:47804_e) [n:127.0.0.1:47804_e c:control_collection x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1330617572, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 1801445 INFO (coreLoadExecutor-3585-thread-1-processing-n:127.0.0.1:47804_e) [n:127.0.0.1:47804_e c:control_collection x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@48bc2b66[collection1] main]
[junit4] 2> 1801445 INFO (coreLoadExecutor-3585-thread-1-processing-n:127.0.0.1:47804_e) [n:127.0.0.1:47804_e c:control_collection x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1801445 INFO (coreLoadExecutor-3585-thread-1-processing-n:127.0.0.1:47804_e) [n:127.0.0.1:47804_e c:control_collection x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1801446 INFO (coreLoadExecutor-3585-thread-1-processing-n:127.0.0.1:47804_e) [n:127.0.0.1:47804_e c:control_collection x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 1801447 INFO (searcherExecutor-3586-thread-1-processing-n:127.0.0.1:47804_e x:collection1 c:control_collection) [n:127.0.0.1:47804_e c:control_collection x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@48bc2b66[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1801448 INFO (coreLoadExecutor-3585-thread-1-processing-n:127.0.0.1:47804_e) [n:127.0.0.1:47804_e c:control_collection x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1559425786988986368
[junit4] 2> 1801460 INFO (coreZkRegister-3578-thread-1-processing-n:127.0.0.1:47804_e x:collection1 c:control_collection) [n:127.0.0.1:47804_e c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1801460 INFO (coreZkRegister-3578-thread-1-processing-n:127.0.0.1:47804_e x:collection1 c:control_collection) [n:127.0.0.1:47804_e c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1801460 INFO (coreZkRegister-3578-thread-1-processing-n:127.0.0.1:47804_e x:collection1 c:control_collection) [n:127.0.0.1:47804_e c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:47804/e/collection1/
[junit4] 2> 1801460 INFO (coreZkRegister-3578-thread-1-processing-n:127.0.0.1:47804_e x:collection1 c:control_collection) [n:127.0.0.1:47804_e c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1801460 INFO (coreZkRegister-3578-thread-1-processing-n:127.0.0.1:47804_e x:collection1 c:control_collection) [n:127.0.0.1:47804_e c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:47804/e/collection1/ has no replicas
[junit4] 2> 1801463 INFO (coreZkRegister-3578-thread-1-processing-n:127.0.0.1:47804_e x:collection1 c:control_collection) [n:127.0.0.1:47804_e c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:47804/e/collection1/ shard1
[junit4] 2> 1801554 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1801555 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:33113/solr ready
[junit4] 2> 1801555 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 1801565 INFO (coreZkRegister-3578-thread-1-processing-n:127.0.0.1:47804_e x:collection1 c:control_collection) [n:127.0.0.1:47804_e c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1801624 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_60BC73E0E73B44EE-001/shard-1-001/cores/collection1
[junit4] 2> 1801624 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_60BC73E0E73B44EE-001/shard-1-001
[junit4] 2> 1801625 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 1801626 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@51ef462b{/e,null,AVAILABLE}
[junit4] 2> 1801626 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@366fa394{HTTP/1.1,[http/1.1]}{127.0.0.1:42712}
[junit4] 2> 1801627 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [ ] o.e.j.s.Server Started @1805205ms
[junit4] 2> 1801627 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:45595/hdfs__localhost_45595__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-6.x_checkout_solr_build_solr-core_test_J2_temp_solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_60BC73E0E73B44EE-001_tempDir-002_jetty1, solrconfig=solrconfig.xml, hostContext=/e, hostPort=42712, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_60BC73E0E73B44EE-001/shard-1-001/cores}
[junit4] 2> 1801628 ERROR (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1801628 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 6.5.0
[junit4] 2> 1801628 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1801628 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1801628 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-02-15T18:45:21.573Z
[junit4] 2> 1801630 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1801630 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_60BC73E0E73B44EE-001/shard-1-001/solr.xml
[junit4] 2> 1801635 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1801635 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:33113/solr
[junit4] 2> 1801641 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [n:127.0.0.1:42712_e ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1801642 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [n:127.0.0.1:42712_e ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1801643 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [n:127.0.0.1:42712_e ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42712_e
[junit4] 2> 1801644 INFO (zkCallback-1457-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1801646 INFO (zkCallback-1453-thread-3-processing-n:127.0.0.1:47804_e) [n:127.0.0.1:47804_e ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1801649 INFO (zkCallback-1462-thread-1-processing-n:127.0.0.1:42712_e) [n:127.0.0.1:42712_e ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1801716 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [n:127.0.0.1:42712_e ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_60BC73E0E73B44EE-001/shard-1-001/cores
[junit4] 2> 1801716 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [n:127.0.0.1:42712_e ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 1801718 INFO (OverseerStateUpdate-97464111652274180-127.0.0.1:47804_e-n_0000000000) [n:127.0.0.1:47804_e ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 1802727 WARN (coreLoadExecutor-3596-thread-1-processing-n:127.0.0.1:42712_e) [n:127.0.0.1:42712_e c:collection1 x:collection1] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
[junit4] 2> 1802727 INFO (coreLoadExecutor-3596-thread-1-processing-n:127.0.0.1:42712_e) [n:127.0.0.1:42712_e c:collection1 x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
[junit4] 2> 1802737 INFO (coreLoadExecutor-3596-thread-1-processing-n:127.0.0.1:42712_e) [n:127.0.0.1:42712_e c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 1802792 WARN (coreLoadExecutor-3596-thread-1-processing-n:127.0.0.1:42712_e) [n:127.0.0.1:42712_e c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 1802793 INFO (coreLoadExecutor-3596-thread-1-processing-n:127.0.0.1:42712_e) [n:127.0.0.1:42712_e c:collection1 x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 1802802 INFO (coreLoadExecutor-3596-thread-1-processing-n:127.0.0.1:42712_e) [n:127.0.0.1:42712_e c:collection1 x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 1802802 INFO (coreLoadExecutor-3596-thread-1-processing-n:127.0.0.1:42712_e) [n:127.0.0.1:42712_e c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:45595/solr_hdfs_home
[junit4] 2> 1802802 INFO (coreLoadExecutor-3596-thread-1-processing-n:127.0.0.1:42712_e) [n:127.0.0.1:42712_e c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 1802802 INFO (coreLoadExecutor-3596-thread-1-processing-n:127.0.0.1:42712_e) [n:127.0.0.1:42712_e c:collection1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_60BC73E0E73B44EE-001/shard-1-001/cores/collection1], dataDir=[hdfs://localhost:45595/solr_hdfs_home/collection1/core_node1/data/]
[junit4] 2> 1802803 INFO (coreLoadExecutor-3596-thread-1-processing-n:127.0.0.1:42712_e) [n:127.0.0.1:42712_e c:collection1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@43950fe7
[junit4] 2> 1802803 INFO (coreLoadExecutor-3596-thread-1-processing-n:127.0.0.1:42712_e) [n:127.0.0.1:42712_e c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:45595/solr_hdfs_home/collection1/core_node1/data/snapshot_metadata
[junit4] 2> 1802808 INFO (coreLoadExecutor-3596-thread-1-processing-n:127.0.0.1:42712_e) [n:127.0.0.1:42712_e c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 1802809 INFO (coreLoadExecutor-3596-thread-1-processing-n:127.0.0.1:42712_e) [n:127.0.0.1:42712_e c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
[junit4] 2> 1802811 INFO (coreLoadExecutor-3596-thread-1-processing-n:127.0.0.1:42712_e) [n:127.0.0.1:42712_e c:collection1 x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 1802811 INFO (coreLoadExecutor-3596-thread-1-processing-n:127.0.0.1:42712_e) [n:127.0.0.1:42712_e c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:45595/solr_hdfs_home/collection1/core_node1/data
[junit4] 2> 1802829 INFO (coreLoadExecutor-3596-thread-1-processing-n:127.0.0.1:42712_e) [n:127.0.0.1:42712_e c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:45595/solr_hdfs_home/collection1/core_node1/data/index
[junit4] 2> 1802833 INFO (coreLoadExecutor-3596-thread-1-processing-n:127.0.0.1:42712_e) [n:127.0.0.1:42712_e c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 1802834 INFO (coreLoadExecutor-3596-thread-1-processing-n:127.0.0.1:42712_e) [n:127.0.0.1:42712_e c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
[junit4] 2> 1802835 INFO (coreLoadExecutor-3596-thread-1-processing-n:127.0.0.1:42712_e) [n:127.0.0.1:42712_e c:collection1 x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 1802835 INFO (coreLoadExecutor-3596-thread-1-processing-n:127.0.0.1:42712_e) [n:127.0.0.1:42712_e c:collection1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=46, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.2680767545100851]
[junit4] 2> 1802846 INFO (IPC Server handler 3 on 45595) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:56075 is added to blk_1073741826_1002{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-a676840f-e799-4673-ac5e-0135fde5d295:NORMAL:127.0.0.1:56720|RBW], ReplicaUC[[DISK]DS-67f40981-438d-4c2b-b750-72574e5d69c3:NORMAL:127.0.0.1:56075|RBW]]} size 0
[junit4] 2> 1802847 INFO (IPC Server handler 4 on 45595) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:56720 is added to blk_1073741826_1002{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-a676840f-e799-4673-ac5e-0135fde5d295:NORMAL:127.0.0.1:56720|RBW], ReplicaUC[[DISK]DS-67f40981-438d-4c2b-b750-72574e5d69c3:NORMAL:127.0.0.1:56075|RBW]]} size 0
[junit4] 2> 1802852 WARN (coreLoadExecutor-3596-thread-1-processing-n:127.0.0.1:42712_e) [n:127.0.0.1:42712_e c:collection1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 1802880 INFO (coreLoadExecutor-3596-thread-1-processing-n:127.0.0.1:42712_e) [n:127.0.0.1:42712_e c:collection1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
[junit4] 2> 1802880 INFO (coreLoadExecutor-3596-thread-1-processing-n:127.0.0.1:42712_e) [n:127.0.0.1:42712_e c:collection1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1802880 INFO (coreLoadExecutor-3596-thread-1-processing-n:127.0.0.1:42712_e) [n:127.0.0.1:42712_e c:collection1 x:collection1] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=2
[junit4] 2> 1802887 INFO (coreLoadExecutor-3596-thread-1-processing-n:127.0.0.1:42712_e) [n:127.0.0.1:42712_e c:collection1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1802887 INFO (coreLoadExecutor-3596-thread-1-processing-n:127.0.0.1:42712_e) [n:127.0.0.1:42712_e c:collection1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1802889 INFO (coreLoadExecutor-3596-thread-1-processing-n:127.0.0.1:42712_e) [n:127.0.0.1:42712_e c:collection1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1330617572, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 1802892 INFO (coreLoadExecutor-3596-thread-1-processing-n:127.0.0.1:42712_e) [n:127.0.0.1:42712_e c:collection1 x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@150149ad[collection1] main]
[junit4] 2> 1802892 INFO (coreLoadExecutor-3596-thread-1-processing-n:127.0.0.1:42712_e) [n:127.0.0.1:42712_e c:collection1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1802892 INFO (coreLoadExecutor-3596-thread-1-processing-n:127.0.0.1:42712_e) [n:127.0.0.1:42712_e c:collection1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1802893 INFO (coreLoadExecutor-3596-thread-1-processing-n:127.0.0.1:42712_e) [n:127.0.0.1:42712_e c:collection1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 1802894 INFO (searcherExecutor-3597-thread-1-processing-n:127.0.0.1:42712_e x:collection1 c:collection1) [n:127.0.0.1:42712_e c:collection1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@150149ad[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1802895 INFO (coreLoadExecutor-3596-thread-1-processing-n:127.0.0.1:42712_e) [n:127.0.0.1:42712_e c:collection1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1559425788506275840
[junit4] 2> 1802900 INFO (coreZkRegister-3591-thread-1-processing-n:127.0.0.1:42712_e x:collection1 c:collection1) [n:127.0.0.1:42712_e c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1802900 INFO (coreZkRegister-3591-thread-1-processing-n:127.0.0.1:42712_e x:collection1 c:collection1) [n:127.0.0.1:42712_e c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1802900 INFO (coreZkRegister-3591-thread-1-processing-n:127.0.0.1:42712_e x:collection1 c:collection1) [n:127.0.0.1:42712_e c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:42712/e/collection1/
[junit4] 2> 1802900 INFO (coreZkRegister-3591-thread-1-processing-n:127.0.0.1:42712_e x:collection1 c:collection1) [n:127.0.0.1:42712_e c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1802900 INFO (coreZkRegister-3591-thread-1-processing-n:127.0.0.1:42712_e x:collection1 c:collection1) [n:127.0.0.1:42712_e c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:42712/e/collection1/ has no replicas
[junit4] 2> 1802902 INFO (coreZkRegister-3591-thread-1-processing-n:127.0.0.1:42712_e x:collection1 c:collection1) [n:127.0.0.1:42712_e c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:42712/e/collection1/ shard1
[junit4] 2> 1803053 INFO (coreZkRegister-3591-thread-1-processing-n:127.0.0.1:42712_e x:collection1 c:collection1) [n:127.0.0.1:42712_e c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1803114 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_60BC73E0E73B44EE-001/shard-2-001/cores/collection1
[junit4] 2> 1803114 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_60BC73E0E73B44EE-001/shard-2-001
[junit4] 2> 1803115 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 1803116 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1cb717e1{/e,null,AVAILABLE}
[junit4] 2> 1803116 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@75c9f9aa{HTTP/1.1,[http/1.1]}{127.0.0.1:43493}
[junit4] 2> 1803116 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [ ] o.e.j.s.Server Started @1806694ms
[junit4] 2> 1803116 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:45595/hdfs__localhost_45595__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-6.x_checkout_solr_build_solr-core_test_J2_temp_solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_60BC73E0E73B44EE-001_tempDir-002_jetty2, solrconfig=solrconfig.xml, hostContext=/e, hostPort=43493, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_60BC73E0E73B44EE-001/shard-2-001/cores}
[junit4] 2> 1803118 ERROR (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1803119 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 6.5.0
[junit4] 2> 1803119 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1803119 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1803119 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-02-15T18:45:23.064Z
[junit4] 2> 1803121 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1803121 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_60BC73E0E73B44EE-001/shard-2-001/solr.xml
[junit4] 2> 1803126 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1803126 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:33113/solr
[junit4] 2> 1803134 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [n:127.0.0.1:43493_e ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1803135 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [n:127.0.0.1:43493_e ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1803137 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[60BC73E0E73B44EE]) [n:127.0.0.1:43493_e ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43493_e
[junit4] 2> 1803140 INFO (zkCallback-1462-thread-1-processing-n:127.0.0.1:42712_e) [n:127.0.0.1:42712_e ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1803142 INFO (zkCallback-1468-thread-1-processing-n:127.0.0.1:43493_e) [n:127.0.0.1:43493_e ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1803142 INFO (zkCallback-1453-thread-2-processing-n:127.0.0.1:47804_e) [n:127.0.0.1:47804_e ] o
[...truncated too long message...]
t4] 2> SUITE-DeleteInactiveReplicaTest-seed#[60BC73E0E73B44EE]:
[junit4] 2> java.lang.Object.wait(Native Method)
[junit4] 2> java.lang.Thread.join(Thread.java:1257)
[junit4] 2> [...com.carrotsearch.randomizedtesting.*]
[junit4] 2>
[junit4] 2> 3586269 INFO (SUITE-DeleteInactiveReplicaTest-seed#[60BC73E0E73B44EE]-worker) [ ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released
[junit4] 2> Feb 15, 2017 7:15:06 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> Feb 15, 2017 7:15:26 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> SEVERE: 1 thread leaked from SUITE scope at org.apache.solr.cloud.DeleteInactiveReplicaTest:
[junit4] 2> 1) Thread[id=234363, name=OverseerHdfsCoreFailoverThread-97464219946188811-127.0.0.1:43049_solr-n_0000000003, state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.]
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:139)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> Feb 15, 2017 7:15:26 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> INFO: Starting to interrupt leaked threads:
[junit4] 2> 1) Thread[id=234363, name=OverseerHdfsCoreFailoverThread-97464219946188811-127.0.0.1:43049_solr-n_0000000003, state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.]
[junit4] 2> Feb 15, 2017 7:15:26 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> INFO: All leaked threads terminated.
[junit4] 2> NOTE: test params are: codec=CheapBastard, sim=RandomSimilarity(queryNorm=false,coord=crazy): {}, locale=es-MX, timezone=US/Aleutian
[junit4] 2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_121 (64-bit)/cpus=4,threads=1,free=111200824,total=522190848
[junit4] 2> NOTE: All tests run in this JVM: [SolrMetricsIntegrationTest, TestNRTOpen, TestReplicaProperties, TestSolrDeletionPolicy1, TestSolrCloudSnapshots, TestZkChroot, LeaderElectionContextKeyTest, PrimUtilsTest, TestSchemaSimilarityResource, TestExportWriter, BlockJoinFacetRandomTest, OpenExchangeRatesOrgProviderTest, ResponseLogComponentTest, DocValuesNotIndexedTest, CloudMLTQParserTest, SolrPluginUtilsTest, DeleteStatusTest, BinaryUpdateRequestHandlerTest, TestLocalFSCloudBackupRestore, TestManagedSchemaThreadSafety, TestTolerantSearch, HLLSerializationTest, LukeRequestHandlerTest, TestIndexSearcher, SolrCoreMetricManagerTest, NoCacheHeaderTest, PreAnalyzedFieldTest, TestFieldCacheSort, TestSubQueryTransformer, TestTrackingShardHandlerFactory, BasicDistributedZk2Test, TestFieldCache, TestSearcherReuse, TestReplicationHandlerBackup, TestSSLRandomization, TestSort, MergeStrategyTest, UtilsToolTest, BaseCdcrDistributedZkTest, TestAnalyzedSuggestions, TestAddFieldRealTimeGet, TestSchemalessBufferedUpdates, AutoCommitTest, RecoveryZkTest, DistributedFacetPivotSmallTest, SuggesterWFSTTest, TestHashQParserPlugin, DOMUtilTest, SolrCoreCheckLockOnStartupTest, QueryParsingTest, SuggesterTSTTest, TestCorePropertiesReload, TestNumericTerms64, SOLR749Test, StatsComponentTest, XmlUpdateRequestHandlerTest, TestCloudManagedSchema, TestDFRSimilarityFactory, HdfsBasicDistributedZkTest, SimpleFacetsTest, QueryResultKeyTest, DirectUpdateHandlerTest, TestSolrQueryParser, TestIndexingPerformance, TestRecovery, InfoHandlerTest, HdfsThreadLeakTest, BadIndexSchemaTest, ShardSplitTest, SolrTestCaseJ4Test, TestSolrJ, ConfigSetsAPITest, OverseerTest, CustomCollectionTest, TestSha256AuthenticationProvider, PeerSyncWithIndexFingerprintCachingTest, TestJsonFacets, TestCloudRecovery, TestTolerantUpdateProcessorCloud, HdfsWriteToMultipleCollectionsTest, SmileWriterTest, BadComponentTest, TestComplexPhraseLeadingWildcard, TestPerFieldSimilarityWithDefaultOverride, TestLRUStatsCache, TestConfig, TestLeaderElectionWithEmptyReplica, TriLevelCompositeIdRoutingTest, CurrencyFieldXmlFileTest, TestCoreDiscovery, MissingSegmentRecoveryTest, TestStressReorder, TestSolrConfigHandlerConcurrent, SimpleCollectionCreateDeleteTest, JSONWriterTest, TestSortByMinMaxFunction, CollectionReloadTest, SolrXmlInZkTest, MetricUtilsTest, TestWriterPerf, TestXmlQParser, TestCollectionAPIs, LeaderInitiatedRecoveryOnCommitTest, CoreAdminCreateDiscoverTest, TestConfigSetImmutable, SolrJmxReporterTest, SegmentsInfoRequestHandlerTest, HdfsCollectionsAPIDistributedZkTest, TestPhraseSuggestions, TestLFUCache, BasicDistributedZkTest, UnloadDistributedZkTest, CollectionsAPIDistributedZkTest, OpenCloseCoreStressTest, FullSolrCloudDistribCmdsTest, LeaderElectionTest, TestDistributedGrouping, TestHashPartitioner, DistributedSpellCheckComponentTest, TermVectorComponentDistributedTest, TestReload, TestStressVersions, HardAutoCommitTest, TestCoreContainer, TestSolr4Spatial, SolrCoreTest, TestGroupingSearch, PeerSyncTest, TestLazyCores, HighlighterTest, SoftAutoCommitTest, SignatureUpdateProcessorFactoryTest, SpellCheckCollatorTest, CoreAdminHandlerTest, TestCSVLoader, SchemaVersionSpecificBehaviorTest, FieldMutatingUpdateProcessorTest, TestWordDelimiterFilterFactory, DefaultValueUpdateProcessorTest, SortByFunctionTest, TestRemoteStreaming, DocValuesMultiTest, SolrInfoMBeanTest, IndexBasedSpellCheckerTest, TestQueryUtils, TestReversedWildcardFilterFactory, PrimitiveFieldTypeTest, RequestHandlersTest, FastVectorHighlighterTest, RegexBoostProcessorTest, ReturnFieldsTest, MBeansHandlerTest, JsonLoaderTest, PingRequestHandlerTest, TestBinaryResponseWriter, HighlighterConfigTest, TestQuerySenderListener, TestQuerySenderNoQuery, MultiTermTest, SampleTest, TestDocSet, NumericFieldsTest, MinimalSchemaTest, OutputWriterTest, TestPostingsSolrHighlighter, TestLuceneMatchVersion, TestCharFilters, SynonymTokenizerTest, TestXIncludeConfig, EchoParamsTest, TestLMDirichletSimilarityFactory, TestIBSimilarityFactory, TimeZoneUtilsTest, ResourceLoaderTest, PluginInfoTest, TestSystemIdResolver, TestSuggestSpellingConverter, SpellingQueryConverterTest, RAMDirectoryFactoryTest, ClusterStateTest, TestUtils, TestDocumentBuilder, SystemInfoHandlerTest, UUIDFieldTest, CircularListTest, DistributedMLTComponentTest, TestRTGBase, DistributedIntervalFacetingTest, TestCursorMarkWithoutUniqueKey, TestDistributedMissingSort, AsyncCallRequestStatusResponseTest, CdcrBootstrapTest, CloudExitableDirectoryReaderTest, CollectionTooManyReplicasTest, ConnectionManagerTest, DeleteInactiveReplicaTest]
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=DeleteInactiveReplicaTest -Dtests.seed=60BC73E0E73B44EE -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/test-data/enwiki.random.lines.txt -Dtests.locale=es-MX -Dtests.timezone=US/Aleutian -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[junit4] ERROR 0.00s J2 | DeleteInactiveReplicaTest (suite) <<<
[junit4] > Throwable #1: java.lang.AssertionError: ObjectTracker found 1 object(s) that were not released!!! [Overseer]
[junit4] > org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException
[junit4] > at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
[junit4] > at org.apache.solr.cloud.Overseer.start(Overseer.java:523)
[junit4] > at org.apache.solr.cloud.OverseerElectionContext.runLeaderProcess(ElectionContext.java:747)
[junit4] > at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:170)
[junit4] > at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:135)
[junit4] > at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:56)
[junit4] > at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:348)
[junit4] > at org.apache.solr.common.cloud.SolrZkClient$3.lambda$process$0(SolrZkClient.java:268)
[junit4] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[junit4] > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] > at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > at __randomizedtesting.SeedInfo.seed([60BC73E0E73B44EE]:0)
[junit4] > at org.apache.solr.SolrTestCaseJ4.teardownTestCases(SolrTestCaseJ4.java:301)
[junit4] > at java.lang.Thread.run(Thread.java:745)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.DeleteInactiveReplicaTest:
[junit4] > 1) Thread[id=234363, name=OverseerHdfsCoreFailoverThread-97464219946188811-127.0.0.1:43049_solr-n_0000000003, state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.]
[junit4] > at java.lang.Thread.sleep(Native Method)
[junit4] > at org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:139)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > at __randomizedtesting.SeedInfo.seed([60BC73E0E73B44EE]:0)
[junit4] Completed [496/692 (3!)] on J2 in 153.06s, 1 test, 1 failure, 1 error <<< FAILURES!
[...truncated 63256 lines...]
[JENKINS] Lucene-Solr-NightlyTests-6.x - Build # 283 - Still
unstable
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.x/283/
3 tests failed.
FAILED: org.apache.solr.cloud.hdfs.StressHdfsTest.test
Error Message:
Timeout occured while waiting response from server at: http://127.0.0.1:45877
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:45877
at __randomizedtesting.SeedInfo.seed([142663C043B89C34:9C725C1AED44F1CC]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:621)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:279)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:268)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:435)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:387)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1358)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:1109)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:1042)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
at org.apache.solr.cloud.hdfs.StressHdfsTest.createAndDeleteCollection(StressHdfsTest.java:220)
at org.apache.solr.cloud.hdfs.StressHdfsTest.test(StressHdfsTest.java:103)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:171)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:515)
... 51 more
FAILED: org.apache.solr.core.HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig
Error Message:
The max direct memory is likely too low. Either increase it (by adding -XX:MaxDirectMemorySize=<size>g -XX:+UseLargePages to your containers startup args) or disable direct allocation using solr.hdfs.blockcache.direct.memory.allocation=false in solrconfig.xml. If you are putting the block cache on the heap, your java heap size might not be large enough. Failed allocating ~134.217728 MB.
Stack Trace:
java.lang.RuntimeException: The max direct memory is likely too low. Either increase it (by adding -XX:MaxDirectMemorySize=<size>g -XX:+UseLargePages to your containers startup args) or disable direct allocation using solr.hdfs.blockcache.direct.memory.allocation=false in solrconfig.xml. If you are putting the block cache on the heap, your java heap size might not be large enough. Failed allocating ~134.217728 MB.
at __randomizedtesting.SeedInfo.seed([142663C043B89C34:E389AAEBBE31761F]:0)
at org.apache.solr.core.HdfsDirectoryFactory.createBlockCache(HdfsDirectoryFactory.java:310)
at org.apache.solr.core.HdfsDirectoryFactory.getBlockDirectoryCache(HdfsDirectoryFactory.java:286)
at org.apache.solr.core.HdfsDirectoryFactory.create(HdfsDirectoryFactory.java:226)
at org.apache.solr.core.HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig(HdfsDirectoryFactoryTest.java:108)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.OutOfMemoryError: Direct buffer memory
at java.nio.Bits.reserveMemory(Bits.java:693)
at java.nio.DirectByteBuffer.<init>(DirectByteBuffer.java:123)
at java.nio.ByteBuffer.allocateDirect(ByteBuffer.java:311)
at org.apache.solr.store.blockcache.BlockCache.<init>(BlockCache.java:68)
at org.apache.solr.core.HdfsDirectoryFactory.createBlockCache(HdfsDirectoryFactory.java:308)
... 42 more
FAILED: org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest.test
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([142663C043B89C34:9C725C1AED44F1CC]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertTrue(Assert.java:54)
at org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest.test(HdfsWriteToMultipleCollectionsTest.java:137)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 12039 lines...]
[junit4] Suite: org.apache.solr.cloud.hdfs.StressHdfsTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_142663C043B89C34-001/init-core-data-001
[junit4] 2> 852982 INFO (SUITE-StressHdfsTest-seed#[142663C043B89C34]-worker) [ ] o.a.s.SolrTestCaseJ4 Using TrieFields
[junit4] 2> 852982 INFO (SUITE-StressHdfsTest-seed#[142663C043B89C34]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
[junit4] 2> 852982 INFO (SUITE-StressHdfsTest-seed#[142663C043B89C34]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
[junit4] 1> Formatting using clusterid: testClusterID
[junit4] 2> 853076 WARN (SUITE-StressHdfsTest-seed#[142663C043B89C34]-worker) [ ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
[junit4] 2> 853103 WARN (SUITE-StressHdfsTest-seed#[142663C043B89C34]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 853109 INFO (SUITE-StressHdfsTest-seed#[142663C043B89C34]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 853140 INFO (SUITE-StressHdfsTest-seed#[142663C043B89C34]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.2-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_46006_hdfs____k2mk9q/webapp
[junit4] 2> 853695 INFO (SUITE-StressHdfsTest-seed#[142663C043B89C34]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46006
[junit4] 2> 853842 WARN (SUITE-StressHdfsTest-seed#[142663C043B89C34]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 853847 INFO (SUITE-StressHdfsTest-seed#[142663C043B89C34]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 853877 INFO (SUITE-StressHdfsTest-seed#[142663C043B89C34]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.2-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_37685_datanode____.9wgmoa/webapp
[junit4] 2> 854289 INFO (SUITE-StressHdfsTest-seed#[142663C043B89C34]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37685
[junit4] 2> 854427 WARN (SUITE-StressHdfsTest-seed#[142663C043B89C34]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 854428 INFO (SUITE-StressHdfsTest-seed#[142663C043B89C34]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 854474 INFO (SUITE-StressHdfsTest-seed#[142663C043B89C34]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.2-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_43536_datanode____.cr9teo/webapp
[junit4] 2> 854639 INFO (IPC Server handler 3 on 42306) [ ] BlockStateChange BLOCK* processReport: from storage DS-21fc0236-e079-4bb5-a49d-7a4145cd728c node DatanodeRegistration(127.0.0.1:35816, datanodeUuid=d1a5b01d-4a19-4e61-8f9f-0e43f803d9e8, infoPort=57098, infoSecurePort=0, ipcPort=47217, storageInfo=lv=-56;cid=testClusterID;nsid=1213767038;c=0), blocks: 0, hasStaleStorage: true, processing time: 2 msecs
[junit4] 2> 854639 INFO (IPC Server handler 3 on 42306) [ ] BlockStateChange BLOCK* processReport: from storage DS-d70d4253-c9cd-4089-a834-4071fd568982 node DatanodeRegistration(127.0.0.1:35816, datanodeUuid=d1a5b01d-4a19-4e61-8f9f-0e43f803d9e8, infoPort=57098, infoSecurePort=0, ipcPort=47217, storageInfo=lv=-56;cid=testClusterID;nsid=1213767038;c=0), blocks: 0, hasStaleStorage: false, processing time: 0 msecs
[junit4] 2> 855303 INFO (SUITE-StressHdfsTest-seed#[142663C043B89C34]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43536
[junit4] 2> 855529 INFO (IPC Server handler 5 on 42306) [ ] BlockStateChange BLOCK* processReport: from storage DS-99eb2233-81cc-454a-986c-8863d2912353 node DatanodeRegistration(127.0.0.1:41684, datanodeUuid=f111a806-f1db-408c-b5a0-84eb02e8aa03, infoPort=58563, infoSecurePort=0, ipcPort=43317, storageInfo=lv=-56;cid=testClusterID;nsid=1213767038;c=0), blocks: 0, hasStaleStorage: true, processing time: 1 msecs
[junit4] 2> 855529 INFO (IPC Server handler 5 on 42306) [ ] BlockStateChange BLOCK* processReport: from storage DS-f9115561-b72b-4824-addc-772d2bde9bed node DatanodeRegistration(127.0.0.1:41684, datanodeUuid=f111a806-f1db-408c-b5a0-84eb02e8aa03, infoPort=58563, infoSecurePort=0, ipcPort=43317, storageInfo=lv=-56;cid=testClusterID;nsid=1213767038;c=0), blocks: 0, hasStaleStorage: false, processing time: 0 msecs
[junit4] 2> 855616 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 855616 INFO (Thread-1608) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 855616 INFO (Thread-1608) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 855716 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.a.s.c.ZkTestServer start zk server on port:57369
[junit4] 2> 855737 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 855739 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 855747 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 855749 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 855750 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 855751 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 855752 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 855753 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 855754 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 855755 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 855755 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 855890 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_142663C043B89C34-001/control-001/cores/collection1
[junit4] 2> 855892 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 855893 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1e7c6882{/,null,AVAILABLE}
[junit4] 2> 855893 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@62335164{HTTP/1.1,[http/1.1]}{127.0.0.1:46035}
[junit4] 2> 855893 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.e.j.s.Server Started @859183ms
[junit4] 2> 855893 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:42306/hdfs__localhost_42306__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-6.x_checkout_solr_build_solr-core_test_J0_temp_solr.cloud.hdfs.StressHdfsTest_142663C043B89C34-001_tempDir-002_control_data, hostContext=/, hostPort=46035, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_142663C043B89C34-001/control-001/cores}
[junit4] 2> 855894 ERROR (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 855894 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 6.5.0
[junit4] 2> 855894 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 855894 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 855894 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-02-14T15:35:22.185Z
[junit4] 2> 855899 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 855899 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_142663C043B89C34-001/control-001/solr.xml
[junit4] 2> 855905 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 855905 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:57369/solr
[junit4] 2> 855940 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [n:127.0.0.1:46035_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 855941 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [n:127.0.0.1:46035_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:46035_
[junit4] 2> 855941 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [n:127.0.0.1:46035_ ] o.a.s.c.Overseer Overseer (id=97457702300876804-127.0.0.1:46035_-n_0000000000) starting
[junit4] 2> 855957 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [n:127.0.0.1:46035_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46035_
[junit4] 2> 855959 INFO (zkCallback-883-thread-1-processing-n:127.0.0.1:46035_) [n:127.0.0.1:46035_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 856161 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [n:127.0.0.1:46035_ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_142663C043B89C34-001/control-001/cores
[junit4] 2> 856161 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [n:127.0.0.1:46035_ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 856180 INFO (OverseerStateUpdate-97457702300876804-127.0.0.1:46035_-n_0000000000) [n:127.0.0.1:46035_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 856221 INFO (coreLoadExecutor-2563-thread-1-processing-n:127.0.0.1:46035_) [n:127.0.0.1:46035_ c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
[junit4] 2> 856239 INFO (coreLoadExecutor-2563-thread-1-processing-n:127.0.0.1:46035_) [n:127.0.0.1:46035_ c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 856495 WARN (coreLoadExecutor-2563-thread-1-processing-n:127.0.0.1:46035_) [n:127.0.0.1:46035_ c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 856497 INFO (coreLoadExecutor-2563-thread-1-processing-n:127.0.0.1:46035_) [n:127.0.0.1:46035_ c:control_collection x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 856505 INFO (coreLoadExecutor-2563-thread-1-processing-n:127.0.0.1:46035_) [n:127.0.0.1:46035_ c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 856505 INFO (coreLoadExecutor-2563-thread-1-processing-n:127.0.0.1:46035_) [n:127.0.0.1:46035_ c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:42306/solr_hdfs_home
[junit4] 2> 856505 INFO (coreLoadExecutor-2563-thread-1-processing-n:127.0.0.1:46035_) [n:127.0.0.1:46035_ c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 856506 INFO (coreLoadExecutor-2563-thread-1-processing-n:127.0.0.1:46035_) [n:127.0.0.1:46035_ c:control_collection x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_142663C043B89C34-001/control-001/cores/collection1], dataDir=[hdfs://localhost:42306/solr_hdfs_home/control_collection/core_node1/data/]
[junit4] 2> 856506 INFO (coreLoadExecutor-2563-thread-1-processing-n:127.0.0.1:46035_) [n:127.0.0.1:46035_ c:control_collection x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3ccd18e9
[junit4] 2> 856506 INFO (coreLoadExecutor-2563-thread-1-processing-n:127.0.0.1:46035_) [n:127.0.0.1:46035_ c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:42306/solr_hdfs_home/control_collection/core_node1/data/snapshot_metadata
[junit4] 2> 856514 INFO (coreLoadExecutor-2563-thread-1-processing-n:127.0.0.1:46035_) [n:127.0.0.1:46035_ c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 856514 INFO (coreLoadExecutor-2563-thread-1-processing-n:127.0.0.1:46035_) [n:127.0.0.1:46035_ c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
[junit4] 2> 856521 WARN (coreLoadExecutor-2563-thread-1-processing-n:127.0.0.1:46035_) [n:127.0.0.1:46035_ c:control_collection x:collection1] o.a.s.s.h.HdfsDirectory The NameNode is in SafeMode - Solr will wait 5 seconds and try again.
[junit4] 2> 861663 INFO (coreLoadExecutor-2563-thread-1-processing-n:127.0.0.1:46035_) [n:127.0.0.1:46035_ c:control_collection x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 861663 INFO (coreLoadExecutor-2563-thread-1-processing-n:127.0.0.1:46035_) [n:127.0.0.1:46035_ c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:42306/solr_hdfs_home/control_collection/core_node1/data
[junit4] 2> 861680 INFO (coreLoadExecutor-2563-thread-1-processing-n:127.0.0.1:46035_) [n:127.0.0.1:46035_ c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:42306/solr_hdfs_home/control_collection/core_node1/data/index
[junit4] 2> 861685 INFO (coreLoadExecutor-2563-thread-1-processing-n:127.0.0.1:46035_) [n:127.0.0.1:46035_ c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 861685 INFO (coreLoadExecutor-2563-thread-1-processing-n:127.0.0.1:46035_) [n:127.0.0.1:46035_ c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
[junit4] 2> 861689 INFO (coreLoadExecutor-2563-thread-1-processing-n:127.0.0.1:46035_) [n:127.0.0.1:46035_ c:control_collection x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 861690 INFO (coreLoadExecutor-2563-thread-1-processing-n:127.0.0.1:46035_) [n:127.0.0.1:46035_ c:control_collection x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=37, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 861736 INFO (IPC Server handler 7 on 42306) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:35816 is added to blk_1073741825_1001{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-f9115561-b72b-4824-addc-772d2bde9bed:NORMAL:127.0.0.1:41684|RBW], ReplicaUC[[DISK]DS-d70d4253-c9cd-4089-a834-4071fd568982:NORMAL:127.0.0.1:35816|RBW]]} size 0
[junit4] 2> 861739 INFO (IPC Server handler 8 on 42306) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:41684 is added to blk_1073741825_1001{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-d70d4253-c9cd-4089-a834-4071fd568982:NORMAL:127.0.0.1:35816|RBW], ReplicaUC[[DISK]DS-99eb2233-81cc-454a-986c-8863d2912353:NORMAL:127.0.0.1:41684|FINALIZED]]} size 0
[junit4] 2> 861754 WARN (coreLoadExecutor-2563-thread-1-processing-n:127.0.0.1:46035_) [n:127.0.0.1:46035_ c:control_collection x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 861803 INFO (coreLoadExecutor-2563-thread-1-processing-n:127.0.0.1:46035_) [n:127.0.0.1:46035_ c:control_collection x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
[junit4] 2> 861803 INFO (coreLoadExecutor-2563-thread-1-processing-n:127.0.0.1:46035_) [n:127.0.0.1:46035_ c:control_collection x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 861803 INFO (coreLoadExecutor-2563-thread-1-processing-n:127.0.0.1:46035_) [n:127.0.0.1:46035_ c:control_collection x:collection1] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=2
[junit4] 2> 861811 INFO (coreLoadExecutor-2563-thread-1-processing-n:127.0.0.1:46035_) [n:127.0.0.1:46035_ c:control_collection x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 861811 INFO (coreLoadExecutor-2563-thread-1-processing-n:127.0.0.1:46035_) [n:127.0.0.1:46035_ c:control_collection x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 861812 INFO (coreLoadExecutor-2563-thread-1-processing-n:127.0.0.1:46035_) [n:127.0.0.1:46035_ c:control_collection x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=8, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7112113658164153]
[junit4] 2> 861849 INFO (coreLoadExecutor-2563-thread-1-processing-n:127.0.0.1:46035_) [n:127.0.0.1:46035_ c:control_collection x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@5094b611[collection1] main]
[junit4] 2> 861849 INFO (coreLoadExecutor-2563-thread-1-processing-n:127.0.0.1:46035_) [n:127.0.0.1:46035_ c:control_collection x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 861850 INFO (coreLoadExecutor-2563-thread-1-processing-n:127.0.0.1:46035_) [n:127.0.0.1:46035_ c:control_collection x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 861850 INFO (coreLoadExecutor-2563-thread-1-processing-n:127.0.0.1:46035_) [n:127.0.0.1:46035_ c:control_collection x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 861851 INFO (searcherExecutor-2564-thread-1-processing-n:127.0.0.1:46035_ x:collection1 c:control_collection) [n:127.0.0.1:46035_ c:control_collection x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@5094b611[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 861852 INFO (coreLoadExecutor-2563-thread-1-processing-n:127.0.0.1:46035_) [n:127.0.0.1:46035_ c:control_collection x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1559323243334074368
[junit4] 2> 861866 INFO (coreZkRegister-2556-thread-1-processing-n:127.0.0.1:46035_ x:collection1 c:control_collection) [n:127.0.0.1:46035_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 861866 INFO (coreZkRegister-2556-thread-1-processing-n:127.0.0.1:46035_ x:collection1 c:control_collection) [n:127.0.0.1:46035_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 861867 INFO (coreZkRegister-2556-thread-1-processing-n:127.0.0.1:46035_ x:collection1 c:control_collection) [n:127.0.0.1:46035_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:46035/collection1/
[junit4] 2> 861867 INFO (coreZkRegister-2556-thread-1-processing-n:127.0.0.1:46035_ x:collection1 c:control_collection) [n:127.0.0.1:46035_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 861867 INFO (coreZkRegister-2556-thread-1-processing-n:127.0.0.1:46035_ x:collection1 c:control_collection) [n:127.0.0.1:46035_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:46035/collection1/ has no replicas
[junit4] 2> 861872 INFO (coreZkRegister-2556-thread-1-processing-n:127.0.0.1:46035_ x:collection1 c:control_collection) [n:127.0.0.1:46035_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:46035/collection1/ shard1
[junit4] 2> 862022 INFO (coreZkRegister-2556-thread-1-processing-n:127.0.0.1:46035_ x:collection1 c:control_collection) [n:127.0.0.1:46035_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 862171 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 862172 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:57369/solr ready
[junit4] 2> 862172 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 862239 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_142663C043B89C34-001/shard-1-001/cores/collection1
[junit4] 2> 862240 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_142663C043B89C34-001/shard-1-001
[junit4] 2> 862240 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 862241 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@30548ecd{/,null,AVAILABLE}
[junit4] 2> 862242 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@62a83c17{HTTP/1.1,[http/1.1]}{127.0.0.1:37407}
[junit4] 2> 862242 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.e.j.s.Server Started @865532ms
[junit4] 2> 862242 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:42306/hdfs__localhost_42306__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-6.x_checkout_solr_build_solr-core_test_J0_temp_solr.cloud.hdfs.StressHdfsTest_142663C043B89C34-001_tempDir-002_jetty1, solrconfig=solrconfig.xml, hostContext=/, hostPort=37407, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_142663C043B89C34-001/shard-1-001/cores}
[junit4] 2> 862243 ERROR (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 862243 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 6.5.0
[junit4] 2> 862243 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 862243 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 862243 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-02-14T15:35:28.534Z
[junit4] 2> 862245 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 862246 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_142663C043B89C34-001/shard-1-001/solr.xml
[junit4] 2> 862251 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 862251 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:57369/solr
[junit4] 2> 862266 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [n:127.0.0.1:37407_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 862267 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [n:127.0.0.1:37407_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 862269 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [n:127.0.0.1:37407_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37407_
[junit4] 2> 862270 INFO (zkCallback-887-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 862270 INFO (zkCallback-883-thread-2-processing-n:127.0.0.1:46035_) [n:127.0.0.1:46035_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 862283 INFO (zkCallback-892-thread-1-processing-n:127.0.0.1:37407_) [n:127.0.0.1:37407_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 862326 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [n:127.0.0.1:37407_ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_142663C043B89C34-001/shard-1-001/cores
[junit4] 2> 862326 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [n:127.0.0.1:37407_ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 862328 INFO (OverseerStateUpdate-97457702300876804-127.0.0.1:46035_-n_0000000000) [n:127.0.0.1:46035_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 863345 INFO (coreLoadExecutor-2574-thread-1-processing-n:127.0.0.1:37407_) [n:127.0.0.1:37407_ c:collection1 x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
[junit4] 2> 864144 INFO (coreLoadExecutor-2574-thread-1-processing-n:127.0.0.1:37407_) [n:127.0.0.1:37407_ c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 864213 WARN (coreLoadExecutor-2574-thread-1-processing-n:127.0.0.1:37407_) [n:127.0.0.1:37407_ c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 864215 INFO (coreLoadExecutor-2574-thread-1-processing-n:127.0.0.1:37407_) [n:127.0.0.1:37407_ c:collection1 x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 864225 INFO (coreLoadExecutor-2574-thread-1-processing-n:127.0.0.1:37407_) [n:127.0.0.1:37407_ c:collection1 x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 864225 INFO (coreLoadExecutor-2574-thread-1-processing-n:127.0.0.1:37407_) [n:127.0.0.1:37407_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:42306/solr_hdfs_home
[junit4] 2> 864225 INFO (coreLoadExecutor-2574-thread-1-processing-n:127.0.0.1:37407_) [n:127.0.0.1:37407_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 864225 INFO (coreLoadExecutor-2574-thread-1-processing-n:127.0.0.1:37407_) [n:127.0.0.1:37407_ c:collection1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_142663C043B89C34-001/shard-1-001/cores/collection1], dataDir=[hdfs://localhost:42306/solr_hdfs_home/collection1/core_node1/data/]
[junit4] 2> 864226 INFO (coreLoadExecutor-2574-thread-1-processing-n:127.0.0.1:37407_) [n:127.0.0.1:37407_ c:collection1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3ccd18e9
[junit4] 2> 864226 INFO (coreLoadExecutor-2574-thread-1-processing-n:127.0.0.1:37407_) [n:127.0.0.1:37407_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:42306/solr_hdfs_home/collection1/core_node1/data/snapshot_metadata
[junit4] 2> 864232 INFO (coreLoadExecutor-2574-thread-1-processing-n:127.0.0.1:37407_) [n:127.0.0.1:37407_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 864232 INFO (coreLoadExecutor-2574-thread-1-processing-n:127.0.0.1:37407_) [n:127.0.0.1:37407_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
[junit4] 2> 864236 INFO (coreLoadExecutor-2574-thread-1-processing-n:127.0.0.1:37407_) [n:127.0.0.1:37407_ c:collection1 x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 864237 INFO (coreLoadExecutor-2574-thread-1-processing-n:127.0.0.1:37407_) [n:127.0.0.1:37407_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:42306/solr_hdfs_home/collection1/core_node1/data
[junit4] 2> 864252 INFO (coreLoadExecutor-2574-thread-1-processing-n:127.0.0.1:37407_) [n:127.0.0.1:37407_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:42306/solr_hdfs_home/collection1/core_node1/data/index
[junit4] 2> 864262 INFO (coreLoadExecutor-2574-thread-1-processing-n:127.0.0.1:37407_) [n:127.0.0.1:37407_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 864262 INFO (coreLoadExecutor-2574-thread-1-processing-n:127.0.0.1:37407_) [n:127.0.0.1:37407_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
[junit4] 2> 864265 INFO (coreLoadExecutor-2574-thread-1-processing-n:127.0.0.1:37407_) [n:127.0.0.1:37407_ c:collection1 x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 864265 INFO (coreLoadExecutor-2574-thread-1-processing-n:127.0.0.1:37407_) [n:127.0.0.1:37407_ c:collection1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=37, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 864293 INFO (IPC Server handler 2 on 42306) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:35816 is added to blk_1073741826_1002{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-21fc0236-e079-4bb5-a49d-7a4145cd728c:NORMAL:127.0.0.1:35816|RBW], ReplicaUC[[DISK]DS-99eb2233-81cc-454a-986c-8863d2912353:NORMAL:127.0.0.1:41684|RBW]]} size 0
[junit4] 2> 864294 INFO (IPC Server handler 4 on 42306) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:41684 is added to blk_1073741826_1002{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-21fc0236-e079-4bb5-a49d-7a4145cd728c:NORMAL:127.0.0.1:35816|RBW], ReplicaUC[[DISK]DS-f9115561-b72b-4824-addc-772d2bde9bed:NORMAL:127.0.0.1:41684|FINALIZED]]} size 0
[junit4] 2> 864303 WARN (coreLoadExecutor-2574-thread-1-processing-n:127.0.0.1:37407_) [n:127.0.0.1:37407_ c:collection1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 864341 INFO (coreLoadExecutor-2574-thread-1-processing-n:127.0.0.1:37407_) [n:127.0.0.1:37407_ c:collection1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
[junit4] 2> 864341 INFO (coreLoadExecutor-2574-thread-1-processing-n:127.0.0.1:37407_) [n:127.0.0.1:37407_ c:collection1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 864341 INFO (coreLoadExecutor-2574-thread-1-processing-n:127.0.0.1:37407_) [n:127.0.0.1:37407_ c:collection1 x:collection1] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=2
[junit4] 2> 864351 INFO (coreLoadExecutor-2574-thread-1-processing-n:127.0.0.1:37407_) [n:127.0.0.1:37407_ c:collection1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 864351 INFO (coreLoadExecutor-2574-thread-1-processing-n:127.0.0.1:37407_) [n:127.0.0.1:37407_ c:collection1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 864361 INFO (coreLoadExecutor-2574-thread-1-processing-n:127.0.0.1:37407_) [n:127.0.0.1:37407_ c:collection1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=8, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7112113658164153]
[junit4] 2> 864383 INFO (coreLoadExecutor-2574-thread-1-processing-n:127.0.0.1:37407_) [n:127.0.0.1:37407_ c:collection1 x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@3a588a53[collection1] main]
[junit4] 2> 864384 INFO (coreLoadExecutor-2574-thread-1-processing-n:127.0.0.1:37407_) [n:127.0.0.1:37407_ c:collection1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 864384 INFO (coreLoadExecutor-2574-thread-1-processing-n:127.0.0.1:37407_) [n:127.0.0.1:37407_ c:collection1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 864384 INFO (coreLoadExecutor-2574-thread-1-processing-n:127.0.0.1:37407_) [n:127.0.0.1:37407_ c:collection1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 864385 INFO (searcherExecutor-2575-thread-1-processing-n:127.0.0.1:37407_ x:collection1 c:collection1) [n:127.0.0.1:37407_ c:collection1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@3a588a53[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 864388 INFO (coreLoadExecutor-2574-thread-1-processing-n:127.0.0.1:37407_) [n:127.0.0.1:37407_ c:collection1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1559323245993263104
[junit4] 2> 864400 INFO (coreZkRegister-2569-thread-1-processing-n:127.0.0.1:37407_ x:collection1 c:collection1) [n:127.0.0.1:37407_ c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 864400 INFO (coreZkRegister-2569-thread-1-processing-n:127.0.0.1:37407_ x:collection1 c:collection1) [n:127.0.0.1:37407_ c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 864401 INFO (coreZkRegister-2569-thread-1-processing-n:127.0.0.1:37407_ x:collection1 c:collection1) [n:127.0.0.1:37407_ c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:37407/collection1/
[junit4] 2> 864401 INFO (coreZkRegister-2569-thread-1-processing-n:127.0.0.1:37407_ x:collection1 c:collection1) [n:127.0.0.1:37407_ c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 864401 INFO (coreZkRegister-2569-thread-1-processing-n:127.0.0.1:37407_ x:collection1 c:collection1) [n:127.0.0.1:37407_ c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:37407/collection1/ has no replicas
[junit4] 2> 864406 INFO (coreZkRegister-2569-thread-1-processing-n:127.0.0.1:37407_ x:collection1 c:collection1) [n:127.0.0.1:37407_ c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:37407/collection1/ shard1
[junit4] 2> 864556 INFO (coreZkRegister-2569-thread-1-processing-n:127.0.0.1:37407_ x:collection1 c:collection1) [n:127.0.0.1:37407_ c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 864713 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_142663C043B89C34-001/shard-2-001/cores/collection1
[junit4] 2> 864714 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_142663C043B89C34-001/shard-2-001
[junit4] 2> 864715 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 864716 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7ad000e0{/,null,AVAILABLE}
[junit4] 2> 864716 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@4f8d5a1e{HTTP/1.1,[http/1.1]}{127.0.0.1:48524}
[junit4] 2> 864716 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.e.j.s.Server Started @868006ms
[junit4] 2> 864716 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:42306/hdfs__localhost_42306__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-6.x_checkout_solr_build_solr-core_test_J0_temp_solr.cloud.hdfs.StressHdfsTest_142663C043B89C34-001_tempDir-002_jetty2, solrconfig=solrconfig.xml, hostContext=/, hostPort=48524, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_142663C043B89C34-001/shard-2-001/cores}
[junit4] 2> 864717 ERROR (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 864724 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 6.5.0
[junit4] 2> 864724 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 864724 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 864724 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-02-14T15:35:31.015Z
[junit4] 2> 864729 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 864730 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_142663C043B89C34-001/shard-2-001/solr.xml
[junit4] 2> 864735 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 864735 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:57369/solr
[junit4] 2> 864751 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [n:127.0.0.1:48524_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 864753 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [n:127.0.0.1:48524_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 864755 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [n:127.0.0.1:48524_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48524_
[junit4] 2> 864756 INFO (zkCallback-892-thread-1-processing-n:127.0.0.1:37407_) [n:127.0.0.1:37407_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 864756 INFO (zkCallback-887-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 864756 INFO (zkCallback-883-thread-1-processing-n:127.0.0.1:46035_) [n:127.0.0.1:46035_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 864763 INFO (zkCallback-898-thread-1-processing-n:127.0.0.1:48524_) [n:127.0.0.1:48524_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 864826 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [n:127.0.0.1:48524_ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_142663C043B89C34-001/shard-2-001/cores
[junit4] 2> 864826 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [n:127.0.0.1:48524_ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 864828 INFO (OverseerStateUpdate-97457702300876804-127.0.0.1:46035_-n_0000000000) [n:127.0.0.1:46035_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 865838 INFO (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:48524_) [n:127.0.0.1:48524_ c:collection1 x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
[junit4] 2> 865852 INFO (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:48524_) [n:127.0.0.1:48524_ c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 865925 WARN (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:48524_) [n:127.0.0.1:48524_ c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 865927 INFO (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:48524_) [n:127.0.0.1:48524_ c:collection1 x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 865939 INFO (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:48524_) [n:127.0.0.1:48524_ c:collection1 x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 865940 INFO (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:48524_) [n:127.0.0.1:48524_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:42306/solr_hdfs_home
[junit4] 2> 865940 INFO (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:48524_) [n:127.0.0.1:48524_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 865940 INFO (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:48524_) [n:127.0.0.1:48524_ c:collection1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_142663C043B89C34-001/shard-2-001/cores/collection1], dataDir=[hdfs://localhost:42306/solr_hdfs_home/collection1/core_node2/data/]
[junit4] 2> 865940 INFO (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:48524_) [n:127.0.0.1:48524_ c:collection1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3ccd18e9
[junit4] 2> 865940 INFO (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:48524_) [n:127.0.0.1:48524_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:42306/solr_hdfs_home/collection1/core_node2/data/snapshot_metadata
[junit4] 2> 865951 INFO (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:48524_) [n:127.0.0.1:48524_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 865951 INFO (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:48524_) [n:127.0.0.1:48524_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
[junit4] 2> 865962 INFO (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:48524_) [n:127.0.0.1:48524_ c:collection1 x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 865964 INFO (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:48524_) [n:127.0.0.1:48524_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:42306/solr_hdfs_home/collection1/core_node2/data
[junit4] 2> 865978 INFO (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:48524_) [n:127.0.0.1:48524_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:42306/solr_hdfs_home/collection1/core_node2/data/index
[junit4] 2> 865983 INFO (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:48524_) [n:127.0.0.1:48524_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 865983 INFO (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:48524_) [n:127.0.0.1:48524_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
[junit4] 2> 865986 INFO (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:48524_) [n:127.0.0.1:48524_ c:collection1 x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 865986 INFO (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:48524_) [n:127.0.0.1:48524_ c:collection1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=37, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 866032 INFO (IPC Server handler 2 on 42306) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:35816 is added to blk_1073741827_1003{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-f9115561-b72b-4824-addc-772d2bde9bed:NORMAL:127.0.0.1:41684|RBW], ReplicaUC[[DISK]DS-d70d4253-c9cd-4089-a834-4071fd568982:NORMAL:127.0.0.1:35816|FINALIZED]]} size 0
[junit4] 2> 866033 INFO (IPC Server handler 4 on 42306) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:41684 is added to blk_1073741827_1003{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-d70d4253-c9cd-4089-a834-4071fd568982:NORMAL:127.0.0.1:35816|FINALIZED], ReplicaUC[[DISK]DS-99eb2233-81cc-454a-986c-8863d2912353:NORMAL:127.0.0.1:41684|FINALIZED]]} size 0
[junit4] 2> 866046 WARN (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:48524_) [n:127.0.0.1:48524_ c:collection1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 866082 INFO (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:48524_) [n:127.0.0.1:48524_ c:collection1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
[junit4] 2> 866082 INFO (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:48524_) [n:127.0.0.1:48524_ c:collection1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 866082 INFO (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:48524_) [n:127.0.0.1:48524_ c:collection1 x:collection1] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=2
[junit4] 2> 866091 INFO (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:48524_) [n:127.0.0.1:48524_ c:collection1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 866091 INFO (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:48524_) [n:127.0.0.1:48524_ c:collection1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 866095 INFO (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:48524_) [n:127.0.0.1:48524_ c:collection1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=8, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7112113658164153]
[junit4] 2> 866120 INFO (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:48524_) [n:127.0.0.1:48524_ c:collection1 x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@6dfae483[collection1] main]
[junit4] 2> 866121 INFO (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:48524_) [n:127.0.0.1:48524_ c:collection1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 866121 INFO (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:48524_) [n:127.0.0.1:48524_ c:collection1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 866121 INFO (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:48524_) [n:127.0.0.1:48524_ c:collection1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 866122 INFO (searcherExecutor-2586-thread-1-processing-n:127.0.0.1:48524_ x:collection1 c:collection1) [n:127.0.0.1:48524_ c:collection1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@6dfae483[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 866125 INFO (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:48524_) [n:127.0.0.1:48524_ c:collection1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1559323247814639616
[junit4] 2> 866133 INFO (coreZkRegister-2580-thread-1-processing-n:127.0.0.1:48524_ x:collection1 c:collection1) [n:127.0.0.1:48524_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.ZkController Core needs to recover:collection1
[junit4] 2> 866133 INFO (updateExecutor-895-thread-1-processing-n:127.0.0.1:48524_ x:collection1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:48524_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.u.DefaultSolrCoreState Running recovery
[junit4] 2> 866134 INFO (recoveryExecutor-896-thread-1-processing-n:127.0.0.1:48524_ x:collection1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:48524_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=true
[junit4] 2> 866134 INFO (recoveryExecutor-896-thread-1-processing-n:127.0.0.1:48524_ x:collection1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:48524_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.RecoveryStrategy ###### startupVersions=[[]]
[junit4] 2> 866134 INFO (recoveryExecutor-896-thread-1-processing-n:127.0.0.1:48524_ x:collection1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:48524_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.RecoveryStrategy Begin buffering updates. core=[collection1]
[junit4] 2> 866134 INFO (recoveryExecutor-896-thread-1-processing-n:127.0.0.1:48524_ x:collection1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:48524_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.u.UpdateLog Starting to buffer updates. HDFSUpdateLog{state=ACTIVE, tlog=null}
[junit4] 2> 866134 INFO (recoveryExecutor-896-thread-1-processing-n:127.0.0.1:48524_ x:collection1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:48524_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.RecoveryStrategy Publishing state of core [collection1] as recovering, leader is [http://127.0.0.1:37407/collection1/] and I am [http://127.0.0.1:48524/collection1/]
[junit4] 2> 866139 INFO (recoveryExecutor-896-thread-1-processing-n:127.0.0.1:48524_ x:collection1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:48524_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.RecoveryStrategy Sending prep recovery command to [http://127.0.0.1:37407]; [WaitForState: action=PREPRECOVERY&core=collection1&nodeName=127.0.0.1:48524_&coreNodeName=core_node2&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true]
[junit4] 2> 866141 INFO (qtp1536917217-6003) [n:127.0.0.1:37407_ ] o.a.s.h.a.PrepRecoveryOp Going to wait for coreNodeName: core_node2, state: recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true
[junit4] 2> 866142 INFO (qtp1536917217-6003) [n:127.0.0.1:37407_ ] o.a.s.h.a.PrepRecoveryOp Will wait a max of 183 seconds to see collection1 (shard1 of collection1) have state: recovering
[junit4] 2> 866142 INFO (qtp1536917217-6003) [n:127.0.0.1:37407_ ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard1, thisCore=collection1, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=down, localState=active, nodeName=127.0.0.1:48524_, coreNodeName=core_node2, onlyIfActiveCheckResult=false, nodeProps: core_node2:{"core":"collection1","base_url":"http://127.0.0.1:48524","node_name":"127.0.0.1:48524_","state":"down"}
[junit4] 2> 866817 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_142663C043B89C34-001/shard-3-001/cores/collection1
[junit4] 2> 866817 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_142663C043B89C34-001/shard-3-001
[junit4] 2> 866818 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 866899 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@68691e7{/,null,AVAILABLE}
[junit4] 2> 866899 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@458b4456{HTTP/1.1,[http/1.1]}{127.0.0.1:53190}
[junit4] 2> 866899 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.e.j.s.Server Started @870189ms
[junit4] 2> 866899 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:42306/hdfs__localhost_42306__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-6.x_checkout_solr_build_solr-core_test_J0_temp_solr.cloud.hdfs.StressHdfsTest_142663C043B89C34-001_tempDir-002_jetty3, solrconfig=solrconfig.xml, hostContext=/, hostPort=53190, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_142663C043B89C34-001/shard-3-001/cores}
[junit4] 2> 866900 ERROR (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 866907 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 6.5.0
[junit4] 2> 866907 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 866907 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 866907 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-02-14T15:35:33.198Z
[junit4] 2> 866912 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 866912 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_142663C043B89C34-001/shard-3-001/solr.xml
[junit4] 2> 866919 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 866919 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:57369/solr
[junit4] 2> 866926 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [n:127.0.0.1:53190_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 866927 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [n:127.0.0.1:53190_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 866928 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [n:127.0.0.1:53190_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53190_
[junit4] 2> 866930 INFO (zkCallback-898-thread-1-processing-n:127.0.0.1:48524_) [n:127.0.0.1:48524_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 866930 INFO (zkCallback-883-thread-1-processing-n:127.0.0.1:46035_) [n:127.0.0.1:46035_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 866930 INFO (zkCallback-892-thread-1-processing-n:127.0.0.1:37407_) [n:127.0.0.1:37407_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 866930 INFO (zkCallback-887-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 866937 INFO (zkCallback-905-thread-2-processing-n:127.0.0.1:53190_) [n:127.0.0.1:53190_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 867001 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [n:127.0.0.1:53190_ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_142663C043B89C34-001/shard-3-001/cores
[junit4] 2> 867001 INFO (TEST-StressHdfsTest.test-seed#[142663C043B89C34]) [n:127.0.0.1:53190_ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 867002 INFO (OverseerStateUpdate-97457702300876804-127.0.0.1:46035_-n_0000000000) [n:127.0.0.1:46035_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 867142 INFO (qtp1536917217-6003) [n:127.0.0.1:37407_ ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard1, thisCore=collection1, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=recovering, localState=active, nodeName=127.0.0.1:48524_, coreNodeName=core_node2, onlyIfActiveCheckResult=false, nodeProps: core_node2:{"core":"collection1","dataDir":"hdfs://localhost:42306/solr_hdfs_home/collection1/core_node2/data/","base_url":"http://127.0.0.1:48524","node_name":"127.0.0.1:48524_","state":"recovering","ulogDir":"hdfs://localhost:42306/solr_hdfs_home/collection1/core_node2/data/tlog"}
[junit4] 2> 867142 INFO (qtp1536917217-6003) [n:127.0.0.1:37407_ ] o.a.s.h.a.PrepRecoveryOp Waited coreNodeName: core_node2, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4] 2> 867142 INFO (qtp1536917217-6003) [n:127.0.0.1:37407_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={nodeName=127.0.0.1:48524_&onlyIfLeaderActive=true&core=collection1&coreNodeName=core_node2&action=PREPRECOVERY&checkLive=true&state=recovering&onlyIfLeader=true&wt=javabin&version=2} status=0 QTime=1000
[junit4] 2> 868033 INFO (coreLoadExecutor-2596-thread-1-processing-n:127.0.0.1:53190_) [n:127.0.0.1:53190_ c:collection1 x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
[junit4] 2> 868044 INFO (coreLoadExecutor-2596-thread-1-processing-n:127.0.0.1:53190_) [n:127.0.0.1:53190_ c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 868123 WARN (coreLoadExecutor-2596-thread-1-processing-n:127.0.0.1:53190_) [n:127.0.0.1:53190_ c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 868125 INFO (coreLoadExecutor-2596-thread-1-processing-n:127.0.0.1:53190_) [n:127.0.0.1:53190_ c:collection1 x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 868133 INFO (coreLoadExecutor-2596-thread-1-processing-n:127.0.0.1:53190_) [n:127.0.0.1:53190_ c:collection1 x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 868134 INFO (coreLoadExecutor-2596-thread-1-processing-n:127.0.0.1:53190_) [n:127.0.0.1:53190_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:42306/solr_hdfs_home
[junit4] 2> 868134 INFO (coreLoadExecutor-2596-thread-1-processing-n:127.0.0.1:53190_) [n:127.0.0.1:53190_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 868134 INFO (coreLoadExecutor-2596-thread-1-processing-n:127.0.0.1:53190_) [n:127.0.0.1:53190_ c:collection1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_142663C043B89C34-001/shard-3-001/cores/collection1], dataDir=[hdfs://localhost:42306/solr_hdfs_home/collection1/core_node3/data/]
[junit4] 2> 868134 INFO (coreLoadExecutor-2596-thread-1-processing-n:127.0.0.1:53190_) [n:127.0.0.1:53190_ c:collection1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3ccd18e9
[junit4] 2> 868134 INFO (coreLoadExecutor-2596-thread-1-processing-n:127.0.0.1:53190_) [n:127.0.0.1:53190_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:42306/solr_hdfs_home/collection1/core_node3/data/snapshot_metadata
[junit4] 2> 868140 INFO (coreLoadExecutor-2596-thread-1-processing-n:127.0.0.1:53190_) [n:127.0.0.1:53190_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 868140 INFO (coreLoadExecutor-2596-thread-1-processing-n:127.0.0.1:53190_) [n:127.0.0.1:53190_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
[junit4] 2> 868144 INFO (coreLoadExecutor-2596-thread-1-processing-n:127.0.0.1:53190_) [n:127.0.0.1:53190_ c:collection1 x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 868145 INFO (coreLoadExecutor-2596-thread-1-processing-n:127.0.0.1:53190_) [n:127.0.0.1:53190_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:42306/solr_hdfs_home/collection1/core_node3/data
[j
[...truncated too long message...]
ceAdapter.getMBeanInfo(MetricsSourceAdapter.java:151)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getClassName(DefaultMBeanServerInterceptor.java:1804)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.safeGetClassName(DefaultMBeanServerInterceptor.java:1595)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.checkMBeanPermission(DefaultMBeanServerInterceptor.java:1813)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.exclusiveUnregisterMBean(DefaultMBeanServerInterceptor.java:430)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.unregisterMBean(DefaultMBeanServerInterceptor.java:415)
[junit4] 2> at com.sun.jmx.mbeanserver.JmxMBeanServer.unregisterMBean(JmxMBeanServer.java:546)
[junit4] 2> at org.apache.hadoop.metrics2.util.MBeans.unregister(MBeans.java:81)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stopMBeans(MetricsSourceAdapter.java:226)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stop(MetricsSourceAdapter.java:211)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stopSources(MetricsSystemImpl.java:463)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stop(MetricsSystemImpl.java:213)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.shutdown(MetricsSystemImpl.java:594)
[junit4] 2> at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdownInstance(DefaultMetricsSystem.java:72)
[junit4] 2> at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdown(DefaultMetricsSystem.java:68)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.metrics.NameNodeMetrics.shutdown(NameNodeMetrics.java:171)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.NameNode.stop(NameNode.java:872)
[junit4] 2> at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1726)
[junit4] 2> at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1705)
[junit4] 2> at org.apache.solr.cloud.hdfs.HdfsTestUtil.teardownClass(HdfsTestUtil.java:198)
[junit4] 2> at org.apache.solr.core.HdfsDirectoryFactoryTest.teardownClass(HdfsDirectoryFactoryTest.java:61)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:498)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:870)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> Caused by: java.lang.NullPointerException
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlocksMap.size(BlocksMap.java:203)
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.getTotalBlocks(BlockManager.java:3370)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlocksTotal(FSNamesystem.java:5729)
[junit4] 2> ... 53 more
[junit4] 2> 4729484 INFO (SUITE-HdfsDirectoryFactoryTest-seed#[142663C043B89C34]-worker) [ ] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.core.HdfsDirectoryFactoryTest_142663C043B89C34-001
[junit4] 2> Feb 14, 2017 4:39:55 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 34 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene62): {}, docValues:{}, maxPointsInLeafNode=1257, maxMBSortInHeap=7.249092028729768, sim=RandomSimilarity(queryNorm=true,coord=crazy): {}, locale=id, timezone=Africa/Khartoum
[junit4] 2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_121 (64-bit)/cpus=4,threads=2,free=361238696,total=521666560
[junit4] 2> NOTE: All tests run in this JVM: [FacetPivotSmallTest, SuggesterFSTTest, TestPartialUpdateDeduplication, TestFuzzyAnalyzedSuggestions, DistributedQueryComponentCustomSortTest, TestElisionMultitermQuery, BlobRepositoryCloudTest, TestCopyFieldCollectionResource, TestGraphMLResponseWriter, DistributedFacetExistsSmallTest, TestSolrFieldCacheMBean, ZkCLITest, MultiTermTest, TestStressLiveNodes, CollectionsAPIDistributedZkTest, VersionInfoTest, TestPerFieldSimilarityClassic, TestFiltering, HdfsBasicDistributedZk2Test, CoreMergeIndexesAdminHandlerTest, DistributedVersionInfoTest, TestImpersonationWithHadoopAuth, TestCharFilters, TestIntervalFaceting, ResponseHeaderTest, TestJsonRequest, OverseerModifyCollectionTest, WrapperMergePolicyFactoryTest, TestReloadDeadlock, ZkSolrClientTest, DirectSolrSpellCheckerTest, EchoParamsTest, TestDocBasedVersionConstraints, IndexBasedSpellCheckerTest, SuggestComponentTest, SimplePostToolTest, URLClassifyProcessorTest, SparseHLLTest, DocValuesTest, TestApiFramework, TestOrdValues, TestJsonFacetRefinement, SecurityConfHandlerTest, DataDrivenBlockJoinTest, TestBM25SimilarityFactory, CoreSorterTest, TestDistributedGrouping, TestManagedSchemaAPI, DistanceFunctionTest, SchemaVersionSpecificBehaviorTest, RestartWhileUpdatingTest, ParsingFieldUpdateProcessorsTest, TestSolrCloudWithKerberosAlt, V2ApiIntegrationTest, TestCloudDeleteByQuery, OverseerTaskQueueTest, TestClusterStateMutator, TestCoreAdminApis, TestSmileRequest, TestSimpleTrackingShardHandler, SampleTest, TermVectorComponentTest, MoreLikeThisHandlerTest, SpellingQueryConverterTest, ShardRoutingCustomTest, AsyncCallRequestStatusResponseTest, TestHdfsCloudBackupRestore, TestRequestStatusCollectionAPI, TestFieldCacheVsDocValues, TestSerializedLuceneMatchVersion, TestSystemIdResolver, SystemInfoHandlerTest, JSONWriterTest, DocumentBuilderTest, CopyFieldTest, DistributedTermsComponentTest, ConvertedLegacyTest, TestOnReconnectListenerSupport, TestSolrConfigHandlerCloud, JvmMetricsTest, TestRestManager, TestDynamicLoading, DeleteLastCustomShardedReplicaTest, TestExactStatsCache, TestInitParams, TestSweetSpotSimilarityFactory, TestGraphTermsQParserPlugin, ShardRoutingTest, ClassificationUpdateProcessorFactoryTest, CollectionTooManyReplicasTest, TestHashPartitioner, TestSuggestSpellingConverter, DistributedMLTComponentTest, SolrMetricReporterTest, FullHLLTest, CreateCollectionCleanupTest, TestDefaultStatsCache, TestClassicSimilarityFactory, IndexSchemaRuntimeFieldTest, CSVRequestHandlerTest, TestShortCircuitedRequests, TestHighFrequencyDictionaryFactory, TestDocTermOrds, TestNumericTerms32, TestRTGBase, TestUseDocValuesAsStored2, RemoteQueryErrorTest, TestSearchPerf, OpenCloseCoreStressTest, SolrCmdDistributorTest, TestShardHandlerFactory, TestMiniSolrCloudCluster, SyncSliceTest, OverseerTest, TestReplicationHandler, CleanupOldIndexTest, CollectionStateFormat2Test, ConfigSetsAPITest, CustomCollectionTest, DeleteReplicaTest, DeleteShardTest, DistribJoinFromCollectionTest, HttpPartitionTest, LeaderInitiatedRecoveryOnCommitTest, MigrateRouteKeyTest, OutOfBoxZkACLAndCredentialsProvidersTest, RecoveryAfterSoftCommitTest, RollingRestartTest, TestRandomRequestDistribution, TestRebalanceLeaders, TestReplicaProperties, TestSegmentSorting, TestTolerantUpdateProcessorRandomCloud, TlogReplayBufferedWhileIndexingTest, TriLevelCompositeIdRoutingTest, HdfsChaosMonkeyNothingIsSafeTest, HdfsChaosMonkeySafeLeaderTest, HdfsRecoverLeaseTest, HdfsRecoveryZkTest, HdfsSyncSliceTest, HdfsUnloadDistributedZkTest, HdfsWriteToMultipleCollectionsTest, ZkStateReaderTest, RulesTest, DirectoryFactoryTest, HdfsDirectoryFactoryTest]
[junit4] Completed [545/692 (3!)] on J1 in 12.90s, 3 tests, 1 error <<< FAILURES!
[...truncated 63079 lines...]
[JENKINS] Lucene-Solr-NightlyTests-6.x - Build # 282 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.x/282/
5 tests failed.
FAILED: org.apache.lucene.index.TestIndexSorting.testRandom3
Error Message:
Java heap space
Stack Trace:
java.lang.OutOfMemoryError: Java heap space
at __randomizedtesting.SeedInfo.seed([977CE2E4FCF62D27:35A4AC3E98040421]:0)
at org.apache.lucene.util.packed.Packed64.<init>(Packed64.java:73)
at org.apache.lucene.util.packed.PackedInts.getMutable(PackedInts.java:972)
at org.apache.lucene.util.packed.PackedInts.getMutable(PackedInts.java:939)
at org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWriter.java:80)
at org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:88)
at org.apache.lucene.util.packed.AbstractPagedMutable.set(AbstractPagedMutable.java:98)
at org.apache.lucene.util.fst.NodeHash.addNew(NodeHash.java:152)
at org.apache.lucene.util.fst.NodeHash.rehash(NodeHash.java:169)
at org.apache.lucene.util.fst.NodeHash.add(NodeHash.java:133)
at org.apache.lucene.util.fst.Builder.compileNode(Builder.java:214)
at org.apache.lucene.util.fst.Builder.freezeTail(Builder.java:310)
at org.apache.lucene.util.fst.Builder.add(Builder.java:414)
at org.apache.lucene.codecs.memory.MemoryDocValuesConsumer.writeFST(MemoryDocValuesConsumer.java:367)
at org.apache.lucene.codecs.memory.MemoryDocValuesConsumer.addSortedField(MemoryDocValuesConsumer.java:404)
at org.apache.lucene.codecs.DocValuesConsumer.mergeSortedField(DocValuesConsumer.java:653)
at org.apache.lucene.codecs.DocValuesConsumer.merge(DocValuesConsumer.java:204)
at org.apache.lucene.codecs.perfield.PerFieldDocValuesFormat$FieldsWriter.merge(PerFieldDocValuesFormat.java:153)
at org.apache.lucene.index.SegmentMerger.mergeDocValues(SegmentMerger.java:167)
at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:111)
at org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4363)
at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3940)
at org.apache.lucene.index.SerialMergeScheduler.merge(SerialMergeScheduler.java:40)
at org.apache.lucene.index.IndexWriter.maybeMerge(IndexWriter.java:2091)
at org.apache.lucene.index.IndexWriter.doAfterSegmentFlushed(IndexWriter.java:5004)
at org.apache.lucene.index.DocumentsWriter$MergePendingEvent.process(DocumentsWriter.java:731)
at org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:5042)
at org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:5033)
at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1582)
at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1324)
at org.apache.lucene.index.TestIndexSorting.testRandom3(TestIndexSorting.java:2229)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
FAILED: org.apache.solr.cloud.CdcrReplicationDistributedZkTest.testBatchAddsWithDelete
Error Message:
Timeout while trying to assert number of documents @ target_collection
Stack Trace:
java.lang.AssertionError: Timeout while trying to assert number of documents @ target_collection
at __randomizedtesting.SeedInfo.seed([8D622B05D79CDF:77971B8FADCE9DF3]:0)
at org.apache.solr.cloud.BaseCdcrDistributedZkTest.assertNumDocs(BaseCdcrDistributedZkTest.java:271)
at org.apache.solr.cloud.CdcrReplicationDistributedZkTest.testBatchAddsWithDelete(CdcrReplicationDistributedZkTest.java:532)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.AssertionError: expected:<59> but was:<33>
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at org.apache.solr.cloud.BaseCdcrDistributedZkTest.assertNumDocs(BaseCdcrDistributedZkTest.java:262)
... 42 more
FAILED: org.apache.solr.cloud.CdcrReplicationDistributedZkTest.testBatchBoundaries
Error Message:
Timeout while trying to assert number of documents @ target_collection
Stack Trace:
java.lang.AssertionError: Timeout while trying to assert number of documents @ target_collection
at __randomizedtesting.SeedInfo.seed([8D622B05D79CDF:22A2BB7E7C735D38]:0)
at org.apache.solr.cloud.BaseCdcrDistributedZkTest.assertNumDocs(BaseCdcrDistributedZkTest.java:271)
at org.apache.solr.cloud.CdcrReplicationDistributedZkTest.testBatchBoundaries(CdcrReplicationDistributedZkTest.java:563)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.AssertionError: expected:<128> but was:<71>
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at org.apache.solr.cloud.BaseCdcrDistributedZkTest.assertNumDocs(BaseCdcrDistributedZkTest.java:262)
... 42 more
FAILED: org.apache.solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR
Error Message:
There are still nodes recoverying - waited for 330 seconds
Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 330 seconds
at __randomizedtesting.SeedInfo.seed([8D622B05D79CDF:DE070C563E75FE2C]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:187)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:144)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:139)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:856)
at org.apache.solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR(LeaderInitiatedRecoveryOnShardRestartTest.java:158)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest.test
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([8D622B05D79CDF:88D95DF1AB2BF127]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertTrue(Assert.java:54)
at org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest.test(HdfsWriteToMultipleCollectionsTest.java:137)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 379 lines...]
[junit4] Suite: org.apache.lucene.index.TestIndexSorting
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestIndexSorting -Dtests.method=testRandom3 -Dtests.seed=977CE2E4FCF62D27 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/test-data/enwiki.random.lines.txt -Dtests.locale=es-CR -Dtests.timezone=America/Argentina/San_Luis -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] ERROR 171s J2 | TestIndexSorting.testRandom3 <<<
[junit4] > Throwable #1: java.lang.OutOfMemoryError: Java heap space
[junit4] > at __randomizedtesting.SeedInfo.seed([977CE2E4FCF62D27:35A4AC3E98040421]:0)
[junit4] > at org.apache.lucene.util.packed.Packed64.<init>(Packed64.java:73)
[junit4] > at org.apache.lucene.util.packed.PackedInts.getMutable(PackedInts.java:972)
[junit4] > at org.apache.lucene.util.packed.PackedInts.getMutable(PackedInts.java:939)
[junit4] > at org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWriter.java:80)
[junit4] > at org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:88)
[junit4] > at org.apache.lucene.util.packed.AbstractPagedMutable.set(AbstractPagedMutable.java:98)
[junit4] > at org.apache.lucene.util.fst.NodeHash.addNew(NodeHash.java:152)
[junit4] > at org.apache.lucene.util.fst.NodeHash.rehash(NodeHash.java:169)
[junit4] > at org.apache.lucene.util.fst.NodeHash.add(NodeHash.java:133)
[junit4] > at org.apache.lucene.util.fst.Builder.compileNode(Builder.java:214)
[junit4] > at org.apache.lucene.util.fst.Builder.freezeTail(Builder.java:310)
[junit4] > at org.apache.lucene.util.fst.Builder.add(Builder.java:414)
[junit4] > at org.apache.lucene.codecs.memory.MemoryDocValuesConsumer.writeFST(MemoryDocValuesConsumer.java:367)
[junit4] > at org.apache.lucene.codecs.memory.MemoryDocValuesConsumer.addSortedField(MemoryDocValuesConsumer.java:404)
[junit4] > at org.apache.lucene.codecs.DocValuesConsumer.mergeSortedField(DocValuesConsumer.java:653)
[junit4] > at org.apache.lucene.codecs.DocValuesConsumer.merge(DocValuesConsumer.java:204)
[junit4] > at org.apache.lucene.codecs.perfield.PerFieldDocValuesFormat$FieldsWriter.merge(PerFieldDocValuesFormat.java:153)
[junit4] > at org.apache.lucene.index.SegmentMerger.mergeDocValues(SegmentMerger.java:167)
[junit4] > at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:111)
[junit4] > at org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4363)
[junit4] > at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3940)
[junit4] > at org.apache.lucene.index.SerialMergeScheduler.merge(SerialMergeScheduler.java:40)
[junit4] > at org.apache.lucene.index.IndexWriter.maybeMerge(IndexWriter.java:2091)
[junit4] > at org.apache.lucene.index.IndexWriter.doAfterSegmentFlushed(IndexWriter.java:5004)
[junit4] > at org.apache.lucene.index.DocumentsWriter$MergePendingEvent.process(DocumentsWriter.java:731)
[junit4] > at org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:5042)
[junit4] > at org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:5033)
[junit4] > at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1582)
[junit4] > at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1324)
[junit4] > at org.apache.lucene.index.TestIndexSorting.testRandom3(TestIndexSorting.java:2229)
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/lucene/build/core/test/J2/temp/lucene.index.TestIndexSorting_977CE2E4FCF62D27-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene62): {docs=BlockTreeOrds(blocksize=128), norms=BlockTreeOrds(blocksize=128), positions=PostingsFormat(name=Asserting), id=BlockTreeOrds(blocksize=128), term_vectors=BlockTreeOrds(blocksize=128)}, docValues:{multi_valued_long=DocValuesFormat(name=Lucene54), double=DocValuesFormat(name=Memory), foo=DocValuesFormat(name=Lucene54), numeric=DocValuesFormat(name=Memory), positions=DocValuesFormat(name=Lucene54), float=DocValuesFormat(name=Direct), multi_valued_numeric=DocValuesFormat(name=Memory), int=DocValuesFormat(name=Memory), long=DocValuesFormat(name=Direct), points=DocValuesFormat(name=Lucene54), sorted=DocValuesFormat(name=Memory), bar=DocValuesFormat(name=Memory), multi_valued_double=DocValuesFormat(name=Memory), docs=DocValuesFormat(name=Memory), multi_valued_string=DocValuesFormat(name=Memory), norms=DocValuesFormat(name=Memory), bytes=DocValuesFormat(name=Memory), binary=DocValuesFormat(name=Memory), id=DocValuesFormat(name=Memory), multi_valued_int=DocValuesFormat(name=Lucene54), multi_valued_bytes=DocValuesFormat(name=Memory), multi_valued_float=DocValuesFormat(name=Lucene54), term_vectors=DocValuesFormat(name=Memory)}, maxPointsInLeafNode=267, maxMBSortInHeap=5.490297365896996, sim=RandomSimilarity(queryNorm=false,coord=yes): {positions=DFR GL2, id=BM25(k1=1.2,b=0.75), term_vectors=DFR I(ne)BZ(0.3)}, locale=es-CR, timezone=America/Argentina/San_Luis
[junit4] 2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_121 (64-bit)/cpus=4,threads=1,free=230667512,total=332398592
[junit4] 2> NOTE: All tests run in this JVM: [TestTopDocsMerge, TestBM25Similarity, TestLevenshteinAutomata, TestRamUsageEstimator, TestSearchWithThreads, TestNumericRangeQuery32, TestMultiPhraseQuery, TestMatchNoDocsQuery, TestStopFilter, TestEarlyTerminatingSortingCollector, TestNumericDocValuesUpdates, TestParallelTermEnum, TestPrefixRandom, TestSortedSetSelector, TestSegmentReader, TestInfoStream, TestIndexSorting]
[junit4] Completed [50/452 (1!)] on J2 in 231.74s, 48 tests, 1 error <<< FAILURES!
[...truncated 1329 lines...]
[junit4] JVM J2: stdout was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/lucene/build/core/test/temp/junit4-J2-20170213_122706_3652506717803470200019.sysout
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] java.lang.OutOfMemoryError: Java heap space
[junit4] Dumping heap to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/heapdumps/java_pid27858.hprof ...
[junit4] Heap dump file created [439243662 bytes in 4.138 secs]
[junit4] <<< JVM J2: EOF ----
[...truncated 10030 lines...]
[junit4] Suite: org.apache.solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_8D622B05D79CDF-001/init-core-data-001
[junit4] 2> 963971 INFO (SUITE-LeaderInitiatedRecoveryOnShardRestartTest-seed#[8D622B05D79CDF]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
[junit4] 2> 963971 INFO (SUITE-LeaderInitiatedRecoveryOnShardRestartTest-seed#[8D622B05D79CDF]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
[junit4] 2> 963973 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 963973 INFO (Thread-20312) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 963973 INFO (Thread-20312) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 964073 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.a.s.c.ZkTestServer start zk server on port:59925
[junit4] 2> 964085 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 964088 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 964093 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 964095 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 964096 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 964098 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 964099 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 964101 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 964104 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 964105 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 964108 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 964181 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_8D622B05D79CDF-001/control-001/cores/collection1
[junit4] 2> 964182 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 964183 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@21329ac{/,null,AVAILABLE}
[junit4] 2> 964185 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@4839e5a5{HTTP/1.1,[http/1.1]}{127.0.0.1:50214}
[junit4] 2> 964185 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.e.j.s.Server Started @967977ms
[junit4] 2> 964185 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_8D622B05D79CDF-001/tempDir-001/control/data, hostContext=/, hostPort=50214, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_8D622B05D79CDF-001/control-001/cores}
[junit4] 2> 964185 ERROR (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 964185 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 6.5.0
[junit4] 2> 964185 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 964185 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 964185 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-02-13T15:03:39.353Z
[junit4] 2> 964205 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 964206 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_8D622B05D79CDF-001/control-001/solr.xml
[junit4] 2> 964211 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 964211 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:59925/solr
[junit4] 2> 964241 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [n:127.0.0.1:50214_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 964242 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [n:127.0.0.1:50214_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:50214_
[junit4] 2> 964244 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [n:127.0.0.1:50214_ ] o.a.s.c.Overseer Overseer (id=97451915289624580-127.0.0.1:50214_-n_0000000000) starting
[junit4] 2> 964260 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [n:127.0.0.1:50214_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50214_
[junit4] 2> 964265 INFO (zkCallback-726-thread-1-processing-n:127.0.0.1:50214_) [n:127.0.0.1:50214_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 964329 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [n:127.0.0.1:50214_ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_8D622B05D79CDF-001/control-001/cores
[junit4] 2> 964329 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [n:127.0.0.1:50214_ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 964338 INFO (OverseerStateUpdate-97451915289624580-127.0.0.1:50214_-n_0000000000) [n:127.0.0.1:50214_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 965355 WARN (coreLoadExecutor-1858-thread-1-processing-n:127.0.0.1:50214_) [n:127.0.0.1:50214_ c:control_collection x:collection1] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
[junit4] 2> 965355 INFO (coreLoadExecutor-1858-thread-1-processing-n:127.0.0.1:50214_) [n:127.0.0.1:50214_ c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
[junit4] 2> 965366 INFO (coreLoadExecutor-1858-thread-1-processing-n:127.0.0.1:50214_) [n:127.0.0.1:50214_ c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 965456 WARN (coreLoadExecutor-1858-thread-1-processing-n:127.0.0.1:50214_) [n:127.0.0.1:50214_ c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 965458 INFO (coreLoadExecutor-1858-thread-1-processing-n:127.0.0.1:50214_) [n:127.0.0.1:50214_ c:control_collection x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 965477 INFO (coreLoadExecutor-1858-thread-1-processing-n:127.0.0.1:50214_) [n:127.0.0.1:50214_ c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 965477 INFO (coreLoadExecutor-1858-thread-1-processing-n:127.0.0.1:50214_) [n:127.0.0.1:50214_ c:control_collection x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_8D622B05D79CDF-001/control-001/cores/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_8D622B05D79CDF-001/control-001/cores/collection1/data/]
[junit4] 2> 965478 INFO (coreLoadExecutor-1858-thread-1-processing-n:127.0.0.1:50214_) [n:127.0.0.1:50214_ c:control_collection x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@15b780f1
[junit4] 2> 965482 INFO (coreLoadExecutor-1858-thread-1-processing-n:127.0.0.1:50214_) [n:127.0.0.1:50214_ c:control_collection x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@7d024cc2
[junit4] 2> 965500 WARN (coreLoadExecutor-1858-thread-1-processing-n:127.0.0.1:50214_) [n:127.0.0.1:50214_ c:control_collection x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 965541 INFO (coreLoadExecutor-1858-thread-1-processing-n:127.0.0.1:50214_) [n:127.0.0.1:50214_ c:control_collection x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 965541 INFO (coreLoadExecutor-1858-thread-1-processing-n:127.0.0.1:50214_) [n:127.0.0.1:50214_ c:control_collection x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 965542 INFO (coreLoadExecutor-1858-thread-1-processing-n:127.0.0.1:50214_) [n:127.0.0.1:50214_ c:control_collection x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 965542 INFO (coreLoadExecutor-1858-thread-1-processing-n:127.0.0.1:50214_) [n:127.0.0.1:50214_ c:control_collection x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 965542 INFO (coreLoadExecutor-1858-thread-1-processing-n:127.0.0.1:50214_) [n:127.0.0.1:50214_ c:control_collection x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@4c604a1b
[junit4] 2> 965546 INFO (coreLoadExecutor-1858-thread-1-processing-n:127.0.0.1:50214_) [n:127.0.0.1:50214_ c:control_collection x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@d41d29a[collection1] main]
[junit4] 2> 965548 INFO (coreLoadExecutor-1858-thread-1-processing-n:127.0.0.1:50214_) [n:127.0.0.1:50214_ c:control_collection x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 965548 INFO (coreLoadExecutor-1858-thread-1-processing-n:127.0.0.1:50214_) [n:127.0.0.1:50214_ c:control_collection x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 965548 INFO (coreLoadExecutor-1858-thread-1-processing-n:127.0.0.1:50214_) [n:127.0.0.1:50214_ c:control_collection x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 965549 INFO (searcherExecutor-1859-thread-1-processing-n:127.0.0.1:50214_ x:collection1 c:control_collection) [n:127.0.0.1:50214_ c:control_collection x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@d41d29a[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 965550 INFO (coreLoadExecutor-1858-thread-1-processing-n:127.0.0.1:50214_) [n:127.0.0.1:50214_ c:control_collection x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1559230646287597568
[junit4] 2> 965562 INFO (coreZkRegister-1851-thread-1-processing-n:127.0.0.1:50214_ x:collection1 c:control_collection) [n:127.0.0.1:50214_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 965562 INFO (coreZkRegister-1851-thread-1-processing-n:127.0.0.1:50214_ x:collection1 c:control_collection) [n:127.0.0.1:50214_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 965562 INFO (coreZkRegister-1851-thread-1-processing-n:127.0.0.1:50214_ x:collection1 c:control_collection) [n:127.0.0.1:50214_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:50214/collection1/
[junit4] 2> 965562 INFO (coreZkRegister-1851-thread-1-processing-n:127.0.0.1:50214_ x:collection1 c:control_collection) [n:127.0.0.1:50214_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 965562 INFO (coreZkRegister-1851-thread-1-processing-n:127.0.0.1:50214_ x:collection1 c:control_collection) [n:127.0.0.1:50214_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:50214/collection1/ has no replicas
[junit4] 2> 965572 INFO (coreZkRegister-1851-thread-1-processing-n:127.0.0.1:50214_ x:collection1 c:control_collection) [n:127.0.0.1:50214_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:50214/collection1/ shard1
[junit4] 2> 965723 INFO (coreZkRegister-1851-thread-1-processing-n:127.0.0.1:50214_ x:collection1 c:control_collection) [n:127.0.0.1:50214_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 965917 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 965919 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:59925/solr ready
[junit4] 2> 965919 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 965919 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with stateFormat=2
[junit4] 2> 966018 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_8D622B05D79CDF-001/shard-1-001/cores/collection1
[junit4] 2> 966020 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_8D622B05D79CDF-001/shard-1-001
[junit4] 2> 966020 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 966029 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@42dea5f{/,null,AVAILABLE}
[junit4] 2> 966029 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@77c2954c{HTTP/1.1,[http/1.1]}{127.0.0.1:35745}
[junit4] 2> 966029 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.e.j.s.Server Started @969822ms
[junit4] 2> 966029 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_8D622B05D79CDF-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/, hostPort=35745, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_8D622B05D79CDF-001/shard-1-001/cores}
[junit4] 2> 966029 ERROR (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 966030 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 6.5.0
[junit4] 2> 966030 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 966030 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 966030 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-02-13T15:03:41.198Z
[junit4] 2> 966059 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 966059 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_8D622B05D79CDF-001/shard-1-001/solr.xml
[junit4] 2> 966064 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 966064 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:59925/solr
[junit4] 2> 966081 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [n:127.0.0.1:35745_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 966099 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [n:127.0.0.1:35745_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 966100 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [n:127.0.0.1:35745_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35745_
[junit4] 2> 966101 INFO (zkCallback-726-thread-3-processing-n:127.0.0.1:50214_) [n:127.0.0.1:50214_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 966102 INFO (zkCallback-730-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 966141 INFO (zkCallback-736-thread-1-processing-n:127.0.0.1:35745_) [n:127.0.0.1:35745_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 966280 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [n:127.0.0.1:35745_ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_8D622B05D79CDF-001/shard-1-001/cores
[junit4] 2> 966280 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [n:127.0.0.1:35745_ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 966282 INFO (OverseerStateUpdate-97451915289624580-127.0.0.1:50214_-n_0000000000) [n:127.0.0.1:50214_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 966388 INFO (zkCallback-736-thread-2-processing-n:127.0.0.1:35745_) [n:127.0.0.1:35745_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 967341 WARN (coreLoadExecutor-1869-thread-1-processing-n:127.0.0.1:35745_) [n:127.0.0.1:35745_ c:collection1 x:collection1] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
[junit4] 2> 967342 INFO (coreLoadExecutor-1869-thread-1-processing-n:127.0.0.1:35745_) [n:127.0.0.1:35745_ c:collection1 x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
[junit4] 2> 967353 INFO (coreLoadExecutor-1869-thread-1-processing-n:127.0.0.1:35745_) [n:127.0.0.1:35745_ c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 967429 WARN (coreLoadExecutor-1869-thread-1-processing-n:127.0.0.1:35745_) [n:127.0.0.1:35745_ c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 967431 INFO (coreLoadExecutor-1869-thread-1-processing-n:127.0.0.1:35745_) [n:127.0.0.1:35745_ c:collection1 x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 967448 INFO (coreLoadExecutor-1869-thread-1-processing-n:127.0.0.1:35745_) [n:127.0.0.1:35745_ c:collection1 x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 967449 INFO (coreLoadExecutor-1869-thread-1-processing-n:127.0.0.1:35745_) [n:127.0.0.1:35745_ c:collection1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_8D622B05D79CDF-001/shard-1-001/cores/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_8D622B05D79CDF-001/shard-1-001/cores/collection1/data/]
[junit4] 2> 967449 INFO (coreLoadExecutor-1869-thread-1-processing-n:127.0.0.1:35745_) [n:127.0.0.1:35745_ c:collection1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@15b780f1
[junit4] 2> 967451 INFO (coreLoadExecutor-1869-thread-1-processing-n:127.0.0.1:35745_) [n:127.0.0.1:35745_ c:collection1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@ab4af8e
[junit4] 2> 967484 WARN (coreLoadExecutor-1869-thread-1-processing-n:127.0.0.1:35745_) [n:127.0.0.1:35745_ c:collection1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 967523 INFO (coreLoadExecutor-1869-thread-1-processing-n:127.0.0.1:35745_) [n:127.0.0.1:35745_ c:collection1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 967523 INFO (coreLoadExecutor-1869-thread-1-processing-n:127.0.0.1:35745_) [n:127.0.0.1:35745_ c:collection1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 967524 INFO (coreLoadExecutor-1869-thread-1-processing-n:127.0.0.1:35745_) [n:127.0.0.1:35745_ c:collection1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 967524 INFO (coreLoadExecutor-1869-thread-1-processing-n:127.0.0.1:35745_) [n:127.0.0.1:35745_ c:collection1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 967525 INFO (coreLoadExecutor-1869-thread-1-processing-n:127.0.0.1:35745_) [n:127.0.0.1:35745_ c:collection1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@415b93d3
[junit4] 2> 967528 INFO (coreLoadExecutor-1869-thread-1-processing-n:127.0.0.1:35745_) [n:127.0.0.1:35745_ c:collection1 x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@5a9357a0[collection1] main]
[junit4] 2> 967531 INFO (coreLoadExecutor-1869-thread-1-processing-n:127.0.0.1:35745_) [n:127.0.0.1:35745_ c:collection1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 967532 INFO (coreLoadExecutor-1869-thread-1-processing-n:127.0.0.1:35745_) [n:127.0.0.1:35745_ c:collection1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 967532 INFO (coreLoadExecutor-1869-thread-1-processing-n:127.0.0.1:35745_) [n:127.0.0.1:35745_ c:collection1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 967533 INFO (searcherExecutor-1870-thread-1-processing-n:127.0.0.1:35745_ x:collection1 c:collection1) [n:127.0.0.1:35745_ c:collection1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@5a9357a0[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 967534 INFO (coreLoadExecutor-1869-thread-1-processing-n:127.0.0.1:35745_) [n:127.0.0.1:35745_ c:collection1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1559230648367972352
[junit4] 2> 967541 INFO (coreZkRegister-1864-thread-1-processing-n:127.0.0.1:35745_ x:collection1 c:collection1) [n:127.0.0.1:35745_ c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 967541 INFO (coreZkRegister-1864-thread-1-processing-n:127.0.0.1:35745_ x:collection1 c:collection1) [n:127.0.0.1:35745_ c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 967541 INFO (coreZkRegister-1864-thread-1-processing-n:127.0.0.1:35745_ x:collection1 c:collection1) [n:127.0.0.1:35745_ c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:35745/collection1/
[junit4] 2> 967541 INFO (coreZkRegister-1864-thread-1-processing-n:127.0.0.1:35745_ x:collection1 c:collection1) [n:127.0.0.1:35745_ c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 967541 INFO (coreZkRegister-1864-thread-1-processing-n:127.0.0.1:35745_ x:collection1 c:collection1) [n:127.0.0.1:35745_ c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:35745/collection1/ has no replicas
[junit4] 2> 967548 INFO (coreZkRegister-1864-thread-1-processing-n:127.0.0.1:35745_ x:collection1 c:collection1) [n:127.0.0.1:35745_ c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:35745/collection1/ shard1
[junit4] 2> 967650 INFO (zkCallback-736-thread-2-processing-n:127.0.0.1:35745_) [n:127.0.0.1:35745_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 967702 INFO (coreZkRegister-1864-thread-1-processing-n:127.0.0.1:35745_ x:collection1 c:collection1) [n:127.0.0.1:35745_ c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 967808 INFO (zkCallback-736-thread-2-processing-n:127.0.0.1:35745_) [n:127.0.0.1:35745_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 967982 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_8D622B05D79CDF-001/shard-2-001/cores/collection1
[junit4] 2> 967982 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_8D622B05D79CDF-001/shard-2-001
[junit4] 2> 967983 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 967984 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@10e1e18d{/,null,AVAILABLE}
[junit4] 2> 967984 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@55c40a7e{HTTP/1.1,[http/1.1]}{127.0.0.1:52863}
[junit4] 2> 967984 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.e.j.s.Server Started @971777ms
[junit4] 2> 967984 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_8D622B05D79CDF-001/tempDir-001/jetty2, solrconfig=solrconfig.xml, hostContext=/, hostPort=52863, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_8D622B05D79CDF-001/shard-2-001/cores}
[junit4] 2> 967984 ERROR (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 967991 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 6.5.0
[junit4] 2> 967991 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 967991 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 967991 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-02-13T15:03:43.159Z
[junit4] 2> 967996 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 967996 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_8D622B05D79CDF-001/shard-2-001/solr.xml
[junit4] 2> 968001 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 968001 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:59925/solr
[junit4] 2> 968020 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [n:127.0.0.1:52863_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 968026 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [n:127.0.0.1:52863_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 968029 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [n:127.0.0.1:52863_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52863_
[junit4] 2> 968031 INFO (zkCallback-726-thread-3-processing-n:127.0.0.1:50214_) [n:127.0.0.1:50214_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 968031 INFO (zkCallback-736-thread-2-processing-n:127.0.0.1:35745_) [n:127.0.0.1:35745_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 968031 INFO (zkCallback-730-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 968046 INFO (zkCallback-742-thread-1-processing-n:127.0.0.1:52863_) [n:127.0.0.1:52863_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 968094 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [n:127.0.0.1:52863_ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_8D622B05D79CDF-001/shard-2-001/cores
[junit4] 2> 968094 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [n:127.0.0.1:52863_ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 968102 INFO (OverseerStateUpdate-97451915289624580-127.0.0.1:50214_-n_0000000000) [n:127.0.0.1:50214_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 968204 INFO (zkCallback-736-thread-1-processing-n:127.0.0.1:35745_) [n:127.0.0.1:35745_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 968204 INFO (zkCallback-742-thread-2-processing-n:127.0.0.1:52863_) [n:127.0.0.1:52863_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 969127 WARN (coreLoadExecutor-1880-thread-1-processing-n:127.0.0.1:52863_) [n:127.0.0.1:52863_ c:collection1 x:collection1] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
[junit4] 2> 969127 INFO (coreLoadExecutor-1880-thread-1-processing-n:127.0.0.1:52863_) [n:127.0.0.1:52863_ c:collection1 x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
[junit4] 2> 969142 INFO (coreLoadExecutor-1880-thread-1-processing-n:127.0.0.1:52863_) [n:127.0.0.1:52863_ c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 969225 WARN (coreLoadExecutor-1880-thread-1-processing-n:127.0.0.1:52863_) [n:127.0.0.1:52863_ c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 969226 INFO (coreLoadExecutor-1880-thread-1-processing-n:127.0.0.1:52863_) [n:127.0.0.1:52863_ c:collection1 x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 969263 INFO (coreLoadExecutor-1880-thread-1-processing-n:127.0.0.1:52863_) [n:127.0.0.1:52863_ c:collection1 x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 969263 INFO (coreLoadExecutor-1880-thread-1-processing-n:127.0.0.1:52863_) [n:127.0.0.1:52863_ c:collection1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_8D622B05D79CDF-001/shard-2-001/cores/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_8D622B05D79CDF-001/shard-2-001/cores/collection1/data/]
[junit4] 2> 969264 INFO (coreLoadExecutor-1880-thread-1-processing-n:127.0.0.1:52863_) [n:127.0.0.1:52863_ c:collection1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@15b780f1
[junit4] 2> 969268 INFO (coreLoadExecutor-1880-thread-1-processing-n:127.0.0.1:52863_) [n:127.0.0.1:52863_ c:collection1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@3b67af81
[junit4] 2> 969283 WARN (coreLoadExecutor-1880-thread-1-processing-n:127.0.0.1:52863_) [n:127.0.0.1:52863_ c:collection1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 969346 INFO (coreLoadExecutor-1880-thread-1-processing-n:127.0.0.1:52863_) [n:127.0.0.1:52863_ c:collection1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 969346 INFO (coreLoadExecutor-1880-thread-1-processing-n:127.0.0.1:52863_) [n:127.0.0.1:52863_ c:collection1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 969347 INFO (coreLoadExecutor-1880-thread-1-processing-n:127.0.0.1:52863_) [n:127.0.0.1:52863_ c:collection1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 969347 INFO (coreLoadExecutor-1880-thread-1-processing-n:127.0.0.1:52863_) [n:127.0.0.1:52863_ c:collection1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 969354 INFO (coreLoadExecutor-1880-thread-1-processing-n:127.0.0.1:52863_) [n:127.0.0.1:52863_ c:collection1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@75c6b733
[junit4] 2> 969354 INFO (coreLoadExecutor-1880-thread-1-processing-n:127.0.0.1:52863_) [n:127.0.0.1:52863_ c:collection1 x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@565956ef[collection1] main]
[junit4] 2> 969355 INFO (coreLoadExecutor-1880-thread-1-processing-n:127.0.0.1:52863_) [n:127.0.0.1:52863_ c:collection1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 969355 INFO (coreLoadExecutor-1880-thread-1-processing-n:127.0.0.1:52863_) [n:127.0.0.1:52863_ c:collection1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 969355 INFO (coreLoadExecutor-1880-thread-1-processing-n:127.0.0.1:52863_) [n:127.0.0.1:52863_ c:collection1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 969356 INFO (coreLoadExecutor-1880-thread-1-processing-n:127.0.0.1:52863_) [n:127.0.0.1:52863_ c:collection1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1559230650278477824
[junit4] 2> 969359 INFO (searcherExecutor-1881-thread-1-processing-n:127.0.0.1:52863_ x:collection1 c:collection1) [n:127.0.0.1:52863_ c:collection1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@565956ef[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 969373 INFO (coreZkRegister-1875-thread-1-processing-n:127.0.0.1:52863_ x:collection1 c:collection1) [n:127.0.0.1:52863_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.ZkController Core needs to recover:collection1
[junit4] 2> 969377 INFO (updateExecutor-739-thread-1-processing-n:127.0.0.1:52863_ x:collection1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:52863_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.u.DefaultSolrCoreState Running recovery
[junit4] 2> 969392 INFO (recoveryExecutor-740-thread-1-processing-n:127.0.0.1:52863_ x:collection1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:52863_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=true
[junit4] 2> 969396 INFO (recoveryExecutor-740-thread-1-processing-n:127.0.0.1:52863_ x:collection1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:52863_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.RecoveryStrategy ###### startupVersions=[[]]
[junit4] 2> 969396 INFO (recoveryExecutor-740-thread-1-processing-n:127.0.0.1:52863_ x:collection1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:52863_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.RecoveryStrategy Begin buffering updates. core=[collection1]
[junit4] 2> 969396 INFO (recoveryExecutor-740-thread-1-processing-n:127.0.0.1:52863_ x:collection1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:52863_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.u.UpdateLog Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4] 2> 969396 INFO (recoveryExecutor-740-thread-1-processing-n:127.0.0.1:52863_ x:collection1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:52863_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.RecoveryStrategy Publishing state of core [collection1] as recovering, leader is [http://127.0.0.1:35745/collection1/] and I am [http://127.0.0.1:52863/collection1/]
[junit4] 2> 969419 INFO (recoveryExecutor-740-thread-1-processing-n:127.0.0.1:52863_ x:collection1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:52863_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.RecoveryStrategy Sending prep recovery command to [http://127.0.0.1:35745]; [WaitForState: action=PREPRECOVERY&core=collection1&nodeName=127.0.0.1:52863_&coreNodeName=core_node2&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true]
[junit4] 2> 969502 INFO (zkCallback-736-thread-1-processing-n:127.0.0.1:35745_) [n:127.0.0.1:35745_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 969502 INFO (zkCallback-742-thread-2-processing-n:127.0.0.1:52863_) [n:127.0.0.1:52863_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 969508 INFO (qtp658547280-24084) [n:127.0.0.1:35745_ ] o.a.s.h.a.PrepRecoveryOp Going to wait for coreNodeName: core_node2, state: recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true
[junit4] 2> 969509 INFO (qtp658547280-24084) [n:127.0.0.1:35745_ ] o.a.s.h.a.PrepRecoveryOp Will wait a max of 183 seconds to see collection1 (shard1 of collection1) have state: recovering
[junit4] 2> 969509 INFO (qtp658547280-24084) [n:127.0.0.1:35745_ ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard1, thisCore=collection1, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=recovering, localState=active, nodeName=127.0.0.1:52863_, coreNodeName=core_node2, onlyIfActiveCheckResult=false, nodeProps: core_node2:{"core":"collection1","base_url":"http://127.0.0.1:52863","node_name":"127.0.0.1:52863_","state":"recovering"}
[junit4] 2> 969509 INFO (qtp658547280-24084) [n:127.0.0.1:35745_ ] o.a.s.h.a.PrepRecoveryOp Waited coreNodeName: core_node2, state: recovering, checkLive: true, onlyIfLeader: true for: 0 seconds.
[junit4] 2> 969509 INFO (qtp658547280-24084) [n:127.0.0.1:35745_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={nodeName=127.0.0.1:52863_&onlyIfLeaderActive=true&core=collection1&coreNodeName=core_node2&action=PREPRECOVERY&checkLive=true&state=recovering&onlyIfLeader=true&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 969678 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testRestartWithAllInLIR
[junit4] 2> 969678 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.a.s.c.AbstractDistribZkTestBase Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):330
[junit4] 2> 976509 INFO (recoveryExecutor-740-thread-1-processing-n:127.0.0.1:52863_ x:collection1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:52863_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.RecoveryStrategy Attempting to PeerSync from [http://127.0.0.1:35745/collection1/] - recoveringAfterStartup=[true]
[junit4] 2> 976510 INFO (recoveryExecutor-740-thread-1-processing-n:127.0.0.1:52863_ x:collection1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:52863_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.u.PeerSync PeerSync: core=collection1 url=http://127.0.0.1:52863 START replicas=[http://127.0.0.1:35745/collection1/] nUpdates=100
[junit4] 2> 976514 INFO (qtp658547280-24082) [n:127.0.0.1:35745_ c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.u.IndexFingerprint IndexFingerprint millis:0.0 result:{maxVersionSpecified=9223372036854775807, maxVersionEncountered=0, maxInHash=0, versionsHash=0, numVersions=0, numDocs=0, maxDoc=0}
[junit4] 2> 976515 INFO (qtp658547280-24082) [n:127.0.0.1:35745_ c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.S.Request [collection1] webapp= path=/get params={distrib=false&qt=/get&getFingerprint=9223372036854775807&wt=javabin&version=2} status=0 QTime=1
[junit4] 2> 976518 INFO (recoveryExecutor-740-thread-1-processing-n:127.0.0.1:52863_ x:collection1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:52863_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.u.IndexFingerprint IndexFingerprint millis:2.0 result:{maxVersionSpecified=9223372036854775807, maxVersionEncountered=0, maxInHash=0, versionsHash=0, numVersions=0, numDocs=0, maxDoc=0}
[junit4] 2> 976518 INFO (recoveryExecutor-740-thread-1-processing-n:127.0.0.1:52863_ x:collection1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:52863_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.u.PeerSync We are already in sync. No need to do a PeerSync
[junit4] 2> 976518 INFO (recoveryExecutor-740-thread-1-processing-n:127.0.0.1:52863_ x:collection1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:52863_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 976518 INFO (recoveryExecutor-740-thread-1-processing-n:127.0.0.1:52863_ x:collection1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:52863_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
[junit4] 2> 976519 INFO (recoveryExecutor-740-thread-1-processing-n:127.0.0.1:52863_ x:collection1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:52863_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 976519 INFO (recoveryExecutor-740-thread-1-processing-n:127.0.0.1:52863_ x:collection1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:52863_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.RecoveryStrategy PeerSync stage of recovery was successful.
[junit4] 2> 976519 INFO (recoveryExecutor-740-thread-1-processing-n:127.0.0.1:52863_ x:collection1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:52863_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.RecoveryStrategy Replaying updates buffered during PeerSync.
[junit4] 2> 976519 INFO (recoveryExecutor-740-thread-1-processing-n:127.0.0.1:52863_ x:collection1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:52863_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.RecoveryStrategy No replay needed.
[junit4] 2> 976519 INFO (recoveryExecutor-740-thread-1-processing-n:127.0.0.1:52863_ x:collection1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:52863_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.RecoveryStrategy Registering as Active after recovery.
[junit4] 2> 976523 INFO (zkCallback-736-thread-1-processing-n:127.0.0.1:35745_) [n:127.0.0.1:35745_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 976523 INFO (zkCallback-742-thread-2-processing-n:127.0.0.1:52863_) [n:127.0.0.1:52863_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 976700 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8D622B05D79CDF]) [ ] o.a.s.c.AbstractDistribZkTestBase Recoveries finished - collection: collection1
[junit4] 2> 976702 INFO (qtp658547280-24085) [n:127.0.0.1:35745_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :delete with params name=collection1&action=DELETE&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 976711 INFO (OverseerThreadFactory-1856-thread-1-processing-n:127.0.0.1:50214_) [n:127.0.0.1:50214_ ] o.a.s.c.OverseerCollectionMessageHandler Executing Collection Cmd : action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true
[junit4] 2> 976727 INFO (qtp658547280-24084) [n:127.0.0.1:35745_ ] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.core.collection1
[junit4] 2> 976727 INFO (qtp658547280-24084) [n:127.0.0.1:35745_ ] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@495ce54f
[junit4] 2> 976733 INFO (qtp267227639-24112) [n:127.0.0.1:52863_ ] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.core.collection1
[junit4] 2> 976733 INFO (qtp267227639-24112) [n:127.0.0.1:52863_ ] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@5b80ac2a
[junit4] 2> 976838 INFO (qtp658547280-24084) [n:127.0.0.1:35745_ ] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.core.collection1
[junit4] 2> 976845 WARN (zkCallback-742-thread-2-processing-n:127.0.0.1:52863_) [n:127.0.0.1:52863_ ] o.a.s.c.LeaderElector
[junit4] 2> org.apache.solr.common.SolrException: SolrCore not found:collection1 in []
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:292)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:170)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:135)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:56)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:348)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.lambda$process$0(SolrZkClient.java:268)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 976877 INFO (qtp658547280-24084) [n:127.0.0.1:35745_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={delete
[...truncated too long message...]
ultMBeanServerInterceptor.java:1813)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.exclusiveUnregisterMBean(DefaultMBeanServerInterceptor.java:430)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.unregisterMBean(DefaultMBeanServerInterceptor.java:415)
[junit4] 2> at com.sun.jmx.mbeanserver.JmxMBeanServer.unregisterMBean(JmxMBeanServer.java:546)
[junit4] 2> at org.apache.hadoop.metrics2.util.MBeans.unregister(MBeans.java:81)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stopMBeans(MetricsSourceAdapter.java:226)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stop(MetricsSourceAdapter.java:211)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stopSources(MetricsSystemImpl.java:463)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stop(MetricsSystemImpl.java:213)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.shutdown(MetricsSystemImpl.java:594)
[junit4] 2> at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdownInstance(DefaultMetricsSystem.java:72)
[junit4] 2> at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdown(DefaultMetricsSystem.java:68)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.metrics.NameNodeMetrics.shutdown(NameNodeMetrics.java:171)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.NameNode.stop(NameNode.java:872)
[junit4] 2> at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1726)
[junit4] 2> at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1705)
[junit4] 2> at org.apache.solr.cloud.hdfs.HdfsTestUtil.teardownClass(HdfsTestUtil.java:198)
[junit4] 2> at org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest.teardownClass(HdfsWriteToMultipleCollectionsTest.java:73)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:498)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:870)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> Caused by: java.lang.NullPointerException
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlocksMap.size(BlocksMap.java:203)
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.getTotalBlocks(BlockManager.java:3370)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlocksTotal(FSNamesystem.java:5729)
[junit4] 2> ... 53 more
[junit4] 2> 4665635 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[8D622B05D79CDF]-worker) [ ] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_8D622B05D79CDF-001
[junit4] 2> Feb 13, 2017 4:05:20 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 34 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene62): {rnd_b=PostingsFormat(name=LuceneVarGapDocFreqInterval), _version_=Lucene50(blocksize=128), a_t=PostingsFormat(name=LuceneFixedGap), a_i=PostingsFormat(name=LuceneVarGapDocFreqInterval), id=PostingsFormat(name=LuceneVarGapDocFreqInterval)}, docValues:{}, maxPointsInLeafNode=848, maxMBSortInHeap=7.926673552907783, sim=RandomSimilarity(queryNorm=true,coord=crazy): {}, locale=he-IL, timezone=America/Glace_Bay
[junit4] 2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_121 (64-bit)/cpus=4,threads=2,free=178134968,total=534249472
[junit4] 2> NOTE: All tests run in this JVM: [V2ApiIntegrationTest, TestQueryWrapperFilter, TestConfigSets, TestAddFieldRealTimeGet, TlogReplayBufferedWhileIndexingTest, TestCoreContainer, BlobRepositoryCloudTest, PeerSyncWithIndexFingerprintCachingTest, JSONWriterTest, DocValuesTest, TestCloudSchemaless, BlockCacheTest, TestIntervalFaceting, BlockJoinFacetRandomTest, CreateCollectionCleanupTest, ConvertedLegacyTest, TestSha256AuthenticationProvider, HttpPartitionTest, TestRawResponseWriter, TestSolrCloudWithHadoopAuthPlugin, TestReRankQParserPlugin, AnalysisErrorHandlingTest, SearchHandlerTest, TestQueryTypes, ClassificationUpdateProcessorIntegrationTest, TestLuceneMatchVersion, MergeStrategyTest, JvmMetricsTest, MultiTermTest, TestFieldCacheSort, UpdateRequestProcessorFactoryTest, DeleteShardTest, OpenCloseCoreStressTest, FileUtilsTest, WordBreakSolrSpellCheckerTest, UtilsToolTest, TestWordDelimiterFilterFactory, TestSimpleTrackingShardHandler, SliceStateTest, CopyFieldTest, CoreMergeIndexesAdminHandlerTest, DirectSolrSpellCheckerTest, TestFieldCacheWithThreads, TestRequestStatusCollectionAPI, BadCopyFieldTest, PreAnalyzedUpdateProcessorTest, DistanceUnitsTest, SoftAutoCommitTest, ZkControllerTest, MigrateRouteKeyTest, ZkSolrClientTest, TestUniqueKeyFieldResource, IndexSchemaTest, TestHashPartitioner, HdfsRecoverLeaseTest, TestSearcherReuse, TestFuzzyAnalyzedSuggestions, DocExpirationUpdateProcessorFactoryTest, ZkCLITest, SolrCmdDistributorTest, SortByFunctionTest, TestCoreAdminApis, SampleTest, CdcrReplicationDistributedZkTest, ShufflingReplicaListTransformerTest, TestPerFieldSimilarityWithDefaultOverride, HdfsUnloadDistributedZkTest, TestHashQParserPlugin, WrapperMergePolicyFactoryTest, TestComplexPhraseLeadingWildcard, TestDynamicLoading, HdfsSyncSliceTest, TestCloudPseudoReturnFields, SmileWriterTest, DistribDocExpirationUpdateProcessorTest, TestSolrCloudWithKerberosAlt, TestSolrXml, ConcurrentDeleteAndCreateCollectionTest, TestNamedUpdateProcessors, SolrIndexSplitterTest, CollectionTooManyReplicasTest, TestFieldTypeCollectionResource, TestInitParams, DistributedVersionInfoTest, SharedFSAutoReplicaFailoverUtilsTest, TestApiFramework, TestTrie, ManagedSchemaRoundRobinCloudTest, SpellCheckCollatorTest, TestConfigSetsAPIZkFailure, TestSolrIndexConfig, TestCopyFieldCollectionResource, HighlighterTest, TermVectorComponentTest, SystemInfoHandlerTest, TestSolr4Spatial2, TestAuthorizationFramework, RemoteQueryErrorTest, AsyncCallRequestStatusResponseTest, TestExceedMaxTermLength, TestDistributedGrouping, OutOfBoxZkACLAndCredentialsProvidersTest, SolrCloudExampleTest, SpellingQueryConverterTest, TestRTimerTree, TestFastOutputStream, TestStandardQParsers, TestNumericTerms64, LoggingHandlerTest, TestCollectionAPI, TestChildDocTransformer, DistributedFacetExistsSmallTest, MetricUtilsTest, TestClusterStateMutator, SharedFSAutoReplicaFailoverTest, TestLeaderInitiatedRecoveryThread, TestLocalFSCloudBackupRestore, TestMiniSolrCloudClusterSSL, TestRandomRequestDistribution, TestReplicaProperties, TestShortCircuitedRequests, TestSolrCloudWithDelegationTokens, TestStressLiveNodes, HdfsBasicDistributedZkTest, HdfsWriteToMultipleCollectionsTest]
[junit4] Completed [543/691 (3!)] on J1 in 57.50s, 1 test, 1 failure <<< FAILURES!
[...truncated 12164 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/build.xml:783: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/build.xml:727: Some of the tests produced a heap dump, but did not fail. Maybe a suppressed OutOfMemoryError? Dumps created:
* java_pid27858.hprof
Total time: 233 minutes 25 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-6.x - Build # 281 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.x/281/
5 tests failed.
FAILED: org.apache.solr.cloud.LeaderFailoverAfterPartitionTest.test
Error Message:
Expected 2 of 3 replicas to be active but only found 1; [core_node3:{"core":"c8n_1x3_lf_shard1_replica1","base_url":"http://127.0.0.1:33265/hgrn/b","node_name":"127.0.0.1:33265_hgrn%2Fb","state":"active","leader":"true"}]; clusterState: DocCollection(c8n_1x3_lf//clusterstate.json/35)={ "replicationFactor":"3", "shards":{"shard1":{ "range":"80000000-7fffffff", "state":"active", "replicas":{ "core_node1":{ "core":"c8n_1x3_lf_shard1_replica3", "base_url":"http://127.0.0.1:57594/hgrn/b", "node_name":"127.0.0.1:57594_hgrn%2Fb", "state":"down"}, "core_node2":{ "state":"down", "base_url":"http://127.0.0.1:48547/hgrn/b", "core":"c8n_1x3_lf_shard1_replica2", "node_name":"127.0.0.1:48547_hgrn%2Fb"}, "core_node3":{ "core":"c8n_1x3_lf_shard1_replica1", "base_url":"http://127.0.0.1:33265/hgrn/b", "node_name":"127.0.0.1:33265_hgrn%2Fb", "state":"active", "leader":"true"}}}}, "router":{"name":"compositeId"}, "maxShardsPerNode":"1", "autoAddReplicas":"false"}
Stack Trace:
java.lang.AssertionError: Expected 2 of 3 replicas to be active but only found 1; [core_node3:{"core":"c8n_1x3_lf_shard1_replica1","base_url":"http://127.0.0.1:33265/hgrn/b","node_name":"127.0.0.1:33265_hgrn%2Fb","state":"active","leader":"true"}]; clusterState: DocCollection(c8n_1x3_lf//clusterstate.json/35)={
"replicationFactor":"3",
"shards":{"shard1":{
"range":"80000000-7fffffff",
"state":"active",
"replicas":{
"core_node1":{
"core":"c8n_1x3_lf_shard1_replica3",
"base_url":"http://127.0.0.1:57594/hgrn/b",
"node_name":"127.0.0.1:57594_hgrn%2Fb",
"state":"down"},
"core_node2":{
"state":"down",
"base_url":"http://127.0.0.1:48547/hgrn/b",
"core":"c8n_1x3_lf_shard1_replica2",
"node_name":"127.0.0.1:48547_hgrn%2Fb"},
"core_node3":{
"core":"c8n_1x3_lf_shard1_replica1",
"base_url":"http://127.0.0.1:33265/hgrn/b",
"node_name":"127.0.0.1:33265_hgrn%2Fb",
"state":"active",
"leader":"true"}}}},
"router":{"name":"compositeId"},
"maxShardsPerNode":"1",
"autoAddReplicas":"false"}
at __randomizedtesting.SeedInfo.seed([7173BED178420272:F927810BD6BE6F8A]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.cloud.LeaderFailoverAfterPartitionTest.testRf3WithLeaderFailover(LeaderFailoverAfterPartitionTest.java:168)
at org.apache.solr.cloud.LeaderFailoverAfterPartitionTest.test(LeaderFailoverAfterPartitionTest.java:55)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.hdfs.HdfsTlogReplayBufferedWhileIndexingTest.test
Error Message:
There are still nodes recoverying - waited for 330 seconds
Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 330 seconds
at __randomizedtesting.SeedInfo.seed([7173BED178420272:F927810BD6BE6F8A]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:187)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:144)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:139)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:850)
at org.apache.solr.cloud.TlogReplayBufferedWhileIndexingTest.test(TlogReplayBufferedWhileIndexingTest.java:72)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.lucene.search.TestFuzzyQuery.testRandom
Error Message:
Test abandoned because suite timeout was reached.
Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
at __randomizedtesting.SeedInfo.seed([B0FDCF8DBB1EAA33]:0)
FAILED: junit.framework.TestSuite.org.apache.lucene.search.TestFuzzyQuery
Error Message:
Suite timeout exceeded (>= 7200000 msec).
Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
at __randomizedtesting.SeedInfo.seed([B0FDCF8DBB1EAA33]:0)
FAILED: org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest.test
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([7173BED178420272:F927810BD6BE6F8A]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertTrue(Assert.java:54)
at org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest.test(HdfsWriteToMultipleCollectionsTest.java:137)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 1810 lines...]
[junit4] Suite: org.apache.lucene.search.TestFuzzyQuery
[junit4] 2> فبر 12, 2017 2:08:08 ص com.carrotsearch.randomizedtesting.ThreadLeakControl$2 evaluate
[junit4] 2> WARNING: Suite execution timed out: org.apache.lucene.search.TestFuzzyQuery
[junit4] 2> 1) Thread[id=5352, name=TEST-TestFuzzyQuery.testRandom-seed#[B0FDCF8DBB1EAA33], state=RUNNABLE, group=TGRP-TestFuzzyQuery]
[junit4] 2> at java.lang.Object.hashCode(Native Method)
[junit4] 2> at java.util.WeakHashMap.hash(WeakHashMap.java:298)
[junit4] 2> at java.util.WeakHashMap.get(WeakHashMap.java:396)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedContext.getPerThread(RandomizedContext.java:319)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedContext.getRandomness(RandomizedContext.java:92)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedContext.getRandom(RandomizedContext.java:114)
[junit4] 2> at org.apache.lucene.util.LuceneTestCase.random(LuceneTestCase.java:747)
[junit4] 2> at org.apache.lucene.search.TestFuzzyQuery.randomSimpleString(TestFuzzyQuery.java:503)
[junit4] 2> at org.apache.lucene.search.TestFuzzyQuery.testRandom(TestFuzzyQuery.java:517)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:498)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
[junit4] 2> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 2) Thread[id=1, name=main, state=WAITING, group=main]
[junit4] 2> at java.lang.Object.wait(Native Method)
[junit4] 2> at java.lang.Thread.join(Thread.java:1249)
[junit4] 2> at java.lang.Thread.join(Thread.java:1323)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:608)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.run(RandomizedRunner.java:457)
[junit4] 2> at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.execute(SlaveMain.java:244)
[junit4] 2> at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.main(SlaveMain.java:355)
[junit4] 2> at com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe.main(SlaveMainSafe.java:13)
[junit4] 2> 3) Thread[id=5351, name=SUITE-TestFuzzyQuery-seed#[B0FDCF8DBB1EAA33], state=RUNNABLE, group=TGRP-TestFuzzyQuery]
[junit4] 2> at java.lang.Thread.getStackTrace(Thread.java:1556)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$4.run(ThreadLeakControl.java:696)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$4.run(ThreadLeakControl.java:693)
[junit4] 2> at java.security.AccessController.doPrivileged(Native Method)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.getStackTrace(ThreadLeakControl.java:693)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.getThreadsWithTraces(ThreadLeakControl.java:709)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.formatThreadStacksFull(ThreadLeakControl.java:689)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.access$1000(ThreadLeakControl.java:65)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$2.evaluate(ThreadLeakControl.java:415)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:678)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.access$200(RandomizedRunner.java:140)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:598)
[junit4] 2> 4) Thread[id=9, name=JUnit4-serializer-daemon, state=TIMED_WAITING, group=main]
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at com.carrotsearch.ant.tasks.junit4.events.Serializer$1.run(Serializer.java:50)
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestFuzzyQuery -Dtests.method=testRandom -Dtests.seed=B0FDCF8DBB1EAA33 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/test-data/enwiki.random.lines.txt -Dtests.locale=ar-DZ -Dtests.timezone=America/Ensenada -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] ERROR 7200s J0 | TestFuzzyQuery.testRandom <<<
[junit4] > Throwable #1: java.lang.Exception: Test abandoned because suite timeout was reached.
[junit4] > at __randomizedtesting.SeedInfo.seed([B0FDCF8DBB1EAA33]:0)
[junit4] 2> فبر 12, 2017 2:08:08 ص com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> فبر 12, 2017 2:08:28 ص com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> SEVERE: 1 thread leaked from SUITE scope at org.apache.lucene.search.TestFuzzyQuery:
[junit4] 2> 1) Thread[id=5352, name=TEST-TestFuzzyQuery.testRandom-seed#[B0FDCF8DBB1EAA33], state=RUNNABLE, group=TGRP-TestFuzzyQuery]
[junit4] 2> at java.util.WeakHashMap.containsKey(WeakHashMap.java:417)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedContext.context(RandomizedContext.java:258)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedContext.current(RandomizedContext.java:134)
[junit4] 2> at org.apache.lucene.util.LuceneTestCase.random(LuceneTestCase.java:747)
[junit4] 2> at org.apache.lucene.search.TestFuzzyQuery.randomSimpleString(TestFuzzyQuery.java:506)
[junit4] 2> at org.apache.lucene.search.TestFuzzyQuery.testRandom(TestFuzzyQuery.java:517)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:498)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
[junit4] 2> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> فبر 12, 2017 2:08:28 ص com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> INFO: Starting to interrupt leaked threads:
[junit4] 2> 1) Thread[id=5352, name=TEST-TestFuzzyQuery.testRandom-seed#[B0FDCF8DBB1EAA33], state=RUNNABLE, group=TGRP-TestFuzzyQuery]
[junit4] 2> فبر 12, 2017 2:08:31 ص com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> SEVERE: There are still zombie threads that couldn't be terminated:
[junit4] 2> 1) Thread[id=5352, name=TEST-TestFuzzyQuery.testRandom-seed#[B0FDCF8DBB1EAA33], state=RUNNABLE, group=TGRP-TestFuzzyQuery]
[junit4] 2> at java.lang.Object.hashCode(Native Method)
[junit4] 2> at java.util.WeakHashMap.hash(WeakHashMap.java:298)
[junit4] 2> at java.util.WeakHashMap.getEntry(WeakHashMap.java:426)
[junit4] 2> at java.util.WeakHashMap.containsKey(WeakHashMap.java:417)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedContext.context(RandomizedContext.java:258)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedContext.current(RandomizedContext.java:134)
[junit4] 2> at org.apache.lucene.util.LuceneTestCase.random(LuceneTestCase.java:747)
[junit4] 2> at org.apache.lucene.search.TestFuzzyQuery.randomSimpleString(TestFuzzyQuery.java:506)
[junit4] 2> at org.apache.lucene.search.TestFuzzyQuery.testRandom(TestFuzzyQuery.java:517)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:498)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
[junit4] 2> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene62): {field=PostingsFormat(name=Memory doPackFST= true)}, docValues:{}, maxPointsInLeafNode=1132, maxMBSortInHeap=6.95059225985797, sim=RandomSimilarity(queryNorm=true,coord=yes): {field=DFR GL1}, locale=ar-DZ, timezone=America/Ensenada
[junit4] 2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_121 (64-bit)/cpus=4,threads=2,free=58896192,total=146276352
[junit4] 2> NOTE: All tests run in this JVM: [TestDeletionPolicy, TestIndexWriterExceptions, TestLRUQueryCache, TestStressDeletes, TestBasics, TestMultiValuedNumericRangeQuery, TestNearSpansOrdered, TestCustomNorms, TestCachingCollector, TestSort, TestBlockPostingsFormat2, TestIndexWriterUnicode, TestPrefixCodedTerms, TestMaxTermFrequency, TestDemoParallelLeafReader, TestSimpleFSDirectory, TestCharsRef, TestReaderWrapperDVTypeCheck, Test2BPositions, TestConsistentFieldNumbers, TestAllFilesDetectTruncation, TestLSBRadixSorter, Test2BBKDPoints, TestByteSlices, TestIndexWriterDeleteByQuery, TestLucene50TermVectorsFormat, TestSloppyMath, TestTimeLimitingCollector, TestIndexWriter, TestMultiset, TestLogMergePolicy, TestMergePolicyWrapper, TestFilterDirectory, TestSpanNearQuery, Test2BPagedBytes, TestFieldMaskingSpanQuery, TestDelegatingAnalyzerWrapper, TestTwoPhaseCommitTool, TestDateTools, TestDocValues, TestNumericTokenStream, TestIntArrayDocIdSet, TestIndexableField, TestLongPostings, TestParallelCompositeReader, TestTimSorterWorstCase, TestLiveFieldValues, TestSpanBoostQuery, TestPerFieldPostingsFormat2, TestDocBoost, TestDocumentsWriterStallControl, TestGraphQuery, TestIndexWriterWithThreads, TestLucene54DocValuesFormat, TestNoDeletionPolicy, TestSleepingLockWrapper, TestSegmentMerger, TestFixedLengthBytesRefArray, TestPhrasePrefixQuery, TestSearchForDuplicates, TestMultiTermsEnum, TestMultiLevelSkipList, TestApproximationSearchEquivalence, TestSortedSetSortField, TestWordlistLoader, TestIndexWriterConfig, TestSimpleExplanations, TestPolygon, TestBooleanCoord, TestFuzzyQuery]
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestFuzzyQuery -Dtests.seed=B0FDCF8DBB1EAA33 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/test-data/enwiki.random.lines.txt -Dtests.locale=ar-DZ -Dtests.timezone=America/Ensenada -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] ERROR 0.00s J0 | TestFuzzyQuery (suite) <<<
[junit4] > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
[junit4] > at __randomizedtesting.SeedInfo.seed([B0FDCF8DBB1EAA33]:0)
[junit4] Completed [446/452 (1!)] on J0 in 7223.15s, 7 tests, 2 errors <<< FAILURES!
[...truncated 9754 lines...]
[junit4] Suite: org.apache.solr.cloud.LeaderFailoverAfterPartitionTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_7173BED178420272-001/init-core-data-001
[junit4] 2> 10993 INFO (SUITE-LeaderFailoverAfterPartitionTest-seed#[7173BED178420272]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
[junit4] 2> 10993 INFO (SUITE-LeaderFailoverAfterPartitionTest-seed#[7173BED178420272]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /hgrn/b
[junit4] 2> 11016 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 11085 INFO (Thread-3) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 11086 INFO (Thread-3) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 11185 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.a.s.c.ZkTestServer start zk server on port:44825
[junit4] 2> 11980 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 11990 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 11992 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 11995 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 11997 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 12008 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 12010 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 12013 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 12016 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 12018 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 12025 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 12186 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_7173BED178420272-001/control-001/cores/collection1
[junit4] 2> 12938 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 13073 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@82cc9ec{/hgrn/b,null,AVAILABLE}
[junit4] 2> 13132 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@66046c5e{HTTP/1.1,[http/1.1]}{127.0.0.1:41271}
[junit4] 2> 13132 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.e.j.s.Server Started @16450ms
[junit4] 2> 13132 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_7173BED178420272-001/tempDir-001/control/data, hostContext=/hgrn/b, hostPort=57594, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_7173BED178420272-001/control-001/cores}
[junit4] 2> 13174 ERROR (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 13174 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 6.5.0
[junit4] 2> 13174 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 13174 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 13205 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-02-12T11:53:11.882Z
[junit4] 2> 13207 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 13244 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 13246 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_7173BED178420272-001/control-001/solr.xml
[junit4] 2> 13315 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 13316 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:44825/solr
[junit4] 2> 13705 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [n:127.0.0.1:57594_hgrn%2Fb ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:57594_hgrn%2Fb
[junit4] 2> 13708 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [n:127.0.0.1:57594_hgrn%2Fb ] o.a.s.c.Overseer Overseer (id=97445503950585860-127.0.0.1:57594_hgrn%2Fb-n_0000000000) starting
[junit4] 2> 13849 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [n:127.0.0.1:57594_hgrn%2Fb ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:57594_hgrn%2Fb
[junit4] 2> 13864 INFO (zkCallback-11-thread-1-processing-n:127.0.0.1:57594_hgrn%2Fb) [n:127.0.0.1:57594_hgrn%2Fb ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 14329 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [n:127.0.0.1:57594_hgrn%2Fb ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_7173BED178420272-001/control-001/cores
[junit4] 2> 14330 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [n:127.0.0.1:57594_hgrn%2Fb ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 14445 INFO (OverseerStateUpdate-97445503950585860-127.0.0.1:57594_hgrn%2Fb-n_0000000000) [n:127.0.0.1:57594_hgrn%2Fb ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 15476 WARN (coreLoadExecutor-32-thread-1-processing-n:127.0.0.1:57594_hgrn%2Fb) [n:127.0.0.1:57594_hgrn%2Fb c:control_collection x:collection1] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
[junit4] 2> 15477 INFO (coreLoadExecutor-32-thread-1-processing-n:127.0.0.1:57594_hgrn%2Fb) [n:127.0.0.1:57594_hgrn%2Fb c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
[junit4] 2> 15515 INFO (coreLoadExecutor-32-thread-1-processing-n:127.0.0.1:57594_hgrn%2Fb) [n:127.0.0.1:57594_hgrn%2Fb c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 15747 WARN (coreLoadExecutor-32-thread-1-processing-n:127.0.0.1:57594_hgrn%2Fb) [n:127.0.0.1:57594_hgrn%2Fb c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 15751 INFO (coreLoadExecutor-32-thread-1-processing-n:127.0.0.1:57594_hgrn%2Fb) [n:127.0.0.1:57594_hgrn%2Fb c:control_collection x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 15805 INFO (coreLoadExecutor-32-thread-1-processing-n:127.0.0.1:57594_hgrn%2Fb) [n:127.0.0.1:57594_hgrn%2Fb c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 15805 INFO (coreLoadExecutor-32-thread-1-processing-n:127.0.0.1:57594_hgrn%2Fb) [n:127.0.0.1:57594_hgrn%2Fb c:control_collection x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_7173BED178420272-001/control-001/cores/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_7173BED178420272-001/control-001/cores/collection1/data/]
[junit4] 2> 15808 INFO (coreLoadExecutor-32-thread-1-processing-n:127.0.0.1:57594_hgrn%2Fb) [n:127.0.0.1:57594_hgrn%2Fb c:control_collection x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@353c9b6d
[junit4] 2> 15810 INFO (coreLoadExecutor-32-thread-1-processing-n:127.0.0.1:57594_hgrn%2Fb) [n:127.0.0.1:57594_hgrn%2Fb c:control_collection x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=2, maxMergeAtOnceExplicit=7, maxMergedSegmentMB=56.17578125, floorSegmentMB=0.8779296875, forceMergeDeletesPctAllowed=8.425810593057351, segmentsPerTier=8.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.49645842083910596
[junit4] 2> 15828 WARN (coreLoadExecutor-32-thread-1-processing-n:127.0.0.1:57594_hgrn%2Fb) [n:127.0.0.1:57594_hgrn%2Fb c:control_collection x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 15916 INFO (coreLoadExecutor-32-thread-1-processing-n:127.0.0.1:57594_hgrn%2Fb) [n:127.0.0.1:57594_hgrn%2Fb c:control_collection x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 15916 INFO (coreLoadExecutor-32-thread-1-processing-n:127.0.0.1:57594_hgrn%2Fb) [n:127.0.0.1:57594_hgrn%2Fb c:control_collection x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 15924 INFO (coreLoadExecutor-32-thread-1-processing-n:127.0.0.1:57594_hgrn%2Fb) [n:127.0.0.1:57594_hgrn%2Fb c:control_collection x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 15924 INFO (coreLoadExecutor-32-thread-1-processing-n:127.0.0.1:57594_hgrn%2Fb) [n:127.0.0.1:57594_hgrn%2Fb c:control_collection x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 15925 INFO (coreLoadExecutor-32-thread-1-processing-n:127.0.0.1:57594_hgrn%2Fb) [n:127.0.0.1:57594_hgrn%2Fb c:control_collection x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@253ce299
[junit4] 2> 15926 INFO (coreLoadExecutor-32-thread-1-processing-n:127.0.0.1:57594_hgrn%2Fb) [n:127.0.0.1:57594_hgrn%2Fb c:control_collection x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@298930aa[collection1] main]
[junit4] 2> 15929 INFO (coreLoadExecutor-32-thread-1-processing-n:127.0.0.1:57594_hgrn%2Fb) [n:127.0.0.1:57594_hgrn%2Fb c:control_collection x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 15930 INFO (coreLoadExecutor-32-thread-1-processing-n:127.0.0.1:57594_hgrn%2Fb) [n:127.0.0.1:57594_hgrn%2Fb c:control_collection x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 15930 INFO (coreLoadExecutor-32-thread-1-processing-n:127.0.0.1:57594_hgrn%2Fb) [n:127.0.0.1:57594_hgrn%2Fb c:control_collection x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 15933 INFO (searcherExecutor-33-thread-1-processing-n:127.0.0.1:57594_hgrn%2Fb x:collection1 c:control_collection) [n:127.0.0.1:57594_hgrn%2Fb c:control_collection x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@298930aa[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 15933 INFO (coreLoadExecutor-32-thread-1-processing-n:127.0.0.1:57594_hgrn%2Fb) [n:127.0.0.1:57594_hgrn%2Fb c:control_collection x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1559128068208984064
[junit4] 2> 15964 INFO (coreZkRegister-25-thread-1-processing-n:127.0.0.1:57594_hgrn%2Fb x:collection1 c:control_collection) [n:127.0.0.1:57594_hgrn%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 15964 INFO (coreZkRegister-25-thread-1-processing-n:127.0.0.1:57594_hgrn%2Fb x:collection1 c:control_collection) [n:127.0.0.1:57594_hgrn%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 15964 INFO (coreZkRegister-25-thread-1-processing-n:127.0.0.1:57594_hgrn%2Fb x:collection1 c:control_collection) [n:127.0.0.1:57594_hgrn%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:57594/hgrn/b/collection1/
[junit4] 2> 15973 INFO (coreZkRegister-25-thread-1-processing-n:127.0.0.1:57594_hgrn%2Fb x:collection1 c:control_collection) [n:127.0.0.1:57594_hgrn%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 15974 INFO (coreZkRegister-25-thread-1-processing-n:127.0.0.1:57594_hgrn%2Fb x:collection1 c:control_collection) [n:127.0.0.1:57594_hgrn%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:57594/hgrn/b/collection1/ has no replicas
[junit4] 2> 16000 INFO (coreZkRegister-25-thread-1-processing-n:127.0.0.1:57594_hgrn%2Fb x:collection1 c:control_collection) [n:127.0.0.1:57594_hgrn%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:57594/hgrn/b/collection1/ shard1
[junit4] 2> 16092 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 16093 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:44825/solr ready
[junit4] 2> 16095 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 16161 INFO (coreZkRegister-25-thread-1-processing-n:127.0.0.1:57594_hgrn%2Fb x:collection1 c:control_collection) [n:127.0.0.1:57594_hgrn%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 16214 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_7173BED178420272-001/shard-1-001/cores/collection1
[junit4] 2> 16215 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_7173BED178420272-001/shard-1-001
[junit4] 2> 16216 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 16347 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4f073ed2{/hgrn/b,null,AVAILABLE}
[junit4] 2> 16348 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@173b7122{HTTP/1.1,[http/1.1]}{127.0.0.1:44760}
[junit4] 2> 16348 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.e.j.s.Server Started @19666ms
[junit4] 2> 16348 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_7173BED178420272-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/hgrn/b, hostPort=33265, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_7173BED178420272-001/shard-1-001/cores}
[junit4] 2> 16355 ERROR (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 16370 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 6.5.0
[junit4] 2> 16370 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 16370 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 16370 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-02-12T11:53:15.076Z
[junit4] 2> 16397 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 16397 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_7173BED178420272-001/shard-1-001/solr.xml
[junit4] 2> 16423 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 16429 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:44825/solr
[junit4] 2> 16461 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [n:127.0.0.1:33265_hgrn%2Fb ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 16469 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [n:127.0.0.1:33265_hgrn%2Fb ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33265_hgrn%2Fb
[junit4] 2> 16481 INFO (zkCallback-15-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 16481 INFO (zkCallback-11-thread-4-processing-n:127.0.0.1:57594_hgrn%2Fb) [n:127.0.0.1:57594_hgrn%2Fb ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 16488 INFO (zkCallback-20-thread-1-processing-n:127.0.0.1:33265_hgrn%2Fb) [n:127.0.0.1:33265_hgrn%2Fb ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 16738 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [n:127.0.0.1:33265_hgrn%2Fb ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_7173BED178420272-001/shard-1-001/cores
[junit4] 2> 16738 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [n:127.0.0.1:33265_hgrn%2Fb ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 16861 INFO (OverseerStateUpdate-97445503950585860-127.0.0.1:57594_hgrn%2Fb-n_0000000000) [n:127.0.0.1:57594_hgrn%2Fb ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2
[junit4] 2> 17907 WARN (coreLoadExecutor-43-thread-1-processing-n:127.0.0.1:33265_hgrn%2Fb) [n:127.0.0.1:33265_hgrn%2Fb c:collection1 x:collection1] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
[junit4] 2> 17907 INFO (coreLoadExecutor-43-thread-1-processing-n:127.0.0.1:33265_hgrn%2Fb) [n:127.0.0.1:33265_hgrn%2Fb c:collection1 x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
[junit4] 2> 17929 INFO (coreLoadExecutor-43-thread-1-processing-n:127.0.0.1:33265_hgrn%2Fb) [n:127.0.0.1:33265_hgrn%2Fb c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 18117 WARN (coreLoadExecutor-43-thread-1-processing-n:127.0.0.1:33265_hgrn%2Fb) [n:127.0.0.1:33265_hgrn%2Fb c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 18120 INFO (coreLoadExecutor-43-thread-1-processing-n:127.0.0.1:33265_hgrn%2Fb) [n:127.0.0.1:33265_hgrn%2Fb c:collection1 x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 18152 INFO (coreLoadExecutor-43-thread-1-processing-n:127.0.0.1:33265_hgrn%2Fb) [n:127.0.0.1:33265_hgrn%2Fb c:collection1 x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 18152 INFO (coreLoadExecutor-43-thread-1-processing-n:127.0.0.1:33265_hgrn%2Fb) [n:127.0.0.1:33265_hgrn%2Fb c:collection1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_7173BED178420272-001/shard-1-001/cores/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_7173BED178420272-001/shard-1-001/cores/collection1/data/]
[junit4] 2> 18153 INFO (coreLoadExecutor-43-thread-1-processing-n:127.0.0.1:33265_hgrn%2Fb) [n:127.0.0.1:33265_hgrn%2Fb c:collection1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@353c9b6d
[junit4] 2> 18165 INFO (coreLoadExecutor-43-thread-1-processing-n:127.0.0.1:33265_hgrn%2Fb) [n:127.0.0.1:33265_hgrn%2Fb c:collection1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=2, maxMergeAtOnceExplicit=7, maxMergedSegmentMB=56.17578125, floorSegmentMB=0.8779296875, forceMergeDeletesPctAllowed=8.425810593057351, segmentsPerTier=8.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.49645842083910596
[junit4] 2> 18185 WARN (coreLoadExecutor-43-thread-1-processing-n:127.0.0.1:33265_hgrn%2Fb) [n:127.0.0.1:33265_hgrn%2Fb c:collection1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 18276 INFO (coreLoadExecutor-43-thread-1-processing-n:127.0.0.1:33265_hgrn%2Fb) [n:127.0.0.1:33265_hgrn%2Fb c:collection1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 18283 INFO (coreLoadExecutor-43-thread-1-processing-n:127.0.0.1:33265_hgrn%2Fb) [n:127.0.0.1:33265_hgrn%2Fb c:collection1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 18284 INFO (coreLoadExecutor-43-thread-1-processing-n:127.0.0.1:33265_hgrn%2Fb) [n:127.0.0.1:33265_hgrn%2Fb c:collection1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 18284 INFO (coreLoadExecutor-43-thread-1-processing-n:127.0.0.1:33265_hgrn%2Fb) [n:127.0.0.1:33265_hgrn%2Fb c:collection1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 18285 INFO (coreLoadExecutor-43-thread-1-processing-n:127.0.0.1:33265_hgrn%2Fb) [n:127.0.0.1:33265_hgrn%2Fb c:collection1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@3c7c7695
[junit4] 2> 18286 INFO (coreLoadExecutor-43-thread-1-processing-n:127.0.0.1:33265_hgrn%2Fb) [n:127.0.0.1:33265_hgrn%2Fb c:collection1 x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@73c2b8a1[collection1] main]
[junit4] 2> 18288 INFO (coreLoadExecutor-43-thread-1-processing-n:127.0.0.1:33265_hgrn%2Fb) [n:127.0.0.1:33265_hgrn%2Fb c:collection1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 18288 INFO (coreLoadExecutor-43-thread-1-processing-n:127.0.0.1:33265_hgrn%2Fb) [n:127.0.0.1:33265_hgrn%2Fb c:collection1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 18288 INFO (coreLoadExecutor-43-thread-1-processing-n:127.0.0.1:33265_hgrn%2Fb) [n:127.0.0.1:33265_hgrn%2Fb c:collection1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 18289 INFO (coreLoadExecutor-43-thread-1-processing-n:127.0.0.1:33265_hgrn%2Fb) [n:127.0.0.1:33265_hgrn%2Fb c:collection1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1559128070679429120
[junit4] 2> 18306 INFO (searcherExecutor-44-thread-1-processing-n:127.0.0.1:33265_hgrn%2Fb x:collection1 c:collection1) [n:127.0.0.1:33265_hgrn%2Fb c:collection1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@73c2b8a1[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 18359 INFO (coreZkRegister-38-thread-1-processing-n:127.0.0.1:33265_hgrn%2Fb x:collection1 c:collection1) [n:127.0.0.1:33265_hgrn%2Fb c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 18363 INFO (coreZkRegister-38-thread-1-processing-n:127.0.0.1:33265_hgrn%2Fb x:collection1 c:collection1) [n:127.0.0.1:33265_hgrn%2Fb c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 18363 INFO (coreZkRegister-38-thread-1-processing-n:127.0.0.1:33265_hgrn%2Fb x:collection1 c:collection1) [n:127.0.0.1:33265_hgrn%2Fb c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:33265/hgrn/b/collection1/
[junit4] 2> 18363 INFO (coreZkRegister-38-thread-1-processing-n:127.0.0.1:33265_hgrn%2Fb x:collection1 c:collection1) [n:127.0.0.1:33265_hgrn%2Fb c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 18363 INFO (coreZkRegister-38-thread-1-processing-n:127.0.0.1:33265_hgrn%2Fb x:collection1 c:collection1) [n:127.0.0.1:33265_hgrn%2Fb c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:33265/hgrn/b/collection1/ has no replicas
[junit4] 2> 18374 INFO (coreZkRegister-38-thread-1-processing-n:127.0.0.1:33265_hgrn%2Fb x:collection1 c:collection1) [n:127.0.0.1:33265_hgrn%2Fb c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:33265/hgrn/b/collection1/ shard2
[junit4] 2> 18525 INFO (coreZkRegister-38-thread-1-processing-n:127.0.0.1:33265_hgrn%2Fb x:collection1 c:collection1) [n:127.0.0.1:33265_hgrn%2Fb c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 18685 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_7173BED178420272-001/shard-2-001/cores/collection1
[junit4] 2> 18686 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_7173BED178420272-001/shard-2-001
[junit4] 2> 18686 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 18700 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2a9ef03e{/hgrn/b,null,AVAILABLE}
[junit4] 2> 18701 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@11b445f6{HTTP/1.1,[http/1.1]}{127.0.0.1:34922}
[junit4] 2> 18701 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.e.j.s.Server Started @22019ms
[junit4] 2> 18701 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_7173BED178420272-001/tempDir-001/jetty2, solrconfig=solrconfig.xml, hostContext=/hgrn/b, hostPort=48547, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_7173BED178420272-001/shard-2-001/cores}
[junit4] 2> 18702 ERROR (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 18708 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 6.5.0
[junit4] 2> 18708 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 18708 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 18709 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-02-12T11:53:17.415Z
[junit4] 2> 18728 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 18729 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_7173BED178420272-001/shard-2-001/solr.xml
[junit4] 2> 18762 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 18768 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:44825/solr
[junit4] 2> 18822 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [n:127.0.0.1:48547_hgrn%2Fb ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 18850 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [n:127.0.0.1:48547_hgrn%2Fb ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48547_hgrn%2Fb
[junit4] 2> 18852 INFO (zkCallback-15-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 18853 INFO (zkCallback-20-thread-1-processing-n:127.0.0.1:33265_hgrn%2Fb) [n:127.0.0.1:33265_hgrn%2Fb ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 18854 INFO (zkCallback-11-thread-4-processing-n:127.0.0.1:57594_hgrn%2Fb) [n:127.0.0.1:57594_hgrn%2Fb ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 18864 INFO (zkCallback-26-thread-2-processing-n:127.0.0.1:48547_hgrn%2Fb) [n:127.0.0.1:48547_hgrn%2Fb ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 18952 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [n:127.0.0.1:48547_hgrn%2Fb ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_7173BED178420272-001/shard-2-001/cores
[junit4] 2> 18952 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [n:127.0.0.1:48547_hgrn%2Fb ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 18977 INFO (OverseerStateUpdate-97445503950585860-127.0.0.1:57594_hgrn%2Fb-n_0000000000) [n:127.0.0.1:57594_hgrn%2Fb ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 20015 WARN (coreLoadExecutor-54-thread-1-processing-n:127.0.0.1:48547_hgrn%2Fb) [n:127.0.0.1:48547_hgrn%2Fb c:collection1 x:collection1] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
[junit4] 2> 20016 INFO (coreLoadExecutor-54-thread-1-processing-n:127.0.0.1:48547_hgrn%2Fb) [n:127.0.0.1:48547_hgrn%2Fb c:collection1 x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
[junit4] 2> 20052 INFO (coreLoadExecutor-54-thread-1-processing-n:127.0.0.1:48547_hgrn%2Fb) [n:127.0.0.1:48547_hgrn%2Fb c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 20269 WARN (coreLoadExecutor-54-thread-1-processing-n:127.0.0.1:48547_hgrn%2Fb) [n:127.0.0.1:48547_hgrn%2Fb c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 20274 INFO (coreLoadExecutor-54-thread-1-processing-n:127.0.0.1:48547_hgrn%2Fb) [n:127.0.0.1:48547_hgrn%2Fb c:collection1 x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 20310 INFO (coreLoadExecutor-54-thread-1-processing-n:127.0.0.1:48547_hgrn%2Fb) [n:127.0.0.1:48547_hgrn%2Fb c:collection1 x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 20310 INFO (coreLoadExecutor-54-thread-1-processing-n:127.0.0.1:48547_hgrn%2Fb) [n:127.0.0.1:48547_hgrn%2Fb c:collection1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_7173BED178420272-001/shard-2-001/cores/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_7173BED178420272-001/shard-2-001/cores/collection1/data/]
[junit4] 2> 20310 INFO (coreLoadExecutor-54-thread-1-processing-n:127.0.0.1:48547_hgrn%2Fb) [n:127.0.0.1:48547_hgrn%2Fb c:collection1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@353c9b6d
[junit4] 2> 20312 INFO (coreLoadExecutor-54-thread-1-processing-n:127.0.0.1:48547_hgrn%2Fb) [n:127.0.0.1:48547_hgrn%2Fb c:collection1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=2, maxMergeAtOnceExplicit=7, maxMergedSegmentMB=56.17578125, floorSegmentMB=0.8779296875, forceMergeDeletesPctAllowed=8.425810593057351, segmentsPerTier=8.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.49645842083910596
[junit4] 2> 20341 WARN (coreLoadExecutor-54-thread-1-processing-n:127.0.0.1:48547_hgrn%2Fb) [n:127.0.0.1:48547_hgrn%2Fb c:collection1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 20565 INFO (coreLoadExecutor-54-thread-1-processing-n:127.0.0.1:48547_hgrn%2Fb) [n:127.0.0.1:48547_hgrn%2Fb c:collection1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 20565 INFO (coreLoadExecutor-54-thread-1-processing-n:127.0.0.1:48547_hgrn%2Fb) [n:127.0.0.1:48547_hgrn%2Fb c:collection1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 20568 INFO (coreLoadExecutor-54-thread-1-processing-n:127.0.0.1:48547_hgrn%2Fb) [n:127.0.0.1:48547_hgrn%2Fb c:collection1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 20568 INFO (coreLoadExecutor-54-thread-1-processing-n:127.0.0.1:48547_hgrn%2Fb) [n:127.0.0.1:48547_hgrn%2Fb c:collection1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 20569 INFO (coreLoadExecutor-54-thread-1-processing-n:127.0.0.1:48547_hgrn%2Fb) [n:127.0.0.1:48547_hgrn%2Fb c:collection1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@2e500df6
[junit4] 2> 20570 INFO (coreLoadExecutor-54-thread-1-processing-n:127.0.0.1:48547_hgrn%2Fb) [n:127.0.0.1:48547_hgrn%2Fb c:collection1 x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@eacecbb[collection1] main]
[junit4] 2> 20572 INFO (coreLoadExecutor-54-thread-1-processing-n:127.0.0.1:48547_hgrn%2Fb) [n:127.0.0.1:48547_hgrn%2Fb c:collection1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 20572 INFO (coreLoadExecutor-54-thread-1-processing-n:127.0.0.1:48547_hgrn%2Fb) [n:127.0.0.1:48547_hgrn%2Fb c:collection1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 20572 INFO (coreLoadExecutor-54-thread-1-processing-n:127.0.0.1:48547_hgrn%2Fb) [n:127.0.0.1:48547_hgrn%2Fb c:collection1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 20574 INFO (searcherExecutor-55-thread-1-processing-n:127.0.0.1:48547_hgrn%2Fb x:collection1 c:collection1) [n:127.0.0.1:48547_hgrn%2Fb c:collection1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@eacecbb[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 20577 INFO (coreLoadExecutor-54-thread-1-processing-n:127.0.0.1:48547_hgrn%2Fb) [n:127.0.0.1:48547_hgrn%2Fb c:collection1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1559128073078571008
[junit4] 2> 20595 INFO (coreZkRegister-49-thread-1-processing-n:127.0.0.1:48547_hgrn%2Fb x:collection1 c:collection1) [n:127.0.0.1:48547_hgrn%2Fb c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 20595 INFO (coreZkRegister-49-thread-1-processing-n:127.0.0.1:48547_hgrn%2Fb x:collection1 c:collection1) [n:127.0.0.1:48547_hgrn%2Fb c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 20595 INFO (coreZkRegister-49-thread-1-processing-n:127.0.0.1:48547_hgrn%2Fb x:collection1 c:collection1) [n:127.0.0.1:48547_hgrn%2Fb c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:48547/hgrn/b/collection1/
[junit4] 2> 20598 INFO (coreZkRegister-49-thread-1-processing-n:127.0.0.1:48547_hgrn%2Fb x:collection1 c:collection1) [n:127.0.0.1:48547_hgrn%2Fb c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 20598 INFO (coreZkRegister-49-thread-1-processing-n:127.0.0.1:48547_hgrn%2Fb x:collection1 c:collection1) [n:127.0.0.1:48547_hgrn%2Fb c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:48547/hgrn/b/collection1/ has no replicas
[junit4] 2> 20604 INFO (coreZkRegister-49-thread-1-processing-n:127.0.0.1:48547_hgrn%2Fb x:collection1 c:collection1) [n:127.0.0.1:48547_hgrn%2Fb c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:48547/hgrn/b/collection1/ shard1
[junit4] 2> 20756 INFO (coreZkRegister-49-thread-1-processing-n:127.0.0.1:48547_hgrn%2Fb x:collection1 c:collection1) [n:127.0.0.1:48547_hgrn%2Fb c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 21159 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_7173BED178420272-001/shard-3-001/cores/collection1
[junit4] 2> 21167 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_7173BED178420272-001/shard-3-001
[junit4] 2> 21168 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 21170 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2b4a767b{/hgrn/b,null,AVAILABLE}
[junit4] 2> 21170 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@45b2fada{HTTP/1.1,[http/1.1]}{127.0.0.1:55667}
[junit4] 2> 21171 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.e.j.s.Server Started @24489ms
[junit4] 2> 21171 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_7173BED178420272-001/tempDir-001/jetty3, solrconfig=solrconfig.xml, hostContext=/hgrn/b, hostPort=56773, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_7173BED178420272-001/shard-3-001/cores}
[junit4] 2> 21171 ERROR (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 21172 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 6.5.0
[junit4] 2> 21172 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 21172 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 21172 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-02-12T11:53:19.878Z
[junit4] 2> 21194 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 21194 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[7173BED178420272])
[...truncated too long message...]
s-changelog-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/apacheds-interceptors-collective-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/apacheds-interceptors-event-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/apacheds-interceptors-exception-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/apacheds-interceptors-journal-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/apacheds-interceptors-normalization-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/apacheds-interceptors-operational-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/apacheds-interceptors-referral-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/apacheds-interceptors-schema-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/apacheds-interceptors-subtree-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/apacheds-interceptors-trigger-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/apacheds-jdbm-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/apacheds-jdbm1-2.0.0-M2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/apacheds-kerberos-codec-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/apacheds-ldif-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/apacheds-mavibot-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/apacheds-protocol-kerberos-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/apacheds-protocol-ldap-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/apacheds-protocol-shared-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/apacheds-xdbm-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/api-all-1.0.0-M20.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/bcprov-jdk15-1.45.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/byte-buddy-1.6.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/cglib-nodep-2.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/commons-collections-3.2.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/commons-math3-3.4.1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/easymock-3.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/ehcache-core-2.4.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/hadoop-common-2.7.2-tests.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/hadoop-hdfs-2.7.2-tests.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/hadoop-minikdc-2.7.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/htrace-core-3.2.0-incubating.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/jackson-annotations-2.5.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/jackson-databind-2.5.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/jersey-core-1.9.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/jersey-server-1.9.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/jetty-6.1.26.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/jetty-util-6.1.26.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/mina-core-2.0.0-M5.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/mockito-core-2.6.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/netty-all-4.0.36.Final.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/objenesis-2.5.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/presto-parser-0.122.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/slice-0.10.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/lucene/build/analysis/icu/lucene-analyzers-icu-6.5.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/contrib/solr-analysis-extras/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/lucene/build/queryparser/classes/test:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/contrib/analysis-extras/lib/icu4j-56.1.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-launcher.jar:/x1/jenkins/.ant/lib/ivy-2.3.0.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-junit.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-log4j.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-junit4.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jai.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-javamail.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-bsf.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-commons-net.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-antlr.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jsch.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-oro.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-commons-logging.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-netrexx.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-testutil.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jdepend.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-bcel.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-xalan2.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-resolver.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jmf.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-regexp.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-swing.jar:/usr/local/asfpackages/java/jdk1.8.0_121/lib/tools.jar:/x1/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.5.0.jar com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe -eventsfile /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/temp/junit4-J2-20170212_115255_3301190990233931455034.events @/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/temp/junit4-J2-20170212_115255_3306341424011128110373.suites -stdin
[junit4] ERROR: JVM J2 ended with an exception: Quit event not received from the forked process? This may indicate JVM crash or runner bugs.
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4.executeSlave(JUnit4.java:1540)
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4.access$000(JUnit4.java:126)
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:982)
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:979)
[junit4] at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] at java.lang.Thread.run(Thread.java:745)
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/build.xml:783: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/build.xml:719: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build.xml:255: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/common-build.xml:536: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/lucene/common-build.xml:1452: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/lucene/common-build.xml:985: At least one slave process threw an exception, first: Quit event not received from the forked process? This may indicate JVM crash or runner bugs.
Total time: 343 minutes 32 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-6.x - Build # 280 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.x/280/
11 tests failed.
FAILED: org.apache.lucene.search.TestFuzzyQuery.testRandom
Error Message:
Test abandoned because suite timeout was reached.
Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
at __randomizedtesting.SeedInfo.seed([A8C3F0D02929C222]:0)
FAILED: junit.framework.TestSuite.org.apache.lucene.search.TestFuzzyQuery
Error Message:
Suite timeout exceeded (>= 7200000 msec).
Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
at __randomizedtesting.SeedInfo.seed([A8C3F0D02929C222]:0)
FAILED: org.apache.solr.cloud.CdcrReplicationDistributedZkTest.testUpdateLogSynchronisation
Error Message:
Timeout waiting for CDCR replication to complete @source_collection:shard2
Stack Trace:
java.lang.RuntimeException: Timeout waiting for CDCR replication to complete @source_collection:shard2
at __randomizedtesting.SeedInfo.seed([351DCD9D7146AF55:CB72953EB3668C44]:0)
at org.apache.solr.cloud.BaseCdcrDistributedZkTest.waitForReplicationToComplete(BaseCdcrDistributedZkTest.java:795)
at org.apache.solr.cloud.CdcrReplicationDistributedZkTest.testUpdateLogSynchronisation(CdcrReplicationDistributedZkTest.java:377)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.CdcrReplicationDistributedZkTest.testBatchAddsWithDelete
Error Message:
Timeout while trying to assert number of documents @ target_collection
Stack Trace:
java.lang.AssertionError: Timeout while trying to assert number of documents @ target_collection
at __randomizedtesting.SeedInfo.seed([351DCD9D7146AF55:4207B439D95FAE79]:0)
at org.apache.solr.cloud.BaseCdcrDistributedZkTest.assertNumDocs(BaseCdcrDistributedZkTest.java:271)
at org.apache.solr.cloud.CdcrReplicationDistributedZkTest.testBatchAddsWithDelete(CdcrReplicationDistributedZkTest.java:532)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.AssertionError: expected:<59> but was:<0>
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at org.apache.solr.cloud.BaseCdcrDistributedZkTest.assertNumDocs(BaseCdcrDistributedZkTest.java:262)
... 42 more
FAILED: org.apache.solr.cloud.CdcrReplicationDistributedZkTest.testReplicationStartStop
Error Message:
Timeout while trying to assert number of documents @ target_collection
Stack Trace:
java.lang.AssertionError: Timeout while trying to assert number of documents @ target_collection
at __randomizedtesting.SeedInfo.seed([351DCD9D7146AF55:B6DE130E659E24DC]:0)
at org.apache.solr.cloud.BaseCdcrDistributedZkTest.assertNumDocs(BaseCdcrDistributedZkTest.java:271)
at org.apache.solr.cloud.CdcrReplicationDistributedZkTest.testReplicationStartStop(CdcrReplicationDistributedZkTest.java:173)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.AssertionError: expected:<10> but was:<4>
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at org.apache.solr.cloud.BaseCdcrDistributedZkTest.assertNumDocs(BaseCdcrDistributedZkTest.java:262)
... 42 more
FAILED: org.apache.solr.cloud.CdcrReplicationDistributedZkTest.testResilienceWithDeleteByQueryOnTarget
Error Message:
Timeout while trying to assert number of documents @ target_collection
Stack Trace:
java.lang.AssertionError: Timeout while trying to assert number of documents @ target_collection
at __randomizedtesting.SeedInfo.seed([351DCD9D7146AF55:957F5F07A11F6A10]:0)
at org.apache.solr.cloud.BaseCdcrDistributedZkTest.assertNumDocs(BaseCdcrDistributedZkTest.java:271)
at org.apache.solr.cloud.CdcrReplicationDistributedZkTest.testResilienceWithDeleteByQueryOnTarget(CdcrReplicationDistributedZkTest.java:595)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.AssertionError: expected:<50> but was:<20>
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at org.apache.solr.cloud.BaseCdcrDistributedZkTest.assertNumDocs(BaseCdcrDistributedZkTest.java:262)
... 42 more
FAILED: org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates.test_dv_stored
Error Message:
There are still nodes recoverying - waited for 330 seconds
Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 330 seconds
at __randomizedtesting.SeedInfo.seed([351DCD9D7146AF55:A721AC19CD01928D]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:187)
at org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates.waitForRecoveriesToFinish(TestStressCloudBlindAtomicUpdates.java:459)
at org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates.checkField(TestStressCloudBlindAtomicUpdates.java:304)
at org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates.test_dv_stored(TestStressCloudBlindAtomicUpdates.java:203)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.testCollectionsAPI
Error Message:
Expected to see collection awhollynewcollection_0 null Last available state: DocCollection(awhollynewcollection_0//collections/awhollynewcollection_0/state.json/11)={ "replicationFactor":"4", "shards":{ "shard1":{ "range":"80000000-b332ffff", "state":"active", "replicas":{"core_node6":{ "core":"awhollynewcollection_0_shard1_replica2", "dataDir":"hdfs://localhost:60437/data/awhollynewcollection_0/core_node6/data/", "base_url":"http://127.0.0.1:37125/solr", "node_name":"127.0.0.1:37125_solr", "state":"active", "ulogDir":"hdfs://localhost:60437/data/awhollynewcollection_0/core_node6/data/tlog", "leader":"true"}}}, "shard2":{ "range":"b3330000-e665ffff", "state":"active", "replicas":{ "core_node5":{ "core":"awhollynewcollection_0_shard2_replica2", "dataDir":"hdfs://localhost:60437/data/awhollynewcollection_0/core_node5/data/", "base_url":"http://127.0.0.1:37125/solr", "node_name":"127.0.0.1:37125_solr", "state":"active", "ulogDir":"hdfs://localhost:60437/data/awhollynewcollection_0/core_node5/data/tlog", "leader":"true"}, "core_node11":{ "core":"awhollynewcollection_0_shard2_replica4", "dataDir":"hdfs://localhost:60437/data/awhollynewcollection_0/core_node11/data/", "base_url":"http://127.0.0.1:46585/solr", "node_name":"127.0.0.1:46585_solr", "state":"active", "ulogDir":"hdfs://localhost:60437/data/awhollynewcollection_0/core_node11/data/tlog"}, "core_node19":{ "core":"awhollynewcollection_0_shard2_replica3", "dataDir":"hdfs://localhost:60437/data/awhollynewcollection_0/core_node19/data/", "base_url":"http://127.0.0.1:54836/solr", "node_name":"127.0.0.1:54836_solr", "state":"active", "ulogDir":"hdfs://localhost:60437/data/awhollynewcollection_0/core_node19/data/tlog"}}}, "shard3":{ "range":"e6660000-1998ffff", "state":"active", "replicas":{ "core_node4":{ "core":"awhollynewcollection_0_shard3_replica1", "dataDir":"hdfs://localhost:60437/data/awhollynewcollection_0/core_node4/data/", "base_url":"http://127.0.0.1:41465/solr", "node_name":"127.0.0.1:41465_solr", "state":"active", "ulogDir":"hdfs://localhost:60437/data/awhollynewcollection_0/core_node4/data/tlog", "leader":"true"}, "core_node10":{ "core":"awhollynewcollection_0_shard3_replica3", "dataDir":"hdfs://localhost:60437/data/awhollynewcollection_0/core_node10/data/", "base_url":"http://127.0.0.1:54836/solr", "node_name":"127.0.0.1:54836_solr", "state":"active", "ulogDir":"hdfs://localhost:60437/data/awhollynewcollection_0/core_node10/data/tlog"}}}, "shard4":{ "range":"19990000-4ccbffff", "state":"active", "replicas":{}}, "shard5":{ "range":"4ccc0000-7fffffff", "state":"active", "replicas":{"core_node16":{ "core":"awhollynewcollection_0_shard5_replica2", "dataDir":"hdfs://localhost:60437/data/awhollynewcollection_0/core_node16/data/", "base_url":"http://127.0.0.1:37125/solr", "node_name":"127.0.0.1:37125_solr", "state":"active", "ulogDir":"hdfs://localhost:60437/data/awhollynewcollection_0/core_node16/data/tlog", "leader":"true"}}}}, "router":{"name":"compositeId"}, "maxShardsPerNode":"6", "autoAddReplicas":"false"}
Stack Trace:
java.lang.AssertionError: Expected to see collection awhollynewcollection_0
null
Last available state: DocCollection(awhollynewcollection_0//collections/awhollynewcollection_0/state.json/11)={
"replicationFactor":"4",
"shards":{
"shard1":{
"range":"80000000-b332ffff",
"state":"active",
"replicas":{"core_node6":{
"core":"awhollynewcollection_0_shard1_replica2",
"dataDir":"hdfs://localhost:60437/data/awhollynewcollection_0/core_node6/data/",
"base_url":"http://127.0.0.1:37125/solr",
"node_name":"127.0.0.1:37125_solr",
"state":"active",
"ulogDir":"hdfs://localhost:60437/data/awhollynewcollection_0/core_node6/data/tlog",
"leader":"true"}}},
"shard2":{
"range":"b3330000-e665ffff",
"state":"active",
"replicas":{
"core_node5":{
"core":"awhollynewcollection_0_shard2_replica2",
"dataDir":"hdfs://localhost:60437/data/awhollynewcollection_0/core_node5/data/",
"base_url":"http://127.0.0.1:37125/solr",
"node_name":"127.0.0.1:37125_solr",
"state":"active",
"ulogDir":"hdfs://localhost:60437/data/awhollynewcollection_0/core_node5/data/tlog",
"leader":"true"},
"core_node11":{
"core":"awhollynewcollection_0_shard2_replica4",
"dataDir":"hdfs://localhost:60437/data/awhollynewcollection_0/core_node11/data/",
"base_url":"http://127.0.0.1:46585/solr",
"node_name":"127.0.0.1:46585_solr",
"state":"active",
"ulogDir":"hdfs://localhost:60437/data/awhollynewcollection_0/core_node11/data/tlog"},
"core_node19":{
"core":"awhollynewcollection_0_shard2_replica3",
"dataDir":"hdfs://localhost:60437/data/awhollynewcollection_0/core_node19/data/",
"base_url":"http://127.0.0.1:54836/solr",
"node_name":"127.0.0.1:54836_solr",
"state":"active",
"ulogDir":"hdfs://localhost:60437/data/awhollynewcollection_0/core_node19/data/tlog"}}},
"shard3":{
"range":"e6660000-1998ffff",
"state":"active",
"replicas":{
"core_node4":{
"core":"awhollynewcollection_0_shard3_replica1",
"dataDir":"hdfs://localhost:60437/data/awhollynewcollection_0/core_node4/data/",
"base_url":"http://127.0.0.1:41465/solr",
"node_name":"127.0.0.1:41465_solr",
"state":"active",
"ulogDir":"hdfs://localhost:60437/data/awhollynewcollection_0/core_node4/data/tlog",
"leader":"true"},
"core_node10":{
"core":"awhollynewcollection_0_shard3_replica3",
"dataDir":"hdfs://localhost:60437/data/awhollynewcollection_0/core_node10/data/",
"base_url":"http://127.0.0.1:54836/solr",
"node_name":"127.0.0.1:54836_solr",
"state":"active",
"ulogDir":"hdfs://localhost:60437/data/awhollynewcollection_0/core_node10/data/tlog"}}},
"shard4":{
"range":"19990000-4ccbffff",
"state":"active",
"replicas":{}},
"shard5":{
"range":"4ccc0000-7fffffff",
"state":"active",
"replicas":{"core_node16":{
"core":"awhollynewcollection_0_shard5_replica2",
"dataDir":"hdfs://localhost:60437/data/awhollynewcollection_0/core_node16/data/",
"base_url":"http://127.0.0.1:37125/solr",
"node_name":"127.0.0.1:37125_solr",
"state":"active",
"ulogDir":"hdfs://localhost:60437/data/awhollynewcollection_0/core_node16/data/tlog",
"leader":"true"}}}},
"router":{"name":"compositeId"},
"maxShardsPerNode":"6",
"autoAddReplicas":"false"}
at __randomizedtesting.SeedInfo.seed([351DCD9D7146AF55:7D68B929777580C0]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.SolrCloudTestCase.waitForState(SolrCloudTestCase.java:265)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:496)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.deleteCollectionOnlyInZk
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([351DCD9D7146AF55:81FD911C87400F44]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertTrue(Assert.java:54)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.deleteCollectionOnlyInZk(CollectionsAPIDistributedZkTest.java:184)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.handler.TestReplicationHandler.doTestStressReplication
Error Message:
timed out waiting for collection1 startAt time to exceed: Sat Feb 11 11:14:13 BRT 2017
Stack Trace:
java.lang.AssertionError: timed out waiting for collection1 startAt time to exceed: Sat Feb 11 11:14:13 BRT 2017
at __randomizedtesting.SeedInfo.seed([351DCD9D7146AF55:EEB6CD5B746EC6E6]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.handler.TestReplicationHandler.watchCoreStartAt(TestReplicationHandler.java:1542)
at org.apache.solr.handler.TestReplicationHandler.doTestStressReplication(TestReplicationHandler.java:867)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest.test
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([351DCD9D7146AF55:BD49F247DFBAC2AD]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertTrue(Assert.java:54)
at org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest.test(HdfsWriteToMultipleCollectionsTest.java:137)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 1781 lines...]
[junit4] Suite: org.apache.lucene.search.TestFuzzyQuery
[junit4] 2> Fra 11, 2017 3:16:30 WN com.carrotsearch.randomizedtesting.ThreadLeakControl$2 evaluate
[junit4] 2> WARNING: Suite execution timed out: org.apache.lucene.search.TestFuzzyQuery
[junit4] 2> 1) Thread[id=1, name=main, state=WAITING, group=main]
[junit4] 2> at java.lang.Object.wait(Native Method)
[junit4] 2> at java.lang.Thread.join(Thread.java:1249)
[junit4] 2> at java.lang.Thread.join(Thread.java:1323)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:608)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.run(RandomizedRunner.java:457)
[junit4] 2> at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.execute(SlaveMain.java:244)
[junit4] 2> at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.main(SlaveMain.java:355)
[junit4] 2> at com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe.main(SlaveMainSafe.java:13)
[junit4] 2> 2) Thread[id=9, name=JUnit4-serializer-daemon, state=TIMED_WAITING, group=main]
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at com.carrotsearch.ant.tasks.junit4.events.Serializer$1.run(Serializer.java:50)
[junit4] 2> 3) Thread[id=2938, name=SUITE-TestFuzzyQuery-seed#[A8C3F0D02929C222], state=RUNNABLE, group=TGRP-TestFuzzyQuery]
[junit4] 2> at java.lang.Thread.getStackTrace(Thread.java:1556)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$4.run(ThreadLeakControl.java:696)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$4.run(ThreadLeakControl.java:693)
[junit4] 2> at java.security.AccessController.doPrivileged(Native Method)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.getStackTrace(ThreadLeakControl.java:693)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.getThreadsWithTraces(ThreadLeakControl.java:709)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.formatThreadStacksFull(ThreadLeakControl.java:689)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.access$1000(ThreadLeakControl.java:65)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$2.evaluate(ThreadLeakControl.java:415)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:678)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.access$200(RandomizedRunner.java:140)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:598)
[junit4] 2> 4) Thread[id=2939, name=TEST-TestFuzzyQuery.testRandom-seed#[A8C3F0D02929C222], state=RUNNABLE, group=TGRP-TestFuzzyQuery]
[junit4] 2> at java.util.WeakHashMap.containsKey(WeakHashMap.java:417)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedContext.context(RandomizedContext.java:258)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedContext.current(RandomizedContext.java:134)
[junit4] 2> at org.apache.lucene.util.LuceneTestCase.random(LuceneTestCase.java:747)
[junit4] 2> at org.apache.lucene.search.TestFuzzyQuery.randomSimpleString(TestFuzzyQuery.java:506)
[junit4] 2> at org.apache.lucene.search.TestFuzzyQuery.testRandom(TestFuzzyQuery.java:517)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:498)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
[junit4] 2> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestFuzzyQuery -Dtests.method=testRandom -Dtests.seed=A8C3F0D02929C222 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/test-data/enwiki.random.lines.txt -Dtests.locale=mt-MT -Dtests.timezone=Africa/Nairobi -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[junit4] ERROR 7200s J0 | TestFuzzyQuery.testRandom <<<
[junit4] > Throwable #1: java.lang.Exception: Test abandoned because suite timeout was reached.
[junit4] > at __randomizedtesting.SeedInfo.seed([A8C3F0D02929C222]:0)
[junit4] 2> Fra 11, 2017 3:16:30 WN com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> Fra 11, 2017 3:16:50 WN com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> SEVERE: 1 thread leaked from SUITE scope at org.apache.lucene.search.TestFuzzyQuery:
[junit4] 2> 1) Thread[id=2939, name=TEST-TestFuzzyQuery.testRandom-seed#[A8C3F0D02929C222], state=RUNNABLE, group=TGRP-TestFuzzyQuery]
[junit4] 2> at com.carrotsearch.randomizedtesting.Xoroshiro128PlusRandom.next(Xoroshiro128PlusRandom.java:95)
[junit4] 2> at java.util.Random.nextInt(Random.java:390)
[junit4] 2> at com.carrotsearch.randomizedtesting.Xoroshiro128PlusRandom.nextInt(Xoroshiro128PlusRandom.java:73)
[junit4] 2> at com.carrotsearch.randomizedtesting.AssertingRandom.nextInt(AssertingRandom.java:87)
[junit4] 2> at com.carrotsearch.randomizedtesting.generators.RandomNumbers.randomIntBetween(RandomNumbers.java:19)
[junit4] 2> at org.apache.lucene.util.TestUtil.nextInt(TestUtil.java:433)
[junit4] 2> at org.apache.lucene.search.TestFuzzyQuery.randomSimpleString(TestFuzzyQuery.java:503)
[junit4] 2> at org.apache.lucene.search.TestFuzzyQuery.testRandom(TestFuzzyQuery.java:517)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:498)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
[junit4] 2> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> Fra 11, 2017 3:16:50 WN com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> INFO: Starting to interrupt leaked threads:
[junit4] 2> 1) Thread[id=2939, name=TEST-TestFuzzyQuery.testRandom-seed#[A8C3F0D02929C222], state=RUNNABLE, group=TGRP-TestFuzzyQuery]
[junit4] 2> Fra 11, 2017 3:16:53 WN com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> SEVERE: There are still zombie threads that couldn't be terminated:
[junit4] 2> 1) Thread[id=2939, name=TEST-TestFuzzyQuery.testRandom-seed#[A8C3F0D02929C222], state=RUNNABLE, group=TGRP-TestFuzzyQuery]
[junit4] 2> at java.lang.Object.hashCode(Native Method)
[junit4] 2> at java.util.WeakHashMap.hash(WeakHashMap.java:298)
[junit4] 2> at java.util.WeakHashMap.getEntry(WeakHashMap.java:426)
[junit4] 2> at java.util.WeakHashMap.containsKey(WeakHashMap.java:417)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedContext.context(RandomizedContext.java:258)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedContext.current(RandomizedContext.java:134)
[junit4] 2> at org.apache.lucene.util.LuceneTestCase.random(LuceneTestCase.java:747)
[junit4] 2> at org.apache.lucene.search.TestFuzzyQuery.randomSimpleString(TestFuzzyQuery.java:506)
[junit4] 2> at org.apache.lucene.search.TestFuzzyQuery.testRandom(TestFuzzyQuery.java:517)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:498)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
[junit4] 2> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene62): {field=FSTOrd50}, docValues:{}, maxPointsInLeafNode=595, maxMBSortInHeap=7.885148162372165, sim=RandomSimilarity(queryNorm=false,coord=no): {field=IB LL-D2}, locale=mt-MT, timezone=Africa/Nairobi
[junit4] 2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_102 (64-bit)/cpus=4,threads=2,free=23764672,total=186646528
[junit4] 2> NOTE: All tests run in this JVM: [TestIndexWriterUnicode, TestConsistentFieldNumbers, TestFilterDirectoryReader, TestNRTThreads, TestDemoParallelLeafReader, TestMinShouldMatch2, TestParallelCompositeReader, TestSortedSetSortField, TestSleepingLockWrapper, TestBlockPostingsFormat2, TestIndexWriter, TestCrashCausesCorruptIndex, TestIndexWriterConfig, TestPerFieldPostingsFormat2, TestTermsEnum2, TestAllFilesDetectTruncation, TestElevationComparator, TestFastCompressionMode, TestDocValuesScoring, Test2BSortedDocValuesFixedSorted, TestNoDeletionPolicy, Test2BBKDPoints, TestConjunctions, TestSimilarityBase, TestField, TestDirectory, TestMaxTermFrequency, TestDemo, TestMultiValuedNumericRangeQuery, TestWordlistLoader, TestNumericUtils, TestDocValuesRewriteMethod, TestApproximationSearchEquivalence, TestThreadedForceMerge, TestLongPostings, TestIndexWriterDeleteByQuery, TestNIOFSDirectory, TestAttributeSource, TestStressIndexing2, TestStandardAnalyzer, TestSortRescorer, TestDocValues, TestLazyProxSkipping, TestFixedLengthBytesRefArray, TestFilterDirectory, TestStressDeletes, TestStressAdvance, TestBooleanSimilarity, TestCharTermAttributeImpl, TestFuzzyQuery]
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestFuzzyQuery -Dtests.seed=A8C3F0D02929C222 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/test-data/enwiki.random.lines.txt -Dtests.locale=mt-MT -Dtests.timezone=Africa/Nairobi -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[junit4] ERROR 0.00s J0 | TestFuzzyQuery (suite) <<<
[junit4] > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
[junit4] > at __randomizedtesting.SeedInfo.seed([A8C3F0D02929C222]:0)
[junit4] Completed [425/452 (1!)] on J0 in 7223.17s, 5 tests, 2 errors <<< FAILURES!
[...truncated 9965 lines...]
[junit4] Suite: org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_351DCD9D7146AF55-001/init-core-data-001
[junit4] 2> 526321 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[351DCD9D7146AF55]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
[junit4] 2> 526321 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[351DCD9D7146AF55]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /r_bx/jf
[junit4] 1> Formatting using clusterid: testClusterID
[junit4] 2> 526444 WARN (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[351DCD9D7146AF55]-worker) [ ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
[junit4] 2> 526477 WARN (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[351DCD9D7146AF55]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 526488 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[351DCD9D7146AF55]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 526513 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[351DCD9D7146AF55]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.2-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_39533_hdfs____xp0zbt/webapp
[junit4] 2> 527053 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[351DCD9D7146AF55]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39533
[junit4] 2> 527132 WARN (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[351DCD9D7146AF55]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 527133 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[351DCD9D7146AF55]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 527154 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[351DCD9D7146AF55]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.2-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_34635_datanode____.dspqwy/webapp
[junit4] 2> 527588 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[351DCD9D7146AF55]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34635
[junit4] 2> 527646 WARN (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[351DCD9D7146AF55]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 527647 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[351DCD9D7146AF55]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 527664 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[351DCD9D7146AF55]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.2-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_39330_datanode____zigscx/webapp
[junit4] 2> 527956 INFO (IPC Server handler 4 on 43899) [ ] BlockStateChange BLOCK* processReport: from storage DS-647ecafc-f9b9-40b9-af28-5441e1e9eb5f node DatanodeRegistration(127.0.0.1:45512, datanodeUuid=6f0e3a9d-34ad-49ea-af0e-44bd6123cb0f, infoPort=38085, infoSecurePort=0, ipcPort=44424, storageInfo=lv=-56;cid=testClusterID;nsid=1102658493;c=0), blocks: 0, hasStaleStorage: true, processing time: 1 msecs
[junit4] 2> 527956 INFO (IPC Server handler 4 on 43899) [ ] BlockStateChange BLOCK* processReport: from storage DS-6375fece-db43-4325-84a4-8ca4086469d6 node DatanodeRegistration(127.0.0.1:45512, datanodeUuid=6f0e3a9d-34ad-49ea-af0e-44bd6123cb0f, infoPort=38085, infoSecurePort=0, ipcPort=44424, storageInfo=lv=-56;cid=testClusterID;nsid=1102658493;c=0), blocks: 0, hasStaleStorage: false, processing time: 0 msecs
[junit4] 2> 528104 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[351DCD9D7146AF55]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39330
[junit4] 2> 528409 INFO (IPC Server handler 6 on 43899) [ ] BlockStateChange BLOCK* processReport: from storage DS-14df3bb5-189a-45e8-b14f-a01804c73dbf node DatanodeRegistration(127.0.0.1:44095, datanodeUuid=c5d0a47c-9489-47fa-aafe-7a00f2a97347, infoPort=47126, infoSecurePort=0, ipcPort=56620, storageInfo=lv=-56;cid=testClusterID;nsid=1102658493;c=0), blocks: 0, hasStaleStorage: true, processing time: 0 msecs
[junit4] 2> 528409 INFO (IPC Server handler 6 on 43899) [ ] BlockStateChange BLOCK* processReport: from storage DS-f76c5755-22fd-404d-97a5-1f75a3965e23 node DatanodeRegistration(127.0.0.1:44095, datanodeUuid=c5d0a47c-9489-47fa-aafe-7a00f2a97347, infoPort=47126, infoSecurePort=0, ipcPort=56620, storageInfo=lv=-56;cid=testClusterID;nsid=1102658493;c=0), blocks: 0, hasStaleStorage: false, processing time: 0 msecs
[junit4] 2> 528458 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[351DCD9D7146AF55]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 528462 INFO (Thread-1494) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 528462 INFO (Thread-1494) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 528562 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[351DCD9D7146AF55]) [ ] o.a.s.c.ZkTestServer start zk server on port:40359
[junit4] 2> 528589 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[351DCD9D7146AF55]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 528590 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[351DCD9D7146AF55]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 528592 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[351DCD9D7146AF55]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 528593 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[351DCD9D7146AF55]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 528594 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[351DCD9D7146AF55]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 528595 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[351DCD9D7146AF55]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 528596 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[351DCD9D7146AF55]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 528596 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[351DCD9D7146AF55]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 528597 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[351DCD9D7146AF55]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 528598 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[351DCD9D7146AF55]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 528599 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[351DCD9D7146AF55]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 528679 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[351DCD9D7146AF55]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_351DCD9D7146AF55-001/control-001/cores/collection1
[junit4] 2> 528681 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[351DCD9D7146AF55]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 528682 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[351DCD9D7146AF55]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@41ff45a5{/r_bx/jf,null,AVAILABLE}
[junit4] 2> 528683 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[351DCD9D7146AF55]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@228c2aab{HTTP/1.1,[http/1.1]}{127.0.0.1:41044}
[junit4] 2> 528683 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[351DCD9D7146AF55]) [ ] o.e.j.s.Server Started @532532ms
[junit4] 2> 528683 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[351DCD9D7146AF55]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:43899/hdfs__localhost_43899__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-6.x_checkout_solr_build_solr-core_test_J2_temp_solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_351DCD9D7146AF55-001_tempDir-002_control_data, hostContext=/r_bx/jf, hostPort=41044, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_351DCD9D7146AF55-001/control-001/cores}
[junit4] 2> 528683 ERROR (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[351DCD9D7146AF55]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 528683 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[351DCD9D7146AF55]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 6.5.0
[junit4] 2> 528683 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[351DCD9D7146AF55]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 528683 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[351DCD9D7146AF55]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 528683 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[351DCD9D7146AF55]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-02-11T14:17:54.915Z
[junit4] 2> 528694 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[351DCD9D7146AF55]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 528694 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[351DCD9D7146AF55]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_351DCD9D7146AF55-001/control-001/solr.xml
[junit4] 2> 528701 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[351DCD9D7146AF55]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 528702 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[351DCD9D7146AF55]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40359/solr
[junit4] 2> 528721 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[351DCD9D7146AF55]) [n:127.0.0.1:41044_r_bx%2Fjf ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:41044_r_bx%2Fjf
[junit4] 2> 528722 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[351DCD9D7146AF55]) [n:127.0.0.1:41044_r_bx%2Fjf ] o.a.s.c.Overseer Overseer (id=97440410808811524-127.0.0.1:41044_r_bx%2Fjf-n_0000000000) starting
[junit4] 2> 528731 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[351DCD9D7146AF55]) [n:127.0.0.1:41044_r_bx%2Fjf ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41044_r_bx%2Fjf
[junit4] 2> 528732 INFO (zkCallback-963-thread-1-processing-n:127.0.0.1:41044_r_bx%2Fjf) [n:127.0.0.1:41044_r_bx%2Fjf ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 529533 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[351DCD9D7146AF55]) [n:127.0.0.1:41044_r_bx%2Fjf ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_351DCD9D7146AF55-001/control-001/cores
[junit4] 2> 529533 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[351DCD9D7146AF55]) [n:127.0.0.1:41044_r_bx%2Fjf ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 529537 INFO (OverseerStateUpdate-97440410808811524-127.0.0.1:41044_r_bx%2Fjf-n_0000000000) [n:127.0.0.1:41044_r_bx%2Fjf ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 530552 INFO (coreLoadExecutor-1064-thread-1-processing-n:127.0.0.1:41044_r_bx%2Fjf) [n:127.0.0.1:41044_r_bx%2Fjf c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
[junit4] 2> 530582 INFO (coreLoadExecutor-1064-thread-1-processing-n:127.0.0.1:41044_r_bx%2Fjf) [n:127.0.0.1:41044_r_bx%2Fjf c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 530669 WARN (coreLoadExecutor-1064-thread-1-processing-n:127.0.0.1:41044_r_bx%2Fjf) [n:127.0.0.1:41044_r_bx%2Fjf c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 530670 INFO (coreLoadExecutor-1064-thread-1-processing-n:127.0.0.1:41044_r_bx%2Fjf) [n:127.0.0.1:41044_r_bx%2Fjf c:control_collection x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 530690 INFO (coreLoadExecutor-1064-thread-1-processing-n:127.0.0.1:41044_r_bx%2Fjf) [n:127.0.0.1:41044_r_bx%2Fjf c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 530690 INFO (coreLoadExecutor-1064-thread-1-processing-n:127.0.0.1:41044_r_bx%2Fjf) [n:127.0.0.1:41044_r_bx%2Fjf c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:43899/solr_hdfs_home
[junit4] 2> 530690 INFO (coreLoadExecutor-1064-thread-1-processing-n:127.0.0.1:41044_r_bx%2Fjf) [n:127.0.0.1:41044_r_bx%2Fjf c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 530690 INFO (coreLoadExecutor-1064-thread-1-processing-n:127.0.0.1:41044_r_bx%2Fjf) [n:127.0.0.1:41044_r_bx%2Fjf c:control_collection x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_351DCD9D7146AF55-001/control-001/cores/collection1], dataDir=[hdfs://localhost:43899/solr_hdfs_home/control_collection/core_node1/data/]
[junit4] 2> 530690 INFO (coreLoadExecutor-1064-thread-1-processing-n:127.0.0.1:41044_r_bx%2Fjf) [n:127.0.0.1:41044_r_bx%2Fjf c:control_collection x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4a7a5fc2
[junit4] 2> 530691 INFO (coreLoadExecutor-1064-thread-1-processing-n:127.0.0.1:41044_r_bx%2Fjf) [n:127.0.0.1:410
[...truncated too long message...]
ctions/target_collection/cdcr/state/process
[junit4] 2> 5 /solr/collections/source_collection/cdcr/state/process
[junit4] 2> 4 /solr/collections/source_collection/state.json
[junit4] 2> 4 /solr/collections/source_collection/cdcr/state/buffer
[junit4] 2> 4 /solr/collections/target_collection/state.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 176 /solr/overseer/collection-queue-work
[junit4] 2> 68 /solr/overseer/queue
[junit4] 2> 25 /solr/collections
[junit4] 2> 24 /solr/live_nodes
[junit4] 2> 19 /solr/overseer/queue-work
[junit4] 2>
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=CdcrReplicationDistributedZkTest -Dtests.method=testResilienceWithDeleteByQueryOnTarget -Dtests.seed=351DCD9D7146AF55 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/test-data/enwiki.random.lines.txt -Dtests.locale=fr-CH -Dtests.timezone=Africa/Dar_es_Salaam -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] FAILURE 184s J2 | CdcrReplicationDistributedZkTest.testResilienceWithDeleteByQueryOnTarget <<<
[junit4] > Throwable #1: java.lang.AssertionError: Timeout while trying to assert number of documents @ target_collection
[junit4] > at __randomizedtesting.SeedInfo.seed([351DCD9D7146AF55:957F5F07A11F6A10]:0)
[junit4] > at org.apache.solr.cloud.BaseCdcrDistributedZkTest.assertNumDocs(BaseCdcrDistributedZkTest.java:271)
[junit4] > at org.apache.solr.cloud.CdcrReplicationDistributedZkTest.testResilienceWithDeleteByQueryOnTarget(CdcrReplicationDistributedZkTest.java:595)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > Caused by: java.lang.AssertionError: expected:<50> but was:<20>
[junit4] > at org.apache.solr.cloud.BaseCdcrDistributedZkTest.assertNumDocs(BaseCdcrDistributedZkTest.java:262)
[junit4] > ... 42 more
[junit4] 2> 4624355 INFO (SUITE-CdcrReplicationDistributedZkTest-seed#[351DCD9D7146AF55]-worker) [ ] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.CdcrReplicationDistributedZkTest_351DCD9D7146AF55-001
[junit4] 2> Feb 11, 2017 3:26:10 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene62): {_version_=PostingsFormat(name=Asserting), id=FST50}, docValues:{}, maxPointsInLeafNode=1112, maxMBSortInHeap=6.6781613991635975, sim=RandomSimilarity(queryNorm=true,coord=crazy): {}, locale=fr-CH, timezone=Africa/Dar_es_Salaam
[junit4] 2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_102 (64-bit)/cpus=4,threads=1,free=252852000,total=517996544
[junit4] 2> NOTE: All tests run in this JVM: [TestSolrJ, CdcrReplicationHandlerTest, RankQueryTest, TestSolrQueryParser, TestMergePolicyConfig, BooleanFieldTest, BasicDistributedZk2Test, HdfsRecoveryZkTest, TestCloudManagedSchema, TestLocalFSCloudBackupRestore, TestBinaryField, SolrPluginUtilsTest, UpdateParamsTest, ExplicitHLLTest, DistributedFacetPivotSmallTest, TestRandomCollapseQParserPlugin, TestComplexPhraseQParserPlugin, LukeRequestHandlerTest, TestCollectionAPIs, JSONWriterTest, TestDefaultSearchFieldResource, TestStressReorder, LeaderElectionTest, OverseerRolesTest, TestPostingsSolrHighlighter, PrimUtilsTest, TestSolrCoreParser, TestExtendedDismaxParser, TestStressUserVersions, HdfsWriteToMultipleCollectionsTest, SubstringBytesRefFilterTest, TestFieldCacheReopen, DistributedDebugComponentTest, TestRawTransformer, SuggesterWFSTTest, DeleteStatusTest, DocValuesMultiTest, TestTrackingShardHandlerFactory, BigEndianAscendingWordDeserializerTest, TestFieldTypeResource, PrimitiveFieldTypeTest, TestSQLHandler, DirectoryFactoryTest, TestXmlQParserPlugin, TestLMJelinekMercerSimilarityFactory, TolerantUpdateProcessorTest, CircularListTest, TestSolrCloudWithSecureImpersonation, TestHdfsUpdateLog, SolrMetricsIntegrationTest, TestPKIAuthenticationPlugin, TestSort, TestDelegationWithHadoopAuth, TestConfigSetImmutable, JsonValidatorTest, XmlUpdateRequestHandlerTest, DistribJoinFromCollectionTest, CdcrUpdateLogTest, TestPhraseSuggestions, SolrCoreMetricManagerTest, HdfsBasicDistributedZkTest, QueryParsingTest, TestCryptoKeys, SuggesterTest, QueryResultKeyTest, CustomCollectionTest, ConfigSetsAPITest, HdfsThreadLeakTest, HLLUtilTest, HdfsCollectionsAPIDistributedZkTest, ClassificationUpdateProcessorTest, IgnoreCommitOptimizeUpdateProcessorFactoryTest, TestExactSharedStatsCache, OverseerTest, TestFilteredDocIdSet, SolrIndexMetricsTest, DeleteNodeTest, BlockDirectoryTest, TestAnalyzeInfixSuggestions, AnalyticsQueryTest, DocValuesMissingTest, TestSimpleQParserPlugin, HardAutoCommitTest, TestFreeTextSuggestions, RuleEngineTest, LeaderInitiatedRecoveryOnCommitTest, ZkStateReaderTest, PreAnalyzedFieldManagedSchemaCloudTest, PeerSyncReplicationTest, SolrJmxReporterTest, AtomicUpdatesTest, InfixSuggestersTest, OverriddenZkACLAndCredentialsProvidersTest, CoreAdminCreateDiscoverTest, ReplaceNodeTest, TestManagedResource, SpellPossibilityIteratorTest, SimpleMLTQParserTest, TestReload, PluginInfoTest, TestLFUCache, TestSubQueryTransformer, TestUninvertingReader, DOMUtilTest, TestExportWriter, ShardSplitTest, CurrencyFieldXmlFileTest, TestSizeLimitedDistributedMap, TestXIncludeConfig, TestReversedWildcardFilterFactory, DirectUpdateHandlerTest, ShardRoutingTest, BasicZkTest, RecoveryZkTest, FullSolrCloudDistribCmdsTest, TestZkChroot, ShardRoutingCustomTest, AutoCommitTest, TestFaceting, TestRecovery, TestHashPartitioner, TermVectorComponentDistributedTest, TestSolr4Spatial, StatsComponentTest, BadIndexSchemaTest, TestFiltering, ShowFileRequestHandlerTest, SimplePostToolTest, TestCoreDiscovery, SignatureUpdateProcessorFactoryTest, SuggesterFSTTest, CoreAdminHandlerTest, TestFoldingMultitermQuery, SuggesterTSTTest, TestStressLucene, PolyFieldTest, NoCacheHeaderTest, WordBreakSolrSpellCheckerTest, SchemaVersionSpecificBehaviorTest, SolrCoreCheckLockOnStartupTest, FieldMutatingUpdateProcessorTest, TestAtomicUpdateErrorCases, TestWordDelimiterFilterFactory, DirectUpdateHandlerOptimizeTest, StatelessScriptUpdateProcessorFactoryTest, XsltUpdateRequestHandlerTest, TestSurroundQueryParser, DirectSolrSpellCheckerTest, DocumentAnalysisRequestHandlerTest, FileBasedSpellCheckerTest, DocumentBuilderTest, RequiredFieldsTest, FastVectorHighlighterTest, RegexBoostProcessorTest, ReturnFieldsTest, UniqFieldsUpdateProcessorFactoryTest, JsonLoaderTest, TestPHPSerializedResponseWriter, TestComponentsName, SearchHandlerTest, TestQuerySenderNoQuery, SolrIndexConfigTest, MinimalSchemaTest, TestElisionMultitermQuery, TestConfig, TestSolrCoreProperties, NotRequiredUniqueKeyTest, TestLuceneMatchVersion, TestCharFilters, TestSweetSpotSimilarityFactory, TestDFRSimilarityFactory, TestPerFieldSimilarity, TestLMDirichletSimilarityFactory, TestIBSimilarityFactory, TestFastWriter, TestJmxMonitoredMap, TimeZoneUtilsTest, TestFastOutputStream, OpenExchangeRatesOrgProviderTest, TestFastLRUCache, DateMathParserTest, PreAnalyzedFieldTest, TestSuggestSpellingConverter, DateFieldTest, SpellingQueryConverterTest, RAMDirectoryFactoryTest, ClusterStateTest, TestUtils, ZkNodePropsTest, SliceStateTest, SystemInfoHandlerTest, UUIDFieldTest, FileUtilsTest, DistributedMLTComponentTest, SolrTestCaseJ4Test, TestDistributedMissingSort, TestTolerantSearch, TestJettySolrRunner, ConnectionReuseTest, AssignTest, AsyncCallRequestStatusResponseTest, BaseCdcrDistributedZkTest, CdcrReplicationDistributedZkTest]
[junit4] Completed [543/691 (5!)] on J2 in 1650.52s, 11 tests, 3 failures, 1 error <<< FAILURES!
[...truncated 62734 lines...]
-documentation-lint:
[jtidy] Checking for broken html (such as invalid tags)...
[delete] Deleting directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/lucene/build/jtidy_tmp
[echo] Checking for broken links...
[exec]
[exec] Crawl/parse...
[exec]
[exec] Verify...
[echo] Checking for malformed docs...
[exec]
[exec] /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/docs/solr-solrj/overview-summary.html
[exec] missing: org.apache.solr.client.solrj.io.eval
[exec]
[exec] Missing javadocs were found!
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/build.xml:783: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/build.xml:101: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build.xml:654: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build.xml:670: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/lucene/common-build.xml:2490: exec returned: 1
Total time: 349 minutes 48 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-6.x - Build # 279 - Failure
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.x/279/
No tests ran.
Build Log:
[...truncated 22 lines...]
ERROR: Failed to update http://svn.apache.org/repos/asf/lucene/test-data
org.tmatesoft.svn.core.SVNException: svn: E200030: FULL
at org.tmatesoft.svn.core.internal.wc.SVNErrorManager.error(SVNErrorManager.java:64)
at org.tmatesoft.svn.core.internal.wc.SVNErrorManager.error(SVNErrorManager.java:51)
at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:793)
at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:398)
at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:386)
at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.performHttpRequest(DAVConnection.java:863)
at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:360)
at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.runReport(DAVRepository.java:1340)
at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.update(DAVRepository.java:868)
at org.tmatesoft.svn.core.internal.wc2.ng.SvnNgAbstractUpdate.updateInternal(SvnNgAbstractUpdate.java:247)
at org.tmatesoft.svn.core.internal.wc2.ng.SvnNgAbstractUpdate.update(SvnNgAbstractUpdate.java:111)
at org.tmatesoft.svn.core.internal.wc2.ng.SvnNgUpdate.run(SvnNgUpdate.java:38)
at org.tmatesoft.svn.core.internal.wc2.ng.SvnNgUpdate.run(SvnNgUpdate.java:18)
at org.tmatesoft.svn.core.internal.wc2.ng.SvnNgOperationRunner.run(SvnNgOperationRunner.java:20)
at org.tmatesoft.svn.core.internal.wc2.SvnOperationRunner.run(SvnOperationRunner.java:21)
at org.tmatesoft.svn.core.wc2.SvnOperationFactory.run(SvnOperationFactory.java:1235)
at org.tmatesoft.svn.core.wc2.SvnOperation.run(SvnOperation.java:294)
at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:311)
at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:291)
at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:387)
at hudson.scm.subversion.UpdateUpdater$TaskImpl.perform(UpdateUpdater.java:158)
at hudson.scm.subversion.WorkspaceUpdater$UpdateTask.delegateTo(WorkspaceUpdater.java:162)
at hudson.scm.SubversionSCM$CheckOutTask.perform(SubversionSCM.java:996)
at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:972)
at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:948)
at hudson.FilePath$FileCallableWrapper.call(FilePath.java:2772)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:332)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.tmatesoft.sqljet.core.SqlJetException: FULL: error code is FULL
at org.tmatesoft.sqljet.core.internal.pager.SqlJetPager.openJournal(SqlJetPager.java:3051)
at org.tmatesoft.sqljet.core.internal.pager.SqlJetPager.begin(SqlJetPager.java:2782)
at org.tmatesoft.sqljet.core.internal.btree.SqlJetBtree.beginTrans(SqlJetBtree.java:931)
at org.tmatesoft.sqljet.core.table.engine.SqlJetEngine.doBeginTransaction(SqlJetEngine.java:561)
at org.tmatesoft.sqljet.core.table.engine.SqlJetEngine.access$100(SqlJetEngine.java:55)
at org.tmatesoft.sqljet.core.table.engine.SqlJetEngine$12.runSynchronized(SqlJetEngine.java:535)
at org.tmatesoft.sqljet.core.table.engine.SqlJetEngine.runSynchronized(SqlJetEngine.java:217)
at org.tmatesoft.sqljet.core.table.engine.SqlJetEngine.runEngineTransaction(SqlJetEngine.java:529)
at org.tmatesoft.sqljet.core.table.SqlJetDb.runTransaction(SqlJetDb.java:238)
at org.tmatesoft.sqljet.core.table.SqlJetDb.runWriteTransaction(SqlJetDb.java:211)
at org.tmatesoft.svn.core.internal.wc17.db.statement.SVNWCDbCreateSchema.exec(SVNWCDbCreateSchema.java:225)
at org.tmatesoft.svn.core.internal.db.SVNSqlJetStatement.done(SVNSqlJetStatement.java:420)
at org.tmatesoft.svn.core.internal.wc17.db.SVNWCDb$BumpRevisionPostUpdate.bumpMovedAway(SVNWCDb.java:5215)
at org.tmatesoft.svn.core.internal.wc17.db.SVNWCDb$BumpRevisionPostUpdate.transaction(SVNWCDb.java:5208)
at org.tmatesoft.svn.core.internal.db.SVNSqlJetDb.runTransaction(SVNSqlJetDb.java:258)
at org.tmatesoft.svn.core.internal.db.SVNSqlJetDb.runTransaction(SVNSqlJetDb.java:252)
at org.tmatesoft.svn.core.internal.wc17.db.SVNWCDb.opBumpRevisionPostUpdate(SVNWCDb.java:5160)
at org.tmatesoft.svn.core.internal.wc17.SVNUpdateEditor17.closeEdit(SVNUpdateEditor17.java:1728)
at org.tmatesoft.svn.core.internal.wc.SVNCancellableEditor.closeEdit(SVNCancellableEditor.java:148)
at org.tmatesoft.svn.core.internal.io.dav.handlers.DAVEditorHandler.endElement(DAVEditorHandler.java:492)
at org.tmatesoft.svn.core.internal.io.dav.handlers.BasicDAVHandler.endElement(BasicDAVHandler.java:103)
at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.endElement(AbstractSAXParser.java:609)
at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanEndElement(XMLDocumentFragmentScannerImpl.java:1776)
at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl$FragmentContentDriver.next(XMLDocumentFragmentScannerImpl.java:2964)
at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl.next(XMLDocumentScannerImpl.java:606)
at com.sun.org.apache.xerces.internal.impl.XMLNSDocumentScannerImpl.next(XMLNSDocumentScannerImpl.java:118)
at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(XMLDocumentFragmentScannerImpl.java:504)
at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:848)
at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:777)
at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.java:141)
at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(AbstractSAXParser.java:1213)
at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(SAXParserImpl.java:642)
at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.readData(HTTPConnection.java:932)
at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.readData(HTTPConnection.java:897)
at org.tmatesoft.svn.core.internal.io.dav.http.HTTPRequest.dispatch(HTTPRequest.java:220)
at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:497)
... 31 more
ERROR: Subversion update failed
java.io.IOException: remote file operation failed: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x at hudson.remoting.Channel@5c75ad5b:lucene: java.io.IOException
at hudson.FilePath.act(FilePath.java:1014)
at hudson.FilePath.act(FilePath.java:996)
at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:897)
at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:833)
at org.jenkinsci.plugins.multiplescms.MultiSCM.checkout(MultiSCM.java:143)
at hudson.scm.SCM.checkout(SCM.java:485)
at hudson.model.AbstractProject.checkout(AbstractProject.java:1269)
at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:604)
at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86)
at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:529)
at hudson.model.Run.execute(Run.java:1741)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:98)
at hudson.model.Executor.run(Executor.java:410)
Caused by: java.io.IOException
at hudson.scm.subversion.UpdateUpdater$TaskImpl.perform(UpdateUpdater.java:212)
at hudson.scm.subversion.WorkspaceUpdater$UpdateTask.delegateTo(WorkspaceUpdater.java:162)
at hudson.scm.SubversionSCM$CheckOutTask.perform(SubversionSCM.java:996)
at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:972)
at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:948)
at hudson.FilePath$FileCallableWrapper.call(FilePath.java:2772)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:332)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to lucene(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1416)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:781)
at hudson.FilePath.act(FilePath.java:1007)
... 13 more
Caused by: hudson.scm.subversion.UpdaterException: failed to perform svn update
at hudson.scm.subversion.UpdateUpdater$TaskImpl.perform(UpdateUpdater.java:212)
at hudson.scm.subversion.WorkspaceUpdater$UpdateTask.delegateTo(WorkspaceUpdater.java:162)
at hudson.scm.SubversionSCM$CheckOutTask.perform(SubversionSCM.java:996)
at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:972)
at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:948)
at hudson.FilePath$FileCallableWrapper.call(FilePath.java:2772)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:332)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.tmatesoft.svn.core.SVNException: svn: E200030: FULL
at org.tmatesoft.svn.core.internal.wc.SVNErrorManager.error(SVNErrorManager.java:64)
at org.tmatesoft.svn.core.internal.wc.SVNErrorManager.error(SVNErrorManager.java:51)
at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:793)
at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:398)
at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:386)
at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.performHttpRequest(DAVConnection.java:863)
at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:360)
at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.runReport(DAVRepository.java:1340)
at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.update(DAVRepository.java:868)
at org.tmatesoft.svn.core.internal.wc2.ng.SvnNgAbstractUpdate.updateInternal(SvnNgAbstractUpdate.java:247)
at org.tmatesoft.svn.core.internal.wc2.ng.SvnNgAbstractUpdate.update(SvnNgAbstractUpdate.java:111)
at org.tmatesoft.svn.core.internal.wc2.ng.SvnNgUpdate.run(SvnNgUpdate.java:38)
at org.tmatesoft.svn.core.internal.wc2.ng.SvnNgUpdate.run(SvnNgUpdate.java:18)
at org.tmatesoft.svn.core.internal.wc2.ng.SvnNgOperationRunner.run(SvnNgOperationRunner.java:20)
at org.tmatesoft.svn.core.internal.wc2.SvnOperationRunner.run(SvnOperationRunner.java:21)
at org.tmatesoft.svn.core.wc2.SvnOperationFactory.run(SvnOperationFactory.java:1235)
at org.tmatesoft.svn.core.wc2.SvnOperation.run(SvnOperation.java:294)
at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:311)
at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:291)
at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:387)
at hudson.scm.subversion.UpdateUpdater$TaskImpl.perform(UpdateUpdater.java:158)
... 13 more
Caused by: org.tmatesoft.sqljet.core.SqlJetException: FULL: error code is FULL
at org.tmatesoft.sqljet.core.internal.pager.SqlJetPager.openJournal(SqlJetPager.java:3051)
at org.tmatesoft.sqljet.core.internal.pager.SqlJetPager.begin(SqlJetPager.java:2782)
at org.tmatesoft.sqljet.core.internal.btree.SqlJetBtree.beginTrans(SqlJetBtree.java:931)
at org.tmatesoft.sqljet.core.table.engine.SqlJetEngine.doBeginTransaction(SqlJetEngine.java:561)
at org.tmatesoft.sqljet.core.table.engine.SqlJetEngine.access$100(SqlJetEngine.java:55)
at org.tmatesoft.sqljet.core.table.engine.SqlJetEngine$12.runSynchronized(SqlJetEngine.java:535)
at org.tmatesoft.sqljet.core.table.engine.SqlJetEngine.runSynchronized(SqlJetEngine.java:217)
at org.tmatesoft.sqljet.core.table.engine.SqlJetEngine.runEngineTransaction(SqlJetEngine.java:529)
at org.tmatesoft.sqljet.core.table.SqlJetDb.runTransaction(SqlJetDb.java:238)
at org.tmatesoft.sqljet.core.table.SqlJetDb.runWriteTransaction(SqlJetDb.java:211)
at org.tmatesoft.svn.core.internal.wc17.db.statement.SVNWCDbCreateSchema.exec(SVNWCDbCreateSchema.java:225)
at org.tmatesoft.svn.core.internal.db.SVNSqlJetStatement.done(SVNSqlJetStatement.java:420)
at org.tmatesoft.svn.core.internal.wc17.db.SVNWCDb$BumpRevisionPostUpdate.bumpMovedAway(SVNWCDb.java:5215)
at org.tmatesoft.svn.core.internal.wc17.db.SVNWCDb$BumpRevisionPostUpdate.transaction(SVNWCDb.java:5208)
at org.tmatesoft.svn.core.internal.db.SVNSqlJetDb.runTransaction(SVNSqlJetDb.java:258)
at org.tmatesoft.svn.core.internal.db.SVNSqlJetDb.runTransaction(SVNSqlJetDb.java:252)
at org.tmatesoft.svn.core.internal.wc17.db.SVNWCDb.opBumpRevisionPostUpdate(SVNWCDb.java:5160)
at org.tmatesoft.svn.core.internal.wc17.SVNUpdateEditor17.closeEdit(SVNUpdateEditor17.java:1728)
at org.tmatesoft.svn.core.internal.wc.SVNCancellableEditor.closeEdit(SVNCancellableEditor.java:148)
at org.tmatesoft.svn.core.internal.io.dav.handlers.DAVEditorHandler.endElement(DAVEditorHandler.java:492)
at org.tmatesoft.svn.core.internal.io.dav.handlers.BasicDAVHandler.endElement(BasicDAVHandler.java:103)
at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.endElement(AbstractSAXParser.java:609)
at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanEndElement(XMLDocumentFragmentScannerImpl.java:1776)
at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl$FragmentContentDriver.next(XMLDocumentFragmentScannerImpl.java:2964)
at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl.next(XMLDocumentScannerImpl.java:606)
at com.sun.org.apache.xerces.internal.impl.XMLNSDocumentScannerImpl.next(XMLNSDocumentScannerImpl.java:118)
at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(XMLDocumentFragmentScannerImpl.java:504)
at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:848)
at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:777)
at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.java:141)
at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(AbstractSAXParser.java:1213)
at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(SAXParserImpl.java:642)
at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.readData(HTTPConnection.java:932)
at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.readData(HTTPConnection.java:897)
at org.tmatesoft.svn.core.internal.io.dav.http.HTTPRequest.dispatch(HTTPRequest.java:220)
at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:497)
... 31 more
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url git://git.apache.org/lucene-solr.git # timeout=10
Fetching upstream changes from git://git.apache.org/lucene-solr.git
> git --version # timeout=10
> git -c core.askpass=true fetch --tags --progress git://git.apache.org/lucene-solr.git +refs/heads/*:refs/remotes/origin/*
> git rev-parse refs/remotes/origin/branch_6x^{commit} # timeout=10
> git rev-parse refs/remotes/origin/origin/branch_6x^{commit} # timeout=10
Checking out Revision a36ebaa90c95d8be6411464c237593a1ff825af0 (refs/remotes/origin/branch_6x)
> git config core.sparsecheckout # timeout=10
> git checkout -f a36ebaa90c95d8be6411464c237593a1ff825af0
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
Cleaning up /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/test-data
Updating http://svn.apache.org/repos/asf/lucene/test-data at revision '2017-02-10T08:36:24.928 +0000'
ERROR: Failed to update http://svn.apache.org/repos/asf/lucene/test-data
org.tmatesoft.svn.core.SVNException: svn: E200030: FULL
at org.tmatesoft.svn.core.internal.wc.SVNErrorManager.error(SVNErrorManager.java:64)
at org.tmatesoft.svn.core.internal.wc.SVNErrorManager.error(SVNErrorManager.java:51)
at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:793)
at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:398)
at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:386)
at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.performHttpRequest(DAVConnection.java:863)
at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:360)
at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.runReport(DAVRepository.java:1340)
at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.update(DAVRepository.java:868)
at org.tmatesoft.svn.core.internal.wc2.ng.SvnNgAbstractUpdate.updateInternal(SvnNgAbstractUpdate.java:247)
at org.tmatesoft.svn.core.internal.wc2.ng.SvnNgAbstractUpdate.update(SvnNgAbstractUpdate.java:111)
at org.tmatesoft.svn.core.internal.wc2.ng.SvnNgUpdate.run(SvnNgUpdate.java:38)
at org.tmatesoft.svn.core.internal.wc2.ng.SvnNgUpdate.run(SvnNgUpdate.java:18)
at org.tmatesoft.svn.core.internal.wc2.ng.SvnNgOperationRunner.run(SvnNgOperationRunner.java:20)
at org.tmatesoft.svn.core.internal.wc2.SvnOperationRunner.run(SvnOperationRunner.java:21)
at org.tmatesoft.svn.core.wc2.SvnOperationFactory.run(SvnOperationFactory.java:1235)
at org.tmatesoft.svn.core.wc2.SvnOperation.run(SvnOperation.java:294)
at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:311)
at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:291)
at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:387)
at hudson.scm.subversion.UpdateUpdater$TaskImpl.perform(UpdateUpdater.java:158)
at hudson.scm.subversion.WorkspaceUpdater$UpdateTask.delegateTo(WorkspaceUpdater.java:162)
at hudson.scm.SubversionSCM$CheckOutTask.perform(SubversionSCM.java:996)
at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:972)
at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:948)
at hudson.FilePath$FileCallableWrapper.call(FilePath.java:2772)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:332)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.tmatesoft.sqljet.core.SqlJetException: FULL: error code is FULL
at org.tmatesoft.sqljet.core.internal.pager.SqlJetPager.openJournal(SqlJetPager.java:3051)
at org.tmatesoft.sqljet.core.internal.pager.SqlJetPager.begin(SqlJetPager.java:2782)
at org.tmatesoft.sqljet.core.internal.btree.SqlJetBtree.beginTrans(SqlJetBtree.java:931)
at org.tmatesoft.sqljet.core.table.engine.SqlJetEngine.doBeginTransaction(SqlJetEngine.java:561)
at org.tmatesoft.sqljet.core.table.engine.SqlJetEngine.access$100(SqlJetEngine.java:55)
at org.tmatesoft.sqljet.core.table.engine.SqlJetEngine$12.runSynchronized(SqlJetEngine.java:535)
at org.tmatesoft.sqljet.core.table.engine.SqlJetEngine.runSynchronized(SqlJetEngine.java:217)
at org.tmatesoft.sqljet.core.table.engine.SqlJetEngine.runEngineTransaction(SqlJetEngine.java:529)
at org.tmatesoft.sqljet.core.table.SqlJetDb.runTransaction(SqlJetDb.java:238)
at org.tmatesoft.sqljet.core.table.SqlJetDb.runWriteTransaction(SqlJetDb.java:211)
at org.tmatesoft.svn.core.internal.wc17.db.statement.SVNWCDbCreateSchema.exec(SVNWCDbCreateSchema.java:225)
at org.tmatesoft.svn.core.internal.db.SVNSqlJetStatement.done(SVNSqlJetStatement.java:420)
at org.tmatesoft.svn.core.internal.wc17.db.SVNWCDb$BumpRevisionPostUpdate.bumpMovedAway(SVNWCDb.java:5215)
at org.tmatesoft.svn.core.internal.wc17.db.SVNWCDb$BumpRevisionPostUpdate.transaction(SVNWCDb.java:5208)
at org.tmatesoft.svn.core.internal.db.SVNSqlJetDb.runTransaction(SVNSqlJetDb.java:258)
at org.tmatesoft.svn.core.internal.db.SVNSqlJetDb.runTransaction(SVNSqlJetDb.java:252)
at org.tmatesoft.svn.core.internal.wc17.db.SVNWCDb.opBumpRevisionPostUpdate(SVNWCDb.java:5160)
at org.tmatesoft.svn.core.internal.wc17.SVNUpdateEditor17.closeEdit(SVNUpdateEditor17.java:1728)
at org.tmatesoft.svn.core.internal.wc.SVNCancellableEditor.closeEdit(SVNCancellableEditor.java:148)
at org.tmatesoft.svn.core.internal.io.dav.handlers.DAVEditorHandler.endElement(DAVEditorHandler.java:492)
at org.tmatesoft.svn.core.internal.io.dav.handlers.BasicDAVHandler.endElement(BasicDAVHandler.java:103)
at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.endElement(AbstractSAXParser.java:609)
at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanEndElement(XMLDocumentFragmentScannerImpl.java:1776)
at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl$FragmentContentDriver.next(XMLDocumentFragmentScannerImpl.java:2964)
at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl.next(XMLDocumentScannerImpl.java:606)
at com.sun.org.apache.xerces.internal.impl.XMLNSDocumentScannerImpl.next(XMLNSDocumentScannerImpl.java:118)
at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(XMLDocumentFragmentScannerImpl.java:504)
at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:848)
at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:777)
at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.java:141)
at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(AbstractSAXParser.java:1213)
at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(SAXParserImpl.java:642)
at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.readData(HTTPConnection.java:932)
at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.readData(HTTPConnection.java:897)
at org.tmatesoft.svn.core.internal.io.dav.http.HTTPRequest.dispatch(HTTPRequest.java:220)
at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:497)
... 31 more
ERROR: Subversion update failed
java.io.IOException: remote file operation failed: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x at hudson.remoting.Channel@5c75ad5b:lucene: java.io.IOException
at hudson.FilePath.act(FilePath.java:1014)
at hudson.FilePath.act(FilePath.java:996)
at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:897)
at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:833)
at org.jenkinsci.plugins.multiplescms.MultiSCM.checkout(MultiSCM.java:143)
at hudson.scm.SCM.checkout(SCM.java:485)
at hudson.model.AbstractProject.checkout(AbstractProject.java:1269)
at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:604)
at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86)
at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:529)
at hudson.model.Run.execute(Run.java:1741)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:98)
at hudson.model.Executor.run(Executor.java:410)
Caused by: java.io.IOException
at hudson.scm.subversion.UpdateUpdater$TaskImpl.perform(UpdateUpdater.java:212)
at hudson.scm.subversion.WorkspaceUpdater$UpdateTask.delegateTo(WorkspaceUpdater.java:162)
at hudson.scm.SubversionSCM$CheckOutTask.perform(SubversionSCM.java:996)
at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:972)
at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:948)
at hudson.FilePath$FileCallableWrapper.call(FilePath.java:2772)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:332)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to lucene(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1416)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:781)
at hudson.FilePath.act(FilePath.java:1007)
... 13 more
Caused by: hudson.scm.subversion.UpdaterException: failed to perform svn update
at hudson.scm.subversion.UpdateUpdater$TaskImpl.perform(UpdateUpdater.java:212)
at hudson.scm.subversion.WorkspaceUpdater$UpdateTask.delegateTo(WorkspaceUpdater.java:162)
at hudson.scm.SubversionSCM$CheckOutTask.perform(SubversionSCM.java:996)
at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:972)
at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:948)
at hudson.FilePath$FileCallableWrapper.call(FilePath.java:2772)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:332)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.tmatesoft.svn.core.SVNException: svn: E200030: FULL
at org.tmatesoft.svn.core.internal.wc.SVNErrorManager.error(SVNErrorManager.java:64)
at org.tmatesoft.svn.core.internal.wc.SVNErrorManager.error(SVNErrorManager.java:51)
at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:793)
at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:398)
at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:386)
at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.performHttpRequest(DAVConnection.java:863)
at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:360)
at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.runReport(DAVRepository.java:1340)
at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.update(DAVRepository.java:868)
at org.tmatesoft.svn.core.internal.wc2.ng.SvnNgAbstractUpdate.updateInternal(SvnNgAbstractUpdate.java:247)
at org.tmatesoft.svn.core.internal.wc2.ng.SvnNgAbstractUpdate.update(SvnNgAbstractUpdate.java:111)
at org.tmatesoft.svn.core.internal.wc2.ng.SvnNgUpdate.run(SvnNgUpdate.java:38)
at org.tmatesoft.svn.core.internal.wc2.ng.SvnNgUpdate.run(SvnNgUpdate.java:18)
at org.tmatesoft.svn.core.internal.wc2.ng.SvnNgOperationRunner.run(SvnNgOperationRunner.java:20)
at org.tmatesoft.svn.core.internal.wc2.SvnOperationRunner.run(SvnOperationRunner.java:21)
at org.tmatesoft.svn.core.wc2.SvnOperationFactory.run(SvnOperationFactory.java:1235)
at org.tmatesoft.svn.core.wc2.SvnOperation.run(SvnOperation.java:294)
at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:311)
at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:291)
at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:387)
at hudson.scm.subversion.UpdateUpdater$TaskImpl.perform(UpdateUpdater.java:158)
... 13 more
Caused by: org.tmatesoft.sqljet.core.SqlJetException: FULL: error code is FULL
at org.tmatesoft.sqljet.core.internal.pager.SqlJetPager.openJournal(SqlJetPager.java:3051)
at org.tmatesoft.sqljet.core.internal.pager.SqlJetPager.begin(SqlJetPager.java:2782)
at org.tmatesoft.sqljet.core.internal.btree.SqlJetBtree.beginTrans(SqlJetBtree.java:931)
at org.tmatesoft.sqljet.core.table.engine.SqlJetEngine.doBeginTransaction(SqlJetEngine.java:561)
at org.tmatesoft.sqljet.core.table.engine.SqlJetEngine.access$100(SqlJetEngine.java:55)
at org.tmatesoft.sqljet.core.table.engine.SqlJetEngine$12.runSynchronized(SqlJetEngine.java:535)
at org.tmatesoft.sqljet.core.table.engine.SqlJetEngine.runSynchronized(SqlJetEngine.java:217)
at org.tmatesoft.sqljet.core.table.engine.SqlJetEngine.runEngineTransaction(SqlJetEngine.java:529)
at org.tmatesoft.sqljet.core.table.SqlJetDb.runTransaction(SqlJetDb.java:238)
at org.tmatesoft.sqljet.core.table.SqlJetDb.runWriteTransaction(SqlJetDb.java:211)
at org.tmatesoft.svn.core.internal.wc17.db.statement.SVNWCDbCreateSchema.exec(SVNWCDbCreateSchema.java:225)
at org.tmatesoft.svn.core.internal.db.SVNSqlJetStatement.done(SVNSqlJetStatement.java:420)
at org.tmatesoft.svn.core.internal.wc17.db.SVNWCDb$BumpRevisionPostUpdate.bumpMovedAway(SVNWCDb.java:5215)
at org.tmatesoft.svn.core.internal.wc17.db.SVNWCDb$BumpRevisionPostUpdate.transaction(SVNWCDb.java:5208)
at org.tmatesoft.svn.core.internal.db.SVNSqlJetDb.runTransaction(SVNSqlJetDb.java:258)
at org.tmatesoft.svn.core.internal.db.SVNSqlJetDb.runTransaction(SVNSqlJetDb.java:252)
at org.tmatesoft.svn.core.internal.wc17.db.SVNWCDb.opBumpRevisionPostUpdate(SVNWCDb.java:5160)
at org.tmatesoft.svn.core.internal.wc17.SVNUpdateEditor17.closeEdit(SVNUpdateEditor17.java:1728)
at org.tmatesoft.svn.core.internal.wc.SVNCancellableEditor.closeEdit(SVNCancellableEditor.java:148)
at org.tmatesoft.svn.core.internal.io.dav.handlers.DAVEditorHandler.endElement(DAVEditorHandler.java:492)
at org.tmatesoft.svn.core.internal.io.dav.handlers.BasicDAVHandler.endElement(BasicDAVHandler.java:103)
at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.endElement(AbstractSAXParser.java:609)
at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanEndElement(XMLDocumentFragmentScannerImpl.java:1776)
at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl$FragmentContentDriver.next(XMLDocumentFragmentScannerImpl.java:2964)
at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl.next(XMLDocumentScannerImpl.java:606)
at com.sun.org.apache.xerces.internal.impl.XMLNSDocumentScannerImpl.next(XMLNSDocumentScannerImpl.java:118)
at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(XMLDocumentFragmentScannerImpl.java:504)
at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:848)
at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:777)
at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.java:141)
at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(AbstractSAXParser.java:1213)
at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(SAXParserImpl.java:642)
at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.readData(HTTPConnection.java:932)
at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.readData(HTTPConnection.java:897)
at org.tmatesoft.svn.core.internal.io.dav.http.HTTPRequest.dispatch(HTTPRequest.java:220)
at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:497)
... 31 more
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url git://git.apache.org/lucene-solr.git # timeout=10
Fetching upstream changes from git://git.apache.org/lucene-solr.git
> git --version # timeout=10
> git -c core.askpass=true fetch --tags --progress git://git.apache.org/lucene-solr.git +refs/heads/*:refs/remotes/origin/*
> git rev-parse refs/remotes/origin/branch_6x^{commit} # timeout=10
> git rev-parse refs/remotes/origin/origin/branch_6x^{commit} # timeout=10
Checking out Revision a36ebaa90c95d8be6411464c237593a1ff825af0 (refs/remotes/origin/branch_6x)
> git config core.sparsecheckout # timeout=10
> git checkout -f a36ebaa90c95d8be6411464c237593a1ff825af0
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
Cleaning up /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/test-data
Updating http://svn.apache.org/repos/asf/lucene/test-data at revision '2017-02-10T08:36:24.928 +0000'
ERROR: Failed to update http://svn.apache.org/repos/asf/lucene/test-data
org.tmatesoft.svn.core.SVNException: svn: E200030: FULL
at org.tmatesoft.svn.core.internal.wc.SVNErrorManager.error(SVNErrorManager.java:64)
at org.tmatesoft.svn.core.internal.wc.SVNErrorManager.error(SVNErrorManager.java:51)
at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:793)
at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:398)
at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:386)
at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.performHttpRequest(DAVConnection.java:863)
at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:360)
at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.runReport(DAVRepository.java:1340)
at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.update(DAVRepository.java:868)
at org.tmatesoft.svn.core.internal.wc2.ng.SvnNgAbstractUpdate.updateInternal(SvnNgAbstractUpdate.java:247)
at org.tmatesoft.svn.core.internal.wc2.ng.SvnNgAbstractUpdate.update(SvnNgAbstractUpdate.java:111)
at org.tmatesoft.svn.core.internal.wc2.ng.SvnNgUpdate.run(SvnNgUpdate.java:38)
at org.tmatesoft.svn.core.internal.wc2.ng.SvnNgUpdate.run(SvnNgUpdate.java:18)
at org.tmatesoft.svn.core.internal.wc2.ng.SvnNgOperationRunner.run(SvnNgOperationRunner.java:20)
at org.tmatesoft.svn.core.internal.wc2.SvnOperationRunner.run(SvnOperationRunner.java:21)
at org.tmatesoft.svn.core.wc2.SvnOperationFactory.run(SvnOperationFactory.java:1235)
at org.tmatesoft.svn.core.wc2.SvnOperation.run(SvnOperation.java:294)
at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:311)
at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:291)
at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:387)
at hudson.scm.subversion.UpdateUpdater$TaskImpl.perform(UpdateUpdater.java:158)
at hudson.scm.subversion.WorkspaceUpdater$UpdateTask.delegateTo(WorkspaceUpdater.java:162)
at hudson.scm.SubversionSCM$CheckOutTask.perform(SubversionSCM.java:996)
at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:972)
at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:948)
at hudson.FilePath$FileCallableWrapper.call(FilePath.java:2772)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:332)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.tmatesoft.sqljet.core.SqlJetException: FULL: error code is FULL
at org.tmatesoft.sqljet.core.internal.pager.SqlJetPager.openJournal(SqlJetPager.java:3051)
at org.tmatesoft.sqljet.core.internal.pager.SqlJetPager.begin(SqlJetPager.java:2782)
at org.tmatesoft.sqljet.core.internal.btree.SqlJetBtree.beginTrans(SqlJetBtree.java:931)
at org.tmatesoft.sqljet.core.table.engine.SqlJetEngine.doBeginTransaction(SqlJetEngine.java:561)
at org.tmatesoft.sqljet.core.table.engine.SqlJetEngine.access$100(SqlJetEngine.java:55)
at org.tmatesoft.sqljet.core.table.engine.SqlJetEngine$12.runSynchronized(SqlJetEngine.java:535)
at org.tmatesoft.sqljet.core.table.engine.SqlJetEngine.runSynchronized(SqlJetEngine.java:217)
at org.tmatesoft.sqljet.core.table.engine.SqlJetEngine.runEngineTransaction(SqlJetEngine.java:529)
at org.tmatesoft.sqljet.core.table.SqlJetDb.runTransaction(SqlJetDb.java:238)
at org.tmatesoft.sqljet.core.table.SqlJetDb.runWriteTransaction(SqlJetDb.java:211)
at org.tmatesoft.svn.core.internal.wc17.db.statement.SVNWCDbCreateSchema.exec(SVNWCDbCreateSchema.java:225)
at org.tmatesoft.svn.core.internal.db.SVNSqlJetStatement.done(SVNSqlJetStatement.java:420)
at org.tmatesoft.svn.core.internal.wc17.db.SVNWCDb$BumpRevisionPostUpdate.bumpMovedAway(SVNWCDb.java:5215)
at org.tmatesoft.svn.core.internal.wc17.db.SVNWCDb$BumpRevisionPostUpdate.transaction(SVNWCDb.java:5208)
at org.tmatesoft.svn.core.internal.db.SVNSqlJetDb.runTransaction(SVNSqlJetDb.java:258)
at org.tmatesoft.svn.core.internal.db.SVNSqlJetDb.runTransaction(SVNSqlJetDb.java:252)
at org.tmatesoft.svn.core.internal.wc17.db.SVNWCDb.opBumpRevisionPostUpdate(SVNWCDb.java:5160)
at org.tmatesoft.svn.core.internal.wc17.SVNUpdateEditor17.closeEdit(SVNUpdateEditor17.java:1728)
at org.tmatesoft.svn.core.internal.wc.SVNCancellableEditor.closeEdit(SVNCancellableEditor.java:148)
at org.tmatesoft.svn.core.internal.io.dav.handlers.DAVEditorHandler.endElement(DAVEditorHandler.java:492)
at org.tmatesoft.svn.core.internal.io.dav.handlers.BasicDAVHandler.endElement(BasicDAVHandler.java:103)
at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.endElement(AbstractSAXParser.java:609)
at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanEndElement(XMLDocumentFragmentScannerImpl.java:1776)
at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl$FragmentContentDriver.next(XMLDocumentFragmentScannerImpl.java:2964)
at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl.next(XMLDocumentScannerImpl.java:606)
at com.sun.org.apache.xerces.internal.impl.XMLNSDocumentScannerImpl.next(XMLNSDocumentScannerImpl.java:118)
at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(XMLDocumentFragmentScannerImpl.java:504)
at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:848)
at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:777)
at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.java:141)
at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(AbstractSAXParser.java:1213)
at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(SAXParserImpl.java:642)
at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.readData(HTTPConnection.java:932)
at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.readData(HTTPConnection.java:897)
at org.tmatesoft.svn.core.internal.io.dav.http.HTTPRequest.dispatch(HTTPRequest.java:220)
at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:497)
... 31 more
ERROR: Subversion update failed
java.io.IOException: remote file operation failed: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x at hudson.remoting.Channel@5c75ad5b:lucene: java.io.IOException
at hudson.FilePath.act(FilePath.java:1014)
at hudson.FilePath.act(FilePath.java:996)
at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:897)
at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:833)
at org.jenkinsci.plugins.multiplescms.MultiSCM.checkout(MultiSCM.java:143)
at hudson.scm.SCM.checkout(SCM.java:485)
at hudson.model.AbstractProject.checkout(AbstractProject.java:1269)
at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:604)
at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86)
at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:529)
at hudson.model.Run.execute(Run.java:1741)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:98)
at hudson.model.Executor.run(Executor.java:410)
Caused by: java.io.IOException
at hudson.scm.subversion.UpdateUpdater$TaskImpl.perform(UpdateUpdater.java:212)
at hudson.scm.subversion.WorkspaceUpdater$UpdateTask.delegateTo(WorkspaceUpdater.java:162)
at hudson.scm.SubversionSCM$CheckOutTask.perform(SubversionSCM.java:996)
at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:972)
at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:948)
at hudson.FilePath$FileCallableWrapper.call(FilePath.java:2772)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:332)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to lucene(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1416)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:781)
at hudson.FilePath.act(FilePath.java:1007)
... 13 more
Caused by: hudson.scm.subversion.UpdaterException: failed to perform svn update
at hudson.scm.subversion.UpdateUpdater$TaskImpl.perform(UpdateUpdater.java:212)
at hudson.scm.subversion.WorkspaceUpdater$UpdateTask.delegateTo(WorkspaceUpdater.java:162)
at hudson.scm.SubversionSCM$CheckOutTask.perform(SubversionSCM.java:996)
at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:972)
at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:948)
at hudson.FilePath$FileCallableWrapper.call(FilePath.java:2772)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:332)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.tmatesoft.svn.core.SVNException: svn: E200030: FULL
at org.tmatesoft.svn.core.internal.wc.SVNErrorManager.error(SVNErrorManager.java:64)
at org.tmatesoft.svn.core.internal.wc.SVNErrorManager.error(SVNErrorManager.java:51)
at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:793)
at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:398)
at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:386)
at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.performHttpRequest(DAVConnection.java:863)
at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:360)
at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.runReport(DAVRepository.java:1340)
at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.update(DAVRepository.java:868)
at org.tmatesoft.svn.core.internal.wc2.ng.SvnNgAbstractUpdate.updateInternal(SvnNgAbstractUpdate.java:247)
at org.tmatesoft.svn.core.internal.wc2.ng.SvnNgAbstractUpdate.update(SvnNgAbstractUpdate.java:111)
at org.tmatesoft.svn.core.internal.wc2.ng.SvnNgUpdate.run(SvnNgUpdate.java:38)
at org.tmatesoft.svn.core.internal.wc2.ng.SvnNgUpdate.run(SvnNgUpdate.java:18)
at org.tmatesoft.svn.core.internal.wc2.ng.SvnNgOperationRunner.run(SvnNgOperationRunner.java:20)
at org.tmatesoft.svn.core.internal.wc2.SvnOperationRunner.run(SvnOperationRunner.java:21)
at org.tmatesoft.svn.core.wc2.SvnOperationFactory.run(SvnOperationFactory.java:1235)
at org.tmatesoft.svn.core.wc2.SvnOperation.run(SvnOperation.java:294)
at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:311)
at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:291)
at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:387)
at hudson.scm.subversion.UpdateUpdater$TaskImpl.perform(UpdateUpdater.java:158)
... 13 more
Caused by: org.tmatesoft.sqljet.core.SqlJetException: FULL: error code is FULL
at org.tmatesoft.sqljet.core.internal.pager.SqlJetPager.openJournal(SqlJetPager.java:3051)
at org.tmatesoft.sqljet.core.internal.pager.SqlJetPager.begin(SqlJetPager.java:2782)
at org.tmatesoft.sqljet.core.internal.btree.SqlJetBtree.beginTrans(SqlJetBtree.java:931)
at org.tmatesoft.sqljet.core.table.engine.SqlJetEngine.doBeginTransaction(SqlJetEngine.java:561)
at org.tmatesoft.sqljet.core.table.engine.SqlJetEngine.access$100(SqlJetEngine.java:55)
at org.tmatesoft.sqljet.core.table.engine.SqlJetEngine$12.runSynchronized(SqlJetEngine.java:535)
at org.tmatesoft.sqljet.core.table.engine.SqlJetEngine.runSynchronized(SqlJetEngine.java:217)
at org.tmatesoft.sqljet.core.table.engine.SqlJetEngine.runEngineTransaction(SqlJetEngine.java:529)
at org.tmatesoft.sqljet.core.table.SqlJetDb.runTransaction(SqlJetDb.java:238)
at org.tmatesoft.sqljet.core.table.SqlJetDb.runWriteTransaction(SqlJetDb.java:211)
at org.tmatesoft.svn.core.internal.wc17.db.statement.SVNWCDbCreateSchema.exec(SVNWCDbCreateSchema.java:225)
at org.tmatesoft.svn.core.internal.db.SVNSqlJetStatement.done(SVNSqlJetStatement.java:420)
at org.tmatesoft.svn.core.internal.wc17.db.SVNWCDb$BumpRevisionPostUpdate.bumpMovedAway(SVNWCDb.java:5215)
at org.tmatesoft.svn.core.internal.wc17.db.SVNWCDb$BumpRevisionPostUpdate.transaction(SVNWCDb.java:5208)
at org.tmatesoft.svn.core.internal.db.SVNSqlJetDb.runTransaction(SVNSqlJetDb.java:258)
at org.tmatesoft.svn.core.internal.db.SVNSqlJetDb.runTransaction(SVNSqlJetDb.java:252)
at org.tmatesoft.svn.core.internal.wc17.db.SVNWCDb.opBumpRevisionPostUpdate(SVNWCDb.java:5160)
at org.tmatesoft.svn.core.internal.wc17.SVNUpdateEditor17.closeEdit(SVNUpdateEditor17.java:1728)
at org.tmatesoft.svn.core.internal.wc.SVNCancellableEditor.closeEdit(SVNCancellableEditor.java:148)
at org.tmatesoft.svn.core.internal.io.dav.handlers.DAVEditorHandler.endElement(DAVEditorHandler.java:492)
at org.tmatesoft.svn.core.internal.io.dav.handlers.BasicDAVHandler.endElement(BasicDAVHandler.java:103)
at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.endElement(AbstractSAXParser.java:609)
at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanEndElement(XMLDocumentFragmentScannerImpl.java:1776)
at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl$FragmentContentDriver.next(XMLDocumentFragmentScannerImpl.java:2964)
at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl.next(XMLDocumentScannerImpl.java:606)
at com.sun.org.apache.xerces.internal.impl.XMLNSDocumentScannerImpl.next(XMLNSDocumentScannerImpl.java:118)
at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(XMLDocumentFragmentScannerImpl.java:504)
at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:848)
at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:777)
at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.java:141)
at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(AbstractSAXParser.java:1213)
at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(SAXParserImpl.java:642)
at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.readData(HTTPConnection.java:932)
at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.readData(HTTPConnection.java:897)
at org.tmatesoft.svn.core.internal.io.dav.http.HTTPRequest.dispatch(HTTPRequest.java:220)
at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:497)
... 31 more
Archiving artifacts
Recording test results
ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error?
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-6.x - Build # 278 - Still
Unstable
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.x/278/
2 tests failed.
FAILED: org.apache.solr.handler.TestReplicationHandler.doTestStressReplication
Error Message:
timed out waiting for collection1 startAt time to exceed: Thu Feb 09 18:07:58 UTC 2017
Stack Trace:
java.lang.AssertionError: timed out waiting for collection1 startAt time to exceed: Thu Feb 09 18:07:58 UTC 2017
at __randomizedtesting.SeedInfo.seed([FBD5B3146F444647:207EB3D26A6C2FF4]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.handler.TestReplicationHandler.watchCoreStartAt(TestReplicationHandler.java:1542)
at org.apache.solr.handler.TestReplicationHandler.doTestStressReplication(TestReplicationHandler.java:867)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest.test
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([FBD5B3146F444647:73818CCEC1B82BBF]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertTrue(Assert.java:54)
at org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest.test(HdfsWriteToMultipleCollectionsTest.java:137)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 12736 lines...]
[junit4] Suite: org.apache.solr.handler.TestReplicationHandler
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_FBD5B3146F444647-001/init-core-data-001
[junit4] 2> 2456828 INFO (SUITE-TestReplicationHandler-seed#[FBD5B3146F444647]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=None)
[junit4] 2> 2456829 INFO (TEST-TestReplicationHandler.doTestReplicateAfterCoreReload-seed#[FBD5B3146F444647]) [ ] o.a.s.SolrTestCaseJ4 ###Starting doTestReplicateAfterCoreReload
[junit4] 2> 2456830 INFO (TEST-TestReplicationHandler.doTestReplicateAfterCoreReload-seed#[FBD5B3146F444647]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_FBD5B3146F444647-001/solr-instance-001/collection1
[junit4] 2> 2456834 INFO (TEST-TestReplicationHandler.doTestReplicateAfterCoreReload-seed#[FBD5B3146F444647]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 2456835 INFO (TEST-TestReplicationHandler.doTestReplicateAfterCoreReload-seed#[FBD5B3146F444647]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3a78a1fc{/solr,null,AVAILABLE}
[junit4] 2> 2456837 INFO (TEST-TestReplicationHandler.doTestReplicateAfterCoreReload-seed#[FBD5B3146F444647]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@354885b2{HTTP/1.1,[http/1.1]}{127.0.0.1:53577}
[junit4] 2> 2456838 INFO (TEST-TestReplicationHandler.doTestReplicateAfterCoreReload-seed#[FBD5B3146F444647]) [ ] o.e.j.s.Server Started @2460131ms
[junit4] 2> 2456838 INFO (TEST-TestReplicationHandler.doTestReplicateAfterCoreReload-seed#[FBD5B3146F444647]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_FBD5B3146F444647-001/solr-instance-001/collection1/data, hostContext=/solr, hostPort=53577}
[junit4] 2> 2456838 ERROR (TEST-TestReplicationHandler.doTestReplicateAfterCoreReload-seed#[FBD5B3146F444647]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2456838 INFO (TEST-TestReplicationHandler.doTestReplicateAfterCoreReload-seed#[FBD5B3146F444647]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 6.5.0
[junit4] 2> 2456838 INFO (TEST-TestReplicationHandler.doTestReplicateAfterCoreReload-seed#[FBD5B3146F444647]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in standalone mode on port null
[junit4] 2> 2456838 INFO (TEST-TestReplicationHandler.doTestReplicateAfterCoreReload-seed#[FBD5B3146F444647]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2456838 INFO (TEST-TestReplicationHandler.doTestReplicateAfterCoreReload-seed#[FBD5B3146F444647]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-02-09T18:01:00.278Z
[junit4] 2> 2456838 INFO (TEST-TestReplicationHandler.doTestReplicateAfterCoreReload-seed#[FBD5B3146F444647]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_FBD5B3146F444647-001/solr-instance-001/solr.xml
[junit4] 2> 2456844 INFO (TEST-TestReplicationHandler.doTestReplicateAfterCoreReload-seed#[FBD5B3146F444647]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 2456861 INFO (TEST-TestReplicationHandler.doTestReplicateAfterCoreReload-seed#[FBD5B3146F444647]) [ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_FBD5B3146F444647-001/solr-instance-001/.
[junit4] 2> 2456861 INFO (TEST-TestReplicationHandler.doTestReplicateAfterCoreReload-seed#[FBD5B3146F444647]) [ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 2456877 INFO (coreLoadExecutor-5837-thread-1) [ x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
[junit4] 2> 2456891 INFO (coreLoadExecutor-5837-thread-1) [ x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 2456893 INFO (coreLoadExecutor-5837-thread-1) [ x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.2 with uniqueid field id
[junit4] 2> 2456894 INFO (coreLoadExecutor-5837-thread-1) [ x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_FBD5B3146F444647-001/solr-instance-001/./collection1
[junit4] 2> 2456894 INFO (coreLoadExecutor-5837-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_FBD5B3146F444647-001/solr-instance-001/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_FBD5B3146F444647-001/solr-instance-001/./collection1/data/]
[junit4] 2> 2456895 INFO (coreLoadExecutor-5837-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=330694088, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 2456919 INFO (coreLoadExecutor-5837-thread-1) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2456919 INFO (coreLoadExecutor-5837-thread-1) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2456919 INFO (coreLoadExecutor-5837-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=11, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.3696253130926449]
[junit4] 2> 2456919 INFO (coreLoadExecutor-5837-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@3797ab0d[collection1] main]
[junit4] 2> 2456919 INFO (coreLoadExecutor-5837-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_FBD5B3146F444647-001/solr-instance-001/collection1/conf
[junit4] 2> 2456920 INFO (coreLoadExecutor-5837-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Replication enabled for following config files: schema.xml,xslt/dummy.xsl
[junit4] 2> 2456920 INFO (coreLoadExecutor-5837-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 2456920 INFO (searcherExecutor-5838-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@3797ab0d[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2457159 INFO (TEST-TestReplicationHandler.doTestReplicateAfterCoreReload-seed#[FBD5B3146F444647]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_FBD5B3146F444647-001/solr-instance-002/collection1
[junit4] 2> 2457160 INFO (TEST-TestReplicationHandler.doTestReplicateAfterCoreReload-seed#[FBD5B3146F444647]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 2457161 INFO (TEST-TestReplicationHandler.doTestReplicateAfterCoreReload-seed#[FBD5B3146F444647]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2378f4e5{/solr,null,AVAILABLE}
[junit4] 2> 2457162 INFO (TEST-TestReplicationHandler.doTestReplicateAfterCoreReload-seed#[FBD5B3146F444647]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@3deea9e5{HTTP/1.1,[http/1.1]}{127.0.0.1:32842}
[junit4] 2> 2457162 INFO (TEST-TestReplicationHandler.doTestReplicateAfterCoreReload-seed#[FBD5B3146F444647]) [ ] o.e.j.s.Server Started @2460456ms
[junit4] 2> 2457162 INFO (TEST-TestReplicationHandler.doTestReplicateAfterCoreReload-seed#[FBD5B3146F444647]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_FBD5B3146F444647-001/solr-instance-002/collection1/data, hostContext=/solr, hostPort=32842}
[junit4] 2> 2457162 ERROR (TEST-TestReplicationHandler.doTestReplicateAfterCoreReload-seed#[FBD5B3146F444647]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2457162 INFO (TEST-TestReplicationHandler.doTestReplicateAfterCoreReload-seed#[FBD5B3146F444647]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 6.5.0
[junit4] 2> 2457162 INFO (TEST-TestReplicationHandler.doTestReplicateAfterCoreReload-seed#[FBD5B3146F444647]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in standalone mode on port null
[junit4] 2> 2457162 INFO (TEST-TestReplicationHandler.doTestReplicateAfterCoreReload-seed#[FBD5B3146F444647]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2457162 INFO (TEST-TestReplicationHandler.doTestReplicateAfterCoreReload-seed#[FBD5B3146F444647]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-02-09T18:01:00.602Z
[junit4] 2> 2457163 INFO (TEST-TestReplicationHandler.doTestReplicateAfterCoreReload-seed#[FBD5B3146F444647]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_FBD5B3146F444647-001/solr-instance-002/solr.xml
[junit4] 2> 2457168 INFO (TEST-TestReplicationHandler.doTestReplicateAfterCoreReload-seed#[FBD5B3146F444647]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 2457184 INFO (TEST-TestReplicationHandler.doTestReplicateAfterCoreReload-seed#[FBD5B3146F444647]) [ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_FBD5B3146F444647-001/solr-instance-002/.
[junit4] 2> 2457184 INFO (TEST-TestReplicationHandler.doTestReplicateAfterCoreReload-seed#[FBD5B3146F444647]) [ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 2457198 INFO (coreLoadExecutor-5847-thread-1) [ x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
[junit4] 2> 2457214 INFO (coreLoadExecutor-5847-thread-1) [ x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 2457216 INFO (coreLoadExecutor-5847-thread-1) [ x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.2 with uniqueid field id
[junit4] 2> 2457217 INFO (coreLoadExecutor-5847-thread-1) [ x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_FBD5B3146F444647-001/solr-instance-002/./collection1
[junit4] 2> 2457218 INFO (coreLoadExecutor-5847-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_FBD5B3146F444647-001/solr-instance-002/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_FBD5B3146F444647-001/solr-instance-002/./collection1/data/]
[junit4] 2> 2457218 INFO (coreLoadExecutor-5847-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=330694088, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 2457248 INFO (coreLoadExecutor-5847-thread-1) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2457248 INFO (coreLoadExecutor-5847-thread-1) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2457248 INFO (coreLoadExecutor-5847-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=11, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.3696253130926449]
[junit4] 2> 2457248 INFO (coreLoadExecutor-5847-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@6cd90cb5[collection1] main]
[junit4] 2> 2457248 INFO (coreLoadExecutor-5847-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_FBD5B3146F444647-001/solr-instance-002/collection1/conf
[junit4] 2> 2457250 INFO (coreLoadExecutor-5847-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 1000ms
[junit4] 2> 2457250 INFO (searcherExecutor-5848-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@6cd90cb5[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2457255 INFO (qtp831111038-71231) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
[junit4] 2> 2457255 INFO (indexFetcher-5852-thread-1) [ x:collection1] o.a.s.h.IndexFetcher Master's generation: 1
[junit4] 2> 2457255 INFO (indexFetcher-5852-thread-1) [ x:collection1] o.a.s.h.IndexFetcher Master's version: 0
[junit4] 2> 2457255 INFO (indexFetcher-5852-thread-1) [ x:collection1] o.a.s.h.IndexFetcher Slave's generation: 1
[junit4] 2> 2457478 INFO (TEST-TestReplicationHandler.doTestReplicateAfterCoreReload-seed#[FBD5B3146F444647]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@3deea9e5{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 2457478 INFO (TEST-TestReplicationHandler.doTestReplicateAfterCoreReload-seed#[FBD5B3146F444647]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1371708534
[junit4] 2> 2457479 INFO (coreCloseExecutor-5853-thread-1) [ x:collection1] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@261ac8b5
[junit4] 2> 2457480 INFO (coreCloseExecutor-5853-thread-1) [ x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.core.collection1
[junit4] 2> 2457481 INFO (TEST-TestReplicationHandler.doTestReplicateAfterCoreReload-seed#[FBD5B3146F444647]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.node
[junit4] 2> 2457481 INFO (TEST-TestReplicationHandler.doTestReplicateAfterCoreReload-seed#[FBD5B3146F444647]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@2378f4e5{/solr,null,UNAVAILABLE}
[junit4] 2> 2457483 INFO (TEST-TestReplicationHandler.doTestReplicateAfterCoreReload-seed#[FBD5B3146F444647]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@354885b2{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 2457484 INFO (TEST-TestReplicationHandler.doTestReplicateAfterCoreReload-seed#[FBD5B3146F444647]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1475147509
[junit4] 2> 2457484 INFO (coreCloseExecutor-5855-thread-1) [ x:collection1] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@128f835c
[junit4] 2> 2457485 INFO (coreCloseExecutor-5855-thread-1) [ x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.core.collection1
[junit4] 2> 2457485 INFO (TEST-TestReplicationHandler.doTestReplicateAfterCoreReload-seed#[FBD5B3146F444647]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.node
[junit4] 2> 2457486 INFO (TEST-TestReplicationHandler.doTestReplicateAfterCoreReload-seed#[FBD5B3146F444647]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@3a78a1fc{/solr,null,UNAVAILABLE}
[junit4] 2> 2457487 INFO (TEST-TestReplicationHandler.doTestReplicateAfterCoreReload-seed#[FBD5B3146F444647]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 2457488 INFO (TEST-TestReplicationHandler.doTestReplicateAfterCoreReload-seed#[FBD5B3146F444647]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@62b833f1{/solr,null,AVAILABLE}
[junit4] 2> 2457488 INFO (TEST-TestReplicationHandler.doTestReplicateAfterCoreReload-seed#[FBD5B3146F444647]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@4bb4d008{HTTP/1.1,[http/1.1]}{127.0.0.1:37368}
[junit4] 2> 2457492 INFO (TEST-TestReplicationHandler.doTestReplicateAfterCoreReload-seed#[FBD5B3146F444647]) [ ] o.e.j.s.Server Started @2460785ms
[junit4] 2> 2457492 INFO (TEST-TestReplicationHandler.doTestReplicateAfterCoreReload-seed#[FBD5B3146F444647]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_FBD5B3146F444647-001/solr-instance-001/collection1/data, hostContext=/solr, hostPort=37368}
[junit4] 2> 2457492 ERROR (TEST-TestReplicationHandler.doTestReplicateAfterCoreReload-seed#[FBD5B3146F444647]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2457492 INFO (TEST-TestReplicationHandler.doTestReplicateAfterCoreReload-seed#[FBD5B3146F444647]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 6.5.0
[junit4] 2> 2457492 INFO (TEST-TestReplicationHandler.doTestReplicateAfterCoreReload-seed#[FBD5B3146F444647]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in standalone mode on port null
[junit4] 2> 2457492 INFO (TEST-TestReplicationHandler.doTestReplicateAfterCoreReload-seed#[FBD5B3146F444647]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2457492 INFO (TEST-TestReplicationHandler.doTestReplicateAfterCoreReload-seed#[FBD5B3146F444647]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-02-09T18:01:00.932Z
[junit4] 2> 2457493 INFO (TEST-TestReplicationHandler.doTestReplicateAfterCoreReload-seed#[FBD5B3146F444647]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_FBD5B3146F444647-001/solr-instance-001/solr.xml
[junit4] 2> 2457497 INFO (TEST-TestReplicationHandler.doTestReplicateAfterCoreReload-seed#[FBD5B3146F444647]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 2457513 INFO (TEST-TestReplicationHandler.doTestReplicateAfterCoreReload-seed#[FBD5B3146F444647]) [ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_FBD5B3146F444647-001/solr-instance-001/.
[junit4] 2> 2457513 INFO (TEST-TestReplicationHandler.doTestReplicateAfterCoreReload-seed#[FBD5B3146F444647]) [ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 2457522 INFO (coreLoadExecutor-5862-thread-1) [ x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
[junit4] 2> 2457543 INFO (coreLoadExecutor-5862-thread-1) [ x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 2457544 INFO (coreLoadExecutor-5862-thread-1) [ x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.2 with uniqueid field id
[junit4] 2> 2457545 INFO (coreLoadExecutor-5862-thread-1) [ x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_FBD5B3146F444647-001/solr-instance-001/./collection1
[junit4] 2> 2457546 INFO (coreLoadExecutor-5862-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_FBD5B3146F444647-001/solr-instance-001/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_FBD5B3146F444647-001/solr-instance-001/./collection1/data/]
[junit4] 2> 2457546 INFO (coreLoadExecutor-5862-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=330694088, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 2457571 INFO (coreLoadExecutor-5862-thread-1) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2457571 INFO (coreLoadExecutor-5862-thread-1) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2457571 INFO (coreLoadExecutor-5862-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=11, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.3696253130926449]
[junit4] 2> 2457572 INFO (coreLoadExecutor-5862-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@2022da4e[collection1] main]
[junit4] 2> 2457572 INFO (coreLoadExecutor-5862-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_FBD5B3146F444647-001/solr-instance-001/collection1/conf
[junit4] 2> 2457572 INFO (coreLoadExecutor-5862-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Replication enabled for following config files: schema.xml
[junit4] 2> 2457572 INFO (coreLoadExecutor-5862-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 2457573 INFO (searcherExecutor-5863-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@2022da4e[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2457807 INFO (qtp77249713-71271) [ x:collection1] o.a.s.u.DirectUpdateHandler2 [collection1] REMOVING ALL DOCUMENTS FROM INDEX
[junit4] 2> 2457807 INFO (qtp77249713-71271) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{deleteByQuery=*:*} 0 0
[junit4] 2> 2457810 INFO (qtp77249713-71272) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[0]} 0 0
[junit4] 2> 2457812 INFO (qtp77249713-71273) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[1]} 0 0
[junit4] 2> 2457813 INFO (qtp77249713-71274) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[2]} 0 0
[junit4] 2> 2457815 INFO (qtp77249713-71275) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[3]} 0 0
[junit4] 2> 2457816 INFO (qtp77249713-71268) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[4]} 0 0
[junit4] 2> 2457818 INFO (qtp77249713-71271) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[5]} 0 0
[junit4] 2> 2457819 INFO (qtp77249713-71271) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[6]} 0 0
[junit4] 2> 2457821 INFO (qtp77249713-71273) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[7]} 0 0
[junit4] 2> 2457823 INFO (qtp77249713-71274) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[8]} 0 0
[junit4] 2> 2457824 INFO (qtp77249713-71274) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[9]} 0 0
[junit4] 2> 2457826 INFO (qtp77249713-71274) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[10]} 0 0
[junit4] 2> 2457827 INFO (qtp77249713-71272) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[11]} 0 0
[junit4] 2> 2457829 INFO (qtp77249713-71271) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[12]} 0 0
[junit4] 2> 2457831 INFO (qtp77249713-71273) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[13]} 0 0
[junit4] 2> 2457832 INFO (qtp77249713-71275) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[14]} 0 0
[junit4] 2> 2457834 INFO (qtp77249713-71275) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[15]} 0 0
[junit4] 2> 2457836 INFO (qtp77249713-71274) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[16]} 0 0
[junit4] 2> 2457837 INFO (qtp77249713-71272) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[17]} 0 0
[junit4] 2> 2457839 INFO (qtp77249713-71271) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[18]} 0 0
[junit4] 2> 2457840 INFO (qtp77249713-71273) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[19]} 0 0
[junit4] 2> 2457842 INFO (qtp77249713-71268) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[20]} 0 0
[junit4] 2> 2457843 INFO (qtp77249713-71268) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[21]} 0 0
[junit4] 2> 2457845 INFO (qtp77249713-71274) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[22]} 0 0
[junit4] 2> 2457846 INFO (qtp77249713-71272) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[23]} 0 0
[junit4] 2> 2457848 INFO (qtp77249713-71272) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[24]} 0 0
[junit4] 2> 2457849 INFO (qtp77249713-71273) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[25]} 0 0
[junit4] 2> 2457851 INFO (qtp77249713-71275) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[26]} 0 0
[junit4] 2> 2457852 INFO (qtp77249713-71268) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[27]} 0 0
[junit4] 2> 2457854 INFO (qtp77249713-71274) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[28]} 0 0
[junit4] 2> 2457855 INFO (qtp77249713-71271) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[29]} 0 0
[junit4] 2> 2457857 INFO (qtp77249713-71272) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[30]} 0 0
[junit4] 2> 2457858 INFO (qtp77249713-71273) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[31]} 0 0
[junit4] 2> 2457860 INFO (qtp77249713-71275) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[32]} 0 0
[junit4] 2> 2457861 INFO (qtp77249713-71268) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[33]} 0 0
[junit4] 2> 2457862 INFO (qtp77249713-71274) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[34]} 0 0
[junit4] 2> 2457864 INFO (qtp77249713-71271) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[35]} 0 0
[junit4] 2> 2457865 INFO (qtp77249713-71272) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[36]} 0 0
[junit4] 2> 2457867 INFO (qtp77249713-71273) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[37]} 0 0
[junit4] 2> 2457868 INFO (qtp77249713-71273) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[38]} 0 0
[junit4] 2> 2457870 INFO (qtp77249713-71273) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[39]} 0 0
[junit4] 2> 2457871 INFO (qtp77249713-71273) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[40]} 0 0
[junit4] 2> 2457873 INFO (qtp77249713-71271) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[41]} 0 0
[junit4] 2> 2457874 INFO (qtp77249713-71272) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[42]} 0 0
[junit4] 2> 2457876 INFO (qtp77249713-71272) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[43]} 0 0
[junit4] 2> 2457877 INFO (qtp77249713-71268) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[44]} 0 0
[junit4] 2> 2457878 INFO (qtp77249713-71274) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[45]} 0 0
[junit4] 2> 2457880 INFO (qtp77249713-71273) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[46]} 0 0
[junit4] 2> 2457881 INFO (qtp77249713-71271) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[47]} 0 0
[junit4] 2> 2457882 INFO (qtp77249713-71275) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[48]} 0 0
[junit4] 2> 2457884 INFO (qtp77249713-71272) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[49]} 0 0
[junit4] 2> 2457885 INFO (qtp77249713-71268) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[50]} 0 0
[junit4] 2> 2457887 INFO (qtp77249713-71274) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[51]} 0 0
[junit4] 2> 2457888 INFO (qtp77249713-71273) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[52]} 0 0
[junit4] 2> 2457890 INFO (qtp77249713-71271) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[53]} 0 0
[junit4] 2> 2457891 INFO (qtp77249713-71275) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[54]} 0 0
[junit4] 2> 2457892 INFO (qtp77249713-71272) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[55]} 0 0
[junit4] 2> 2457894 INFO (qtp77249713-71268) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[56]} 0 0
[junit4] 2> 2457895 INFO (qtp77249713-71274) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[57]} 0 0
[junit4] 2> 2457897 INFO (qtp77249713-71273) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[58]} 0 0
[junit4] 2> 2457898 INFO (qtp77249713-71271) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[59]} 0 0
[junit4] 2> 2457900 INFO (qtp77249713-71275) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[60]} 0 0
[junit4] 2> 2457901 INFO (qtp77249713-71272) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[61]} 0 0
[junit4] 2> 2457902 INFO (qtp77249713-71268) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[62]} 0 0
[junit4] 2> 2457904 INFO (qtp77249713-71274) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[63]} 0 0
[junit4] 2> 2457905 INFO (qtp77249713-71273) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[64]} 0 0
[junit4] 2> 2457907 INFO (qtp77249713-71271) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[65]} 0 0
[junit4] 2> 2457908 INFO (qtp77249713-71275) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[66]} 0 0
[junit4] 2> 2457910 INFO (qtp77249713-71272) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[67]} 0 0
[junit4] 2> 2457911 INFO (qtp77249713-71272) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[68]} 0 0
[junit4] 2> 2457912 INFO (qtp77249713-71274) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[69]} 0 0
[junit4] 2> 2457914 INFO (qtp77249713-71273) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[70]} 0 0
[junit4] 2> 2457915 INFO (qtp77249713-71271) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[71]} 0 0
[junit4] 2> 2457917 INFO (qtp77249713-71275) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[72]} 0 0
[junit4] 2> 2457918 INFO (qtp77249713-71268) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[73]} 0 0
[junit4] 2> 2457919 INFO (qtp77249713-71272) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[74]} 0 0
[junit4] 2> 2457921 INFO (qtp77249713-71274) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[75]} 0 0
[junit4] 2> 2457922 INFO (qtp77249713-71273) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[76]} 0 0
[junit4] 2> 2457924 INFO (qtp77249713-71273) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[77]} 0 0
[junit4] 2> 2457925 INFO (qtp77249713-71275) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[78]} 0 0
[junit4] 2> 2457926 INFO (qtp77249713-71268) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[79]} 0 0
[junit4] 2> 2457928 INFO (qtp77249713-71272) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[80]} 0 0
[junit4] 2> 2457929 INFO (qtp77249713-71274) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[81]} 0 0
[junit4] 2> 2457930 INFO (qtp77249713-71271) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[82]} 0 0
[junit4] 2> 2457932 INFO (qtp77249713-71273) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[83]} 0 0
[junit4] 2> 2457933 INFO (qtp77249713-71275) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[84]} 0 0
[junit4] 2> 2457935 INFO (qtp77249713-71268) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[85]} 0 0
[junit4] 2> 2457936 INFO (qtp77249713-71272) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[86]} 0 0
[junit4] 2> 2457938 INFO (qtp77249713-71274) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[87]} 0 0
[junit4] 2> 2457939 INFO (qtp77249713-71271) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[88]} 0 0
[junit4] 2> 2457940 INFO (qtp77249713-71273) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[89]} 0 0
[junit4] 2> 2457942 INFO (qtp77249713-71275) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[90]} 0 0
[junit4] 2> 2457943 INFO (qtp77249713-71268) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[91]} 0 0
[junit4] 2> 2457945 INFO (qtp77249713-71272) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[92]} 0 0
[junit4] 2> 2457946 INFO (qtp77249713-71274) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[93]} 0 0
[junit4] 2> 2457947 INFO (qtp77249713-71271) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[94]} 0 0
[junit4] 2> 2457949 INFO (qtp77249713-71273) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[95]} 0 0
[junit4] 2> 2457950 INFO (qtp77249713-71275) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[96]} 0 0
[junit4] 2> 2457952 INFO (qtp77249713-71268) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[97]} 0 0
[junit4] 2> 2457953 INFO (qtp77249713-71272) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[98]} 0 0
[junit4] 2> 2457954 INFO (qtp77249713-71274) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[99]} 0 0
[junit4] 2> 2457956 INFO (qtp77249713-71271) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[100]} 0 0
[junit4] 2> 2457957 INFO (qtp77249713-71273) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[101]} 0 0
[junit4] 2> 2457959 INFO (qtp77249713-71275) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[102]} 0 0
[junit4] 2> 2457960 INFO (qtp77249713-71268) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[103]} 0 0
[junit4] 2> 2457961 INFO (qtp77249713-71272) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[104]} 0 0
[junit4] 2> 2457963 INFO (qtp77249713-71274) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[105]} 0 0
[junit4] 2> 2457964 INFO (qtp77249713-71271) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[106]} 0 0
[junit4] 2> 2457966 INFO (qtp77249713-71273) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[107]} 0 0
[junit4] 2> 2457967 INFO (qtp77249713-71275) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[108]} 0 0
[junit4] 2> 2457968 INFO (qtp77249713-71268) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[109]} 0 0
[junit4] 2> 2457970 INFO (qtp77249713-71272) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[110]} 0 0
[junit4] 2> 2457971 INFO (qtp77249713-71274) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[111]} 0 0
[junit4] 2> 2457973 INFO (qtp77249713-71271) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[112]} 0 0
[junit4] 2> 2457974 INFO (qtp77249713-71273) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[113]} 0 0
[junit4] 2> 2457975 INFO (qtp77249713-71275) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[114]} 0 0
[junit4] 2> 2457977 INFO (qtp77249713-71268) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[115]} 0 0
[junit4] 2> 2457978 INFO (qtp77249713-71272) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[116]} 0 0
[junit4] 2> 2457980 INFO (qtp77249713-71274) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[117]} 0 0
[junit4] 2> 2457981 INFO (qtp77249713-71271) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[118]} 0 0
[junit4] 2> 2457983 INFO (qtp77249713-71273) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[119]} 0 0
[junit4] 2> 2457984 INFO (qtp77249713-71275) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[120]} 0 0
[junit4] 2> 2457985 INFO (qtp77249713-71268) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[121]} 0 0
[junit4] 2> 2457987 INFO (qtp77249713-71272) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[122]} 0 0
[junit4] 2> 2457988 INFO (qtp77249713-71274) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[123]} 0 0
[junit4] 2> 2457990 INFO (qtp77249713-71274) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[124]} 0 0
[junit4] 2> 2457991 INFO (qtp77249713-71273) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[125]} 0 0
[junit4] 2> 2457992 INFO (qtp77249713-71275) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[126]} 0 0
[junit4] 2> 2457994 INFO (qtp77249713-71268) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[127]} 0 0
[junit4] 2> 2457995 INFO (qtp77249713-71272) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[128]} 0 0
[junit4] 2> 2457997 INFO (qtp77249713-71271) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[129]} 0 0
[junit4] 2> 2457998 INFO (qtp77249713-71274) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[130]} 0 0
[junit4] 2> 2458000 INFO (qtp77249713-71273) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[131]} 0 0
[junit4] 2> 2458001 INFO (qtp77249713-71275) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[132]} 0 0
[junit4] 2> 2458002 INFO (qtp77249713-71268) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[133]} 0 0
[junit4] 2> 2458004 INFO (qtp77249713-71272) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[134]} 0 0
[junit4] 2> 2458005 INFO (qtp77249713-71271) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[135]} 0 0
[junit4] 2> 2458007 INFO (qtp77249713-71274) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[136]} 0 0
[junit4] 2> 2458008 INFO (qtp77249713-71273) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[137]} 0 0
[junit4] 2> 2458009 INFO (qtp77249713-71275) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[138]} 0 0
[junit4] 2> 2458011 INFO (qtp77249713-71268) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[139]} 0 0
[junit4] 2> 2458012 INFO (qtp77249713-71272) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[140]} 0 0
[junit4] 2> 2458014 INFO (qtp77249713-71271) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[141]} 0 0
[junit4] 2> 2458015 INFO (qtp77249713-71274) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[142]} 0 0
[junit4] 2> 2458016 INFO (qtp77249713-71273) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[143]} 0 0
[junit4] 2> 2458018 INFO (qtp77249713-71275) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[144]} 0 0
[junit4] 2> 2458020 INFO (qtp77249713-71268) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[145]} 0 0
[junit4] 2> 2458021 INFO (qtp77249713-71272) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[146]} 0 0
[junit4] 2> 2458022 INFO (qtp77249713-71271) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[147]} 0 0
[junit4] 2> 2458024 INFO (qtp77249713-71274) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[148]} 0 0
[junit4] 2> 2458025 INFO (qtp77249713-71273) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[149]} 0 0
[junit4] 2> 2458027 INFO (qtp77249713-71275) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[150]} 0 0
[junit4] 2> 2458028 INFO (qtp77249713-71268) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[151]} 0 0
[junit4] 2> 2458029 INFO (qtp77249713-71272) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[152]} 0 0
[junit4] 2> 2458031 INFO (qtp77249713-71271) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[153]} 0 0
[junit4] 2> 2458032 INFO (qtp77249713-71274) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[154]} 0 0
[junit4] 2> 2458034 INFO (qtp77249713-71273) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[155]} 0 0
[junit4] 2> 2458035 INFO (qtp77249713-71275) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[156]} 0 0
[junit4] 2> 2458036 INFO (qtp77249713-71268) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[157]} 0 0
[junit4] 2> 2458038 INFO (qtp77249713-71272) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[158]} 0 0
[junit4] 2> 2458039 INFO (qtp77249713-71271) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[159]} 0 0
[junit4] 2> 2458041 INFO (qtp77249713-71274) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[160]} 0 0
[junit4] 2> 2458042 INFO (qtp77249713-71273) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[161]} 0 0
[junit4] 2> 2458044 INFO (qtp77249713-71275) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[162]} 0 0
[junit4] 2> 2458045 INFO (qtp77249713-71268) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[163]} 0 0
[junit4] 2> 2458046 INFO (qtp77249713-71272) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[164]} 0 0
[junit4] 2> 2458048 INFO (qtp77249713-71271) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[165]} 0 0
[junit4] 2> 2458049 INFO (qtp77249713-71274) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[166]} 0 0
[junit4] 2> 2458051 INFO (qtp77249713-71273) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[167]} 0 0
[junit4] 2> 2458052 INFO (qtp77249713-71275) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[168]} 0 0
[junit4] 2> 2458054 INFO (qtp77249713-71268) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[169]} 0 0
[junit4] 2> 2458055 INFO (qtp77249713-71272) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[170]} 0 0
[junit4] 2> 2458056 INFO (qtp77249713-71271) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[171]} 0 0
[junit4] 2> 2458058 INFO (qtp77249713-71274) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[172]} 0 0
[junit4] 2> 2458059 INFO (qtp77249713-71273) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[173]} 0 0
[junit4] 2> 2458061 INFO (qtp77249713-71275) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[174]} 0 0
[junit4] 2> 2458062 INFO (qtp77249713-71268) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[175]} 0 0
[junit4] 2> 2458064 INFO (qtp77249713-71272) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[176]} 0 0
[junit4] 2> 2458065 INFO (qtp77249713-71271) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[177]} 0 0
[junit4] 2> 2458067 INFO (qtp77249713-71274) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[178]} 0 0
[junit4] 2> 2458068 INFO (qtp77249713-71273) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[179]} 0 0
[junit4] 2> 2458069 INFO (qtp77249713-71275) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[180]} 0 0
[junit4] 2> 2458071 INFO (qtp77249713-71268) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[181]} 0 0
[junit4] 2> 2458072 INFO (qtp77249713-71272) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[182]} 0 0
[junit4] 2> 2458074 INFO (qtp77249713-71271) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[183]} 0 0
[junit4] 2> 2458075 INFO (qtp77249713-71271) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[184]} 0 0
[junit4] 2> 2458077 INFO (qtp77249713-71273) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[185]} 0 0
[junit4] 2> 2458078 INFO (qtp77249713-71275) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[186]} 0 0
[junit4] 2> 2458080 INFO (qtp77249713-71268) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[187]} 0 0
[junit4] 2> 2458081 INFO (qtp77249713-71272) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[188]} 0 0
[junit4] 2> 2458083 INFO (qtp77249713-71274) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[189]} 0 0
[junit4] 2> 2458084 INFO (qtp77249713-71271) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[190]} 0 0
[junit4] 2> 2458086 INFO (qtp77249713-71273) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[191]} 0 0
[junit4] 2> 2458088 INFO (qtp77249713-71275) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[192]} 0 0
[junit4] 2> 2458089 INFO (qtp77249713-71268) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[193]} 0 0
[junit4] 2> 2458091 INFO (qtp77249713-71272) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[194]} 0 0
[junit4] 2> 2458092 INFO (qtp77249713-71274) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[195]} 0 0
[junit4] 2> 2458094 INFO (qtp77249713-71271) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[196]} 0 0
[junit4] 2> 2458095 INFO (qtp77249713-71273) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[197]} 0 0
[junit4] 2> 2458097 INFO (qtp77249713-71275) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[198]} 0 0
[junit4] 2> 2458098 INFO (qtp77249713-71268) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[199]} 0 0
[junit4] 2> 2458100 INFO (qtp77249713-71272) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[200]} 0 0
[junit4] 2> 2458101 INFO (qtp77249713-71274) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[201]} 0 0
[junit4] 2> 2458103 INFO (qtp77249713-71271) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[202]} 0 0
[junit4] 2> 2458104 INFO (qtp77249713-71273) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[203]} 0 0
[junit4] 2> 2458106 INFO (qtp77249713-71275) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[204]} 0 0
[junit4] 2> 2458107 INFO (qtp77249713-71275) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[205]} 0 0
[junit4] 2> 2458109 INFO (qtp77249713-71272) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[206]} 0 0
[junit4] 2> 2458110 INFO (qtp77249713-71274) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[207]} 0 0
[junit4] 2> 2458112 INFO (qtp77249713-71271) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[208]} 0 0
[junit4] 2> 2458113 INFO (qtp77249713-71273) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[209]} 0 0
[junit4] 2> 2458115 INFO (qtp77249713-71268) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[210]} 0 0
[junit4] 2> 2458116 INFO (qtp77249713-71275) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[211]} 0 0
[junit4] 2> 2458118 INFO (qtp77249713-71272) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[212]} 0 0
[junit4] 2> 2458119 INFO (qtp77249713-71274) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[213]} 0 0
[junit4] 2> 2458121 INFO (qtp77249713-71274) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[214]} 0 0
[junit4] 2> 2458122 INFO (qtp77249713-71273) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[215]} 0 0
[junit4] 2> 2458124 INFO (qtp77249713-71268) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[216]} 0 0
[junit4] 2> 2458125 INFO (qtp77249713-71275) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[217]} 0 0
[junit4] 2> 2458127 INFO (qtp77249713-71272) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[218]} 0 0
[junit4] 2> 2458129 INFO (qtp77249713-71271) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[219]} 0 0
[junit4] 2> 2458130 INFO (qtp77249713-71274) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[220]} 0 0
[junit4] 2> 2458131 INFO (qtp77249713-71273) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[221]} 0 0
[junit4] 2> 2458133 INFO (qtp77249713-71268) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[222]} 0 0
[junit4] 2> 2458134 INFO (qtp77249713-71275) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[223]} 0 0
[junit4] 2> 2458136 INFO (qtp77249713-71272) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[224]} 0 0
[junit4] 2> 2458137 INFO (qtp77249713-71271) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[225]} 0 0
[junit4] 2> 2458139 INFO (qtp77249713-71274) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[226]} 0 0
[junit4] 2> 2458140 INFO (qtp77249713-71273) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[227]} 0 0
[junit4] 2> 2458142 INFO (qtp77249713-71268) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[228]} 0 0
[junit4] 2> 2458143 INFO (qtp77249713-71275) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[229]} 0 0
[junit4] 2> 2458145 INFO (qtp77249713-71272) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[230]} 0 0
[junit4] 2> 2458146 INFO (qtp77249713-71271) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[231]} 0 0
[junit4] 2> 2458148 INFO (qtp77249713-71274) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[232]} 0 0
[junit4] 2> 2458149 INFO (qtp77249713-71273) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[233]} 0 0
[junit4] 2> 2458151 INFO (qtp77249713-71268) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[234]} 0 0
[junit4] 2> 2458152 INFO (qtp77249713-71275) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[235]} 0 0
[junit4] 2> 2458154 INFO (qtp77249713-71272) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[236]} 0 0
[junit4] 2> 2458155 INFO (qtp77249713-71271) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[237]} 0 0
[junit4] 2> 2458156 INFO (qtp77249713-71274) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[238]} 0 0
[junit4] 2> 2458158 INFO (qtp77249713-71273) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[239]} 0 0
[junit4] 2> 2458159 INFO (qtp77249713-71268) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[240]} 0 0
[junit4] 2> 2458161 INFO (qtp77249713-71275) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[241]} 0 0
[junit4] 2> 2458162 INFO (qtp77249713-71272) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[242]} 0 0
[junit4] 2> 2458164 INFO (qtp77249713-71271) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[243]} 0 0
[junit4] 2> 2458165 INFO (qtp77249713-71274) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[244]} 0 0
[junit4] 2> 2458166 INFO (qtp77249713-71273) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[245]} 0 0
[junit4] 2> 2458168 INFO (qtp77249713-71268) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[246]} 0 0
[junit4] 2> 2458169 INFO (qtp77249713-71275) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[247]} 0 0
[junit4] 2> 2458171 INFO (qtp77249713-71272) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[248]} 0 0
[junit4] 2> 2458172 INFO (qtp77249713-71271) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[249]} 0 0
[junit4] 2> 2458174 INFO (qtp77249713-71274) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[250]} 0 0
[junit4] 2> 2458175 INFO (qtp77249713-71274) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[251]} 0 0
[junit4] 2> 2458177 INFO (qtp77249713-71268) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[252]} 0 0
[junit4] 2> 2458178 INFO (qtp77249713-71275) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[253]} 0 0
[junit4] 2> 2458180 INFO (qtp77249713-71272) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[254]} 0 0
[junit4] 2> 2458181 INFO (qtp77249713-71271) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[255]} 0 0
[junit4] 2> 2458183 INFO (qtp77249713-71273) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[256]} 0 0
[junit4] 2> 2458184 INFO (qtp77249713-71274) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[257]} 0 0
[junit4] 2> 2458186 INFO (qtp77249713-71268) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[258]} 0 0
[junit4] 2> 2458187 INFO (qtp77249713-71275) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[259]} 0 0
[junit4] 2> 2458189 INFO (qtp77249713-71272) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[260]} 0 0
[junit4] 2> 2458190 INFO (qtp77249713-71271) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[261]} 0 0
[junit4] 2> 2458192 INFO (qtp77249713-71273) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[262]} 0 0
[junit4] 2> 2458193 INFO (qtp77249713-71274) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[263]} 0 0
[junit4] 2> 2458195 INFO (qtp77249713-71268) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[264]} 0 0
[junit4] 2> 2458196 INFO (qtp77249713-71275) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[265]} 0 0
[junit4] 2> 2458197 INFO (qtp77249713-71272) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[266]} 0 0
[junit4] 2> 2458199 INFO (qtp77249713-71271) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[267]} 0 0
[junit4] 2> 2458200 INFO (qtp77249713-71273) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[268]} 0 0
[junit4] 2> 2458202 INFO (qtp77249713-71274) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[269]} 0 0
[junit4] 2> 2458203 INFO (qtp77249713-71268) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[270]} 0 0
[junit4] 2> 2458204 INFO (qtp77249713-71275) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[271]} 0 0
[junit4] 2> 2458206 INFO (qtp77249713-71272) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[272]} 0 0
[junit4] 2> 2458207 INFO (qtp77249713-71272) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[273]} 0 0
[junit4] 2> 2458209 INFO (qtp77249713-71273) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[274]} 0 0
[junit4] 2> 2458211 INFO (qtp77249713-71274) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[275]} 0 0
[junit4] 2> 2458212 INFO (qtp77249713-71268) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[276]} 0 0
[junit4] 2> 2458214 INFO (qtp77249713-71275) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[277]} 0 0
[junit4] 2> 2458215 INFO (qtp77249713-71271) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[278]} 0 0
[junit4] 2> 2458216 INFO (qtp77249713-71272) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[279]} 0 0
[junit4] 2> 2458218 INFO (qtp77249713-71273) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[280]} 0 0
[junit4] 2> 2458219 INFO (qtp77249713-71274) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[281]} 0 0
[junit4] 2> 2458221 INFO (qtp77249713-71268) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[282]} 0 0
[junit4] 2> 2458222 INFO (qtp77249713-71275) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[283]} 0 0
[junit4] 2> 2458224 INFO (qtp77249713-71271) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[284]} 0 0
[junit4] 2> 2458225 INFO (qtp77249713-71272) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[285]} 0 0
[junit4] 2> 2458227 INFO (qtp77249713-71273) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[286]} 0 0
[junit4] 2> 2458228 INFO (qtp77249713-71274) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[287]} 0 0
[junit4] 2> 2458229 INFO (qtp77249713-71268) [ x:coll
[...truncated too long message...]
:79)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.getMetrics(MetricsSourceAdapter.java:194)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.updateJmxCache(MetricsSourceAdapter.java:172)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.getMBeanInfo(MetricsSourceAdapter.java:151)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getClassName(DefaultMBeanServerInterceptor.java:1804)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.safeGetClassName(DefaultMBeanServerInterceptor.java:1595)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.checkMBeanPermission(DefaultMBeanServerInterceptor.java:1813)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.exclusiveUnregisterMBean(DefaultMBeanServerInterceptor.java:430)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.unregisterMBean(DefaultMBeanServerInterceptor.java:415)
[junit4] 2> at com.sun.jmx.mbeanserver.JmxMBeanServer.unregisterMBean(JmxMBeanServer.java:546)
[junit4] 2> at org.apache.hadoop.metrics2.util.MBeans.unregister(MBeans.java:81)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stopMBeans(MetricsSourceAdapter.java:226)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stop(MetricsSourceAdapter.java:211)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stopSources(MetricsSystemImpl.java:463)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stop(MetricsSystemImpl.java:213)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.shutdown(MetricsSystemImpl.java:594)
[junit4] 2> at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdownInstance(DefaultMetricsSystem.java:72)
[junit4] 2> at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdown(DefaultMetricsSystem.java:68)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.metrics.NameNodeMetrics.shutdown(NameNodeMetrics.java:171)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.NameNode.stop(NameNode.java:872)
[junit4] 2> at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1726)
[junit4] 2> at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1705)
[junit4] 2> at org.apache.solr.cloud.hdfs.HdfsTestUtil.teardownClass(HdfsTestUtil.java:198)
[junit4] 2> at org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest.teardownClass(HdfsWriteToMultipleCollectionsTest.java:73)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:498)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:870)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> Caused by: java.lang.NullPointerException
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlocksMap.size(BlocksMap.java:203)
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.getTotalBlocks(BlockManager.java:3370)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlocksTotal(FSNamesystem.java:5729)
[junit4] 2> ... 53 more
[junit4] 2> 4338336 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[FBD5B3146F444647]-worker) [ ] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_FBD5B3146F444647-001
[junit4] 2> Feb 09, 2017 6:32:22 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 34 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene62): {rnd_b=PostingsFormat(name=LuceneFixedGap), _version_=PostingsFormat(name=Asserting), a_t=PostingsFormat(name=Asserting), a_i=PostingsFormat(name=LuceneFixedGap), id=PostingsFormat(name=LuceneFixedGap)}, docValues:{}, maxPointsInLeafNode=1699, maxMBSortInHeap=5.136250123701682, sim=RandomSimilarity(queryNorm=false,coord=no): {}, locale=ga-IE, timezone=Pacific/Fiji
[junit4] 2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_102 (64-bit)/cpus=4,threads=2,free=282602976,total=534773760
[junit4] 2> NOTE: All tests run in this JVM: [TestConfigSets, MultiTermTest, TestSchemaSimilarityResource, WrapperMergePolicyFactoryTest, MigrateRouteKeyTest, MoreLikeThisHandlerTest, TestSolrConfigHandlerCloud, TestManagedResource, LeaderFailureAfterFreshStartTest, WordBreakSolrSpellCheckerTest, TestMacroExpander, DirectSolrConnectionTest, TestManagedStopFilterFactory, ZkCLITest, TestStressVersions, TestFuzzyAnalyzedSuggestions, SearchHandlerTest, TestExportWriter, TestRecoveryHdfs, TestExactSharedStatsCache, DistributedFacetPivotSmallAdvancedTest, HttpSolrCallGetCoreTest, DeleteShardTest, TestSimpleTrackingShardHandler, TermsComponentTest, OutOfBoxZkACLAndCredentialsProvidersTest, TestLMDirichletSimilarityFactory, DocValuesTest, TestSolrXml, CSVRequestHandlerTest, TestAnalyzeInfixSuggestions, CopyFieldTest, TestSolrCLIRunExample, OpenCloseCoreStressTest, HighlighterMaxOffsetTest, TestSurroundQueryParser, TestCollationFieldDocValues, ChaosMonkeySafeLeaderTest, TestSearchPerf, V2ApiIntegrationTest, HdfsDirectoryFactoryTest, TestUpdate, SolrInfoMBeanTest, TestRawTransformer, TestNoOpRegenerator, TestLuceneMatchVersion, SystemInfoHandlerTest, SuggesterFSTTest, TestQueryTypes, TestFieldCollectionResource, SolrIndexSplitterTest, TestHdfsUpdateLog, TestDistributedGrouping, TestRestoreCore, SecurityConfHandlerTest, TestStressLiveNodes, CdcrReplicationDistributedZkTest, TestClusterStateMutator, TolerantUpdateProcessorTest, DistribDocExpirationUpdateProcessorTest, ClassificationUpdateProcessorTest, LoggingHandlerTest, IndexSchemaRuntimeFieldTest, HdfsUnloadDistributedZkTest, DistributedFacetExistsSmallTest, FileUtilsTest, CoreMergeIndexesAdminHandlerTest, ActionThrottleTest, TestSolrIndexConfig, DocumentBuilderTest, AnalyticsQueryTest, TestShortCircuitedRequests, BlockDirectoryTest, ShardRoutingCustomTest, PreAnalyzedFieldManagedSchemaCloudTest, RAMDirectoryFactoryTest, SortByFunctionTest, TestUninvertingReader, DirectSolrSpellCheckerTest, TestCloudPseudoReturnFields, TestShardHandlerFactory, ShardRoutingTest, HdfsRecoverLeaseTest, TestSolrQueryParserDefaultOperatorResource, DateMathParserTest, TestFilteredDocIdSet, TestLRUCache, CreateCollectionCleanupTest, JsonLoaderTest, TestCoreContainer, BasicAuthIntegrationTest, SimpleMLTQParserTest, DeleteLastCustomShardedReplicaTest, DistributedVersionInfoTest, TestRebalanceLeaders, TestHashPartitioner, DocValuesMissingTest, TestFieldTypeResource, SpellingQueryConverterTest, TestDefaultSearchFieldResource, TestDelegationWithHadoopAuth, TestQueryUtils, SolrCloudExampleTest, TestFastOutputStream, OverseerTaskQueueTest, TestCharFilters, CloudExitableDirectoryReaderTest, DistributedTermsComponentTest, CollectionsAPIDistributedZkTest, BlobRepositoryCloudTest, TestCloudDeleteByQuery, BlockJoinFacetSimpleTest, TestEmbeddedSolrServerConstructors, TestCollectionAPI, SpellCheckComponentTest, RecoveryAfterSoftCommitTest, RollingRestartTest, TriLevelCompositeIdRoutingTest, HdfsBasicDistributedZk2Test, HdfsChaosMonkeySafeLeaderTest, HdfsRecoveryZkTest, HdfsRestartWhileUpdatingTest, HdfsWriteToMultipleCollectionsTest]
[junit4] Completed [537/690 (2!)] on J1 in 48.67s, 1 test, 1 failure <<< FAILURES!
[...truncated 62961 lines...]
[JENKINS] Lucene-Solr-NightlyTests-6.x - Build # 277 - Still
unstable
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.x/277/
4 tests failed.
FAILED: org.apache.solr.cloud.CdcrReplicationDistributedZkTest.testReplicationAfterRestart
Error Message:
Timeout waiting for CDCR replication to complete @source_collection:shard2
Stack Trace:
java.lang.RuntimeException: Timeout waiting for CDCR replication to complete @source_collection:shard2
at __randomizedtesting.SeedInfo.seed([C4CB6E434FA11BEE:98D689C28181AFD8]:0)
at org.apache.solr.cloud.BaseCdcrDistributedZkTest.waitForReplicationToComplete(BaseCdcrDistributedZkTest.java:795)
at org.apache.solr.cloud.CdcrReplicationDistributedZkTest.testReplicationAfterRestart(CdcrReplicationDistributedZkTest.java:236)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR
Error Message:
There are still nodes recoverying - waited for 330 seconds
Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 330 seconds
at __randomizedtesting.SeedInfo.seed([C4CB6E434FA11BEE:1A41003E7403791D]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:187)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:144)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:139)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:856)
at org.apache.solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR(LeaderInitiatedRecoveryOnShardRestartTest.java:158)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
FAILED: junit.framework.TestSuite.org.apache.solr.handler.TestReplicationHandler
Error Message:
ObjectTracker found 1 object(s) that were not released!!! [NRTCachingDirectory] org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:43) at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:347) at org.apache.solr.core.MetricsDirectoryFactory.get(MetricsDirectoryFactory.java:201) at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:367) at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:249) at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:399) at org.apache.solr.handler.ReplicationHandler.lambda$handleRequestBody$0(ReplicationHandler.java:281) at java.lang.Thread.run(Thread.java:745)
Stack Trace:
java.lang.AssertionError: ObjectTracker found 1 object(s) that were not released!!! [NRTCachingDirectory]
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException
at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:43)
at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:347)
at org.apache.solr.core.MetricsDirectoryFactory.get(MetricsDirectoryFactory.java:201)
at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:367)
at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:249)
at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:399)
at org.apache.solr.handler.ReplicationHandler.lambda$handleRequestBody$0(ReplicationHandler.java:281)
at java.lang.Thread.run(Thread.java:745)
at __randomizedtesting.SeedInfo.seed([C4CB6E434FA11BEE]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNull(Assert.java:551)
at org.apache.solr.SolrTestCaseJ4.teardownTestCases(SolrTestCaseJ4.java:269)
at sun.reflect.GeneratedMethodAccessor35.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:870)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest.test
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([C4CB6E434FA11BEE:4C9F5199E15D7616]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertTrue(Assert.java:54)
at org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest.test(HdfsWriteToMultipleCollectionsTest.java:137)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 12466 lines...]
[junit4] Suite: org.apache.solr.handler.TestReplicationHandler
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_C4CB6E434FA11BEE-001/init-core-data-001
[junit4] 2> 2152813 INFO (SUITE-TestReplicationHandler-seed#[C4CB6E434FA11BEE]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=None)
[junit4] 2> 2152815 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[C4CB6E434FA11BEE]) [ ] o.a.s.SolrTestCaseJ4 ###Starting doTestDetails
[junit4] 2> 2152815 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[C4CB6E434FA11BEE]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_C4CB6E434FA11BEE-001/solr-instance-001/collection1
[junit4] 2> 2152817 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[C4CB6E434FA11BEE]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 2152819 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[C4CB6E434FA11BEE]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@54baeab2{/solr,null,AVAILABLE}
[junit4] 2> 2152821 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[C4CB6E434FA11BEE]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@35b2bb4d{HTTP/1.1,[http/1.1]}{127.0.0.1:41811}
[junit4] 2> 2152821 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[C4CB6E434FA11BEE]) [ ] o.e.j.s.Server Started @2156726ms
[junit4] 2> 2152821 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[C4CB6E434FA11BEE]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_C4CB6E434FA11BEE-001/solr-instance-001/collection1/data, hostContext=/solr, hostPort=41811}
[junit4] 2> 2152822 ERROR (TEST-TestReplicationHandler.doTestDetails-seed#[C4CB6E434FA11BEE]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2152822 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[C4CB6E434FA11BEE]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 6.5.0
[junit4] 2> 2152822 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[C4CB6E434FA11BEE]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in standalone mode on port null
[junit4] 2> 2152822 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[C4CB6E434FA11BEE]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2152822 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[C4CB6E434FA11BEE]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-02-08T23:23:00.577Z
[junit4] 2> 2152823 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[C4CB6E434FA11BEE]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_C4CB6E434FA11BEE-001/solr-instance-001/solr.xml
[junit4] 2> 2152830 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[C4CB6E434FA11BEE]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 2152848 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[C4CB6E434FA11BEE]) [ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_C4CB6E434FA11BEE-001/solr-instance-001/.
[junit4] 2> 2152848 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[C4CB6E434FA11BEE]) [ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 2152863 INFO (coreLoadExecutor-10031-thread-1) [ x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
[junit4] 2> 2152869 INFO (coreLoadExecutor-10031-thread-1) [ x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 2152871 INFO (coreLoadExecutor-10031-thread-1) [ x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.2 with uniqueid field id
[junit4] 2> 2152872 INFO (coreLoadExecutor-10031-thread-1) [ x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_C4CB6E434FA11BEE-001/solr-instance-001/./collection1
[junit4] 2> 2152873 INFO (coreLoadExecutor-10031-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_C4CB6E434FA11BEE-001/solr-instance-001/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_C4CB6E434FA11BEE-001/solr-instance-001/./collection1/data/]
[junit4] 2> 2152874 INFO (coreLoadExecutor-10031-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=25, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6855700662523313]
[junit4] 2> 2152897 INFO (coreLoadExecutor-10031-thread-1) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2152897 INFO (coreLoadExecutor-10031-thread-1) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2152897 INFO (coreLoadExecutor-10031-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@721f3d35
[junit4] 2> 2152898 INFO (coreLoadExecutor-10031-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@2293f9b0[collection1] main]
[junit4] 2> 2152898 INFO (coreLoadExecutor-10031-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_C4CB6E434FA11BEE-001/solr-instance-001/collection1/conf
[junit4] 2> 2152898 INFO (coreLoadExecutor-10031-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Replication enabled for following config files: schema.xml,xslt/dummy.xsl
[junit4] 2> 2152898 INFO (coreLoadExecutor-10031-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 2152898 INFO (searcherExecutor-10032-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@2293f9b0[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2153132 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[C4CB6E434FA11BEE]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_C4CB6E434FA11BEE-001/solr-instance-002/collection1
[junit4] 2> 2153134 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[C4CB6E434FA11BEE]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 2153135 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[C4CB6E434FA11BEE]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@270133{/solr,null,AVAILABLE}
[junit4] 2> 2153135 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[C4CB6E434FA11BEE]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@3c81d232{HTTP/1.1,[http/1.1]}{127.0.0.1:54679}
[junit4] 2> 2153136 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[C4CB6E434FA11BEE]) [ ] o.e.j.s.Server Started @2157040ms
[junit4] 2> 2153136 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[C4CB6E434FA11BEE]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_C4CB6E434FA11BEE-001/solr-instance-002/collection1/data, hostContext=/solr, hostPort=54679}
[junit4] 2> 2153136 ERROR (TEST-TestReplicationHandler.doTestDetails-seed#[C4CB6E434FA11BEE]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2153136 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[C4CB6E434FA11BEE]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 6.5.0
[junit4] 2> 2153136 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[C4CB6E434FA11BEE]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in standalone mode on port null
[junit4] 2> 2153136 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[C4CB6E434FA11BEE]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2153136 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[C4CB6E434FA11BEE]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-02-08T23:23:00.891Z
[junit4] 2> 2153136 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[C4CB6E434FA11BEE]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_C4CB6E434FA11BEE-001/solr-instance-002/solr.xml
[junit4] 2> 2153141 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[C4CB6E434FA11BEE]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 2153160 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[C4CB6E434FA11BEE]) [ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_C4CB6E434FA11BEE-001/solr-instance-002/.
[junit4] 2> 2153160 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[C4CB6E434FA11BEE]) [ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 2153169 INFO (coreLoadExecutor-10041-thread-1) [ x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
[junit4] 2> 2153176 INFO (coreLoadExecutor-10041-thread-1) [ x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 2153178 INFO (coreLoadExecutor-10041-thread-1) [ x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.2 with uniqueid field id
[junit4] 2> 2153179 INFO (coreLoadExecutor-10041-thread-1) [ x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_C4CB6E434FA11BEE-001/solr-instance-002/./collection1
[junit4] 2> 2153179 INFO (coreLoadExecutor-10041-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_C4CB6E434FA11BEE-001/solr-instance-002/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_C4CB6E434FA11BEE-001/solr-instance-002/./collection1/data/]
[junit4] 2> 2153181 INFO (coreLoadExecutor-10041-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=25, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6855700662523313]
[junit4] 2> 2153207 INFO (coreLoadExecutor-10041-thread-1) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2153207 INFO (coreLoadExecutor-10041-thread-1) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2153207 INFO (coreLoadExecutor-10041-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@257fec62
[junit4] 2> 2153208 INFO (coreLoadExecutor-10041-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@6286f730[collection1] main]
[junit4] 2> 2153208 INFO (coreLoadExecutor-10041-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_C4CB6E434FA11BEE-001/solr-instance-002/collection1/conf
[junit4] 2> 2153209 INFO (coreLoadExecutor-10041-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 1000ms
[junit4] 2> 2153210 INFO (searcherExecutor-10042-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@6286f730[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2153354 INFO (qtp255834780-117198) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
[junit4] 2> 2153355 INFO (indexFetcher-10046-thread-1) [ x:collection1] o.a.s.h.IndexFetcher Master's generation: 1
[junit4] 2> 2153355 INFO (indexFetcher-10046-thread-1) [ x:collection1] o.a.s.h.IndexFetcher Master's version: 0
[junit4] 2> 2153355 INFO (indexFetcher-10046-thread-1) [ x:collection1] o.a.s.h.IndexFetcher Slave's generation: 1
[junit4] 2> 2153450 INFO (qtp255834780-117200) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/select params={q=*:*&sort=id+desc&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 2153453 INFO (qtp255834780-117201) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={_trace=getDetails&qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
[junit4] 2> 2153463 INFO (qtp255834780-117199) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={slave=false&qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
[junit4] 2> 2153464 INFO (qtp1240720125-117216) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={_trace=getDetails&qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=2
[junit4] 2> 2153466 INFO (qtp255834780-117202) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[0]} 0 0
[junit4] 2> 2153467 INFO (qtp255834780-117198) [ x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 2153467 INFO (qtp255834780-117198) [ x:collection1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@7fd0c010
[junit4] 2> 2153473 INFO (qtp255834780-117198) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@1d4acb75[collection1] main]
[junit4] 2> 2153473 INFO (qtp255834780-117198) [ x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 2153473 INFO (searcherExecutor-10032-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@1d4acb75[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.5.0):C1)))}
[junit4] 2> 2153473 INFO (qtp255834780-117198) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 6
[junit4] 2> 2153486 WARN (explicit-fetchindex-cmd) [ x:collection1] o.a.s.h.IndexFetcher 'masterUrl' must be specified without the /replication suffix
[junit4] 2> 2153488 INFO (qtp255834780-117195) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
[junit4] 2> 2153488 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.h.IndexFetcher Master's generation: 2
[junit4] 2> 2153488 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.h.IndexFetcher Master's version: 1486596181222
[junit4] 2> 2153488 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.h.IndexFetcher Slave's generation: 1
[junit4] 2> 2153488 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.h.IndexFetcher Starting replication process
[junit4] 2> 2153491 INFO (qtp255834780-117200) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={generation=2&qt=/replication&wt=javabin&version=2&command=filelist} status=0 QTime=1
[junit4] 2> 2153491 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.h.IndexFetcher Number of files in latest index in master: 10
[junit4] 2> 2153492 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@683d5462
[junit4] 2> 2153493 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
[junit4] 2> 2153493 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.h.IndexFetcher Starting download (fullCopy=false) to MetricsDirectory(MockDirectoryWrapper(RAMDirectory@7339dc85 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@29a02ce4))
[junit4] 2> 2153495 INFO (qtp255834780-117201) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.si&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2153497 INFO (qtp255834780-117199) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0_FSTOrd50_0.doc&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2153499 INFO (qtp255834780-117202) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0_FSTOrd50_0.tix&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2153501 INFO (qtp255834780-117198) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.nvd&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2153502 INFO (qtp255834780-117195) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.fdx&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2153504 INFO (qtp255834780-117200) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.fdt&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2153506 INFO (qtp255834780-117201) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0_FSTOrd50_0.tbk&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2153508 INFO (qtp255834780-117199) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.fnm&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2153512 INFO (qtp255834780-117202) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.nvm&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2153515 INFO (qtp255834780-117198) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=segments_2&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2153515 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.h.IndexFetcher Total time taken for download (fullCopy=false,bytesDownloaded=1572) : 0 secs (null bytes/sec) to MetricsDirectory(MockDirectoryWrapper(RAMDirectory@7339dc85 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@29a02ce4))
[junit4] 2> 2153518 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=14, maxMergeAtOnceExplicit=37, maxMergedSegmentMB=19.5205078125, floorSegmentMB=1.826171875, forceMergeDeletesPctAllowed=22.92769837925279, segmentsPerTier=43.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6547863094652318
[junit4] 2> 2153520 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
[junit4] 2> 2153520 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@57fa5778[collection1] main]
[junit4] 2> 2153520 INFO (searcherExecutor-10042-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@57fa5778[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.5.0):C1)))}
[junit4] 2> 2153520 INFO (qtp1240720125-117213) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={wait=true&masterUrl=http://127.0.0.1:41811/solr/collection1/replication&command=fetchindex} status=0 QTime=46
[junit4] 2> 2153529 INFO (qtp255834780-117195) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={slave=false&qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
[junit4] 2> 2153529 INFO (qtp1240720125-117217) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={_trace=getDetails&qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=2
[junit4] 2> 2153531 INFO (qtp255834780-117196) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[1]} 0 0
[junit4] 2> 2153533 INFO (qtp255834780-117201) [ x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 2153533 INFO (qtp255834780-117201) [ x:collection1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@7fd0c010
[junit4] 2> 2153540 INFO (qtp255834780-117201) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@2a9e4460[collection1] main]
[junit4] 2> 2153540 INFO (qtp255834780-117201) [ x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 2153540 INFO (searcherExecutor-10032-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@2a9e4460[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_2(6.5.0):c2)))}
[junit4] 2> 2153540 INFO (qtp255834780-117201) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 7
[junit4] 2> 2153541 WARN (explicit-fetchindex-cmd) [ x:collection1] o.a.s.h.IndexFetcher 'masterUrl' must be specified without the /replication suffix
[junit4] 2> 2153544 INFO (qtp255834780-117200) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
[junit4] 2> 2153544 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.h.IndexFetcher Master's generation: 3
[junit4] 2> 2153544 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.h.IndexFetcher Master's version: 1486596181288
[junit4] 2> 2153544 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.h.IndexFetcher Slave's generation: 2
[junit4] 2> 2153544 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.h.IndexFetcher Starting replication process
[junit4] 2> 2153546 INFO (qtp255834780-117202) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={generation=3&qt=/replication&wt=javabin&version=2&command=filelist} status=0 QTime=0
[junit4] 2> 2153547 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.h.IndexFetcher Number of files in latest index in master: 19
[junit4] 2> 2153548 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@774d13e0
[junit4] 2> 2153548 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
[junit4] 2> 2153548 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.h.IndexFetcher Starting download (fullCopy=false) to MetricsDirectory(MockDirectoryWrapper(RAMDirectory@15a598ea lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@6b137c2a))
[junit4] 2> 2153548 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.h.IndexFetcher Skipping download for _0.si because it already exists
[junit4] 2> 2153548 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.h.IndexFetcher Skipping download for _0_FSTOrd50_0.doc because it already exists
[junit4] 2> 2153548 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.h.IndexFetcher Skipping download for _0_FSTOrd50_0.tix because it already exists
[junit4] 2> 2153548 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.h.IndexFetcher Skipping download for _0.nvd because it already exists
[junit4] 2> 2153548 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.h.IndexFetcher Skipping download for _0.fdx because it already exists
[junit4] 2> 2153548 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.h.IndexFetcher Skipping download for _0.fdt because it already exists
[junit4] 2> 2153548 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.h.IndexFetcher Skipping download for _0_FSTOrd50_0.tbk because it already exists
[junit4] 2> 2153549 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.h.IndexFetcher Skipping download for _0.fnm because it already exists
[junit4] 2> 2153549 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.h.IndexFetcher Skipping download for _0.nvm because it already exists
[junit4] 2> 2153551 INFO (qtp255834780-117198) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={generation=3&qt=/replication&file=_1_FSTOrd50_0.doc&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2153560 INFO (qtp255834780-117195) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={generation=3&qt=/replication&file=_1.si&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2153562 INFO (qtp255834780-117195) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={generation=3&qt=/replication&file=_1.nvd&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2153565 INFO (qtp255834780-117201) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={generation=3&qt=/replication&file=_1_FSTOrd50_0.tix&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2153567 INFO (qtp255834780-117200) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={generation=3&qt=/replication&file=_1.fdx&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2153569 INFO (qtp255834780-117202) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={generation=3&qt=/replication&file=_1.fnm&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2153572 INFO (qtp255834780-117198) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={generation=3&qt=/replication&file=_1.nvm&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2153574 INFO (qtp255834780-117196) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={generation=3&qt=/replication&file=_1_FSTOrd50_0.tbk&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2153576 INFO (qtp255834780-117195) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={generation=3&qt=/replication&file=_1.fdt&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2153578 INFO (qtp255834780-117201) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={generation=3&qt=/replication&file=segments_3&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2153579 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.h.IndexFetcher Total time taken for download (fullCopy=false,bytesDownloaded=1635) : 0 secs (null bytes/sec) to MetricsDirectory(MockDirectoryWrapper(RAMDirectory@15a598ea lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@6b137c2a))
[junit4] 2> 2153581 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=14, maxMergeAtOnceExplicit=37, maxMergedSegmentMB=19.5205078125, floorSegmentMB=1.826171875, forceMergeDeletesPctAllowed=22.92769837925279, segmentsPerTier=43.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6547863094652318
[junit4] 2> 2153581 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
[junit4] 2> 2153582 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@4914086e[collection1] main]
[junit4] 2> 2153582 INFO (searcherExecutor-10042-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@4914086e[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.5.0):C1) Uninverting(_1(6.5.0):C1)))}
[junit4] 2> 2153582 INFO (qtp1240720125-117218) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={wait=true&masterUrl=http://127.0.0.1:41811/solr/collection1/replication&command=fetchindex} status=0 QTime=41
[junit4] 2> 2153586 INFO (qtp255834780-117200) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={slave=false&qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
[junit4] 2> 2153586 INFO (qtp1240720125-117219) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={_trace=getDetails&qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=2
[junit4] 2> 2153588 INFO (qtp255834780-117199) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[2]} 0 0
[junit4] 2> 2153589 INFO (qtp255834780-117198) [ x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 2153589 INFO (qtp255834780-117198) [ x:collection1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@7fd0c010
[junit4] 2> 2153591 INFO (qtp255834780-117198) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@7987e678[collection1] main]
[junit4] 2> 2153591 INFO (qtp255834780-117198) [ x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 2153591 INFO (searcherExecutor-10032-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@7987e678[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_2(6.5.0):c2) Uninverting(_3(6.5.0):C1)))}
[junit4] 2> 2153591 INFO (qtp255834780-117198) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 1
[junit4] 2> 2153592 WARN (explicit-fetchindex-cmd) [ x:collection1] o.a.s.h.IndexFetcher 'masterUrl' must be specified without the /replication suffix
[junit4] 2> 2153594 INFO (qtp255834780-117202) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
[junit4] 2> 2153594 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.h.IndexFetcher Master's generation: 4
[junit4] 2> 2153594 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.h.IndexFetcher Master's version: 1486596181344
[junit4] 2> 2153594 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.h.IndexFetcher Slave's generation: 3
[junit4] 2> 2153594 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.h.IndexFetcher Starting replication process
[junit4] 2> 2153646 INFO (qtp255834780-117195) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={generation=4&qt=/replication&wt=javabin&version=2&command=filelist} status=0 QTime=50
[junit4] 2> 2153646 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.h.IndexFetcher Number of files in latest index in master: 13
[junit4] 2> 2153647 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@b8b1002
[junit4] 2> 2153647 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
[junit4] 2> 2153648 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.h.IndexFetcher Starting download (fullCopy=false) to MetricsDirectory(MockDirectoryWrapper(RAMDirectory@4fa25482 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@6e25313d))
[junit4] 2> 2153649 INFO (qtp255834780-117201) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={generation=4&qt=/replication&file=_2.si&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2153651 INFO (qtp255834780-117200) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={generation=4&qt=/replication&file=_2.cfe&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2153653 INFO (qtp255834780-117199) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={generation=4&qt=/replication&file=_2.cfs&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2153655 INFO (qtp255834780-117198) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={generation=4&qt=/replication&file=_3.fdx&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2153657 INFO (qtp255834780-117202) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={generation=4&qt=/replication&file=_3.si&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2153659 INFO (qtp255834780-117195) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={generation=4&qt=/replication&file=_3.nvd&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2153661 INFO (qtp255834780-117201) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={generation=4&qt=/replication&file=_3_FSTOrd50_0.tbk&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2153663 INFO (qtp255834780-117200) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={generation=4&qt=/replication&file=_3_FSTOrd50_0.tix&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2153664 INFO (qtp255834780-117199) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={generation=4&qt=/replication&file=_3_FSTOrd50_0.doc&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2153666 INFO (qtp255834780-117198) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={generation=4&qt=/replication&file=_3.fnm&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2153668 INFO (qtp255834780-117202) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={generation=4&qt=/replication&file=_3.nvm&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2153670 INFO (qtp255834780-117195) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={generation=4&qt=/replication&file=_3.fdt&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2153671 INFO (qtp255834780-117201) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={generation=4&qt=/replication&file=segments_4&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2153672 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.h.IndexFetcher Total time taken for download (fullCopy=false,bytesDownloaded=3358) : 0 secs (null bytes/sec) to MetricsDirectory(MockDirectoryWrapper(RAMDirectory@4fa25482 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@6e25313d))
[junit4] 2> 2153673 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=14, maxMergeAtOnceExplicit=37, maxMergedSegmentMB=19.5205078125, floorSegmentMB=1.826171875, forceMergeDeletesPctAllowed=22.92769837925279, segmentsPerTier=43.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6547863094652318
[junit4] 2> 2153674 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
[junit4] 2> 2153676 INFO (explicit-fetchindex-cmd) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@4ed4523e[collection1] main]
[junit4] 2> 2153676 INFO (searcherExecutor-10042-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@4ed4523e[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_2(6.5.0):c2) Uninverting(_3(6.5.0):C1)))}
[junit4] 2> 2153677 INFO (qtp1240720125-117212) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={wait=true&masterUrl=http://127.0.0.1:41811/solr/collection1/replication&command=fetchindex} status=0 QTime=85
[junit4] 2> 2153678 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[C4CB6E434FA11BEE]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_C4CB6E434FA11BEE-001/solr-instance-003/collection1
[junit4] 2> 2153680 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[C4CB6E434FA11BEE]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 2153684 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[C4CB6E434FA11BEE]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@73b4f819{/solr,null,AVAILABLE}
[junit4] 2> 2153684 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[C4CB6E434FA11BEE]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@59962f9a{HTTP/1.1,[http/1.1]}{127.0.0.1:37123}
[junit4] 2> 2153684 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[C4CB6E434FA11BEE]) [ ] o.e.j.s.Server Started @2157589ms
[junit4] 2> 2153684 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[C4CB6E434FA11BEE]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_C4CB6E434FA11BEE-001/solr-instance-003/collection1/data, hostContext=/solr, hostPort=37123}
[junit4] 2> 2153685 ERROR (TEST-TestReplicationHandler.doTestDetails-seed#[C4CB6E434FA11BEE]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2153685 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[C4CB6E434FA11BEE]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 6.5.0
[junit4] 2> 2153685 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[C4CB6E434FA11BEE]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in standalone mode on port null
[junit4] 2> 2153685 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[C4CB6E434FA11BEE]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2153685 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[C4CB6E434FA11BEE]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-02-08T23:23:01.440Z
[junit4] 2> 2153685 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[C4CB6E434FA11BEE]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_C4CB6E434FA11BEE-001/solr-instance-003/solr.xml
[junit4] 2> 2153698 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[C4CB6E434FA11BEE]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 2153716 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[C4CB6E434FA11BEE]) [ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_C4CB6E434FA11BEE-001/solr-instance-003/.
[junit4] 2> 2153717 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[C4CB6E434FA11BEE]) [ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 2153728 INFO (coreLoadExecutor-10055-thread-1) [ x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
[junit4] 2> 2153734 INFO (coreLoadExecutor-10055-thread-1) [ x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 2153736 INFO (coreLoadExecutor-10055-thread-1) [ x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.2 with uniqueid field id
[junit4] 2> 2153737 INFO (coreLoadExecutor-10055-thread-1) [ x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_C4CB6E434FA11BEE-001/solr-instance-003/./collection1
[junit4] 2> 2153737 INFO (coreLoadExecutor-10055-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_C4CB6E434FA11BEE-001/solr-instance-003/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_C4CB6E434FA11BEE-001/solr-instance-003/./collection1/data/]
[junit4] 2> 2153738 INFO (coreLoadExecutor-10055-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=25, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6855700662523313]
[junit4] 2> 2153761 INFO (coreLoadExecutor-10055-thread-1) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2153761 INFO (coreLoadExecutor-10055-thread-1) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2153762 INFO (coreLoadExecutor-10055-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@6e3994ad
[junit4] 2> 2153762 INFO (coreLoadExecutor-10055-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@6244a1c5[collection1] main]
[junit4] 2> 2153762 INFO (coreLoadExecutor-10055-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_C4CB6E434FA11BEE-001/solr-instance-003/collection1/conf
[junit4] 2> 2153762 WARN (coreLoadExecutor-10055-thread-1) [ x:collection1] o.a.s.h.IndexFetcher 'masterUrl' must be specified without the /replication suffix
[junit4] 2> 2153763 INFO (coreLoadExecutor-10055-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler No value set for 'pollInterval'. Timer Task not started.
[junit4] 2> 2153763 INFO (coreLoadExecutor-10055-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Replication enabled for following config files: schema.xml
[junit4] 2> 2153763 INFO (coreLoadExecutor-10055-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 2153763 INFO (searcherExecutor-10056-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@6244a1c5[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2154036 WARN (qtp1909877272-117242) [ x:collection1] o.a.s.h.ReplicationHandler Exception while invoking 'details' method for replication on master
[junit4] 2> org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:41811/solr: Expected mime type application/octet-stream but got text/html. <html>
[junit4] 2> <head>
[junit4] 2> <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
[junit4] 2> <title>Error 404 </title>
[junit4] 2> </head>
[junit4] 2> <body>
[junit4] 2> <h2>HTTP ERROR: 404</h2>
[junit4] 2> <p>Problem accessing /solr/replication. Reason:
[junit4] 2> <pre> Can not find: /solr/replication</pre></p>
[junit4] 2> <hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.14.v20161028</a><hr/>
[junit4] 2> </body>
[junit4] 2> </html>
[junit4] 2>
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:578)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:279)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:268)
[junit4] 2> at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
[junit4] 2> at org.apache.solr.handler.IndexFetcher.getDetails(IndexFetcher.java:1660)
[junit4] 2> at org.apache.solr.handler.ReplicationHandler.getReplicationDetails(ReplicationHandler.java:922)
[junit4] 2> at org.apache.solr.handler.ReplicationHandler.handleRequestBody(ReplicationHandler.java:314)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:171)
[junit4] 2> at org.apache.solr.core.SolrCore.execute(SolrCore.java:2384)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:723)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:529)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:347)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:298)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1699)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:110)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1699)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
[junit4] 2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:462)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:534)
[junit4] 2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
[junit4] 2> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:273)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)
[junit4] 2> at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 2154036 INFO (qtp1909877272-117242) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={_trace=getDetails&qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=2
[junit4] 2> 2154038 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[C4CB6E434FA11BEE]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@59962f9a{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 2154038 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[C4CB6E434FA11BEE]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=300557927
[junit4] 2> 2154039 INFO (coreCloseExecutor-10060-thread-1) [ x:collection1] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@441e3ada
[junit4] 2> 2154039 INFO (coreCloseExecutor-10060-thread-1) [ x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.core.collection1
[junit4] 2> 2154039 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[C4CB6E434FA11BEE]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.node
[junit4] 2> 2154040 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[C4CB6E434FA11BEE]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@73b4f819{/solr,null,UNAVAILABLE}
[junit4] 2> 2154040 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[C4CB6E434FA11BEE]) [ ] o.a.s.SolrTestCaseJ4 ###Ending doTestDetails
[junit4] 2> 2154041 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[C4CB6E434FA11BEE]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@35b2bb4d{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 2154041 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[C4CB6E434FA11BEE]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=510500620
[junit4] 2> 2154043 INFO (coreCloseExecutor-10062-thread-1) [ x:collection1] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@b306ef3
[junit4] 2> 2154043 INFO (coreCloseExecutor-10062-thread-1) [ x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.core.collection1
[junit4] 2> 2154044 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[C4CB6E434FA11BEE]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.node
[junit4] 2> 2154044 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[C4CB6E434FA11BEE]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@54baeab2{/solr,null,UNAVAILABLE}
[junit4] 2> 2154045 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[C4CB6E434FA11BEE]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@3c81d232{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 2154045 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[C4CB6E434FA11BEE]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=154745013
[junit4] 2> 2154045 INFO (coreCloseExecutor-10064-thread-1) [ x:collection1] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@6626f93f
[junit4] 2> 2154046 INFO (coreCloseExecutor-10064-thread-1) [ x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.core.collection1
[junit4] 2> 2154046 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[C4CB6E434FA11BEE]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.node
[junit4] 2> 2154046 INFO (TEST-TestReplicationHandler.doTestDetails-seed#[C4CB6E434FA11BEE]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@270133{/solr,null,UNAVAILABLE}
[junit4] 2> 2154049 INFO (TEST-TestReplicationHandler.doTestHandlerPathUnchanged-seed#[C4CB6E434FA11BEE]) [ ] o.a.s.SolrTestCaseJ4 ###Starting doTestHandlerPathUnchanged
[junit4] 2> 2154049 INFO (TEST-TestReplicationHandler.doTestHandlerPathUnchanged-seed#[C4CB6E434FA11BEE]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_C4CB6E434FA11BEE-001/solr-instance-004/collection1
[junit4] 2> 2154051 INFO (TEST-TestReplicationHandler.doTestHandlerPathUnchanged-seed#[C4CB6E434FA11BEE]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 2154055 INFO (TEST-TestReplicationHandler.doTestHandlerPathUnchanged-seed#[C4CB6E434FA11BEE]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@104af98b{/solr,null,AVAILABLE}
[junit4] 2> 2154056 INFO (TEST-TestReplicationHandler.doTestHandlerPathUnchanged-seed#[C4CB6E434FA11BEE]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@49f87454{HTTP/1.1,[http/1.1]}{127.0.0.1:55095}
[junit4] 2> 2154056 INFO (TEST-TestReplicationHandler.doTestHandlerPathUnchanged-seed#[C4CB6E434FA11BEE]) [ ] o.e.j.s.Server Started @2157960ms
[junit4] 2> 2154056 INFO (TEST-TestReplicationHandler.doTestHandlerPathUnchanged-seed#[C4CB6E434FA11BEE]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_C4CB6E434FA11BEE-001/solr-instance-004/collection1/data, hostContext=/solr, hostPort=55095}
[junit4] 2> 2154056 ERROR (TEST-TestReplicationHandler.doTestHandlerPathUnchanged-seed#[C4CB6E434FA11BEE]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2154056 INFO (TEST-TestReplicationHandler.doTestHandlerPathUnchanged-seed#[C4CB6E434FA11BEE]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 6.5.0
[junit4] 2> 2154056 INFO (TEST-TestReplicationHandler.doTestHandlerPathUnchanged-seed#[C4CB6E434FA11BEE]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in standalone mode on port null
[junit4] 2> 2154056 INFO (TEST-TestReplicationHandler.doTestHandlerPathUnchanged-seed#[C4CB6E434FA11BEE]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2154056 INFO (TEST-TestReplicationHandler.doTestHandlerPathUnchanged-seed#[C4CB6E434FA11BEE]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-02-08T23:23:01.811Z
[junit4] 2> 2154056 INFO (TEST-TestReplicationHandler.doTestHandlerPathUnchanged-seed#[C4CB6E434FA11BEE]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_C4CB6E434FA11BEE-001/solr-instance-004/solr.xml
[junit4] 2> 2154061 INFO (TEST-TestReplicationHandler.doTestHandlerPathUnchanged-seed#[C4CB6E434FA11BEE]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 2154081 INFO (TEST-TestReplicationHandler.doTestHandlerPathUnchanged-seed#[C4CB6E434FA11BEE]) [ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_C4CB6E434FA11BEE-001/solr-instance-004/.
[junit4] 2> 2154081 INFO (TEST-TestReplicationHandler.doTestHandlerPathUnchanged-seed#[C4CB6E434FA11BEE]) [ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 2154092 INFO (coreLoadExecutor-10071-thread-1) [ x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
[junit4] 2> 2154099 INFO (coreLoadExecutor-10071-thread-1) [ x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 2154101 INFO (coreLoadExecutor-10071-thread-1) [ x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.2 with uniqueid field id
[junit4] 2> 2154102 INFO (coreLoadExecutor-10071-thread-1) [ x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_C4CB6E434FA11BEE-001/solr-instance-004/./collection1
[junit4] 2> 2154102 INFO (coreLoadExecutor-10071-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_C4CB6E434FA11BEE-001/solr-instance-004/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_C4CB6E434FA11BEE-001/solr-instance-004/./collection1/data/]
[junit4] 2> 2154103 INFO (coreLoadExecutor-10071-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=25, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6855700662523313]
[junit4] 2> 2154126 INFO (coreLoadExecutor-10071-thread-1) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2154127 INFO (coreLoadExecutor-10071-thread-1) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2154127 INFO (coreLoadExecutor-10071-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@31c3b99b
[junit4] 2> 2154127 INFO (coreLoadExecutor-10071-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@6c35f731[collection1] main]
[junit4] 2> 2154127 INFO (coreLoadExecutor-10071-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_C4CB6E434FA11BEE-001/solr-instance-004/collection1/conf
[junit4] 2> 2154128 INFO (coreLoadExecutor-10071-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Replication enabled for following config files: schema.xml,xslt/dummy.xsl
[junit4] 2> 2154128 INFO (coreLoadExecutor-10071-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 2154128 INFO (searcherExecutor-10072-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@6c35f731[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2154371 INFO (TEST-TestReplicationHandler.doTestHandlerPathUnchanged-seed#[C4CB6E434FA11BEE]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_C4CB6E434FA11BEE-001/solr-instance-005/collection1
[junit4] 2> 2154373 INFO (TEST-TestReplicationHandler.doTestHandlerPathUnchanged-seed#[C4CB6E434FA11BEE]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 2154374 INFO (TEST-TestReplicationHandler.doTestHandlerPathUnchanged-seed#[C4CB6E434FA11BEE]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1360d495{/solr,null,AVAILABLE}
[junit4] 2> 2154374 INFO (TEST-TestReplicationHandler.doTestHandlerPathUnchanged-seed#[C4CB6E434FA11BEE]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@583436b2{HTTP/1.1,[http/1.1]}{127.0.0.1:58473}
[junit4] 2> 2154374 INFO (TEST-TestReplicationHandler.doTestHandlerPathUnchanged-seed#[C4CB6E434FA11BEE]) [ ] o.e.j.s.Server Started @2158279ms
[junit4] 2> 2154377 INFO (TEST-TestReplicationHandler.doTestHandlerPathUnchanged-seed#[C4CB6E434FA11BEE]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_C4CB6E434FA11BEE-001/solr-instance-005/collection1/data, hostContext=/solr, hostPort=58473}
[junit4] 2> 2154378 ERROR (TEST-TestReplicationHandler.doTestHandlerPathUnchanged-seed#[C4CB6E434FA11BEE]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2154378 INFO (TEST-TestReplicationHandler.doTestHandlerPathUnchanged-seed#[C4CB6E434FA11BEE]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 6.5.0
[junit4] 2> 2154378 INFO (TEST-TestReplicationHandler.doTestHandlerPathUnchanged-seed#[C4CB6E434FA11BEE]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in standalone mode on port null
[junit4] 2> 2154378 INFO (TEST-TestReplicationHandler.doTestHandlerPathUnchanged-seed#[C4CB6E434FA11BEE]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2154378 INFO (TEST-TestReplicationHandler.doTestHandlerPathUnchanged-seed#[C4CB6E434FA11BEE]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-02-08T23:23:02.133Z
[junit4] 2> 2154378 INFO (TEST-TestReplicationHandler.doTestHandlerPathUnchanged-seed#[C4CB6E434FA11BEE]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_C4CB6E434FA11BEE-001/solr-instance-005/solr.xml
[junit4] 2> 2154383 INFO (TEST-TestReplicationHandler.doTestHandlerPathUnchanged-seed#[C4CB6E434FA11BEE]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 2154399 INFO (TEST-TestReplicationHandler.doTestHandlerPathUnchanged-seed#[C4CB6E434FA11BEE]) [ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_C4CB6E434FA11BEE-001/solr-instance-005/.
[junit4] 2> 2154400 INFO (TEST-TestReplicationHandler.doTestHandlerPathUnchanged-seed#[C4CB6E434FA11BEE]) [ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 2154410 INFO (coreLoadExecutor-10081-thread-1) [ x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
[junit4] 2> 2154416 INFO (coreLoadExecutor-10081-thread-1) [ x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 2154417 INFO (coreLoadExecutor-10081-thread-1) [ x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.2 with uniqueid field id
[junit4] 2> 2154418 INFO (coreLoadExecutor-10081-thread-1) [ x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_C4CB6E434FA11BEE-001/solr-instance-005/./collection1
[junit4] 2> 2154419 INFO (coreLoadExecutor-10081-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_C4CB6E434FA11BEE-001/solr-instance-005/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_C4CB6E434FA11BEE-001/solr-instance-005/./collection1/data/]
[junit4] 2> 2154420 INFO (coreLoadExecutor-10081-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=25, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6855700662523313]
[junit4] 2> 2154443 INFO (coreLoadExecutor-10081-thread-1) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2154443 INFO (coreLoadExecutor-10081-thread-1) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2154444 INFO (coreLoadExecutor-10081-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@366236c5
[junit4] 2> 2154444 INFO (coreLoadExecutor-10081-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@7294e6c5[collection1] main]
[junit4] 2> 2154445 INFO (coreLoadExecutor-10081-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_C4CB6E434FA11BEE-001/solr-instance-005/collection1/conf
[junit4] 2> 2154445 INFO (coreLoadExecutor-10081-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 1000ms
[junit4] 2> 2154446 INFO (searcherExecutor-10082-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@7294e6c5[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2154460 INFO (qtp864358047-117266) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
[junit4] 2> 2154461 INFO (indexFetcher-10086-thread-1) [ x:collection1] o.a.s.h.IndexFetcher Master's generation: 1
[junit4] 2> 2154461 INFO (indexFetcher-10086-thread-1) [ x:collection1] o.a.s.h.In
[...truncated too long message...]
pl.java:594)
[junit4] 2> at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdownInstance(DefaultMetricsSystem.java:72)
[junit4] 2> at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdown(DefaultMetricsSystem.java:68)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.metrics.NameNodeMetrics.shutdown(NameNodeMetrics.java:171)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.NameNode.stop(NameNode.java:872)
[junit4] 2> at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1726)
[junit4] 2> at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1705)
[junit4] 2> at org.apache.solr.cloud.hdfs.HdfsTestUtil.teardownClass(HdfsTestUtil.java:198)
[junit4] 2> at org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest.teardownClass(HdfsWriteToMultipleCollectionsTest.java:73)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:498)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:870)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> Caused by: java.lang.NullPointerException
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlocksMap.size(BlocksMap.java:203)
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.getTotalBlocks(BlockManager.java:3370)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlocksTotal(FSNamesystem.java:5729)
[junit4] 2> ... 53 more
[junit4] 2> 4633800 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[C4CB6E434FA11BEE]-worker) [ ] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_C4CB6E434FA11BEE-001
[junit4] 2> Feb 09, 2017 12:04:21 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 35 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=CheapBastard, sim=RandomSimilarity(queryNorm=true,coord=yes): {}, locale=it, timezone=Europe/Athens
[junit4] 2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_102 (64-bit)/cpus=4,threads=2,free=100006304,total=527958016
[junit4] 2> NOTE: All tests run in this JVM: [TestConfigOverlay, IndexSchemaTest, TestConfigSetsAPIZkFailure, BJQParserTest, BasicAuthIntegrationTest, TestMinMaxOnMultiValuedField, TestDistribDocBasedVersion, ShardRoutingCustomTest, HdfsLockFactoryTest, TestOnReconnectListenerSupport, TestLuceneMatchVersion, HighlighterTest, JvmMetricsTest, CdcrVersionReplicationTest, TestExactSharedStatsCache, OverseerModifyCollectionTest, TestRTGBase, DistributedMLTComponentTest, TestBulkSchemaAPI, TestSuggestSpellingConverter, TestFieldTypeResource, TestCSVResponseWriter, TestFieldCollectionResource, CollectionsAPIDistributedZkTest, SimpleMLTQParserTest, TestFastOutputStream, OpenCloseCoreStressTest, SolrCloudExampleTest, DeleteShardTest, SimplePostToolTest, TestRestoreCore, EchoParamsTest, TestXmlQParserPlugin, HdfsDirectoryFactoryTest, TestFuzzyAnalyzedSuggestions, TestSurroundQueryParser, TestCloudPseudoReturnFields, AnalyticsQueryTest, HdfsChaosMonkeySafeLeaderTest, DistributedIntervalFacetingTest, SolrIndexSplitterTest, TestStressUserVersions, TestSubQueryTransformer, TestRecoveryHdfs, TestHdfsCloudBackupRestore, SortByFunctionTest, DirectSolrSpellCheckerTest, LoggingHandlerTest, TestUninvertingReader, TestFreeTextSuggestions, TestSolrConfigHandlerCloud, FacetPivotSmallTest, TestSearchPerf, TestQueryUtils, CoreSorterTest, SliceStateTest, TestJavabinTupleStreamParser, BlockDirectoryTest, DateMathParserTest, SolrInfoMBeanTest, TestHdfsBackupRestoreCore, SaslZkACLProviderTest, ShufflingReplicaListTransformerTest, TestSchemaSimilarityResource, TestRequestStatusCollectionAPI, ZkCLITest, TestPartialUpdateDeduplication, TestDistributedGrouping, WordBreakSolrSpellCheckerTest, TestSystemIdResolver, SystemInfoHandlerTest, SolrIndexMetricsTest, TestExportWriter, TestCoreAdminApis, TestSimpleTrackingShardHandler, HttpSolrCallGetCoreTest, SolrIndexConfigTest, TestBM25SimilarityFactory, TestStressLiveNodes, LeaderFailureAfterFreshStartTest, DeleteLastCustomShardedReplicaTest, TestSweetSpotSimilarityFactory, ShardRoutingTest, TestWordDelimiterFilterFactory, BasicFunctionalityTest, TestLeaderInitiatedRecoveryThread, TestNoOpRegenerator, DistribDocExpirationUpdateProcessorTest, MigrateRouteKeyTest, RemoteQueryErrorTest, ChaosMonkeySafeLeaderTest, AsyncCallRequestStatusResponseTest, TestApiFramework, TestHdfsUpdateLog, BlockJoinFacetSimpleTest, BigEndianAscendingWordDeserializerTest, DistributedTermsComponentTest, WrapperMergePolicyFactoryTest, SpatialFilterTest, TestAnalyzeInfixSuggestions, TestLRUCache, TestTrie, BlobRepositoryCloudTest, SecurityConfHandlerTest, DistributedFacetPivotSmallAdvancedTest, TolerantUpdateProcessorTest, TestShortCircuitedRequests, TestSolrQueryParserDefaultOperatorResource, TestCoreContainer, TestRandomCollapseQParserPlugin, TestSolrCoreParser, ClusterStateUpdateTest, TestUseDocValuesAsStored, MultiTermTest, BasicDistributedZkTest, OverseerTest, LeaderElectionIntegrationTest, BasicZkTest, RecoveryZkTest, FullSolrCloudDistribCmdsTest, TestReplicationHandler, TestFaceting, TestHashPartitioner, ZkControllerTest, TestJoin, TestStressVersions, SpellCheckComponentTest, SolrCmdDistributorTest, PeerSyncTest, BadIndexSchemaTest, ConvertedLegacyTest, TestFunctionQuery, TestBadConfig, SoftAutoCommitTest, SpellCheckCollatorTest, SolrRequestParserTest, DocValuesTest, TestRemoteStreaming, XsltUpdateRequestHandlerTest, IndexBasedSpellCheckerTest, StandardRequestHandlerTest, TestReversedWildcardFilterFactory, TestQueryTypes, TermsComponentTest, DocumentBuilderTest, TestIndexingPerformance, MoreLikeThisHandlerTest, FieldAnalysisRequestHandlerTest, TestJmxIntegration, MBeansHandlerTest, UniqFieldsUpdateProcessorFactoryTest, BinaryUpdateRequestHandlerTest, SearchHandlerTest, HighlighterConfigTest, SOLR749Test, TestQuerySenderListener, UpdateParamsTest, AlternateDirectoryTest, TestSolrIndexConfig, TestQuerySenderNoQuery, CopyFieldTest, ResponseLogComponentTest, BadComponentTest, TestMergePolicyConfig, SampleTest, TestDocSet, TestBinaryField, MinimalSchemaTest, TestElisionMultitermQuery, TestSolrCoreProperties, DirectSolrConnectionTest, NotRequiredUniqueKeyTest, TestPhraseSuggestions, SpellPossibilityIteratorTest, TestCharFilters, TestCodecSupport, TestDFRSimilarityFactory, TestPerFieldSimilarity, TestLMDirichletSimilarityFactory, TestLMJelinekMercerSimilarityFactory, TestFastWriter, TimeZoneUtilsTest, ResourceLoaderTest, URLClassifyProcessorTest, TestFastLRUCache, ChaosMonkeyNothingIsSafeTest, CdcrRequestHandlerTest, ConcurrentDeleteAndCreateCollectionTest, DeleteStatusTest, DistributedQueueTest, DistributedVersionInfoTest, ForceLeaderTest, LeaderFailoverAfterPartitionTest, MissingSegmentRecoveryTest, ReplaceNodeTest, SSLMigrationTest, ShardSplitTest, TestRandomRequestDistribution, TestRebalanceLeaders, TestReplicaProperties, TestRequestForwarding, TestSSLRandomization, TestSolrCloudWithDelegationTokens, TestSolrCloudWithKerberosAlt, TestSolrCloudWithSecureImpersonation, TestTolerantUpdateProcessorCloud, TestTolerantUpdateProcessorRandomCloud, TlogReplayBufferedWhileIndexingTest, HdfsRecoverLeaseTest, HdfsSyncSliceTest, HdfsWriteToMultipleCollectionsTest]
[junit4] Completed [542/690 (4!)] on J1 in 44.74s, 1 test, 1 failure <<< FAILURES!
[...truncated 62927 lines...]
[JENKINS] Lucene-Solr-NightlyTests-6.x - Build # 276 - Failure
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.x/276/
7 tests failed.
FAILED: org.apache.lucene.index.TestIndexSorting.testRandom3
Error Message:
Java heap space
Stack Trace:
java.lang.OutOfMemoryError: Java heap space
at __randomizedtesting.SeedInfo.seed([B92E69CC2FAD4D04:1BF627164B5F6402]:0)
at org.apache.lucene.util.packed.Packed8ThreeBlocks.<init>(Packed8ThreeBlocks.java:41)
at org.apache.lucene.util.packed.PackedInts.getMutable(PackedInts.java:963)
at org.apache.lucene.util.packed.PackedInts.getMutable(PackedInts.java:939)
at org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWriter.java:80)
at org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:88)
at org.apache.lucene.util.packed.AbstractPagedMutable.set(AbstractPagedMutable.java:98)
at org.apache.lucene.util.fst.NodeHash.addNew(NodeHash.java:152)
at org.apache.lucene.util.fst.NodeHash.rehash(NodeHash.java:169)
at org.apache.lucene.util.fst.NodeHash.add(NodeHash.java:133)
at org.apache.lucene.util.fst.Builder.compileNode(Builder.java:214)
at org.apache.lucene.util.fst.Builder.freezeTail(Builder.java:310)
at org.apache.lucene.util.fst.Builder.add(Builder.java:414)
at org.apache.lucene.codecs.memory.MemoryDocValuesConsumer.writeFST(MemoryDocValuesConsumer.java:367)
at org.apache.lucene.codecs.memory.MemoryDocValuesConsumer.addSortedField(MemoryDocValuesConsumer.java:404)
at org.apache.lucene.codecs.DocValuesConsumer.mergeSortedField(DocValuesConsumer.java:653)
at org.apache.lucene.codecs.DocValuesConsumer.merge(DocValuesConsumer.java:204)
at org.apache.lucene.codecs.perfield.PerFieldDocValuesFormat$FieldsWriter.merge(PerFieldDocValuesFormat.java:153)
at org.apache.lucene.index.SegmentMerger.mergeDocValues(SegmentMerger.java:167)
at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:111)
at org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4363)
at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3940)
at org.apache.lucene.index.SerialMergeScheduler.merge(SerialMergeScheduler.java:40)
at org.apache.lucene.index.IndexWriter.maybeMerge(IndexWriter.java:2091)
at org.apache.lucene.index.IndexWriter.doAfterSegmentFlushed(IndexWriter.java:5004)
at org.apache.lucene.index.DocumentsWriter$MergePendingEvent.process(DocumentsWriter.java:731)
at org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:5042)
at org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:5033)
at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1582)
at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1324)
at org.apache.lucene.index.TestIndexSorting.testRandom3(TestIndexSorting.java:2229)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
FAILED: org.apache.solr.cloud.CdcrReplicationDistributedZkTest.testOps
Error Message:
Timeout waiting for CDCR replication to complete @source_collection:shard1
Stack Trace:
java.lang.RuntimeException: Timeout waiting for CDCR replication to complete @source_collection:shard1
at __randomizedtesting.SeedInfo.seed([C7ADB5AA436D7EF4:DBD529490C5E7529]:0)
at org.apache.solr.cloud.BaseCdcrDistributedZkTest.waitForReplicationToComplete(BaseCdcrDistributedZkTest.java:795)
at org.apache.solr.cloud.CdcrReplicationDistributedZkTest.testOps(CdcrReplicationDistributedZkTest.java:463)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.SharedFSAutoReplicaFailoverTest.test
Error Message:
Timeout waiting for all live and active
Stack Trace:
java.lang.AssertionError: Timeout waiting for all live and active
at __randomizedtesting.SeedInfo.seed([C7ADB5AA436D7EF4:4FF98A70ED91130C]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.cloud.SharedFSAutoReplicaFailoverTest.testBasics(SharedFSAutoReplicaFailoverTest.java:309)
at org.apache.solr.cloud.SharedFSAutoReplicaFailoverTest.test(SharedFSAutoReplicaFailoverTest.java:127)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.addReplicaTest
Error Message:
Could not find collection : addReplicaColl
Stack Trace:
org.apache.solr.common.SolrException: Could not find collection : addReplicaColl
at __randomizedtesting.SeedInfo.seed([C7ADB5AA436D7EF4:540DE28CCD653525]:0)
at org.apache.solr.common.cloud.ClusterState.getCollection(ClusterState.java:194)
at org.apache.solr.cloud.SolrCloudTestCase.getCollectionState(SolrCloudTestCase.java:245)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.addReplicaTest(CollectionsAPIDistributedZkTest.java:666)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.testCollectionsAPI
Error Message:
Expected to see collection awhollynewcollection_0 null Last available state: DocCollection(awhollynewcollection_0//collections/awhollynewcollection_0/state.json/10)={ "replicationFactor":"3", "shards":{ "shard1":{ "range":"80000000-d554ffff", "state":"active", "replicas":{ "core_node4":{ "core":"awhollynewcollection_0_shard1_replica3", "dataDir":"hdfs://localhost:56123/data/awhollynewcollection_0/core_node4/data/", "base_url":"http://127.0.0.1:33892/solr", "node_name":"127.0.0.1:33892_solr", "state":"active", "ulogDir":"hdfs://localhost:56123/data/awhollynewcollection_0/core_node4/data/tlog"}, "core_node5":{ "core":"awhollynewcollection_0_shard1_replica2", "dataDir":"hdfs://localhost:56123/data/awhollynewcollection_0/core_node5/data/", "base_url":"http://127.0.0.1:39131/solr", "node_name":"127.0.0.1:39131_solr", "state":"active", "ulogDir":"hdfs://localhost:56123/data/awhollynewcollection_0/core_node5/data/tlog", "leader":"true"}}}, "shard2":{ "range":"d5550000-2aa9ffff", "state":"active", "replicas":{ "core_node3":{ "core":"awhollynewcollection_0_shard2_replica3", "dataDir":"hdfs://localhost:56123/data/awhollynewcollection_0/core_node3/data/", "base_url":"http://127.0.0.1:39131/solr", "node_name":"127.0.0.1:39131_solr", "state":"active", "ulogDir":"hdfs://localhost:56123/data/awhollynewcollection_0/core_node3/data/tlog"}, "core_node8":{ "core":"awhollynewcollection_0_shard2_replica2", "dataDir":"hdfs://localhost:56123/data/awhollynewcollection_0/core_node8/data/", "base_url":"http://127.0.0.1:51948/solr", "node_name":"127.0.0.1:51948_solr", "state":"active", "ulogDir":"hdfs://localhost:56123/data/awhollynewcollection_0/core_node8/data/tlog", "leader":"true"}}}, "shard3":{ "range":"2aaa0000-7fffffff", "state":"active", "replicas":{}}}, "router":{"name":"compositeId"}, "maxShardsPerNode":"3", "autoAddReplicas":"false"}
Stack Trace:
java.lang.AssertionError: Expected to see collection awhollynewcollection_0
null
Last available state: DocCollection(awhollynewcollection_0//collections/awhollynewcollection_0/state.json/10)={
"replicationFactor":"3",
"shards":{
"shard1":{
"range":"80000000-d554ffff",
"state":"active",
"replicas":{
"core_node4":{
"core":"awhollynewcollection_0_shard1_replica3",
"dataDir":"hdfs://localhost:56123/data/awhollynewcollection_0/core_node4/data/",
"base_url":"http://127.0.0.1:33892/solr",
"node_name":"127.0.0.1:33892_solr",
"state":"active",
"ulogDir":"hdfs://localhost:56123/data/awhollynewcollection_0/core_node4/data/tlog"},
"core_node5":{
"core":"awhollynewcollection_0_shard1_replica2",
"dataDir":"hdfs://localhost:56123/data/awhollynewcollection_0/core_node5/data/",
"base_url":"http://127.0.0.1:39131/solr",
"node_name":"127.0.0.1:39131_solr",
"state":"active",
"ulogDir":"hdfs://localhost:56123/data/awhollynewcollection_0/core_node5/data/tlog",
"leader":"true"}}},
"shard2":{
"range":"d5550000-2aa9ffff",
"state":"active",
"replicas":{
"core_node3":{
"core":"awhollynewcollection_0_shard2_replica3",
"dataDir":"hdfs://localhost:56123/data/awhollynewcollection_0/core_node3/data/",
"base_url":"http://127.0.0.1:39131/solr",
"node_name":"127.0.0.1:39131_solr",
"state":"active",
"ulogDir":"hdfs://localhost:56123/data/awhollynewcollection_0/core_node3/data/tlog"},
"core_node8":{
"core":"awhollynewcollection_0_shard2_replica2",
"dataDir":"hdfs://localhost:56123/data/awhollynewcollection_0/core_node8/data/",
"base_url":"http://127.0.0.1:51948/solr",
"node_name":"127.0.0.1:51948_solr",
"state":"active",
"ulogDir":"hdfs://localhost:56123/data/awhollynewcollection_0/core_node8/data/tlog",
"leader":"true"}}},
"shard3":{
"range":"2aaa0000-7fffffff",
"state":"active",
"replicas":{}}},
"router":{"name":"compositeId"},
"maxShardsPerNode":"3",
"autoAddReplicas":"false"}
at __randomizedtesting.SeedInfo.seed([C7ADB5AA436D7EF4:8FD8C11E455E5161]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.SolrCloudTestCase.waitForState(SolrCloudTestCase.java:265)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:496)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.hdfs.HdfsRecoveryZkTest
Error Message:
ObjectTracker found 1 object(s) that were not released!!! [HdfsTransactionLog] org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:43) at org.apache.solr.update.HdfsTransactionLog.<init>(HdfsTransactionLog.java:130) at org.apache.solr.update.HdfsUpdateLog.init(HdfsUpdateLog.java:202) at org.apache.solr.update.UpdateHandler.<init>(UpdateHandler.java:137) at org.apache.solr.update.UpdateHandler.<init>(UpdateHandler.java:94) at org.apache.solr.update.DirectUpdateHandler2.<init>(DirectUpdateHandler2.java:102) at sun.reflect.GeneratedConstructorAccessor174.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.solr.core.SolrCore.createInstance(SolrCore.java:737) at org.apache.solr.core.SolrCore.createUpdateHandler(SolrCore.java:799) at org.apache.solr.core.SolrCore.initUpdateHandler(SolrCore.java:1049) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:914) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:807) at org.apache.solr.core.CoreContainer.create(CoreContainer.java:904) at org.apache.solr.core.CoreContainer.lambda$load$3(CoreContainer.java:555) at com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:197) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745)
Stack Trace:
java.lang.AssertionError: ObjectTracker found 1 object(s) that were not released!!! [HdfsTransactionLog]
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException
at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:43)
at org.apache.solr.update.HdfsTransactionLog.<init>(HdfsTransactionLog.java:130)
at org.apache.solr.update.HdfsUpdateLog.init(HdfsUpdateLog.java:202)
at org.apache.solr.update.UpdateHandler.<init>(UpdateHandler.java:137)
at org.apache.solr.update.UpdateHandler.<init>(UpdateHandler.java:94)
at org.apache.solr.update.DirectUpdateHandler2.<init>(DirectUpdateHandler2.java:102)
at sun.reflect.GeneratedConstructorAccessor174.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.solr.core.SolrCore.createInstance(SolrCore.java:737)
at org.apache.solr.core.SolrCore.createUpdateHandler(SolrCore.java:799)
at org.apache.solr.core.SolrCore.initUpdateHandler(SolrCore.java:1049)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:914)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:807)
at org.apache.solr.core.CoreContainer.create(CoreContainer.java:904)
at org.apache.solr.core.CoreContainer.lambda$load$3(CoreContainer.java:555)
at com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:197)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
at __randomizedtesting.SeedInfo.seed([C7ADB5AA436D7EF4]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNull(Assert.java:551)
at org.apache.solr.SolrTestCaseJ4.teardownTestCases(SolrTestCaseJ4.java:269)
at sun.reflect.GeneratedMethodAccessor86.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:870)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest.test
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([C7ADB5AA436D7EF4:4FF98A70ED91130C]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertTrue(Assert.java:54)
at org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest.test(HdfsWriteToMultipleCollectionsTest.java:137)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 1477 lines...]
[junit4] Suite: org.apache.lucene.index.TestIndexSorting
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestIndexSorting -Dtests.method=testRandom3 -Dtests.seed=B92E69CC2FAD4D04 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/test-data/enwiki.random.lines.txt -Dtests.locale=es-CU -Dtests.timezone=Jamaica -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[junit4] ERROR 76.1s J0 | TestIndexSorting.testRandom3 <<<
[junit4] > Throwable #1: java.lang.OutOfMemoryError: Java heap space
[junit4] > at __randomizedtesting.SeedInfo.seed([B92E69CC2FAD4D04:1BF627164B5F6402]:0)
[junit4] > at org.apache.lucene.util.packed.Packed8ThreeBlocks.<init>(Packed8ThreeBlocks.java:41)
[junit4] > at org.apache.lucene.util.packed.PackedInts.getMutable(PackedInts.java:963)
[junit4] > at org.apache.lucene.util.packed.PackedInts.getMutable(PackedInts.java:939)
[junit4] > at org.apache.lucene.util.packed.GrowableWriter.ensureCapacity(GrowableWriter.java:80)
[junit4] > at org.apache.lucene.util.packed.GrowableWriter.set(GrowableWriter.java:88)
[junit4] > at org.apache.lucene.util.packed.AbstractPagedMutable.set(AbstractPagedMutable.java:98)
[junit4] > at org.apache.lucene.util.fst.NodeHash.addNew(NodeHash.java:152)
[junit4] > at org.apache.lucene.util.fst.NodeHash.rehash(NodeHash.java:169)
[junit4] > at org.apache.lucene.util.fst.NodeHash.add(NodeHash.java:133)
[junit4] > at org.apache.lucene.util.fst.Builder.compileNode(Builder.java:214)
[junit4] > at org.apache.lucene.util.fst.Builder.freezeTail(Builder.java:310)
[junit4] > at org.apache.lucene.util.fst.Builder.add(Builder.java:414)
[junit4] > at org.apache.lucene.codecs.memory.MemoryDocValuesConsumer.writeFST(MemoryDocValuesConsumer.java:367)
[junit4] > at org.apache.lucene.codecs.memory.MemoryDocValuesConsumer.addSortedField(MemoryDocValuesConsumer.java:404)
[junit4] > at org.apache.lucene.codecs.DocValuesConsumer.mergeSortedField(DocValuesConsumer.java:653)
[junit4] > at org.apache.lucene.codecs.DocValuesConsumer.merge(DocValuesConsumer.java:204)
[junit4] > at org.apache.lucene.codecs.perfield.PerFieldDocValuesFormat$FieldsWriter.merge(PerFieldDocValuesFormat.java:153)
[junit4] > at org.apache.lucene.index.SegmentMerger.mergeDocValues(SegmentMerger.java:167)
[junit4] > at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:111)
[junit4] > at org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4363)
[junit4] > at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3940)
[junit4] > at org.apache.lucene.index.SerialMergeScheduler.merge(SerialMergeScheduler.java:40)
[junit4] > at org.apache.lucene.index.IndexWriter.maybeMerge(IndexWriter.java:2091)
[junit4] > at org.apache.lucene.index.IndexWriter.doAfterSegmentFlushed(IndexWriter.java:5004)
[junit4] > at org.apache.lucene.index.DocumentsWriter$MergePendingEvent.process(DocumentsWriter.java:731)
[junit4] > at org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:5042)
[junit4] > at org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:5033)
[junit4] > at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1582)
[junit4] > at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1324)
[junit4] > at org.apache.lucene.index.TestIndexSorting.testRandom3(TestIndexSorting.java:2229)
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/lucene/build/core/test/J0/temp/lucene.index.TestIndexSorting_B92E69CC2FAD4D04-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene62): {docs=BlockTreeOrds(blocksize=128), norms=BlockTreeOrds(blocksize=128), positions=FSTOrd50, id=BlockTreeOrds(blocksize=128), term_vectors=BlockTreeOrds(blocksize=128)}, docValues:{multi_valued_long=DocValuesFormat(name=Asserting), double=DocValuesFormat(name=Memory), foo=DocValuesFormat(name=Asserting), numeric=DocValuesFormat(name=Memory), positions=DocValuesFormat(name=Asserting), float=DocValuesFormat(name=Lucene54), multi_valued_numeric=DocValuesFormat(name=Memory), int=DocValuesFormat(name=Memory), long=DocValuesFormat(name=Lucene54), points=DocValuesFormat(name=Direct), bar=DocValuesFormat(name=Memory), sorted=DocValuesFormat(name=Memory), multi_valued_double=DocValuesFormat(name=Memory), docs=DocValuesFormat(name=Memory), multi_valued_string=DocValuesFormat(name=Memory), norms=DocValuesFormat(name=Memory), bytes=DocValuesFormat(name=Memory), binary=DocValuesFormat(name=Memory), id=DocValuesFormat(name=Memory), multi_valued_int=DocValuesFormat(name=Direct), multi_valued_bytes=DocValuesFormat(name=Memory), multi_valued_float=DocValuesFormat(name=Asserting), term_vectors=DocValuesFormat(name=Memory)}, maxPointsInLeafNode=1888, maxMBSortInHeap=5.37999386554413, sim=RandomSimilarity(queryNorm=false,coord=crazy): {positions=DFR GL1, id=DFR I(ne)1, term_vectors=DFR GBZ(0.3)}, locale=es-CU, timezone=Jamaica
[junit4] 2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_102 (64-bit)/cpus=4,threads=1,free=355526808,total=383254528
[junit4] 2> NOTE: All tests run in this JVM: [TestSpanFirstQuery, TestAllFilesDetectTruncation, TestIndexingSequenceNumbers, TestRegexpRandom2, TestCharArrayMap, TestNRTReaderCleanup, TestTimeLimitingCollector, TestCustomNorms, TestNearSpansOrdered, TestCustomSearcherSort, TestPersistentSnapshotDeletionPolicy, TestCharsRef, TestBagOfPositions, TestSynonymQuery, TestSparseFixedBitDocIdSet, TestLazyProxSkipping, TestSpanCollection, TestSortedNumericSortField, TestDocValues, TestOfflineSorter, TestPrefixCodedTerms, TestStandardAnalyzer, TestDelegatingAnalyzerWrapper, TestSort, TestDirectPacked, TestPerSegmentDeletes, TestDemoParallelLeafReader, TestRoaringDocIdSet, TestFrequencyTrackingRingBuffer, TestIndexInput, TestBlockPostingsFormat2, TestIndexWriterUnicode, TestTrackingDirectoryWrapper, TestStringMSBRadixSorter, TestNativeFSLockFactory, TestDeletionPolicy, TestIntroSelector, TestNumericRangeQuery64, TestDoubleValuesSource, TestTransactions, TestBasics, TestPrefixQuery, TestAxiomaticSimilarity, TestIntsRef, TestDirectory, TestField, TestFastCompressionMode, TestCharTermAttributeImpl, TestDocIdSetBuilder, TestPhrasePrefixQuery, TestDocumentWriter, TestSegmentMerger, TestElevationComparator, TestSwappedIndexFiles, Test2BDocs, TestMultiValuedNumericRangeQuery, TestMaxTermFrequency, TestCrashCausesCorruptIndex, TestControlledRealTimeReopenThread, TestIndexReaderClose, TestIndexFileDeleter, TestIndexWriterExceptions2, TestTragicIndexWriterDeadlock, TestLongPostings, TestCodecHoldsOpenFiles, FiniteStringsIteratorTest, TestSegmentInfos, TestFieldMaskingSpanQuery, TestLucene50TermVectorsFormat, TestLucene54DocValuesFormat, Test2BSortedDocValuesFixedSorted, TestThreadedForceMerge, TestBlendedTermQuery, TestNRTCachingDirectory, TestSimpleFSLockFactory, TestPointValues, TestNorms, TestIndexWriterCommit, TestSearchWithThreads, TestConcurrentMergeScheduler, TestHighCompressionMode, TestDocumentsWriterStallControl, Test2BPoints, TestAllFilesHaveChecksumFooter, TestDocIDMerger, TestExceedMaxTermLength, TestExitableDirectoryReader, TestIndexSorting]
[junit4] Completed [383/451 (1!)] on J0 in 122.16s, 48 tests, 1 error <<< FAILURES!
[...truncated 229 lines...]
[junit4] JVM J0: stdout was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/lucene/build/core/test/temp/junit4-J0-20170208_004149_5774942643123258049452.sysout
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] java.lang.OutOfMemoryError: Java heap space
[junit4] Dumping heap to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/heapdumps/java_pid28001.hprof ...
[junit4] Heap dump file created [439536777 bytes in 1.869 secs]
[junit4] <<< JVM J0: EOF ----
[...truncated 10147 lines...]
[junit4] Suite: org.apache.solr.cloud.CdcrReplicationDistributedZkTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.CdcrReplicationDistributedZkTest_C7ADB5AA436D7EF4-001/init-core-data-001
[junit4] 2> 224532 INFO (SUITE-CdcrReplicationDistributedZkTest-seed#[C7ADB5AA436D7EF4]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 2> 224532 INFO (SUITE-CdcrReplicationDistributedZkTest-seed#[C7ADB5AA436D7EF4]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
[junit4] 2> 224547 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 224561 INFO (Thread-352) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 224561 INFO (Thread-352) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 224648 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [ ] o.a.s.c.ZkTestServer start zk server on port:60543
[junit4] 2> 224700 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/solrconfig-cdcr.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 224703 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 224704 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 224706 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 224707 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 224709 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 224710 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 224711 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 224713 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 224714 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 224716 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 224719 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testReplicationStartStop
[junit4] 2> 224851 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.CdcrReplicationDistributedZkTest_C7ADB5AA436D7EF4-001/jetty-001/cores/collection1
[junit4] 2> 224853 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 224867 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@13eff365{/,null,AVAILABLE}
[junit4] 2> 224867 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@51ebee52{HTTP/1.1,[http/1.1]}{127.0.0.1:43525}
[junit4] 2> 224867 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [ ] o.e.j.s.Server Started @229145ms
[junit4] 2> 224867 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {shards=shard1, hostContext=/, hostPort=43525, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.CdcrReplicationDistributedZkTest_C7ADB5AA436D7EF4-001/jetty-001/cores}
[junit4] 2> 224868 ERROR (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 224868 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 6.5.0
[junit4] 2> 224868 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 224868 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 224868 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-02-08T04:05:08.730Z
[junit4] 2> 224875 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 224875 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.CdcrReplicationDistributedZkTest_C7ADB5AA436D7EF4-001/jetty-001/solr.xml
[junit4] 2> 224899 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 224900 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:60543/solr
[junit4] 2> 224943 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [n:127.0.0.1:43525_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:43525_
[junit4] 2> 224944 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [n:127.0.0.1:43525_ ] o.a.s.c.Overseer Overseer (id=97421014364323844-127.0.0.1:43525_-n_0000000000) starting
[junit4] 2> 224988 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [n:127.0.0.1:43525_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43525_
[junit4] 2> 224990 INFO (zkCallback-281-thread-1-processing-n:127.0.0.1:43525_) [n:127.0.0.1:43525_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 225074 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [n:127.0.0.1:43525_ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.CdcrReplicationDistributedZkTest_C7ADB5AA436D7EF4-001/jetty-001/cores
[junit4] 2> 225074 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [n:127.0.0.1:43525_ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 225077 INFO (OverseerStateUpdate-97421014364323844-127.0.0.1:43525_-n_0000000000) [n:127.0.0.1:43525_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2
[junit4] 2> 225084 INFO (coreLoadExecutor-816-thread-1-processing-n:127.0.0.1:43525_) [n:127.0.0.1:43525_ c:tmp_collection x:collection1] o.a.s.c.CreateCollectionCmd Only one config set found in zk - using it:conf1
[junit4] 2> 225101 WARN (coreLoadExecutor-816-thread-1-processing-n:127.0.0.1:43525_) [n:127.0.0.1:43525_ c:tmp_collection x:collection1] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
[junit4] 2> 225102 INFO (coreLoadExecutor-816-thread-1-processing-n:127.0.0.1:43525_) [n:127.0.0.1:43525_ c:tmp_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
[junit4] 2> 225115 INFO (coreLoadExecutor-816-thread-1-processing-n:127.0.0.1:43525_) [n:127.0.0.1:43525_ c:tmp_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 225197 WARN (coreLoadExecutor-816-thread-1-processing-n:127.0.0.1:43525_) [n:127.0.0.1:43525_ c:tmp_collection x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 225198 INFO (coreLoadExecutor-816-thread-1-processing-n:127.0.0.1:43525_) [n:127.0.0.1:43525_ c:tmp_collection x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 225217 INFO (coreLoadExecutor-816-thread-1-processing-n:127.0.0.1:43525_) [n:127.0.0.1:43525_ c:tmp_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection tmp_collection
[junit4] 2> 225218 INFO (coreLoadExecutor-816-thread-1-processing-n:127.0.0.1:43525_) [n:127.0.0.1:43525_ c:tmp_collection x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.CdcrReplicationDistributedZkTest_C7ADB5AA436D7EF4-001/jetty-001/cores/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.CdcrReplicationDistributedZkTest_C7ADB5AA436D7EF4-001/jetty-001/cores/collection1/data/]
[junit4] 2> 225218 INFO (coreLoadExecutor-816-thread-1-processing-n:127.0.0.1:43525_) [n:127.0.0.1:43525_ c:tmp_collection x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@9b0b3ad
[junit4] 2> 225219 INFO (coreLoadExecutor-816-thread-1-processing-n:127.0.0.1:43525_) [n:127.0.0.1:43525_ c:tmp_collection x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=10, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 225300 INFO (coreLoadExecutor-816-thread-1-processing-n:127.0.0.1:43525_) [n:127.0.0.1:43525_ c:tmp_collection x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.CdcrUpdateLog
[junit4] 2> 225300 INFO (coreLoadExecutor-816-thread-1-processing-n:127.0.0.1:43525_) [n:127.0.0.1:43525_ c:tmp_collection x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 225301 INFO (coreLoadExecutor-816-thread-1-processing-n:127.0.0.1:43525_) [n:127.0.0.1:43525_ c:tmp_collection x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 225301 INFO (coreLoadExecutor-816-thread-1-processing-n:127.0.0.1:43525_) [n:127.0.0.1:43525_ c:tmp_collection x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 225301 INFO (coreLoadExecutor-816-thread-1-processing-n:127.0.0.1:43525_) [n:127.0.0.1:43525_ c:tmp_collection x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=34, maxMergeAtOnceExplicit=43, maxMergedSegmentMB=19.212890625, floorSegmentMB=0.2890625, forceMergeDeletesPctAllowed=11.853442286861272, segmentsPerTier=18.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 225302 INFO (coreLoadExecutor-816-thread-1-processing-n:127.0.0.1:43525_) [n:127.0.0.1:43525_ c:tmp_collection x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@1c0d728e[collection1] main]
[junit4] 2> 225303 INFO (coreLoadExecutor-816-thread-1-processing-n:127.0.0.1:43525_) [n:127.0.0.1:43525_ c:tmp_collection x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 225303 INFO (coreLoadExecutor-816-thread-1-processing-n:127.0.0.1:43525_) [n:127.0.0.1:43525_ c:tmp_collection x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 225304 INFO (coreLoadExecutor-816-thread-1-processing-n:127.0.0.1:43525_) [n:127.0.0.1:43525_ c:tmp_collection x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 225310 INFO (coreLoadExecutor-816-thread-1-processing-n:127.0.0.1:43525_) [n:127.0.0.1:43525_ c:tmp_collection x:collection1] o.a.s.h.CdcrBufferStateManager Created znode /collections/tmp_collection/cdcr/state/buffer
[junit4] 2> 225314 INFO (coreLoadExecutor-816-thread-1-processing-n:127.0.0.1:43525_) [n:127.0.0.1:43525_ c:tmp_collection x:collection1] o.a.s.h.CdcrProcessStateManager Created znode /collections/tmp_collection/cdcr/state/process
[junit4] 2> 225334 INFO (searcherExecutor-817-thread-1-processing-n:127.0.0.1:43525_ x:collection1 c:tmp_collection) [n:127.0.0.1:43525_ c:tmp_collection x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@1c0d728e[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 225334 INFO (coreLoadExecutor-816-thread-1-processing-n:127.0.0.1:43525_) [n:127.0.0.1:43525_ c:tmp_collection x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1558736230621904896
[junit4] 2> 225342 INFO (coreZkRegister-809-thread-1-processing-n:127.0.0.1:43525_ x:collection1 c:tmp_collection) [n:127.0.0.1:43525_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 225342 INFO (coreZkRegister-809-thread-1-processing-n:127.0.0.1:43525_ x:collection1 c:tmp_collection) [n:127.0.0.1:43525_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 225342 INFO (coreZkRegister-809-thread-1-processing-n:127.0.0.1:43525_ x:collection1 c:tmp_collection) [n:127.0.0.1:43525_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:43525/collection1/
[junit4] 2> 225342 INFO (coreZkRegister-809-thread-1-processing-n:127.0.0.1:43525_ x:collection1 c:tmp_collection) [n:127.0.0.1:43525_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 225342 INFO (coreZkRegister-809-thread-1-processing-n:127.0.0.1:43525_ x:collection1 c:tmp_collection) [n:127.0.0.1:43525_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:43525/collection1/ has no replicas
[junit4] 2> 225347 INFO (zkCallback-281-thread-1-processing-n:127.0.0.1:43525_) [n:127.0.0.1:43525_ ] o.a.s.h.CdcrLeaderStateManager Received new leader state @ tmp_collection:shard2
[junit4] 2> 225359 INFO (coreZkRegister-809-thread-1-processing-n:127.0.0.1:43525_ x:collection1 c:tmp_collection) [n:127.0.0.1:43525_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:43525/collection1/ shard2
[junit4] 2> 225511 INFO (coreZkRegister-809-thread-1-processing-n:127.0.0.1:43525_ x:collection1 c:tmp_collection) [n:127.0.0.1:43525_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 225787 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.CdcrReplicationDistributedZkTest_C7ADB5AA436D7EF4-001/jetty-002/cores/collection1
[junit4] 2> 225788 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 225790 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2ccf3c56{/,null,AVAILABLE}
[junit4] 2> 225790 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@23e7ae05{HTTP/1.1,[http/1.1]}{127.0.0.1:53463}
[junit4] 2> 225790 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [ ] o.e.j.s.Server Started @230068ms
[junit4] 2> 225790 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {shards=shard2, hostContext=/, hostPort=53463, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.CdcrReplicationDistributedZkTest_C7ADB5AA436D7EF4-001/jetty-002/cores}
[junit4] 2> 225790 ERROR (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 225791 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 6.5.0
[junit4] 2> 225791 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 225791 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 225791 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-02-08T04:05:09.653Z
[junit4] 2> 225800 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 225800 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.CdcrReplicationDistributedZkTest_C7ADB5AA436D7EF4-001/jetty-002/solr.xml
[junit4] 2> 225807 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 225807 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:60543/solr
[junit4] 2> 225819 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [n:127.0.0.1:53463_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 225824 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [n:127.0.0.1:53463_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53463_
[junit4] 2> 225827 INFO (zkCallback-281-thread-3-processing-n:127.0.0.1:43525_) [n:127.0.0.1:43525_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 225828 INFO (zkCallback-287-thread-1-processing-n:127.0.0.1:53463_) [n:127.0.0.1:53463_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 225884 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [n:127.0.0.1:53463_ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.CdcrReplicationDistributedZkTest_C7ADB5AA436D7EF4-001/jetty-002/cores
[junit4] 2> 225884 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [n:127.0.0.1:53463_ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 225887 INFO (OverseerStateUpdate-97421014364323844-127.0.0.1:43525_-n_0000000000) [n:127.0.0.1:43525_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 226903 WARN (coreLoadExecutor-828-thread-1-processing-n:127.0.0.1:53463_) [n:127.0.0.1:53463_ c:tmp_collection x:collection1] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
[junit4] 2> 226903 INFO (coreLoadExecutor-828-thread-1-processing-n:127.0.0.1:53463_) [n:127.0.0.1:53463_ c:tmp_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
[junit4] 2> 226915 INFO (coreLoadExecutor-828-thread-1-processing-n:127.0.0.1:53463_) [n:127.0.0.1:53463_ c:tmp_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 226996 WARN (coreLoadExecutor-828-thread-1-processing-n:127.0.0.1:53463_) [n:127.0.0.1:53463_ c:tmp_collection x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 226998 INFO (coreLoadExecutor-828-thread-1-processing-n:127.0.0.1:53463_) [n:127.0.0.1:53463_ c:tmp_collection x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 227017 INFO (coreLoadExecutor-828-thread-1-processing-n:127.0.0.1:53463_) [n:127.0.0.1:53463_ c:tmp_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection tmp_collection
[junit4] 2> 227018 INFO (coreLoadExecutor-828-thread-1-processing-n:127.0.0.1:53463_) [n:127.0.0.1:53463_ c:tmp_collection x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.CdcrReplicationDistributedZkTest_C7ADB5AA436D7EF4-001/jetty-002/cores/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.CdcrReplicationDistributedZkTest_C7ADB5AA436D7EF4-001/jetty-002/cores/collection1/data/]
[junit4] 2> 227018 INFO (coreLoadExecutor-828-thread-1-processing-n:127.0.0.1:53463_) [n:127.0.0.1:53463_ c:tmp_collection x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@9b0b3ad
[junit4] 2> 227019 INFO (coreLoadExecutor-828-thread-1-processing-n:127.0.0.1:53463_) [n:127.0.0.1:53463_ c:tmp_collection x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=10, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 227070 INFO (coreLoadExecutor-828-thread-1-processing-n:127.0.0.1:53463_) [n:127.0.0.1:53463_ c:tmp_collection x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.CdcrUpdateLog
[junit4] 2> 227070 INFO (coreLoadExecutor-828-thread-1-processing-n:127.0.0.1:53463_) [n:127.0.0.1:53463_ c:tmp_collection x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 227071 INFO (coreLoadExecutor-828-thread-1-processing-n:127.0.0.1:53463_) [n:127.0.0.1:53463_ c:tmp_collection x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 227071 INFO (coreLoadExecutor-828-thread-1-processing-n:127.0.0.1:53463_) [n:127.0.0.1:53463_ c:tmp_collection x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 227072 INFO (coreLoadExecutor-828-thread-1-processing-n:127.0.0.1:53463_) [n:127.0.0.1:53463_ c:tmp_collection x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=34, maxMergeAtOnceExplicit=43, maxMergedSegmentMB=19.212890625, floorSegmentMB=0.2890625, forceMergeDeletesPctAllowed=11.853442286861272, segmentsPerTier=18.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 227073 INFO (coreLoadExecutor-828-thread-1-processing-n:127.0.0.1:53463_) [n:127.0.0.1:53463_ c:tmp_collection x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@58582f93[collection1] main]
[junit4] 2> 227074 INFO (coreLoadExecutor-828-thread-1-processing-n:127.0.0.1:53463_) [n:127.0.0.1:53463_ c:tmp_collection x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 227074 INFO (coreLoadExecutor-828-thread-1-processing-n:127.0.0.1:53463_) [n:127.0.0.1:53463_ c:tmp_collection x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 227074 INFO (coreLoadExecutor-828-thread-1-processing-n:127.0.0.1:53463_) [n:127.0.0.1:53463_ c:tmp_collection x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 227077 INFO (searcherExecutor-829-thread-1-processing-n:127.0.0.1:53463_ x:collection1 c:tmp_collection) [n:127.0.0.1:53463_ c:tmp_collection x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@58582f93[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 227077 INFO (coreLoadExecutor-828-thread-1-processing-n:127.0.0.1:53463_) [n:127.0.0.1:53463_ c:tmp_collection x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1558736232449572864
[junit4] 2> 227084 INFO (coreZkRegister-823-thread-1-processing-n:127.0.0.1:53463_ x:collection1 c:tmp_collection) [n:127.0.0.1:53463_ c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 227084 INFO (coreZkRegister-823-thread-1-processing-n:127.0.0.1:53463_ x:collection1 c:tmp_collection) [n:127.0.0.1:53463_ c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 227085 INFO (coreZkRegister-823-thread-1-processing-n:127.0.0.1:53463_ x:collection1 c:tmp_collection) [n:127.0.0.1:53463_ c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:53463/collection1/
[junit4] 2> 227085 INFO (coreZkRegister-823-thread-1-processing-n:127.0.0.1:53463_ x:collection1 c:tmp_collection) [n:127.0.0.1:53463_ c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 227085 INFO (coreZkRegister-823-thread-1-processing-n:127.0.0.1:53463_ x:collection1 c:tmp_collection) [n:127.0.0.1:53463_ c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:53463/collection1/ has no replicas
[junit4] 2> 227088 INFO (zkCallback-287-thread-1-processing-n:127.0.0.1:53463_) [n:127.0.0.1:53463_ ] o.a.s.h.CdcrLeaderStateManager Received new leader state @ tmp_collection:shard1
[junit4] 2> 227091 INFO (coreZkRegister-823-thread-1-processing-n:127.0.0.1:53463_ x:collection1 c:tmp_collection) [n:127.0.0.1:53463_ c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:53463/collection1/ shard1
[junit4] 2> 227243 INFO (coreZkRegister-823-thread-1-processing-n:127.0.0.1:53463_ x:collection1 c:tmp_collection) [n:127.0.0.1:53463_ c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 227594 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.CdcrReplicationDistributedZkTest_C7ADB5AA436D7EF4-001/jetty-003/cores/collection1
[junit4] 2> 227596 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 227597 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3224fffd{/,null,AVAILABLE}
[junit4] 2> 227598 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@41b1272e{HTTP/1.1,[http/1.1]}{127.0.0.1:48903}
[junit4] 2> 227598 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [ ] o.e.j.s.Server Started @231876ms
[junit4] 2> 227598 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {shards=shard3, hostContext=/, hostPort=48903, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.CdcrReplicationDistributedZkTest_C7ADB5AA436D7EF4-001/jetty-003/cores}
[junit4] 2> 227599 ERROR (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 227599 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 6.5.0
[junit4] 2> 227599 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 227599 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 227599 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-02-08T04:05:11.461Z
[junit4] 2> 227602 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 227602 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.CdcrReplicationDistributedZkTest_C7ADB5AA436D7EF4-001/jetty-003/solr.xml
[junit4] 2> 227610 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 227611 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:60543/solr
[junit4] 2> 227626 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [n:127.0.0.1:48903_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 227631 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [n:127.0.0.1:48903_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48903_
[junit4] 2> 227633 INFO (zkCallback-281-thread-2-processing-n:127.0.0.1:43525_) [n:127.0.0.1:43525_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 227634 INFO (zkCallback-287-thread-1-processing-n:127.0.0.1:53463_) [n:127.0.0.1:53463_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 227645 INFO (zkCallback-293-thread-1-processing-n:127.0.0.1:48903_) [n:127.0.0.1:48903_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 227707 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [n:127.0.0.1:48903_ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.CdcrReplicationDistributedZkTest_C7ADB5AA436D7EF4-001/jetty-003/cores
[junit4] 2> 227707 INFO (TEST-CdcrReplicationDistributedZkTest.testReplicationStartStop-seed#[C7ADB5AA436D7EF4]) [n:127.0.0.1:48903_ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 227709 INFO (OverseerStateUpdate-97421014364323844-127.0.0.1:43525_-n_0000000000) [n:127.0.0.1:43525_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2
[junit4] 2> 228770 WARN (coreLoadExecutor-840-thread-1-processing-n:127.0.0.1:48903_) [n:127.0.0.1:48903_ c:tmp_collection x:collection1] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
[junit4] 2> 228771 INFO (coreLoadExecutor-840-thread-1-processing-n:127.0.0.1:48903_) [n:127.0.0.1:48903_ c:tmp_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
[junit4] 2> 228783 INFO (coreLoadExecutor-840-thread-1-processing-n:127.0.0.1:48903_) [n:127.0.0.1:48903_ c:tmp_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 228859 WARN (coreLoadExecutor-840-thread-1-processing-n:127.0.0.1:48903_) [n:127.0.0.1:48903_ c:tmp_collection x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 228860 INFO (coreLoadExecutor-840-thread-1-processing-n:127.0.0.1:48903_) [n:127.0.0.1:48903_ c:tmp_collection x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 228883 INFO (coreLoadExecutor-840-thread-1-processing-n:127.0.0.1:48903_) [n:127.0.0.1:48903_ c:tmp_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection tmp_collection
[junit4] 2> 228884 INFO (coreLoadExecutor-840-thread-1-processing-n:127.0.0.1:48903_) [n:127.0.0.1:48903_ c:tmp_collection x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.CdcrReplicationDistributedZkTest_C7ADB5AA436D7EF4-001/jetty-003/cores/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.CdcrReplicationDistributedZkTest_C7ADB5AA436D7EF4-001/jetty-003/cores/collection1/data/]
[junit4] 2> 228884 INFO (coreLoadExecutor-840-thread-1-processing-n:127.0.0.1:48903_) [n:127.0.0.1:48903_ c:tmp_collection x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@9b0b3ad
[junit4] 2> 228886 INFO (coreLoadExecutor-840-thread-1-processing-n:127.0.0.1:48903_) [n:127.0.0.1:48903_ c:tmp_collection x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=10, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 228966 INFO (coreLoadExecutor-840-thread-1-processing-n:127.0.0.1:48903_) [n:127.0.0.1:48903_ c:tmp_collection x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.CdcrUpdateLog
[junit4] 2> 228966 INFO (coreLoadExecutor-840-thread-1-processing-n:127.0.0.1:48903_) [n:127.0.0.1:48903_ c:tmp_collection x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 228999 INFO (coreLoadExecutor-840-thread-1-processing-n:127.0.0.1:48903_) [n:127.0.0.1:48903_ c:tmp_collection x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 228999 INFO (coreLoadExecutor-840-thread-1-processing-n:127.0.0.1:48903_) [n:127.0.0.1:48903_ c:tmp_collection x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 229001 INFO (coreLoadExecutor-840-thread-1-processing-n:127.0.0.1:48903_) [n:127.0.0.1:48903_ c:tmp_collection x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=34, maxMergeAtOnceExplicit=43, maxMergedSegmentMB=19.212890625, floorSegmentMB=0.2890625, forceMergeDeletesPctAllowed=11.853442286861272, segmentsPerTier=18.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 229001 INFO (coreLoadExecutor-840-thread-1-processing-n:127.0.0.1:48903_) [n:127.0.0.1:48903_ c:tmp_collection x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@12cdc912[collection1] main]
[junit4] 2> 229008 INFO (coreLoadExecutor-840-thread-1-processing-n:127.0.0.1:48903_) [n:127.0.0.1:48903_ c:tmp_collection x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 229008 INFO (coreLoadExecutor-840-thread-1-processing-n:127.0.0.1:48903_) [n:127.0.0.1:48903_ c:tmp_collection x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 229008 INFO (coreLoadExecutor-840-thread-1-processing-n:127.0.0.1:48903_) [n:127.0.0.1:48903_ c:tmp_collection x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 229013 INFO (coreLoadExecutor-840-thread-1-processing-n:127.0.0.1:48903_) [n:127.0.0.1:48903_ c:tmp_collection x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1558736234479616000
[junit4] 2> 229014 INFO (searcherExecutor-841-thread-1-processing-n:127.0.0.1:48903_ x:collection1 c:tmp_collection) [n:127.0.0.1:48903_ c:tmp_collection x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@12cdc912[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 229028 INFO (coreZkRegister-835-thread-1-processing-n:127.0.0.1:48903_ x:collection1 c:tmp_collection) [n:127.0.0.1:48903_ c:tmp_collection s:shard2 r:core_node3 x:collection1] o.a.s.c.ZkController Core needs to recover:collection1
[junit4] 2> 229030 INFO (updateExecutor-290-thread-1-processing-n:127.0.0.1:48903_ x:collection1 s:shard2 c:tmp_collection r:core_node3) [n:127.0.0.1:48903_ c:tmp_collection s:shard2 r:core_node3 x:collection1] o.a.s.u.DefaultSolrCoreState Running recovery
[junit4] 2> 229043 INFO (recoveryExecutor-291-thread-1-processing-n:127.0.0.1:48903_ x:collection1 s:shard2 c:tmp_collection r:core_node3) [n:127.0.0.1:48903_ c:tmp_collection s:shard2 r:core_node3 x:collection1] o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=true
[junit4] 2> 229044 INFO (recoveryExecutor-291-thread-1-processing-n:127.0.0.1:48903_ x:collection1 s:shard2 c:tmp_collection r:core_node3) [n:127.0.0.1:48903_ c:tmp_collection s:shard2 r:core_node3 x:collection1] o.a.s.c.RecoveryStrategy ###### startupVersions=[[]]
[junit4] 2> 229044 INFO (recoveryExecutor-291-thread-1-processing-n:127.0.0.1:48903_ x:collection1 s:shard2 c:tmp_collection r:core_node3) [n:127.0.0.1:48903_ c:tmp_collection s:shard2 r:core_node3 x:collection1] o.a.s.c.RecoveryStrategy Begin buffering updates. core=[collection1]
[junit4] 2> 229044 INFO (recoveryExecutor-291-thread-1-processing-n:127.0.0.1:48903_ x:collection1 s:shard2 c:tmp_collection r:core_node3) [n:127.0.0.1:48903_ c:tmp_collection s:shard2 r:core_node3 x:collection1] o.a.s.u.UpdateLog Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4] 2> 229044 INFO (recoveryExecutor-291-thread-1-processing-n:127.0.0.1:48903_ x:collection1 s:shard2 c:tmp_collection r:core_node3) [n:127.0.0.1:48903_ c:tmp_collection s:shard2 r:core_node3 x:collection1] o.a.s.c.RecoveryStrategy Publishing state of core [collection1] as recovering, leader is [http://127.0.0.1:43525/collection1/] and I am [http://127.0.0.1:48903/collection1/]
[junit4] 2> 229047 INFO (recoveryExecutor-291-thread-1-processing-n:127.0.0.1:48903_ x:collection1 s:shard2 c:tmp_collection r:core_node3) [n:127.0.0.1:48903_ c:tmp_collection s:shard2 r:core_node3 x:collection1] o.a.s.c.RecoveryStrategy Sending prep recovery command to [http://127.0.0.1:43525]; [WaitForState: action=PREPRECOVERY&core=collection1&nodeName=127.0.0.1:48903_&coreNodeName=core_node3&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true]
[junit4] 2> 229055 INFO (qtp714401321-1443) [n:127.0.0.1:43525_ ] o.a.s.h.a.PrepRecoveryOp Going to wait for coreNodeName: core_node3, state: recovering, checkLive: tru
[...truncated too long message...]
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> Caused by: java.lang.NullPointerException
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlocksMap.size(BlocksMap.java:203)
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.getTotalBlocks(BlockManager.java:3370)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlocksTotal(FSNamesystem.java:5729)
[junit4] 2> ... 53 more
[junit4] 2> 4876304 INFO (SUITE-HdfsRecoveryZkTest-seed#[C7ADB5AA436D7EF4]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:53618 53618
[junit4] 2> 4876304 INFO (SUITE-HdfsRecoveryZkTest-seed#[C7ADB5AA436D7EF4]-worker) [ ] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene62): {rnd_b=PostingsFormat(name=LuceneFixedGap), _version_=Lucene50(blocksize=128), a_t=Lucene50(blocksize=128), a_i=PostingsFormat(name=LuceneFixedGap), id=PostingsFormat(name=LuceneFixedGap)}, docValues:{}, maxPointsInLeafNode=25, maxMBSortInHeap=5.471213637757435, sim=RandomSimilarity(queryNorm=true,coord=no): {}, locale=bg-BG, timezone=Africa/Blantyre
[junit4] 2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_102 (64-bit)/cpus=4,threads=2,free=211290336,total=525860864
[junit4] 2> NOTE: All tests run in this JVM: [StressHdfsTest, TestAddFieldRealTimeGet, TestCodecSupport, TestChildDocTransformer, HdfsTlogReplayBufferedWhileIndexingTest, TestConfigsApi, AnalysisErrorHandlingTest, HdfsChaosMonkeyNothingIsSafeTest, SolrCoreTest, CdcrBootstrapTest, BadCopyFieldTest, VMParamsZkACLAndCredentialsProvidersTest, TestReqParamsAPI, TestSha256AuthenticationProvider, CollectionStateFormat2Test, TestInfoStreamLogging, TestFieldSortValues, TestSerializedLuceneMatchVersion, ClusterStateTest, QueryElevationComponentTest, SolrSlf4jReporterTest, TestBulkSchemaConcurrent, TestMissingGroups, NumericFieldsTest, TestBackupRepositoryFactory, CoreAdminRequestStatusTest, BitVectorTest, TestRandomDVFaceting, RulesTest, TestRangeQuery, DistributedExpandComponentTest, AddSchemaFieldsUpdateProcessorFactoryTest, TestRequestForwarding, TestAtomicUpdateErrorCases, LeaderFailoverAfterPartitionTest, OverseerCollectionConfigSetProcessorTest, DocExpirationUpdateProcessorFactoryTest, TestComponentsName, TestReplicationHandler, TestUniqueKeyFieldResource, TestCrossCoreJoin, RecoveryAfterSoftCommitTest, TestJsonFacets, TestDynamicFieldResource, HdfsRestartWhileUpdatingTest, TestManagedSchemaAPI, TestExceedMaxTermLength, TestSolr4Spatial2, TestRTimerTree, TestAuthenticationFramework, ReturnFieldsTest, RequiredFieldsTest, TestRandomFaceting, TestMiniSolrCloudClusterSSL, JSONWriterTest, TestJmxIntegration, TestIBSimilarityFactory, TestFoldingMultitermQuery, TestDistribIDF, ConnectionManagerTest, LeaderElectionIntegrationTest, TestBadConfig, JavabinLoaderTest, CurrencyFieldOpenExchangeTest, DefaultValueUpdateProcessorTest, TestSegmentSorting, TestRawResponseWriter, TestQuerySenderNoQuery, DistributedFacetPivotWhiteBoxTest, TestFieldCacheSort, AlternateDirectoryTest, ManagedSchemaRoundRobinCloudTest, ZkStateWriterTest, TestPHPSerializedResponseWriter, DateFieldTest, TestPerFieldSimilarityWithDefaultOverride, CacheHeaderTest, UtilsToolTest, TestPathTrie, TestSQLHandlerNonCloud, TestConfigReload, TestSearcherReuse, TestDFISimilarityFactory, CleanupOldIndexTest, TestFileDictionaryLookup, ReplicationFactorTest, TestScoreJoinQPNoScore, ForceLeaderTest, DistributedQueryElevationComponentTest, TestSolrCloudWithDelegationTokens, DistributedSpellCheckComponentTest, FastVectorHighlighterTest, TestJoin, TestExpandComponent, DocumentAnalysisRequestHandlerTest, DistanceUnitsTest, DeleteReplicaTest, ReplicaListTransformerTest, DeleteInactiveReplicaTest, CursorPagingTest, TestQueryWrapperFilter, TestRandomRequestDistribution, SynonymTokenizerTest, TestConfigSetsAPIExclusivity, NotRequiredUniqueKeyTest, TestFaceting, BlockCacheTest, DistributedFacetPivotLongTailTest, ConjunctionSolrSpellCheckerTest, TestSchemaResource, MultiThreadedOCPTest, UniqFieldsUpdateProcessorFactoryTest, TestLockTree, TestTolerantUpdateProcessorRandomCloud, ExitableDirectoryReaderTest, LeaderElectionTest, TestZkChroot, ZkCLITest, TestDistributedSearch, CdcrVersionReplicationTest, CollectionsAPISolrJTest, CreateCollectionCleanupTest, DistribCursorPagingTest, SolrCLIZkUtilsTest, TestCloudDeleteByQuery, TestCloudInspectUtil, TestCloudPivotFacet, TestCloudPseudoReturnFields, TestCloudRecovery, TestDownShardTolerantSearch, TestLeaderElectionZkExpiry, TestRandomFlRTGCloud, HdfsBasicDistributedZk2Test, HdfsCollectionsAPIDistributedZkTest, HdfsNNFailoverTest, HdfsRecoverLeaseTest, HdfsRecoveryZkTest]
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=HdfsRecoveryZkTest -Dtests.seed=C7ADB5AA436D7EF4 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/test-data/enwiki.random.lines.txt -Dtests.locale=bg-BG -Dtests.timezone=Africa/Blantyre -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] ERROR 0.00s J0 | HdfsRecoveryZkTest (suite) <<<
[junit4] > Throwable #1: java.lang.AssertionError: ObjectTracker found 1 object(s) that were not released!!! [HdfsTransactionLog]
[junit4] > org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException
[junit4] > at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:43)
[junit4] > at org.apache.solr.update.HdfsTransactionLog.<init>(HdfsTransactionLog.java:130)
[junit4] > at org.apache.solr.update.HdfsUpdateLog.init(HdfsUpdateLog.java:202)
[junit4] > at org.apache.solr.update.UpdateHandler.<init>(UpdateHandler.java:137)
[junit4] > at org.apache.solr.update.UpdateHandler.<init>(UpdateHandler.java:94)
[junit4] > at org.apache.solr.update.DirectUpdateHandler2.<init>(DirectUpdateHandler2.java:102)
[junit4] > at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
[junit4] > at org.apache.solr.core.SolrCore.createInstance(SolrCore.java:737)
[junit4] > at org.apache.solr.core.SolrCore.createUpdateHandler(SolrCore.java:799)
[junit4] > at org.apache.solr.core.SolrCore.initUpdateHandler(SolrCore.java:1049)
[junit4] > at org.apache.solr.core.SolrCore.<init>(SolrCore.java:914)
[junit4] > at org.apache.solr.core.SolrCore.<init>(SolrCore.java:807)
[junit4] > at org.apache.solr.core.CoreContainer.create(CoreContainer.java:904)
[junit4] > at org.apache.solr.core.CoreContainer.lambda$load$3(CoreContainer.java:555)
[junit4] > at com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:197)
[junit4] > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] > at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > at __randomizedtesting.SeedInfo.seed([C7ADB5AA436D7EF4]:0)
[junit4] > at org.apache.solr.SolrTestCaseJ4.teardownTestCases(SolrTestCaseJ4.java:269)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] Completed [537/690 (5!)] on J0 in 59.29s, 1 test, 1 failure <<< FAILURES!
[...truncated 12161 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/build.xml:783: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/build.xml:727: Some of the tests produced a heap dump, but did not fail. Maybe a suppressed OutOfMemoryError? Dumps created:
* java_pid28001.hprof
Total time: 307 minutes 24 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-6.x - Build # 275 - Still
Unstable
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.x/275/
6 tests failed.
FAILED: org.apache.solr.TestDistributedSearch.test
Error Message:
Captured an uncaught exception in thread: Thread[id=56167, name=Thread-50578, state=RUNNABLE, group=TGRP-TestDistributedSearch]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=56167, name=Thread-50578, state=RUNNABLE, group=TGRP-TestDistributedSearch]
Caused by: java.lang.AssertionError: Expected to find shardAddress in the up shard info
at __randomizedtesting.SeedInfo.seed([133465527413FA1F]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.TestDistributedSearch.comparePartialResponses(TestDistributedSearch.java:1174)
at org.apache.solr.TestDistributedSearch$1.run(TestDistributedSearch.java:1130)
FAILED: org.apache.solr.cloud.TestLeaderElectionWithEmptyReplica.test
Error Message:
Stack Trace:
java.util.concurrent.TimeoutException
at __randomizedtesting.SeedInfo.seed([133465527413FA1F:9B605A88DAEF97E7]:0)
at org.apache.solr.common.cloud.ZkStateReader.waitForState(ZkStateReader.java:1251)
at org.apache.solr.client.solrj.impl.CloudSolrClient.waitForState(CloudSolrClient.java:702)
at org.apache.solr.cloud.TestLeaderElectionWithEmptyReplica.test(TestLeaderElectionWithEmptyReplica.java:97)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.hdfs.HdfsRecoveryZkTest
Error Message:
ObjectTracker found 1 object(s) that were not released!!! [HdfsTransactionLog] org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:43) at org.apache.solr.update.HdfsTransactionLog.<init>(HdfsTransactionLog.java:130) at org.apache.solr.update.HdfsUpdateLog.init(HdfsUpdateLog.java:202) at org.apache.solr.update.UpdateHandler.<init>(UpdateHandler.java:137) at org.apache.solr.update.UpdateHandler.<init>(UpdateHandler.java:94) at org.apache.solr.update.DirectUpdateHandler2.<init>(DirectUpdateHandler2.java:102) at sun.reflect.GeneratedConstructorAccessor176.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.solr.core.SolrCore.createInstance(SolrCore.java:737) at org.apache.solr.core.SolrCore.createUpdateHandler(SolrCore.java:799) at org.apache.solr.core.SolrCore.initUpdateHandler(SolrCore.java:1049) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:914) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:807) at org.apache.solr.core.CoreContainer.create(CoreContainer.java:904) at org.apache.solr.core.CoreContainer.lambda$load$3(CoreContainer.java:555) at com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:197) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745)
Stack Trace:
java.lang.AssertionError: ObjectTracker found 1 object(s) that were not released!!! [HdfsTransactionLog]
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException
at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:43)
at org.apache.solr.update.HdfsTransactionLog.<init>(HdfsTransactionLog.java:130)
at org.apache.solr.update.HdfsUpdateLog.init(HdfsUpdateLog.java:202)
at org.apache.solr.update.UpdateHandler.<init>(UpdateHandler.java:137)
at org.apache.solr.update.UpdateHandler.<init>(UpdateHandler.java:94)
at org.apache.solr.update.DirectUpdateHandler2.<init>(DirectUpdateHandler2.java:102)
at sun.reflect.GeneratedConstructorAccessor176.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.solr.core.SolrCore.createInstance(SolrCore.java:737)
at org.apache.solr.core.SolrCore.createUpdateHandler(SolrCore.java:799)
at org.apache.solr.core.SolrCore.initUpdateHandler(SolrCore.java:1049)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:914)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:807)
at org.apache.solr.core.CoreContainer.create(CoreContainer.java:904)
at org.apache.solr.core.CoreContainer.lambda$load$3(CoreContainer.java:555)
at com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:197)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
at __randomizedtesting.SeedInfo.seed([133465527413FA1F]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNull(Assert.java:551)
at org.apache.solr.SolrTestCaseJ4.teardownTestCases(SolrTestCaseJ4.java:269)
at sun.reflect.GeneratedMethodAccessor28.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:870)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.core.HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig
Error Message:
The max direct memory is likely too low. Either increase it (by adding -XX:MaxDirectMemorySize=<size>g -XX:+UseLargePages to your containers startup args) or disable direct allocation using solr.hdfs.blockcache.direct.memory.allocation=false in solrconfig.xml. If you are putting the block cache on the heap, your java heap size might not be large enough. Failed allocating ~134.217728 MB.
Stack Trace:
java.lang.RuntimeException: The max direct memory is likely too low. Either increase it (by adding -XX:MaxDirectMemorySize=<size>g -XX:+UseLargePages to your containers startup args) or disable direct allocation using solr.hdfs.blockcache.direct.memory.allocation=false in solrconfig.xml. If you are putting the block cache on the heap, your java heap size might not be large enough. Failed allocating ~134.217728 MB.
at __randomizedtesting.SeedInfo.seed([133465527413FA1F:E49BAC79899A1034]:0)
at org.apache.solr.core.HdfsDirectoryFactory.createBlockCache(HdfsDirectoryFactory.java:307)
at org.apache.solr.core.HdfsDirectoryFactory.getBlockDirectoryCache(HdfsDirectoryFactory.java:289)
at org.apache.solr.core.HdfsDirectoryFactory.create(HdfsDirectoryFactory.java:223)
at org.apache.solr.core.HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig(HdfsDirectoryFactoryTest.java:108)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.OutOfMemoryError: Direct buffer memory
at java.nio.Bits.reserveMemory(Bits.java:693)
at java.nio.DirectByteBuffer.<init>(DirectByteBuffer.java:123)
at java.nio.ByteBuffer.allocateDirect(ByteBuffer.java:311)
at org.apache.solr.store.blockcache.BlockCache.<init>(BlockCache.java:68)
at org.apache.solr.core.HdfsDirectoryFactory.createBlockCache(HdfsDirectoryFactory.java:305)
... 42 more
FAILED: org.apache.solr.handler.admin.MBeansHandlerTest.testDiff
Error Message:
expected:<Was: [1, Now: 2], Delta: 1> but was:<Was: [4, Now: 5], Delta: 1>
Stack Trace:
org.junit.ComparisonFailure: expected:<Was: [1, Now: 2], Delta: 1> but was:<Was: [4, Now: 5], Delta: 1>
at __randomizedtesting.SeedInfo.seed([133465527413FA1F:D622A1C964A5C27F]:0)
at org.junit.Assert.assertEquals(Assert.java:125)
at org.junit.Assert.assertEquals(Assert.java:147)
at org.apache.solr.handler.admin.MBeansHandlerTest.testDiff(MBeansHandlerTest.java:63)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest.test
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([133465527413FA1F:9B605A88DAEF97E7]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertTrue(Assert.java:54)
at org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest.test(HdfsWriteToMultipleCollectionsTest.java:137)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 11433 lines...]
[junit4] Suite: org.apache.solr.core.HdfsDirectoryFactoryTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.core.HdfsDirectoryFactoryTest_133465527413FA1F-001/init-core-data-001
[junit4] 2> 283165 INFO (SUITE-HdfsDirectoryFactoryTest-seed#[133465527413FA1F]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 1> Formatting using clusterid: testClusterID
[junit4] 2> 283244 WARN (SUITE-HdfsDirectoryFactoryTest-seed#[133465527413FA1F]-worker) [ ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
[junit4] 2> 283261 WARN (SUITE-HdfsDirectoryFactoryTest-seed#[133465527413FA1F]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 283264 INFO (SUITE-HdfsDirectoryFactoryTest-seed#[133465527413FA1F]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 283281 INFO (SUITE-HdfsDirectoryFactoryTest-seed#[133465527413FA1F]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.2-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_53867_hdfs____5sv0hx/webapp
[junit4] 2> 283663 INFO (SUITE-HdfsDirectoryFactoryTest-seed#[133465527413FA1F]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:53867
[junit4] 2> 283808 WARN (SUITE-HdfsDirectoryFactoryTest-seed#[133465527413FA1F]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 283809 INFO (SUITE-HdfsDirectoryFactoryTest-seed#[133465527413FA1F]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 283825 INFO (SUITE-HdfsDirectoryFactoryTest-seed#[133465527413FA1F]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.2-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_34097_datanode____.a62j4c/webapp
[junit4] 2> 284341 INFO (SUITE-HdfsDirectoryFactoryTest-seed#[133465527413FA1F]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34097
[junit4] 2> 284414 WARN (SUITE-HdfsDirectoryFactoryTest-seed#[133465527413FA1F]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 284415 INFO (SUITE-HdfsDirectoryFactoryTest-seed#[133465527413FA1F]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 284454 INFO (SUITE-HdfsDirectoryFactoryTest-seed#[133465527413FA1F]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.2-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_57980_datanode____.8552fe/webapp
[junit4] 2> 284525 INFO (IPC Server handler 1 on 55506) [ ] BlockStateChange BLOCK* processReport: from storage DS-06242c40-82c4-4979-a170-ad08d765d673 node DatanodeRegistration(127.0.0.1:39704, datanodeUuid=3c03ea3e-1bc7-40dd-b729-15efc739e411, infoPort=57835, infoSecurePort=0, ipcPort=38198, storageInfo=lv=-56;cid=testClusterID;nsid=1891094399;c=0), blocks: 0, hasStaleStorage: true, processing time: 0 msecs
[junit4] 2> 284526 INFO (IPC Server handler 1 on 55506) [ ] BlockStateChange BLOCK* processReport: from storage DS-70227e05-dd34-4a3a-a837-436502409b53 node DatanodeRegistration(127.0.0.1:39704, datanodeUuid=3c03ea3e-1bc7-40dd-b729-15efc739e411, infoPort=57835, infoSecurePort=0, ipcPort=38198, storageInfo=lv=-56;cid=testClusterID;nsid=1891094399;c=0), blocks: 0, hasStaleStorage: false, processing time: 0 msecs
[junit4] 2> 284854 INFO (SUITE-HdfsDirectoryFactoryTest-seed#[133465527413FA1F]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:57980
[junit4] 2> 284977 INFO (IPC Server handler 3 on 55506) [ ] BlockStateChange BLOCK* processReport: from storage DS-51a33b2a-28c9-423a-a4ca-6d7bfef1759f node DatanodeRegistration(127.0.0.1:57105, datanodeUuid=9a58baa3-7c1d-409b-bbfb-f5a0503697f5, infoPort=49010, infoSecurePort=0, ipcPort=40086, storageInfo=lv=-56;cid=testClusterID;nsid=1891094399;c=0), blocks: 0, hasStaleStorage: true, processing time: 1 msecs
[junit4] 2> 284977 INFO (IPC Server handler 3 on 55506) [ ] BlockStateChange BLOCK* processReport: from storage DS-e631dff9-7e95-42d9-ad94-c9e039810c8c node DatanodeRegistration(127.0.0.1:57105, datanodeUuid=9a58baa3-7c1d-409b-bbfb-f5a0503697f5, infoPort=49010, infoSecurePort=0, ipcPort=40086, storageInfo=lv=-56;cid=testClusterID;nsid=1891094399;c=0), blocks: 0, hasStaleStorage: false, processing time: 0 msecs
[junit4] 2> 285043 INFO (TEST-HdfsDirectoryFactoryTest.testLocalityReporter-seed#[133465527413FA1F]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testLocalityReporter
[junit4] 2> 285052 INFO (TEST-HdfsDirectoryFactoryTest.testLocalityReporter-seed#[133465527413FA1F]) [ ] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:55506/solr
[junit4] 2> 285052 INFO (TEST-HdfsDirectoryFactoryTest.testLocalityReporter-seed#[133465527413FA1F]) [ ] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 285052 INFO (TEST-HdfsDirectoryFactoryTest.testLocalityReporter-seed#[133465527413FA1F]) [ ] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:55506/solr3/
[junit4] 2> 285067 INFO (TEST-HdfsDirectoryFactoryTest.testLocalityReporter-seed#[133465527413FA1F]) [ ] o.a.s.s.h.HdfsLocalityReporter Registering direcotry hdfs://localhost:55506/solr3 for locality metrics.
[junit4] 2> 285125 INFO (IPC Server handler 3 on 55506) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:39704 is added to blk_1073741825_1001{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-51a33b2a-28c9-423a-a4ca-6d7bfef1759f:NORMAL:127.0.0.1:57105|RBW], ReplicaUC[[DISK]DS-70227e05-dd34-4a3a-a837-436502409b53:NORMAL:127.0.0.1:39704|RBW]]} size 0
[junit4] 2> 285132 INFO (IPC Server handler 8 on 55506) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:57105 is added to blk_1073741825_1001{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-70227e05-dd34-4a3a-a837-436502409b53:NORMAL:127.0.0.1:39704|RBW], ReplicaUC[[DISK]DS-e631dff9-7e95-42d9-ad94-c9e039810c8c:NORMAL:127.0.0.1:57105|FINALIZED]]} size 0
[junit4] 2> 285139 INFO (TEST-HdfsDirectoryFactoryTest.testLocalityReporter-seed#[133465527413FA1F]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testLocalityReporter
[junit4] 2> 285197 INFO (TEST-HdfsDirectoryFactoryTest.testCleanupOldIndexDirectories-seed#[133465527413FA1F]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testCleanupOldIndexDirectories
[junit4] 2> 285197 INFO (TEST-HdfsDirectoryFactoryTest.testCleanupOldIndexDirectories-seed#[133465527413FA1F]) [ ] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:55506/solr1
[junit4] 2> 285198 INFO (TEST-HdfsDirectoryFactoryTest.testCleanupOldIndexDirectories-seed#[133465527413FA1F]) [ ] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 285260 INFO (TEST-HdfsDirectoryFactoryTest.testCleanupOldIndexDirectories-seed#[133465527413FA1F]) [ ] o.a.s.c.HdfsDirectoryFactory Deleted old index directory hdfs://localhost:55506/solr1/mock/data/index.20170206194215707
[junit4] 2> 285261 INFO (TEST-HdfsDirectoryFactoryTest.testCleanupOldIndexDirectories-seed#[133465527413FA1F]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testCleanupOldIndexDirectories
[junit4] 2> 285292 INFO (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[133465527413FA1F]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testInitArgsOrSysPropConfig
[junit4] 2> 285292 INFO (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[133465527413FA1F]) [ ] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:55506/solr1
[junit4] 2> 285293 INFO (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[133465527413FA1F]) [ ] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 285293 INFO (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[133465527413FA1F]) [ ] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:55506/solr2
[junit4] 2> 285293 INFO (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[133465527413FA1F]) [ ] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 285293 INFO (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[133465527413FA1F]) [ ] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:55506/solr2
[junit4] 2> 285293 INFO (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[133465527413FA1F]) [ ] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 285294 INFO (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[133465527413FA1F]) [ ] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:55506/solr
[junit4] 2> 285306 INFO (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[133465527413FA1F]) [ ] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 285306 INFO (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[133465527413FA1F]) [ ] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [134217728] will allocate [1] slabs and use ~[134217728] bytes
[junit4] 2> 285306 INFO (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[133465527413FA1F]) [ ] o.a.s.c.HdfsDirectoryFactory Creating new global HDFS BlockCache
[junit4] 2> 286037 ERROR (Finalizer) [ ] o.a.s.c.CoreContainer CoreContainer was not close prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!! instance=371176094
[junit4] 2> 286037 ERROR (Finalizer) [ ] o.a.s.c.CoreContainer CoreContainer was not close prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!! instance=1546053741
[junit4] 2> 286037 ERROR (Finalizer) [ ] o.a.s.c.CoreContainer CoreContainer was not close prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!! instance=95415001
[junit4] 2> 286037 ERROR (Finalizer) [ ] o.a.s.c.CoreContainer CoreContainer was not close prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!! instance=914233980
[junit4] 2> 286549 INFO (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[133465527413FA1F]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testInitArgsOrSysPropConfig
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=HdfsDirectoryFactoryTest -Dtests.method=testInitArgsOrSysPropConfig -Dtests.seed=133465527413FA1F -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/test-data/enwiki.random.lines.txt -Dtests.locale=es-NI -Dtests.timezone=Atlantic/Cape_Verde -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] ERROR 1.30s J1 | HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig <<<
[junit4] > Throwable #1: java.lang.RuntimeException: The max direct memory is likely too low. Either increase it (by adding -XX:MaxDirectMemorySize=<size>g -XX:+UseLargePages to your containers startup args) or disable direct allocation using solr.hdfs.blockcache.direct.memory.allocation=false in solrconfig.xml. If you are putting the block cache on the heap, your java heap size might not be large enough. Failed allocating ~134.217728 MB.
[junit4] > at __randomizedtesting.SeedInfo.seed([133465527413FA1F:E49BAC79899A1034]:0)
[junit4] > at org.apache.solr.core.HdfsDirectoryFactory.createBlockCache(HdfsDirectoryFactory.java:307)
[junit4] > at org.apache.solr.core.HdfsDirectoryFactory.getBlockDirectoryCache(HdfsDirectoryFactory.java:289)
[junit4] > at org.apache.solr.core.HdfsDirectoryFactory.create(HdfsDirectoryFactory.java:223)
[junit4] > at org.apache.solr.core.HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig(HdfsDirectoryFactoryTest.java:108)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > Caused by: java.lang.OutOfMemoryError: Direct buffer memory
[junit4] > at java.nio.Bits.reserveMemory(Bits.java:693)
[junit4] > at java.nio.DirectByteBuffer.<init>(DirectByteBuffer.java:123)
[junit4] > at java.nio.ByteBuffer.allocateDirect(ByteBuffer.java:311)
[junit4] > at org.apache.solr.store.blockcache.BlockCache.<init>(BlockCache.java:68)
[junit4] > at org.apache.solr.core.HdfsDirectoryFactory.createBlockCache(HdfsDirectoryFactory.java:305)
[junit4] > ... 42 more
[junit4] 2> 286562 WARN (SUITE-HdfsDirectoryFactoryTest-seed#[133465527413FA1F]-worker) [ ] o.a.h.h.s.d.DirectoryScanner DirectoryScanner: shutdown has been called
[junit4] 2> 286589 INFO (SUITE-HdfsDirectoryFactoryTest-seed#[133465527413FA1F]-worker) [ ] o.m.log Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0
[junit4] 2> 286699 WARN (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.core.HdfsDirectoryFactoryTest_133465527413FA1F-001/tempDir-001/hdfsBaseDir/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.core.HdfsDirectoryFactoryTest_133465527413FA1F-001/tempDir-001/hdfsBaseDir/data/data4/]] heartbeating to localhost/127.0.0.1:55506) [ ] o.a.h.h.s.d.DataNode BPOfferService for Block pool BP-844981115-10.41.0.5-1486413733692 (Datanode Uuid 9a58baa3-7c1d-409b-bbfb-f5a0503697f5) service to localhost/127.0.0.1:55506 interrupted
[junit4] 2> 286699 WARN (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.core.HdfsDirectoryFactoryTest_133465527413FA1F-001/tempDir-001/hdfsBaseDir/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.core.HdfsDirectoryFactoryTest_133465527413FA1F-001/tempDir-001/hdfsBaseDir/data/data4/]] heartbeating to localhost/127.0.0.1:55506) [ ] o.a.h.h.s.d.DataNode Ending block pool service for: Block pool BP-844981115-10.41.0.5-1486413733692 (Datanode Uuid 9a58baa3-7c1d-409b-bbfb-f5a0503697f5) service to localhost/127.0.0.1:55506
[junit4] 2> 286703 WARN (SUITE-HdfsDirectoryFactoryTest-seed#[133465527413FA1F]-worker) [ ] o.a.h.h.s.d.DirectoryScanner DirectoryScanner: shutdown has been called
[junit4] 2> 286728 INFO (SUITE-HdfsDirectoryFactoryTest-seed#[133465527413FA1F]-worker) [ ] o.m.log Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0
[junit4] 2> 286830 WARN (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.core.HdfsDirectoryFactoryTest_133465527413FA1F-001/tempDir-001/hdfsBaseDir/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.core.HdfsDirectoryFactoryTest_133465527413FA1F-001/tempDir-001/hdfsBaseDir/data/data2/]] heartbeating to localhost/127.0.0.1:55506) [ ] o.a.h.h.s.d.DataNode BPOfferService for Block pool BP-844981115-10.41.0.5-1486413733692 (Datanode Uuid 3c03ea3e-1bc7-40dd-b729-15efc739e411) service to localhost/127.0.0.1:55506 interrupted
[junit4] 2> 286830 WARN (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.core.HdfsDirectoryFactoryTest_133465527413FA1F-001/tempDir-001/hdfsBaseDir/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.core.HdfsDirectoryFactoryTest_133465527413FA1F-001/tempDir-001/hdfsBaseDir/data/data2/]] heartbeating to localhost/127.0.0.1:55506) [ ] o.a.h.h.s.d.DataNode Ending block pool service for: Block pool BP-844981115-10.41.0.5-1486413733692 (Datanode Uuid 3c03ea3e-1bc7-40dd-b729-15efc739e411) service to localhost/127.0.0.1:55506
[junit4] 2> 286862 INFO (SUITE-HdfsDirectoryFactoryTest-seed#[133465527413FA1F]-worker) [ ] o.m.log Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0
[junit4] 2> 286964 ERROR (SUITE-HdfsDirectoryFactoryTest-seed#[133465527413FA1F]-worker) [ ] o.a.h.m.l.MethodMetric Error invoking method getBlocksTotal
[junit4] 2> java.lang.reflect.InvocationTargetException
[junit4] 2> at sun.reflect.GeneratedMethodAccessor50.invoke(Unknown Source)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:498)
[junit4] 2> at org.apache.hadoop.metrics2.lib.MethodMetric$2.snapshot(MethodMetric.java:111)
[junit4] 2> at org.apache.hadoop.metrics2.lib.MethodMetric.snapshot(MethodMetric.java:144)
[junit4] 2> at org.apache.hadoop.metrics2.lib.MetricsRegistry.snapshot(MetricsRegistry.java:401)
[junit4] 2> at org.apache.hadoop.metrics2.lib.MetricsSourceBuilder$1.getMetrics(MetricsSourceBuilder.java:79)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.getMetrics(MetricsSourceAdapter.java:194)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.updateJmxCache(MetricsSourceAdapter.java:172)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.getMBeanInfo(MetricsSourceAdapter.java:151)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getClassName(DefaultMBeanServerInterceptor.java:1804)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.safeGetClassName(DefaultMBeanServerInterceptor.java:1595)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.checkMBeanPermission(DefaultMBeanServerInterceptor.java:1813)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.exclusiveUnregisterMBean(DefaultMBeanServerInterceptor.java:430)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.unregisterMBean(DefaultMBeanServerInterceptor.java:415)
[junit4] 2> at com.sun.jmx.mbeanserver.JmxMBeanServer.unregisterMBean(JmxMBeanServer.java:546)
[junit4] 2> at org.apache.hadoop.metrics2.util.MBeans.unregister(MBeans.java:81)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stopMBeans(MetricsSourceAdapter.java:226)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stop(MetricsSourceAdapter.java:211)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stopSources(MetricsSystemImpl.java:463)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stop(MetricsSystemImpl.java:213)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.shutdown(MetricsSystemImpl.java:594)
[junit4] 2> at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdownInstance(DefaultMetricsSystem.java:72)
[junit4] 2> at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdown(DefaultMetricsSystem.java:68)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.metrics.NameNodeMetrics.shutdown(NameNodeMetrics.java:171)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.NameNode.stop(NameNode.java:872)
[junit4] 2> at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1726)
[junit4] 2> at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1705)
[junit4] 2> at org.apache.solr.cloud.hdfs.HdfsTestUtil.teardownClass(HdfsTestUtil.java:198)
[junit4] 2> at org.apache.solr.core.HdfsDirectoryFactoryTest.teardownClass(HdfsDirectoryFactoryTest.java:61)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:498)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:870)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> Caused by: java.lang.NullPointerException
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlocksMap.size(BlocksMap.java:203)
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.getTotalBlocks(BlockManager.java:3370)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlocksTotal(FSNamesystem.java:5729)
[junit4] 2> ... 53 more
[junit4] 2> 286968 INFO (SUITE-HdfsDirectoryFactoryTest-seed#[133465527413FA1F]-worker) [ ] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.core.HdfsDirectoryFactoryTest_133465527413FA1F-001
[junit4] 2> Feb 06, 2017 8:42:17 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 34 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Lucene62, sim=RandomSimilarity(queryNorm=false,coord=crazy): {}, locale=es-NI, timezone=Atlantic/Cape_Verde
[junit4] 2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_102 (64-bit)/cpus=4,threads=2,free=235918888,total=380108800
[junit4] 2> NOTE: All tests run in this JVM: [BlockDirectoryTest, ConcurrentDeleteAndCreateCollectionTest, BasicAuthIntegrationTest, TestSystemIdResolver, HdfsUnloadDistributedZkTest, CoreMergeIndexesAdminHandlerTest, SystemInfoHandlerTest, TestQuerySenderListener, TestFilteredDocIdSet, TestSolrXml, TestInitParams, HdfsDirectoryFactoryTest]
[junit4] Completed [38/690 (1!)] on J1 in 13.48s, 3 tests, 1 error <<< FAILURES!
[...truncated 58 lines...]
[junit4] Suite: org.apache.solr.handler.admin.MBeansHandlerTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.handler.admin.MBeansHandlerTest_133465527413FA1F-001/init-core-data-001
[junit4] 2> 409328 INFO (SUITE-MBeansHandlerTest-seed#[133465527413FA1F]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 2> 409329 INFO (SUITE-MBeansHandlerTest-seed#[133465527413FA1F]-worker) [ ] o.a.s.SolrTestCaseJ4 ####initCore
[junit4] 2> 409329 INFO (SUITE-MBeansHandlerTest-seed#[133465527413FA1F]-worker) [ ] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/lib, /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/lib/classes]
[junit4] 2> 409371 INFO (SUITE-MBeansHandlerTest-seed#[133465527413FA1F]-worker) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
[junit4] 2> 409401 INFO (SUITE-MBeansHandlerTest-seed#[133465527413FA1F]-worker) [ ] o.a.s.s.IndexSchema [null] Schema name=test
[junit4] 2> 409487 WARN (SUITE-MBeansHandlerTest-seed#[133465527413FA1F]-worker) [ ] o.a.s.s.IndexSchema [null] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 409490 INFO (SUITE-MBeansHandlerTest-seed#[133465527413FA1F]-worker) [ ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 409500 INFO (SUITE-MBeansHandlerTest-seed#[133465527413FA1F]-worker) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=30000&connTimeout=30000&retry=true
[junit4] 2> 409526 WARN (SUITE-MBeansHandlerTest-seed#[133465527413FA1F]-worker) [ ] o.a.s.m.r.SolrJmxReporter No serviceUrl or agentId was configured, using first MBeanServer.
[junit4] 2> 409529 INFO (SUITE-MBeansHandlerTest-seed#[133465527413FA1F]-worker) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@44b7390e
[junit4] 2> 409529 WARN (SUITE-MBeansHandlerTest-seed#[133465527413FA1F]-worker) [ ] o.a.s.m.r.SolrJmxReporter No serviceUrl or agentId was configured, using first MBeanServer.
[junit4] 2> 409533 INFO (SUITE-MBeansHandlerTest-seed#[133465527413FA1F]-worker) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@44b7390e
[junit4] 2> 409533 WARN (SUITE-MBeansHandlerTest-seed#[133465527413FA1F]-worker) [ ] o.a.s.m.r.SolrJmxReporter No serviceUrl or agentId was configured, using first MBeanServer.
[junit4] 2> 409533 INFO (SUITE-MBeansHandlerTest-seed#[133465527413FA1F]-worker) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@44b7390e
[junit4] 2> 409534 INFO (coreLoadExecutor-714-thread-1) [ x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/lib, /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/lib/classes]
[junit4] 2> 409566 INFO (coreLoadExecutor-714-thread-1) [ x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
[junit4] 2> 409591 INFO (coreLoadExecutor-714-thread-1) [ x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 409685 WARN (coreLoadExecutor-714-thread-1) [ x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 409694 INFO (coreLoadExecutor-714-thread-1) [ x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 409702 INFO (coreLoadExecutor-714-thread-1) [ x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1
[junit4] 2> 409702 WARN (coreLoadExecutor-714-thread-1) [ x:collection1] o.a.s.m.r.SolrJmxReporter No serviceUrl or agentId was configured, using first MBeanServer.
[junit4] 2> 409702 INFO (coreLoadExecutor-714-thread-1) [ x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@44b7390e
[junit4] 2> 409702 INFO (coreLoadExecutor-714-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.handler.admin.MBeansHandlerTest_133465527413FA1F-001/init-core-data-001/]
[junit4] 2> 409703 INFO (coreLoadExecutor-714-thread-1) [ x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@44b7390e
[junit4] 2> 409704 INFO (coreLoadExecutor-714-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=7, maxMergeAtOnceExplicit=5, maxMergedSegmentMB=33.6455078125, floorSegmentMB=0.435546875, forceMergeDeletesPctAllowed=14.378135303517492, segmentsPerTier=32.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.26775625044827756
[junit4] 2> 409767 INFO (coreLoadExecutor-714-thread-1) [ x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 409767 INFO (coreLoadExecutor-714-thread-1) [ x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 409768 INFO (coreLoadExecutor-714-thread-1) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 409768 INFO (coreLoadExecutor-714-thread-1) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 409769 INFO (coreLoadExecutor-714-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@5875cf16
[junit4] 2> 409770 INFO (coreLoadExecutor-714-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@70659bb0[collection1] main]
[junit4] 2> 409770 INFO (coreLoadExecutor-714-thread-1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
[junit4] 2> 409780 INFO (coreLoadExecutor-714-thread-1) [ x:collection1] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4] 2> 409811 INFO (coreLoadExecutor-714-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 409812 INFO (coreLoadExecutor-714-thread-1) [ x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1558617900351225856
[junit4] 2> 409816 INFO (SUITE-MBeansHandlerTest-seed#[133465527413FA1F]-worker) [ ] o.a.s.SolrTestCaseJ4 ####initCore end
[junit4] 2> 409817 INFO (searcherExecutor-715-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
[junit4] 2> 409819 INFO (searcherExecutor-715-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
[junit4] 2> 409819 INFO (searcherExecutor-715-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
[junit4] 2> 409819 INFO (searcherExecutor-715-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: multipleFields
[junit4] 2> 409820 INFO (searcherExecutor-715-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
[junit4] 2> 409820 INFO (TEST-MBeansHandlerTest.testXMLDiffWithExternalEntity-seed#[133465527413FA1F]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testXMLDiffWithExternalEntity
[junit4] 2> 409828 INFO (searcherExecutor-715-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
[junit4] 2> 409828 INFO (searcherExecutor-715-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
[junit4] 2> 409828 INFO (searcherExecutor-715-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
[junit4] 2> 409829 INFO (searcherExecutor-715-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
[junit4] 2> 409830 INFO (searcherExecutor-715-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@70659bb0[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 409884 INFO (TEST-MBeansHandlerTest.testXMLDiffWithExternalEntity-seed#[133465527413FA1F]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testXMLDiffWithExternalEntity
[junit4] 2> 409886 INFO (TEST-MBeansHandlerTest.testBackCompatNames-seed#[133465527413FA1F]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testBackCompatNames
[junit4] 2> 409888 INFO (TEST-MBeansHandlerTest.testBackCompatNames-seed#[133465527413FA1F]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={qt=/admin/mbeans&wt=xml} status=0 QTime=1
[junit4] 2> 409911 INFO (TEST-MBeansHandlerTest.testBackCompatNames-seed#[133465527413FA1F]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={qt=/admin/mbeans&cat=QUERYHANDLER&wt=xml} status=0 QTime=6
[junit4] 2> 409915 INFO (TEST-MBeansHandlerTest.testBackCompatNames-seed#[133465527413FA1F]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={qt=/admin/mbeans&cat=UPDATE&wt=xml} status=0 QTime=0
[junit4] 2> 409917 INFO (TEST-MBeansHandlerTest.testBackCompatNames-seed#[133465527413FA1F]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testBackCompatNames
[junit4] 2> 409919 INFO (TEST-MBeansHandlerTest.testDiff-seed#[133465527413FA1F]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testDiff
[junit4] 2> 409923 INFO (TEST-MBeansHandlerTest.testDiff-seed#[133465527413FA1F]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={qt=/admin/mbeans&stats=true&wt=xml} status=0 QTime=3
[junit4] 2> 409998 INFO (TEST-MBeansHandlerTest.testDiff-seed#[133465527413FA1F]) [ ] o.a.s.c.S.Request [collection1] webapp=null path=null params={qt=/admin/mbeans&stats=true&diff=true&wt=xml} status=0 QTime=52
[junit4] 2> 410003 INFO (TEST-MBeansHandlerTest.testDiff-seed#[133465527413FA1F]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testDiff
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=MBeansHandlerTest -Dtests.method=testDiff -Dtests.seed=133465527413FA1F -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/test-data/enwiki.random.lines.txt -Dtests.locale=be-BY -Dtests.timezone=ROK -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] FAILURE 0.09s J0 | MBeansHandlerTest.testDiff <<<
[junit4] > Throwable #1: org.junit.ComparisonFailure: expected:<Was: [1, Now: 2], Delta: 1> but was:<Was: [4, Now: 5], Delta: 1>
[junit4] > at __randomizedtesting.SeedInfo.seed([133465527413FA1F:D622A1C964A5C27F]:0)
[junit4] > at org.apache.solr.handler.admin.MBeansHandlerTest.testDiff(MBeansHandlerTest.java:63)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 410010 INFO (SUITE-MBeansHandlerTest-seed#[133465527413FA1F]-worker) [ ] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> 410010 INFO (SUITE-MBeansHandlerTest-seed#[133465527413FA1F]-worker) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=491404461
[junit4] 2> 410018 INFO (coreCloseExecutor-720-thread-1) [ x:collection1] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@48a42ba6
[junit4] 2> 410092 INFO (coreCloseExecutor-720-thread-1) [ x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.core.collection1
[junit4] 2> 410102 INFO (SUITE-MBeansHandlerTest-seed#[133465527413FA1F]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.node
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.handler.admin.MBeansHandlerTest_133465527413FA1F-001
[junit4] 2> Feb 06, 2017 8:44:20 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Lucene62, sim=RandomSimilarity(queryNorm=true,coord=crazy): {}, locale=be-BY, timezone=ROK
[junit4] 2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_102 (64-bit)/cpus=4,threads=1,free=281534024,total=508559360
[junit4] 2> NOTE: All tests run in this JVM: [TestIBSimilarityFactory, TestCustomStream, TestCustomDocTransformer, TestSortByMinMaxFunction, RequiredFieldsTest, SolrMetricManagerTest, RegexBoostProcessorTest, TestAddFieldRealTimeGet, MultiThreadedOCPTest, TestDocumentBuilder, TestRawResponseWriter, TestSolrDeletionPolicy2, TestCodecSupport, TestFieldSortValues, HdfsRestartWhileUpdatingTest, TestSystemCollAutoCreate, TestExceedMaxTermLength, VMParamsZkACLAndCredentialsProvidersTest, MBeansHandlerTest]
[junit4] Completed [57/690 (2!)] on J0 in 1.05s, 3 tests, 1 failure <<< FAILURES!
[...truncated 590 lines...]
[junit4] Suite: org.apache.solr.TestDistributedSearch
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_133465527413FA1F-001/init-core-data-001
[junit4] 2> 1646923 INFO (SUITE-TestDistributedSearch-seed#[133465527413FA1F]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-9061)
[junit4] 2> 1646923 INFO (SUITE-TestDistributedSearch-seed#[133465527413FA1F]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /k/
[junit4] 2> 1647035 INFO (TEST-TestDistributedSearch.test-seed#[133465527413FA1F]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_133465527413FA1F-001/tempDir-001/control/cores/collection1
[junit4] 2> 1647036 INFO (TEST-TestDistributedSearch.test-seed#[133465527413FA1F]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 1647038 INFO (TEST-TestDistributedSearch.test-seed#[133465527413FA1F]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@70db5ae0{/k,null,AVAILABLE}
[junit4] 2> 1647040 INFO (TEST-TestDistributedSearch.test-seed#[133465527413FA1F]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@6cb7af1e{HTTP/1.1,[http/1.1]}{127.0.0.1:48346}
[junit4] 2> 1647040 INFO (TEST-TestDistributedSearch.test-seed#[133465527413FA1F]) [ ] o.e.j.s.Server Started @1651136ms
[junit4] 2> 1647040 INFO (TEST-TestDistributedSearch.test-seed#[133465527413FA1F]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/k, hostPort=48346, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_133465527413FA1F-001/tempDir-001/control/cores}
[junit4] 2> 1647040 ERROR (TEST-TestDistributedSearch.test-seed#[133465527413FA1F]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1647040 INFO (TEST-TestDistributedSearch.test-seed#[133465527413FA1F]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 6.5.0
[junit4] 2> 1647040 INFO (TEST-TestDistributedSearch.test-seed#[133465527413FA1F]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in standalone mode on port null
[junit4] 2> 1647040 INFO (TEST-TestDistributedSearch.test-seed#[133465527413FA1F]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1647041 INFO (TEST-TestDistributedSearch.test-seed#[133465527413FA1F]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-02-06T21:04:57.885Z
[junit4] 2> 1647041 INFO (TEST-TestDistributedSearch.test-seed#[133465527413FA1F]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_133465527413FA1F-001/tempDir-001/control/solr.xml
[junit4] 2> 1647059 INFO (TEST-TestDistributedSearch.test-seed#[133465527413FA1F]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1647087 INFO (TEST-TestDistributedSearch.test-seed#[133465527413FA1F]) [ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_133465527413FA1F-001/tempDir-001/control/cores
[junit4] 2> 1647087 INFO (TEST-TestDistributedSearch.test-seed#[133465527413FA1F]) [ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 1647088 INFO (coreLoadExecutor-3551-thread-1) [ x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/lib, /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/lib/classes]
[junit4] 2> 1647122 WARN (coreLoadExecutor-3551-thread-1) [ x:collection1] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
[junit4] 2> 1647124 INFO (coreLoadExecutor-3551-thread-1) [ x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
[junit4] 2> 1647158 INFO (coreLoadExecutor-3551-thread-1) [ x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 1647240 WARN (coreLoadExecutor-3551-thread-1) [ x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 1647243 INFO (coreLoadExecutor-3551-thread-1) [ x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 1647253 INFO (coreLoadExecutor-3551-thread-1) [ x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from configset /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1
[junit4] 2> 1647253 INFO (coreLoadExecutor-3551-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_133465527413FA1F-001/tempDir-001/control/cores/collection1/data/]
[junit4] 2> 1647253 INFO (coreLoadExecutor-3551-thread-1) [ x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@44b7390e
[junit4] 2> 1647254 INFO (coreLoadExecutor-3551-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=34, maxMergeAtOnceExplicit=19, maxMergedSegmentMB=67.3232421875, floorSegmentMB=1.59375, forceMergeDeletesPctAllowed=8.797926218733155, segmentsPerTier=36.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.14878913942897373
[junit4] 2> 1647343 INFO (coreLoadExecutor-3551-thread-1) [ x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1647343 INFO (coreLoadExecutor-3551-thread-1) [ x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1647344 INFO (coreLoadExecutor-3551-thread-1) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1647344 INFO (coreLoadExecutor-3551-thread-1) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1647345 INFO (coreLoadExecutor-3551-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@10fd7f40
[junit4] 2> 1647345 INFO (coreLoadExecutor-3551-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@2e541c[collection1] main]
[junit4] 2> 1647346 INFO (coreLoadExecutor-3551-thread-1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
[junit4] 2> 1647354 INFO (coreLoadExecutor-3551-thread-1) [ x:collection1] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4] 2> 1647390 INFO (coreLoadExecutor-3551-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 1647391 INFO (coreLoadExecutor-3551-thread-1) [ x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1558619198046863360
[junit4] 2> 1647394 INFO (searcherExecutor-3552-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
[junit4] 2> 1647394 INFO (searcherExecutor-3552-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
[junit4] 2> 1647394 INFO (searcherExecutor-3552-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
[junit4] 2> 1647394 INFO (searcherExecutor-3552-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: multipleFields
[junit4] 2> 1647394 INFO (searcherExecutor-3552-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
[junit4] 2> 1647395 INFO (searcherExecutor-3552-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
[junit4] 2> 1647395 INFO (searcherExecutor-3552-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
[junit4] 2> 1647395 INFO (searcherExecutor-3552-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
[junit4] 2> 1647395 INFO (searcherExecutor-3552-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
[junit4] 2> 1647396 INFO (searcherExecutor-3552-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@2e541c[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1647814 INFO (TEST-TestDistributedSearch.test-seed#[133465527413FA1F]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_133465527413FA1F-001/tempDir-001/shard0/cores/collection1
[junit4] 2> 1647816 INFO (TEST-TestDistributedSearch.test-seed#[133465527413FA1F]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 1647817 INFO (TEST-TestDistributedSearch.test-seed#[133465527413FA1F]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1d2f676f{/k,null,AVAILABLE}
[junit4] 2> 1647817 INFO (TEST-TestDistributedSearch.test-seed#[133465527413FA1F]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@6a44a836{HTTP/1.1,[http/1.1]}{127.0.0.1:52171}
[junit4] 2> 1647817 INFO (TEST-TestDistributedSearch.test-seed#[133465527413FA1F]) [ ] o.e.j.s.Server Started @1651913ms
[junit4] 2> 1647817 INFO (TEST-TestDistributedSearch.test-seed#[133465527413FA1F]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/k, hostPort=52171, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_133465527413FA1F-001/tempDir-001/shard0/cores}
[junit4] 2> 1647818 ERROR (TEST-TestDistributedSearch.test-seed#[133465527413FA1F]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1647818 INFO (TEST-TestDistributedSearch.test-seed#[133465527413FA1F]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 6.5.0
[junit4] 2> 1647818 INFO (TEST-TestDistributedSearch.test-seed#[133465527413FA1F]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in standalone mode on port null
[junit4] 2> 1647819 INFO (TEST-TestDistributedSearch.test-seed#[133465527413FA1F]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1647819 INFO (TEST-TestDistributedSearch.test-seed#[133465527413FA1F]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-02-06T21:04:58.663Z
[junit4] 2> 1647819 INFO (TEST-TestDistributedSearch.test-seed#[133465527413FA1F]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_133465527413FA1F-001/tempDir-001/shard0/solr.xml
[junit4] 2> 1647826 INFO (TEST-TestDistributedSearch.test-seed#[133465527413FA1F]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1647863 INFO (TEST-TestDistributedSearch.test-seed#[133465527413FA1F]) [ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_133465527413FA1F-001/tempDir-001/shard0/cores
[junit4] 2> 1647863 INFO (TEST-TestDistributedSearch.test-seed#[133465527413FA1F]) [ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 1647864 INFO (coreLoadExecutor-3562-thread-1) [ x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/lib, /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/lib/classes]
[junit4] 2> 1647937 WARN (coreLoadExecutor-3562-thread-1) [ x:collection1] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
[junit4] 2> 1647938 INFO (coreLoadExecutor-3562-thread-1) [ x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
[junit4] 2> 1647962 INFO (coreLoadExecutor-3562-thread-1) [ x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 1648059 WARN (coreLoadExecutor-3562-thread-1) [ x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 1648061 INFO (coreLoadExecutor-3562-thread-1) [ x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 1648070 INFO (coreLoadExecutor-3562-thread-1) [ x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from configset /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1
[junit4] 2> 1648071 INFO (coreLoadExecutor-3562-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_133465527413FA1F-001/tempDir-001/shard0/cores/collection1/data/]
[junit4] 2> 1648071 INFO (coreLoadExecutor-3562-thread-1) [ x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@44b7390e
[junit4] 2> 1648072 INFO (coreLoadExecutor-3562-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=34, maxMergeAtOnceExplicit=19, maxMergedSegmentMB=67.3232421875, floorSegmentMB=1.59375, forceMergeDeletesPctAllowed=8.797926218733155, segmentsPerTier=36.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.14878913942897373
[junit4] 2> 1648125 INFO (coreLoadExecutor-3562-thread-1) [ x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1648125 INFO (coreLoadExecutor-3562-thread-1) [ x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1648126 INFO (coreLoadExecutor-3562-thread-1) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1648126 INFO (coreLoadExecutor-3562-thread-1) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1648127 INFO (coreLoadExecutor-3562-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@5fc6a6e5
[junit4] 2> 1648127 INFO (coreLoadExecutor-3562-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@469b208b[collection1] main]
[junit4] 2> 1648127 INFO (coreLoadExecutor-3562-thread-1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
[junit4] 2> 1648134 INFO (coreLoadExecutor-3562-thread-1) [ x:collection1] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4] 2> 1648161 INFO (coreLoadExecutor-3562-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 1648161 INFO (searcherExecutor-3563-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
[junit4] 2> 1648161 INFO (searcherExecutor-3563-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
[junit4] 2> 1648161 INFO (searcherExecutor-3563-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
[junit4] 2> 1648161 INFO (searcherExecutor-3563-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: multipleFields
[junit4] 2> 1648162 INFO (searcherExecutor-3563-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
[junit4] 2> 1648162 INFO (searcherExecutor-3563-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
[junit4] 2> 1648162 INFO (searcherExecutor-3563-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
[junit4] 2> 1648162 INFO (searcherExecutor-3563-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
[junit4] 2> 1648163 INFO (searcherExecutor-3563-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
[junit4] 2> 1648164 INFO (searcherExecutor-3563-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@469b208b[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1648165 INFO (coreLoadExecutor-3562-thread-1) [ x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1558619198858461184
[junit4] 2> 1648525 INFO (TEST-TestDistributedSearch.test-seed#[133465527413FA1F]) [ ] o.a.s.SolrTestCaseJ4 ###Starting test
[junit4] 2> 1648529 INFO (qtp545487656-8384) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/k path=/update params={wt=javabin&version=2}{deleteByQuery=*:* (-1558619199238045696)} 0 1
[junit4] 2> 1648531 INFO (qtp1588388855-8401) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/k path=/update params={wt=javabin&version=2}{deleteByQuery=*:* (-1558619199241191424)} 0 1
[junit4] 2> 1648536 INFO (qtp545487656-8385) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/k path=/update params={wt=javabin&version=2}{add=[1 (1558619199245385728)]} 0 2
[junit4] 2> 1648546 INFO (qtp1588388855-8402) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/k path=/update params={wt=javabin&version=2}{add=[1 (1558619199255871488)]} 0 1
[junit4] 2> 1648550 INFO (qtp545487656-8385) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/k path=/update params={wt=javabin&version=2}{add=[2 (1558619199261114368)]} 0 0
[junit4] 2> 1648558 INFO (qtp1588388855-8403) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/k path=/update params={wt=javabin&version=2}{add=[2 (1558619199267405824)]} 0 2
[junit4] 2> 1648560 INFO (qtp545487656-8387) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/k path=/update params={wt=javabin&version=2}{add=[3 (1558619199272648704)]} 0 0
[junit4] 2> 1648562 INFO (qtp1588388855-8404) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/k path=/update params={wt=javabin&version=2}{add=[3 (1558619199274745856)]} 0 0
[junit4] 2> 1648568 INFO (qtp545487656-8388) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/k path=/update params={wt=javabin&version=2}{add=[4 (1558619199281037312)]} 0 0
[junit4] 2> 1648571 INFO (qtp1588388855-8404) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/k path=/update params={wt=javabin&version=2}{add=[4 (1558619199283134464)]} 0 0
[junit4] 2> 1648573 INFO (qtp545487656-8381) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/k path=/update params={wt=javabin&version=2}{add=[5 (1558619199285231616)]} 0 0
[junit4] 2> 1648575 INFO (qtp1588388855-8398) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/k path=/update params={wt=javabin&version=2}{add=[5 (1558619199287328768)]} 0 0
[junit4] 2> 1648577 INFO (qtp545487656-8384) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/k path=/update params={wt=javabin&version=2}{add=[6 (1558619199290474496)]} 0 0
[junit4] 2> 1648579 INFO (qtp1588388855-8401) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/k path=/update params={wt=javabin&version=2}{add=[6 (1558619199292571648)]} 0 0
[junit4] 2> 1648581 INFO (qtp545487656-8384) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/k path=/update params={wt=javabin&version=2}{add=[7 (1558619199294668800)]} 0 0
[junit4] 2> 1648583 INFO (qtp1588388855-8402) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/k path=/update params={wt=javabin&version=2}{add=[7 (1558619199296765952)]} 0 0
[junit4] 2> 1648585 INFO (qtp545487656-8385) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/k path=/update params={wt=javabin&version=2}{add=[8 (1558619199298863104)]} 0 0
[junit4] 2> 1648587 INFO (qtp1588388855-8403) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/k path=/update params={wt=javabin&version=2}{add=[8 (1558619199300960256)]} 0 0
[junit4] 2> 1648589 INFO (qtp545487656-8387) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/k path=/update params={wt=javabin&version=2}{add=[9 (1558619199303057408)]} 0 0
[junit4] 2> 1648591 INFO (qtp1588388855-8405) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/k path=/update params={wt=javabin&version=2}{add=[9 (1558619199305154560)]} 0 0
[junit4] 2> 1648593 INFO (qtp545487656-8387) [ x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 164859
[...truncated too long message...]
FSCluster.shutdown(MiniDFSCluster.java:1705)
[junit4] 2> at org.apache.solr.cloud.hdfs.HdfsTestUtil.teardownClass(HdfsTestUtil.java:198)
[junit4] 2> at org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest.teardownClass(HdfsWriteToMultipleCollectionsTest.java:73)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:498)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:870)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> Caused by: java.lang.NullPointerException
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlocksMap.size(BlocksMap.java:203)
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.getTotalBlocks(BlockManager.java:3370)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlocksTotal(FSNamesystem.java:5729)
[junit4] 2> ... 53 more
[junit4] 2> 5108201 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[133465527413FA1F]-worker) [ ] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_133465527413FA1F-001
[junit4] 2> Feb 06, 2017 10:02:38 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 35 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene62): {rnd_b=PostingsFormat(name=Asserting), _version_=PostingsFormat(name=LuceneVarGapFixedInterval), a_t=PostingsFormat(name=Memory doPackFST= false), a_i=PostingsFormat(name=Asserting), id=PostingsFormat(name=Asserting)}, docValues:{}, maxPointsInLeafNode=674, maxMBSortInHeap=7.338945333913445, sim=RandomSimilarity(queryNorm=true,coord=yes): {}, locale=cs-CZ, timezone=Asia/Bishkek
[junit4] 2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_102 (64-bit)/cpus=4,threads=2,free=176778792,total=535822336
[junit4] 2> NOTE: All tests run in this JVM: [BlockDirectoryTest, ConcurrentDeleteAndCreateCollectionTest, BasicAuthIntegrationTest, TestSystemIdResolver, HdfsUnloadDistributedZkTest, CoreMergeIndexesAdminHandlerTest, SystemInfoHandlerTest, TestQuerySenderListener, TestFilteredDocIdSet, TestSolrXml, TestInitParams, HdfsDirectoryFactoryTest, TestUninvertingReader, CoreSorterTest, TestDefaultSearchFieldResource, BlockJoinFacetSimpleTest, TestBM25SimilarityFactory, IgnoreCommitOptimizeUpdateProcessorFactoryTest, TestFuzzyAnalyzedSuggestions, TestCollectionAPI, AtomicUpdatesTest, RequestLoggingTest, TestClusterStateMutator, DistributedVersionInfoTest, TestOnReconnectListenerSupport, DateMathParserTest, TestXmlQParserPlugin, V2ApiIntegrationTest, DistribDocExpirationUpdateProcessorTest, TestManagedStopFilterFactory, UpdateRequestProcessorFactoryTest, TestQueryUtils, SuggesterFSTTest, TestLeaderInitiatedRecoveryThread, TestFieldCacheSortRandom, TestApiFramework, SimplePostToolTest, TestTrie, LeaderFailureAfterFreshStartTest, SchemaVersionSpecificBehaviorTest, TestStressVersions, HdfsSyncSliceTest, TestPivotHelperCode, BJQParserTest, TestSolrCLIRunExample, HdfsBasicDistributedZk2Test, HighlighterMaxOffsetTest, HLLUtilTest, DistributedMLTComponentTest, OutOfBoxZkACLAndCredentialsProvidersTest, TestSolrQueryParserDefaultOperatorResource, TestUseDocValuesAsStored, TestRequestStatusCollectionAPI, TestHdfsBackupRestoreCore, TestMacroExpander, TestLMDirichletSimilarityFactory, RestartWhileUpdatingTest, IndexSchemaRuntimeFieldTest, CreateCollectionCleanupTest, TolerantUpdateProcessorTest, SpellingQueryConverterTest, SoftAutoCommitTest, TestFieldCollectionResource, ShardRoutingTest, SpellCheckComponentTest, SimpleMLTQParserTest, TestWordDelimiterFilterFactory, DistanceFunctionTest, DirectSolrConnectionTest, TestDynamicLoading, TestFiltering, TestRawTransformer, TestScoreJoinQPScore, DocumentBuilderTest, EchoParamsTest, TestConfigOverlay, ExplicitHLLTest, TestStressLiveNodes, OverseerModifyCollectionTest, TestSearchPerf, TestMiniSolrCloudCluster, ClassificationUpdateProcessorTest, ClusterStateUpdateTest, SecurityConfHandlerTest, TestSubQueryTransformer, SearchHandlerTest, MultiTermTest, AnalyticsQueryTest, TestMinMaxOnMultiValuedField, SampleTest, BooleanFieldTest, HttpPartitionTest, TestConfigSets, TestSchemaSimilarityResource, DocValuesTest, TestCoreAdminApis, TestRestoreCore, SolrIndexMetricsTest, SolrIndexSplitterTest, TestCursorMarkWithoutUniqueKey, TestLRUCache, SolrIndexConfigTest, SolrGraphiteReporterTest, TestSolrCoreParser, TestShortCircuitedRequests, TestFieldTypeResource, TestDistributedGrouping, CopyFieldTest, SharedFSAutoReplicaFailoverUtilsTest, SpellCheckCollatorTest, JsonLoaderTest, TestHdfsCloudBackupRestore, ShardRoutingCustomTest, ChaosMonkeySafeLeaderTest, BasicDistributedZk2Test, CollectionsAPIDistributedZkTest, OpenCloseCoreStressTest, OverseerTest, LeaderElectionIntegrationTest, RecoveryZkTest, FullSolrCloudDistribCmdsTest, ZkSolrClientTest, TestZkChroot, TestRandomDVFaceting, ZkCLITest, AutoCommitTest, TestHashPartitioner, ZkControllerTest, TestRealTimeGet, TestStressReorder, TestJoin, DistributedTermsComponentTest, SolrCmdDistributorTest, QueryElevationComponentTest, PeerSyncTest, BasicFunctionalityTest, TestLazyCores, CurrencyFieldOpenExchangeTest, AnalysisAfterCoreReloadTest, SignatureUpdateProcessorFactoryTest, TestExtendedDismaxParser, CoreAdminHandlerTest, TestStressLucene, SpatialFilterTest, WordBreakSolrSpellCheckerTest, TestPseudoReturnFields, TestAtomicUpdateErrorCases, StatelessScriptUpdateProcessorFactoryTest, SolrInfoMBeanTest, IndexBasedSpellCheckerTest, StandardRequestHandlerTest, TestReversedWildcardFilterFactory, TestQueryTypes, TermsComponentTest, TermVectorComponentTest, MoreLikeThisHandlerTest, LoggingHandlerTest, IndexSchemaTest, ReturnFieldsTest, JSONWriterTest, UniqFieldsUpdateProcessorFactoryTest, TestPartialUpdateDeduplication, CSVRequestHandlerTest, TestBinaryResponseWriter, SOLR749Test, UpdateParamsTest, AlternateDirectoryTest, TestSolrIndexConfig, TestQuerySenderNoQuery, ResponseLogComponentTest, TestStressRecovery, NumericFieldsTest, TestElisionMultitermQuery, TestConfig, TestSolrCoreProperties, TestPostingsSolrHighlighter, NotRequiredUniqueKeyTest, TestLuceneMatchVersion, SpellPossibilityIteratorTest, TestCharFilters, SynonymTokenizerTest, TestSweetSpotSimilarityFactory, TestDFRSimilarityFactory, TestPerFieldSimilarity, TestLMJelinekMercerSimilarityFactory, TestFastWriter, TestFastOutputStream, OpenExchangeRatesOrgProviderTest, URLClassifyProcessorTest, PrimUtilsTest, TestSuggestSpellingConverter, RAMDirectoryFactoryTest, ClusterStateTest, TestUtils, ZkNodePropsTest, SliceStateTest, FileUtilsTest, TestRTGBase, DistributedIntervalFacetingTest, CdcrReplicationHandlerTest, CdcrVersionReplicationTest, CloudExitableDirectoryReaderTest, CollectionReloadTest, CollectionTooManyReplicasTest, ConfigSetsAPITest, ConnectionManagerTest, DeleteLastCustomShardedReplicaTest, DeleteReplicaTest, DeleteShardTest, DeleteStatusTest, DistribJoinFromCollectionTest, ForceLeaderTest, LeaderFailoverAfterPartitionTest, MigrateRouteKeyTest, OverriddenZkACLAndCredentialsProvidersTest, OverseerStatusTest, OverseerTaskQueueTest, RemoteQueryErrorTest, ReplicationFactorTest, SSLMigrationTest, SaslZkACLProviderTest, ShardSplitTest, HdfsBasicDistributedZkTest, HdfsChaosMonkeySafeLeaderTest, HdfsWriteToMultipleCollectionsTest]
[junit4] Completed [541/690 (6!)] on J1 in 67.02s, 1 test, 1 failure <<< FAILURES!
[...truncated 62930 lines...]
[JENKINS] Lucene-Solr-NightlyTests-6.x - Build # 274 - Still
Unstable
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.x/274/
9 tests failed.
FAILED: org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates.test_dv_idx
Error Message:
There are still nodes recoverying - waited for 330 seconds
Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 330 seconds
at __randomizedtesting.SeedInfo.seed([AF5E5783F941C682:3A22224B259D6B63]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:187)
at org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates.waitForRecoveriesToFinish(TestStressCloudBlindAtomicUpdates.java:459)
at org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates.checkField(TestStressCloudBlindAtomicUpdates.java:304)
at org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates.test_dv_idx(TestStressCloudBlindAtomicUpdates.java:224)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
FAILED: junit.framework.TestSuite.org.apache.solr.core.TestLazyCores
Error Message:
ObjectTracker found 5 object(s) that were not released!!! [MMapDirectory, MMapDirectory, MMapDirectory, MDCAwareThreadPoolExecutor, SolrCore] org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:43) at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:347) at org.apache.solr.core.MetricsDirectoryFactory.get(MetricsDirectoryFactory.java:201) at org.apache.solr.update.SolrIndexWriter.create(SolrIndexWriter.java:97) at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:705) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:890) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:807) at org.apache.solr.core.CoreContainer.create(CoreContainer.java:904) at org.apache.solr.core.CoreContainer.lambda$load$3(CoreContainer.java:555) at com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:197) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:43) at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:347) at org.apache.solr.core.MetricsDirectoryFactory.get(MetricsDirectoryFactory.java:201) at org.apache.solr.core.SolrCore.getNewIndexDir(SolrCore.java:348) at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:673) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:890) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:807) at org.apache.solr.core.CoreContainer.create(CoreContainer.java:904) at org.apache.solr.core.CoreContainer.lambda$load$3(CoreContainer.java:555) at com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:197) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:43) at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:347) at org.apache.solr.core.MetricsDirectoryFactory.get(MetricsDirectoryFactory.java:201) at org.apache.solr.core.SolrCore.initSnapshotMetaDataManager(SolrCore.java:479) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:884) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:807) at org.apache.solr.core.CoreContainer.create(CoreContainer.java:904) at org.apache.solr.core.CoreContainer.lambda$load$3(CoreContainer.java:555) at com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:197) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:43) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:830) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:807) at org.apache.solr.core.CoreContainer.create(CoreContainer.java:904) at org.apache.solr.core.CoreContainer.lambda$load$3(CoreContainer.java:555) at com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:197) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:43) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:980) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:807) at org.apache.solr.core.CoreContainer.create(CoreContainer.java:904) at org.apache.solr.core.CoreContainer.lambda$load$3(CoreContainer.java:555) at com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:197) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745)
Stack Trace:
java.lang.AssertionError: ObjectTracker found 5 object(s) that were not released!!! [MMapDirectory, MMapDirectory, MMapDirectory, MDCAwareThreadPoolExecutor, SolrCore]
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException
at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:43)
at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:347)
at org.apache.solr.core.MetricsDirectoryFactory.get(MetricsDirectoryFactory.java:201)
at org.apache.solr.update.SolrIndexWriter.create(SolrIndexWriter.java:97)
at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:705)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:890)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:807)
at org.apache.solr.core.CoreContainer.create(CoreContainer.java:904)
at org.apache.solr.core.CoreContainer.lambda$load$3(CoreContainer.java:555)
at com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:197)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException
at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:43)
at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:347)
at org.apache.solr.core.MetricsDirectoryFactory.get(MetricsDirectoryFactory.java:201)
at org.apache.solr.core.SolrCore.getNewIndexDir(SolrCore.java:348)
at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:673)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:890)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:807)
at org.apache.solr.core.CoreContainer.create(CoreContainer.java:904)
at org.apache.solr.core.CoreContainer.lambda$load$3(CoreContainer.java:555)
at com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:197)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException
at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:43)
at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:347)
at org.apache.solr.core.MetricsDirectoryFactory.get(MetricsDirectoryFactory.java:201)
at org.apache.solr.core.SolrCore.initSnapshotMetaDataManager(SolrCore.java:479)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:884)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:807)
at org.apache.solr.core.CoreContainer.create(CoreContainer.java:904)
at org.apache.solr.core.CoreContainer.lambda$load$3(CoreContainer.java:555)
at com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:197)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException
at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:43)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:830)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:807)
at org.apache.solr.core.CoreContainer.create(CoreContainer.java:904)
at org.apache.solr.core.CoreContainer.lambda$load$3(CoreContainer.java:555)
at com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:197)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException
at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:43)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:980)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:807)
at org.apache.solr.core.CoreContainer.create(CoreContainer.java:904)
at org.apache.solr.core.CoreContainer.lambda$load$3(CoreContainer.java:555)
at com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:197)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
at __randomizedtesting.SeedInfo.seed([AF5E5783F941C682]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNull(Assert.java:551)
at org.apache.solr.SolrTestCaseJ4.teardownTestCases(SolrTestCaseJ4.java:269)
at sun.reflect.GeneratedMethodAccessor51.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:870)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
FAILED: junit.framework.TestSuite.org.apache.solr.core.TestLazyCores
Error Message:
1 thread leaked from SUITE scope at org.apache.solr.core.TestLazyCores: 1) Thread[id=66008, name=searcherExecutor-5621-thread-1, state=WAITING, group=TGRP-TestLazyCores] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.core.TestLazyCores:
1) Thread[id=66008, name=searcherExecutor-5621-thread-1, state=WAITING, group=TGRP-TestLazyCores]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
at __randomizedtesting.SeedInfo.seed([AF5E5783F941C682]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.core.TestLazyCores
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=66008, name=searcherExecutor-5621-thread-1, state=WAITING, group=TGRP-TestLazyCores] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=66008, name=searcherExecutor-5621-thread-1, state=WAITING, group=TGRP-TestLazyCores]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
at __randomizedtesting.SeedInfo.seed([AF5E5783F941C682]:0)
FAILED: org.apache.solr.handler.admin.MBeansHandlerTest.testDiff
Error Message:
expected:<Was: [1, Now: 2], Delta: 1> but was:<Was: [4, Now: 5], Delta: 1>
Stack Trace:
org.junit.ComparisonFailure: expected:<Was: [1, Now: 2], Delta: 1> but was:<Was: [4, Now: 5], Delta: 1>
at __randomizedtesting.SeedInfo.seed([AF5E5783F941C682:6A489318E9F7FEE2]:0)
at org.junit.Assert.assertEquals(Assert.java:125)
at org.junit.Assert.assertEquals(Assert.java:147)
at org.apache.solr.handler.admin.MBeansHandlerTest.testDiff(MBeansHandlerTest.java:63)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.CdcrReplicationDistributedZkTest.testReplicationAfterRestart
Error Message:
Timeout waiting for CDCR replication to complete @source_collection:shard2
Stack Trace:
java.lang.RuntimeException: Timeout waiting for CDCR replication to complete @source_collection:shard2
at __randomizedtesting.SeedInfo.seed([AF5E5783F941C682:F343B002376172B4]:0)
at org.apache.solr.cloud.BaseCdcrDistributedZkTest.waitForReplicationToComplete(BaseCdcrDistributedZkTest.java:795)
at org.apache.solr.cloud.CdcrReplicationDistributedZkTest.testReplicationAfterRestart(CdcrReplicationDistributedZkTest.java:236)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.CdcrReplicationDistributedZkTest.testResilienceWithDeleteByQueryOnTarget
Error Message:
Timeout while trying to assert number of documents @ target_collection
Stack Trace:
java.lang.AssertionError: Timeout while trying to assert number of documents @ target_collection
at __randomizedtesting.SeedInfo.seed([AF5E5783F941C682:F3CC519291803C7]:0)
at org.apache.solr.cloud.BaseCdcrDistributedZkTest.assertNumDocs(BaseCdcrDistributedZkTest.java:271)
at org.apache.solr.cloud.CdcrReplicationDistributedZkTest.testResilienceWithDeleteByQueryOnTarget(CdcrReplicationDistributedZkTest.java:595)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.AssertionError: expected:<50> but was:<0>
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at org.apache.solr.cloud.BaseCdcrDistributedZkTest.assertNumDocs(BaseCdcrDistributedZkTest.java:262)
... 42 more
FAILED: org.apache.solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest.test
Error Message:
There were too many update fails (65 > 60) - we expect it can happen, but shouldn't easily
Stack Trace:
java.lang.AssertionError: There were too many update fails (65 > 60) - we expect it can happen, but shouldn't easily
at __randomizedtesting.SeedInfo.seed([AF5E5783F941C682:270A685957BDAB7A]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertFalse(Assert.java:68)
at org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest.test(ChaosMonkeyNothingIsSafeTest.java:218)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest.test
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([AF5E5783F941C682:270A685957BDAB7A]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertTrue(Assert.java:54)
at org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest.test(HdfsWriteToMultipleCollectionsTest.java:137)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 11829 lines...]
[junit4] Suite: org.apache.solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_AF5E5783F941C682-001/init-core-data-001
[junit4] 2> 1107196 INFO (SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[AF5E5783F941C682]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
[junit4] 2> 1107196 INFO (SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[AF5E5783F941C682]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
[junit4] 1> Formatting using clusterid: testClusterID
[junit4] 2> 1108385 WARN (SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[AF5E5783F941C682]-worker) [ ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
[junit4] 2> 1108597 INFO (SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[AF5E5783F941C682]-worker) [ ] o.m.log Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
[junit4] 2> 1108620 WARN (SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[AF5E5783F941C682]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 1108703 INFO (SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[AF5E5783F941C682]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 1108772 INFO (SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[AF5E5783F941C682]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.2-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_38131_hdfs____.2vi7po/webapp
[junit4] 2> 1109590 INFO (SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[AF5E5783F941C682]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38131
[junit4] 2> 1110621 WARN (SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[AF5E5783F941C682]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 1110628 INFO (SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[AF5E5783F941C682]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 1110659 INFO (SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[AF5E5783F941C682]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.2-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_59021_datanode____8zk2b6/webapp
[junit4] 2> 1111097 INFO (SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[AF5E5783F941C682]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:59021
[junit4] 2> 1111673 WARN (SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[AF5E5783F941C682]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 1111677 INFO (SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[AF5E5783F941C682]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 1111720 INFO (SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[AF5E5783F941C682]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.2-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_35342_datanode____.jt6csq/webapp
[junit4] 2> 1112345 INFO (SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[AF5E5783F941C682]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35342
[junit4] 2> 1113567 INFO (IPC Server handler 9 on 46907) [ ] BlockStateChange BLOCK* processReport: from storage DS-e61d9696-9779-4472-883d-caa8f2b83216 node DatanodeRegistration(127.0.0.1:36419, datanodeUuid=a71e2edc-a5e8-4d08-8152-9b7202fc279c, infoPort=45000, infoSecurePort=0, ipcPort=47221, storageInfo=lv=-56;cid=testClusterID;nsid=107884310;c=0), blocks: 0, hasStaleStorage: true, processing time: 3 msecs
[junit4] 2> 1113568 INFO (IPC Server handler 9 on 46907) [ ] BlockStateChange BLOCK* processReport: from storage DS-5c50e1b2-b39d-4255-bdf2-e167aa96dbeb node DatanodeRegistration(127.0.0.1:36419, datanodeUuid=a71e2edc-a5e8-4d08-8152-9b7202fc279c, infoPort=45000, infoSecurePort=0, ipcPort=47221, storageInfo=lv=-56;cid=testClusterID;nsid=107884310;c=0), blocks: 0, hasStaleStorage: false, processing time: 0 msecs
[junit4] 2> 1113577 INFO (IPC Server handler 8 on 46907) [ ] BlockStateChange BLOCK* processReport: from storage DS-3e9fe482-1172-474b-9b7c-00ac78c42bb6 node DatanodeRegistration(127.0.0.1:53638, datanodeUuid=7e16f600-dad3-4128-bf47-fbbad6ae3f34, infoPort=57509, infoSecurePort=0, ipcPort=56949, storageInfo=lv=-56;cid=testClusterID;nsid=107884310;c=0), blocks: 0, hasStaleStorage: true, processing time: 8 msecs
[junit4] 2> 1113577 INFO (IPC Server handler 8 on 46907) [ ] BlockStateChange BLOCK* processReport: from storage DS-62837648-767e-46be-b9c1-e6968523093d node DatanodeRegistration(127.0.0.1:53638, datanodeUuid=7e16f600-dad3-4128-bf47-fbbad6ae3f34, infoPort=57509, infoSecurePort=0, ipcPort=56949, storageInfo=lv=-56;cid=testClusterID;nsid=107884310;c=0), blocks: 0, hasStaleStorage: false, processing time: 0 msecs
[junit4] 2> 1114231 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[AF5E5783F941C682]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1114231 INFO (Thread-1949) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1114231 INFO (Thread-1949) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1114331 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[AF5E5783F941C682]) [ ] o.a.s.c.ZkTestServer start zk server on port:54538
[junit4] 2> 1114364 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[AF5E5783F941C682]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 1114367 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[AF5E5783F941C682]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 1114370 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[AF5E5783F941C682]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1114371 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[AF5E5783F941C682]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 1114374 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[AF5E5783F941C682]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 1114376 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[AF5E5783F941C682]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 1114386 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[AF5E5783F941C682]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 1114387 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[AF5E5783F941C682]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1114389 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[AF5E5783F941C682]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1114390 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[AF5E5783F941C682]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 1114391 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[AF5E5783F941C682]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 1114581 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[AF5E5783F941C682]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_AF5E5783F941C682-001/control-001/cores/collection1
[junit4] 2> 1114584 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[AF5E5783F941C682]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 1114623 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[AF5E5783F941C682]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1762b3c3{/,null,AVAILABLE}
[junit4] 2> 1114623 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[AF5E5783F941C682]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@175ae649{HTTP/1.1,[http/1.1]}{127.0.0.1:42719}
[junit4] 2> 1114623 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[AF5E5783F941C682]) [ ] o.e.j.s.Server Started @1118326ms
[junit4] 2> 1114624 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[AF5E5783F941C682]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:46907/hdfs__localhost_46907__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-6.x_checkout_solr_build_solr-core_test_J2_temp_solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_AF5E5783F941C682-001_tempDir-002_control_data, hostContext=/, hostPort=42719, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_AF5E5783F941C682-001/control-001/cores}
[junit4] 2> 1114624 ERROR (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[AF5E5783F941C682]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1114624 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[AF5E5783F941C682]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 6.5.0
[junit4] 2> 1114624 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[AF5E5783F941C682]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1114624 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[AF5E5783F941C682]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1114624 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[AF5E5783F941C682]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-02-04T12:12:29.618Z
[junit4] 2> 1114640 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[AF5E5783F941C682]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1114641 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[AF5E5783F941C682]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_AF5E5783F941C682-001/control-001/solr.xml
[junit4] 2> 1114649 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[AF5E5783F941C682]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1114650 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[AF5E5783F941C682]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:54538/solr
[junit4] 2> 1114701 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[AF5E5783F941C682]) [n:127.0.0.1:42719_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:42719_
[junit4] 2> 1114703 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[AF5E5783F941C682]) [n:127.0.0.1:42719_ ] o.a.s.c.Overseer Overseer (id=97400281446940676-127.0.0.1:42719_-n_0000000000) starting
[junit4] 2> 1114719 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[AF5E5783F941C682]) [n:127.0.0.1:42719_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42719_
[junit4] 2> 1114722 INFO (zkCallback-1516-thread-1-processing-n:127.0.0.1:42719_) [n:127.0.0.1:42719_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1114808 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[AF5E5783F941C682]) [n:127.0.0.1:42719_ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_AF5E5783F941C682-001/control-001/cores
[junit4] 2> 1114808 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[AF5E5783F941C682]) [n:127.0.0.1:42719_ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 1114820 INFO (OverseerStateUpdate-97400281446940676-127.0.0.1:42719_-n_0000000000) [n:127.0.0.1:42719_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 1114858 WARN (coreLoadExecutor-3005-thread-1-processing-n:127.0.0.1:42719_) [n:127.0.0.1:42719_ c:control_collection x:collection1] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
[junit4] 2> 1114859 INFO (coreLoadExecutor-3005-thread-1-processing-n:127.0.0.1:42719_) [n:127.0.0.1:42719_ c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
[junit4] 2> 1114877 INFO (coreLoadExecutor-3005-thread-1-processing-n:127.0.0.1:42719_) [n:127.0.0.1:42719_ c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 1115035 WARN (coreLoadExecutor-3005-thread-1-processing-n:127.0.0.1:42719_) [n:127.0.0.1:42719_ c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 1115036 INFO (coreLoadExecutor-3005-thread-1-processing-n:127.0.0.1:42719_) [n:127.0.0.1:42719_ c:control_collection x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 1115076 INFO (coreLoadExecutor-3005-thread-1-processing-n:127.0.0.1:42719_) [n:127.0.0.1:42719_ c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 1115096 INFO (coreLoadExecutor-3005-thread-1-processing-n:127.0.0.1:42719_) [n:127.0.0.1:42719_ c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:46907/solr_hdfs_home
[junit4] 2> 1115096 INFO (coreLoadExecutor-3005-thread-1-processing-n:127.0.0.1:42719_) [n:127.0.0.1:42719_ c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 1115096 INFO (coreLoadExecutor-3005-thread-1-processing-n:127.0.0.1:42719_) [n:127.0.0.1:42719_ c:control_collection x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_AF5E5783F941C682-001/control-001/cores/collection1], dataDir=[hdfs://localhost:46907/solr_hdfs_home/control_collection/core_node1/data/]
[junit4] 2> 1115096 INFO (coreLoadExecutor-3005-thread-1-processing-n:127.0.0.1:42719_) [n:127.0.0.1:42719_ c:control_collection x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@608e7ef8
[junit4] 2> 1115098 INFO (coreLoadExecutor-3005-thread-1-processing-n:127.0.0.1:42719_) [n:127.0.0.1:42719_ c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:46907/solr_hdfs_home/control_collection/core_node1/data/snapshot_metadata
[junit4] 2> 1115125 INFO (coreLoadExecutor-3005-thread-1-processing-n:127.0.0.1:42719_) [n:127.0.0.1:42719_ c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 1115125 INFO (coreLoadExecutor-3005-thread-1-processing-n:127.0.0.1:42719_) [n:127.0.0.1:42719_ c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
[junit4] 2> 1115126 INFO (coreLoadExecutor-3005-thread-1-processing-n:127.0.0.1:42719_) [n:127.0.0.1:42719_ c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Creating new single instance HDFS BlockCache
[junit4] 2> 1117442 INFO (coreLoadExecutor-3005-thread-1-processing-n:127.0.0.1:42719_) [n:127.0.0.1:42719_ c:control_collection x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 1117451 INFO (coreLoadExecutor-3005-thread-1-processing-n:127.0.0.1:42719_) [n:127.0.0.1:42719_ c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:46907/solr_hdfs_home/control_collection/core_node1/data
[junit4] 2> 1117534 INFO (coreLoadExecutor-3005-thread-1-processing-n:127.0.0.1:42719_) [n:127.0.0.1:42719_ c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:46907/solr_hdfs_home/control_collection/core_node1/data/index
[junit4] 2> 1117546 INFO (coreLoadExecutor-3005-thread-1-processing-n:127.0.0.1:42719_) [n:127.0.0.1:42719_ c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 1117546 INFO (coreLoadExecutor-3005-thread-1-processing-n:127.0.0.1:42719_) [n:127.0.0.1:42719_ c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
[junit4] 2> 1117547 INFO (coreLoadExecutor-3005-thread-1-processing-n:127.0.0.1:42719_) [n:127.0.0.1:42719_ c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Creating new single instance HDFS BlockCache
[junit4] 2> 1117559 INFO (coreLoadExecutor-3005-thread-1-processing-n:127.0.0.1:42719_) [n:127.0.0.1:42719_ c:control_collection x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 1117560 INFO (coreLoadExecutor-3005-thread-1-processing-n:127.0.0.1:42719_) [n:127.0.0.1:42719_ c:control_collection x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1435470398, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 1117879 INFO (IPC Server handler 5 on 46907) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:53638 is added to blk_1073741825_1001{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-5c50e1b2-b39d-4255-bdf2-e167aa96dbeb:NORMAL:127.0.0.1:36419|RBW], ReplicaUC[[DISK]DS-3e9fe482-1172-474b-9b7c-00ac78c42bb6:NORMAL:127.0.0.1:53638|RBW]]} size 71
[junit4] 2> 1117879 INFO (IPC Server handler 1 on 46907) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:36419 is added to blk_1073741825_1001 size 71
[junit4] 2> 1118316 WARN (coreLoadExecutor-3005-thread-1-processing-n:127.0.0.1:42719_) [n:127.0.0.1:42719_ c:control_collection x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 1118358 INFO (coreLoadExecutor-3005-thread-1-processing-n:127.0.0.1:42719_) [n:127.0.0.1:42719_ c:control_collection x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
[junit4] 2> 1118358 INFO (coreLoadExecutor-3005-thread-1-processing-n:127.0.0.1:42719_) [n:127.0.0.1:42719_ c:control_collection x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1118358 INFO (coreLoadExecutor-3005-thread-1-processing-n:127.0.0.1:42719_) [n:127.0.0.1:42719_ c:control_collection x:collection1] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=2
[junit4] 2> 1118375 INFO (coreLoadExecutor-3005-thread-1-processing-n:127.0.0.1:42719_) [n:127.0.0.1:42719_ c:control_collection x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: if uncommited for 15000ms;
[junit4] 2> 1118375 INFO (coreLoadExecutor-3005-thread-1-processing-n:127.0.0.1:42719_) [n:127.0.0.1:42719_ c:control_collection x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1118379 INFO (coreLoadExecutor-3005-thread-1-processing-n:127.0.0.1:42719_) [n:127.0.0.1:42719_ c:control_collection x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1478386956, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 1118516 INFO (coreLoadExecutor-3005-thread-1-processing-n:127.0.0.1:42719_) [n:127.0.0.1:42719_ c:control_collection x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@242c76c8[collection1] main]
[junit4] 2> 1118519 INFO (coreLoadExecutor-3005-thread-1-processing-n:127.0.0.1:42719_) [n:127.0.0.1:42719_ c:control_collection x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1118521 INFO (coreLoadExecutor-3005-thread-1-processing-n:127.0.0.1:42719_) [n:127.0.0.1:42719_ c:control_collection x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1118524 INFO (coreLoadExecutor-3005-thread-1-processing-n:127.0.0.1:42719_) [n:127.0.0.1:42719_ c:control_collection x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 1118526 INFO (searcherExecutor-3006-thread-1-processing-n:127.0.0.1:42719_ x:collection1 c:control_collection) [n:127.0.0.1:42719_ c:control_collection x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@242c76c8[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1118535 INFO (coreLoadExecutor-3005-thread-1-processing-n:127.0.0.1:42719_) [n:127.0.0.1:42719_ c:control_collection x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1558404507662024704
[junit4] 2> 1118556 INFO (coreZkRegister-2998-thread-1-processing-n:127.0.0.1:42719_ x:collection1 c:control_collection) [n:127.0.0.1:42719_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1118556 INFO (coreZkRegister-2998-thread-1-processing-n:127.0.0.1:42719_ x:collection1 c:control_collection) [n:127.0.0.1:42719_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1118556 INFO (coreZkRegister-2998-thread-1-processing-n:127.0.0.1:42719_ x:collection1 c:control_collection) [n:127.0.0.1:42719_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:42719/collection1/
[junit4] 2> 1118556 INFO (coreZkRegister-2998-thread-1-processing-n:127.0.0.1:42719_ x:collection1 c:control_collection) [n:127.0.0.1:42719_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1118556 INFO (coreZkRegister-2998-thread-1-processing-n:127.0.0.1:42719_ x:collection1 c:control_collection) [n:127.0.0.1:42719_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:42719/collection1/ has no replicas
[junit4] 2> 1118561 INFO (coreZkRegister-2998-thread-1-processing-n:127.0.0.1:42719_ x:collection1 c:control_collection) [n:127.0.0.1:42719_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:42719/collection1/ shard1
[junit4] 2> 1118712 INFO (coreZkRegister-2998-thread-1-processing-n:127.0.0.1:42719_ x:collection1 c:control_collection) [n:127.0.0.1:42719_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1119024 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[AF5E5783F941C682]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1119026 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[AF5E5783F941C682]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:54538/solr ready
[junit4] 2> 1119026 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[AF5E5783F941C682]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 1119026 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[AF5E5783F941C682]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with stateFormat=2
[junit4] 2> 1119153 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[AF5E5783F941C682]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_AF5E5783F941C682-001/shard-1-001/cores/collection1
[junit4] 2> 1119154 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[AF5E5783F941C682]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_AF5E5783F941C682-001/shard-1-001
[junit4] 2> 1119155 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[AF5E5783F941C682]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 1119156 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[AF5E5783F941C682]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1f20a7d3{/,null,AVAILABLE}
[junit4] 2> 1119157 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[AF5E5783F941C682]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@3794cb66{HTTP/1.1,[http/1.1]}{127.0.0.1:46446}
[junit4] 2> 1119158 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[AF5E5783F941C682]) [ ] o.e.j.s.Server Started @1122860ms
[junit4] 2> 1119158 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[AF5E5783F941C682]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:46907/hdfs__localhost_46907__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-6.x_checkout_solr_build_solr-core_test_J2_temp_solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_AF5E5783F941C682-001_tempDir-002_jetty1, solrconfig=solrconfig.xml, hostContext=/, hostPort=46446, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_AF5E5783F941C682-001/shard-1-001/cores}
[junit4] 2> 1119158 ERROR (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[AF5E5783F941C682]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1119158 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[AF5E5783F941C682]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 6.5.0
[junit4] 2> 1119158 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[AF5E5783F941C682]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1119158 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[AF5E5783F941C682]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1119158 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[AF5E5783F941C682]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-02-04T12:12:34.152Z
[junit4] 2> 1119162 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[AF5E5783F941C682]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1119162 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[AF5E5783F941C682]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_AF5E5783F941C682-001/shard-1-001/solr.xml
[junit4] 2> 1119169 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[AF5E5783F941C682]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1119170 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[AF5E5783F941C682]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:54538/solr
[junit4] 2> 1119191 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[AF5E5783F941C682]) [n:127.0.0.1:46446_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1119198 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[AF5E5783F941C682]) [n:127.0.0.1:46446_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46446_
[junit4] 2> 1119201 INFO (zkCallback-1516-thread-3-processing-n:127.0.0.1:42719_) [n:127.0.0.1:42719_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1119211 INFO (zkCallback-1526-thread-1-processing-n:127.0.0.1:46446_) [n:127.0.0.1:46446_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1119212 INFO (zkCallback-1520-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1119365 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[AF5E5783F941C682]) [n:127.0.0.1:46446_ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_AF5E5783F941C682-001/shard-1-001/cores
[junit4] 2> 1119365 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[AF5E5783F941C682]) [n:127.0.0.1:46446_ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 1119370 INFO (OverseerStateUpdate-97400281446940676-127.0.0.1:42719_-n_0000000000) [n:127.0.0.1:42719_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2
[junit4] 2> 1119474 INFO (zkCallback-1526-thread-1-processing-n:127.0.0.1:46446_) [n:127.0.0.1:46446_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1120385 WARN (coreLoadExecutor-3016-thread-1-processing-n:127.0.0.1:46446_) [n:127.0.0.1:46446_ c:collection1 x:collection1] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
[junit4] 2> 1120386 INFO (coreLoadExecutor-3016-thread-1-processing-n:127.0.0.1:46446_) [n:127.0.0.1:46446_ c:collection1 x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
[junit4] 2> 1120405 INFO (coreLoadExecutor-3016-thread-1-processing-n:127.0.0.1:46446_) [n:127.0.0.1:46446_ c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 1120485 WARN (coreLoadExecutor-3016-thread-1-processing-n:127.0.0.1:46446_) [n:127.0.0.1:46446_ c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 1120487 INFO (coreLoadExecutor-3016-thread-1-processing-n:127.0.0.1:46446_) [n:127.0.0.1:46446_ c:collection1 x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 1120517 INFO (coreLoadExecutor-3016-thread-1-processing-n:127.0.0.1:46446_) [n:127.0.0.1:46446_ c:collection1 x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 1120517 INFO (coreLoadExecutor-3016-thread-1-processing-n:127.0.0.1:46446_) [n:127.0.0.1:46446_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:46907/solr_hdfs_home
[junit4] 2> 1120517 INFO (coreLoadExecutor-3016-thread-1-processing-n:127.0.0.1:46446_) [n:127.0.0.1:46446_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 1120517 INFO (coreLoadExecutor-3016-thread-1-processing-n:127.0.0.1:46446_) [n:127.0.0.1:46446_ c:collection1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_AF5E5783F941C682-001/shard-1-001/cores/collection1], dataDir=[hdfs://localhost:46907/solr_hdfs_home/collection1/core_node1/data/]
[junit4] 2> 1120517 INFO (coreLoadExecutor-3016-thread-1-processing-n:127.0.0.1:46446_) [n:127.0.0.1:46446_ c:collection1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@608e7ef8
[junit4] 2> 1120518 INFO (coreLoadExecutor-3016-thread-1-processing-n:127.0.0.1:46446_) [n:127.0.0.1:46446_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:46907/solr_hdfs_home/collection1/core_node1/data/snapshot_metadata
[junit4] 2> 1120532 INFO (coreLoadExecutor-3016-thread-1-processing-n:127.0.0.1:46446_) [n:127.0.0.1:46446_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 1120532 INFO (coreLoadExecutor-3016-thread-1-processing-n:127.0.0.1:46446_) [n:127.0.0.1:46446_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
[junit4] 2> 1120532 INFO (coreLoadExecutor-3016-thread-1-processing-n:127.0.0.1:46446_) [n:127.0.0.1:46446_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Creating new single instance HDFS BlockCache
[junit4] 2> 1120553 INFO (coreLoadExecutor-3016-thread-1-processing-n:127.0.0.1:46446_) [n:127.0.0.1:46446_ c:collection1 x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 1120554 INFO (coreLoadExecutor-3016-thread-1-processing-n:127.0.0.1:46446_) [n:127.0.0.1:46446_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:46907/solr_hdfs_home/collection1/core_node1/data
[junit4] 2> 1120586 INFO (coreLoadExecutor-3016-thread-1-processing-n:127.0.0.1:46446_) [n:127.0.0.1:46446_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:46907/solr_hdfs_home/collection1/core_node1/data/index
[junit4] 2> 1120604 INFO (coreLoadExecutor-3016-thread-1-processing-n:127.0.0.1:46446_) [n:127.0.0.1:46446_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 1120604 INFO (coreLoadExecutor-3016-thread-1-processing-n:127.0.0.1:46446_) [n:127.0.0.1:46446_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
[junit4] 2> 1120604 INFO (coreLoadExecutor-3016-thread-1-processing-n:127.0.0.1:46446_) [n:127.0.0.1:46446_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Creating new single instance HDFS BlockCache
[junit4] 2> 1120614 INFO (coreLoadExecutor-3016-thread-1-processing-n:127.0.0.1:46446_) [n:127.0.0.1:46446_ c:collection1 x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 1120616 INFO (coreLoadExecutor-3016-thread-1-processing-n:127.0.0.1:46446_) [n:127.0.0.1:46446_ c:collection1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1435470398, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 1120676 INFO (IPC Server handler 4 on 46907) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:36419 is added to blk_1073741826_1002{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-62837648-767e-46be-b9c1-e6968523093d:NORMAL:127.0.0.1:53638|RBW], ReplicaUC[[DISK]DS-e61d9696-9779-4472-883d-caa8f2b83216:NORMAL:127.0.0.1:36419|FINALIZED]]} size 0
[junit4] 2> 1120679 INFO (IPC Server handler 2 on 46907) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:53638 is added to blk_1073741826_1002{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-e61d9696-9779-4472-883d-caa8f2b83216:NORMAL:127.0.0.1:36419|FINALIZED], ReplicaUC[[DISK]DS-3e9fe482-1172-474b-9b7c-00ac78c42bb6:NORMAL:127.0.0.1:53638|FINALIZED]]} size 0
[junit4] 2> 1120703 WARN (coreLoadExecutor-3016-thread-1-processing-n:127.0.0.1:46446_) [n:127.0.0.1:46446_ c:collection1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 1120734 INFO (coreLoadExecutor-3016-thread-1-processing-n:127.0.0.1:46446_) [n:127.0.0.1:46446_ c:collection1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
[junit4] 2> 1120734 INFO (coreLoadExecutor-3016-thread-1-processing-n:127.0.0.1:46446_) [n:127.0.0.1:46446_ c:collection1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1120734 INFO (coreLoadExecutor-3016-thread-1-processing-n:127.0.0.1:46446_) [n:127.0.0.1:46446_ c:collection1 x:collection1] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=2
[junit4] 2> 1120752 INFO (coreLoadExecutor-3016-thread-1-processing-n:127.0.0.1:46446_) [n:127.0.0.1:46446_ c:collection1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: if uncommited for 15000ms;
[junit4] 2> 1120752 INFO (coreLoadExecutor-3016-thread-1-processing-n:127.0.0.1:46446_) [n:127.0.0.1:46446_ c:collection1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1120759 INFO (coreLoadExecutor-3016-thread-1-processing-n:127.0.0.1:46446_) [n:127.0.0.1:46446_ c:collection1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1478386956, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 1120791 INFO (coreLoadExecutor-3016-thread-1-processing-n:127.0.0.1:46446_) [n:127.0.0.1:46446_ c:collection1 x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@1a01d149[collection1] main]
[junit4] 2> 1120793 INFO (coreLoadExecutor-3016-thread-1-processing-n:127.0.0.1:46446_) [n:127.0.0.1:46446_ c:collection1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1120793 INFO (coreLoadExecutor-3016-thread-1-processing-n:127.0.0.1:46446_) [n:127.0.0.1:46446_ c:collection1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1120793 INFO (coreLoadExecutor-3016-thread-1-processing-n:127.0.0.1:46446_) [n:127.0.0.1:46446_ c:collection1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 1120795 INFO (searcherExecutor-3017-thread-1-processing-n:127.0.0.1:46446_ x:collection1 c:collection1) [n:127.0.0.1:46446_ c:collection1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@1a01d149[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1120806 INFO (coreLoadExecutor-3016-thread-1-processing-n:127.0.0.1:46446_) [n:127.0.0.1:46446_ c:collection1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1558404510043340800
[junit4] 2> 1120820 INFO (coreZkRegister-3011-thread-1-processing-n:127.0.0.1:46446_ x:collection1 c:collection1) [n:127.0.0.1:46446_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1120820 INFO (coreZkRegister-3011-thread-1-processing-n:127.0.0.1:46446_ x:collection1 c:collection1) [n:127.0.0.1:46446_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1120820 INFO (coreZkRegister-3011-thread-1-processing-n:127.0.0.1:46446_ x:collection1 c:collection1) [n:127.0.0.1:46446_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:46446/collection1/
[junit4] 2> 11
[...truncated too long message...]
ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 4775147 INFO (jetty-launcher-3997-thread-13) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.node
[junit4] 2> 4775147 INFO (jetty-launcher-3997-thread-13) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@763773d0{/solr,null,UNAVAILABLE}
[junit4] 2> 4775334 WARN (zkCallback-4055-thread-4-processing-n:127.0.0.1:55183_solr) [n:127.0.0.1:55183_solr ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 4775334 INFO (jetty-launcher-3997-thread-15) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.node
[junit4] 2> 4775334 INFO (jetty-launcher-3997-thread-15) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@2948ab9b{/solr,null,UNAVAILABLE}
[junit4] 2> 4775353 WARN (zkCallback-4049-thread-5-processing-n:127.0.0.1:36498_solr) [n:127.0.0.1:36498_solr ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 4775353 INFO (jetty-launcher-3997-thread-16) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.node
[junit4] 2> 4775353 INFO (jetty-launcher-3997-thread-16) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@3657bb60{/solr,null,UNAVAILABLE}
[junit4] 2> 4775359 WARN (zkCallback-4028-thread-4-processing-n:127.0.0.1:35677_solr) [n:127.0.0.1:35677_solr ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 4775359 INFO (jetty-launcher-3997-thread-20) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.node
[junit4] 2> 4775360 INFO (jetty-launcher-3997-thread-20) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@57073f9c{/solr,null,UNAVAILABLE}
[junit4] 2> 4775379 WARN (zkCallback-4038-thread-5-processing-n:127.0.0.1:45136_solr) [n:127.0.0.1:45136_solr ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 4775379 INFO (jetty-launcher-3997-thread-19) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.node
[junit4] 2> 4775379 INFO (jetty-launcher-3997-thread-19) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@5fbc4eec{/solr,null,UNAVAILABLE}
[junit4] 2> 4775388 WARN (zkCallback-4034-thread-4-processing-n:127.0.0.1:38880_solr) [n:127.0.0.1:38880_solr ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 4775388 INFO (jetty-launcher-3997-thread-14) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.node
[junit4] 2> 4775388 INFO (jetty-launcher-3997-thread-14) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@45a2d554{/solr,null,UNAVAILABLE}
[junit4] 2> 4775393 INFO (SUITE-TestStressCloudBlindAtomicUpdates-seed#[AF5E5783F941C682]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:58165 58165
[junit4] 2> 4775477 INFO (Thread-17856) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:58165 58165
[junit4] 2> 4775478 WARN (Thread-17856) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 11 /solr/aliases.json
[junit4] 2> 11 /solr/clusterprops.json
[junit4] 2> 10 /solr/configs/org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates_config-set
[junit4] 2> 10 /solr/security.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 11 /solr/clusterstate.json
[junit4] 2> 10 /solr/collections/test_col/state.json
[junit4] 2> 3 /solr/overseer_elect/election/97400489924493334-127.0.0.1:45356_solr-n_0000000005
[junit4] 2> 3 /solr/overseer_elect/election/97400489924493333-127.0.0.1:38880_solr-n_0000000001
[junit4] 2> 2 /solr/overseer_elect/election/97400489924493331-127.0.0.1:35677_solr-n_0000000002
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 474 /solr/overseer/collection-queue-work
[junit4] 2> 36 /solr/overseer/queue
[junit4] 2> 11 /solr/live_nodes
[junit4] 2> 11 /solr/collections
[junit4] 2> 8 /solr/overseer/queue-work
[junit4] 2>
[junit4] 2> 4775478 INFO (SUITE-TestStressCloudBlindAtomicUpdates-seed#[AF5E5783F941C682]-worker) [ ] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressCloudBlindAtomicUpdates_AF5E5783F941C682-001
[junit4] 2> Feb 04, 2017 1:13:30 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene62): {long_stored_idx=FSTOrd50, long_dv_idx=PostingsFormat(name=Memory doPackFST= true), id=PostingsFormat(name=Direct), long_dv_stored_idx=PostingsFormat(name=Memory doPackFST= true)}, docValues:{_version_=DocValuesFormat(name=Asserting), long_dv_idx=DocValuesFormat(name=Direct), long_dv_stored=DocValuesFormat(name=Lucene54), id=DocValuesFormat(name=Lucene54), long_dv=DocValuesFormat(name=Direct), long_dv_stored_idx=DocValuesFormat(name=Direct)}, maxPointsInLeafNode=661, maxMBSortInHeap=5.5013311745593985, sim=RandomSimilarity(queryNorm=true,coord=no): {}, locale=sq, timezone=Asia/Ulaanbaatar
[junit4] 2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_102 (64-bit)/cpus=4,threads=1,free=81929440,total=532676608
[junit4] 2> NOTE: All tests run in this JVM: [SystemInfoHandlerTest, TestSystemIdResolver, TestFiltering, TestFilteredDocIdSet, ShardRoutingTest, TestSimpleTrackingShardHandler, CdcrUpdateLogTest, TestJavabinTupleStreamParser, BasicAuthIntegrationTest, TestAnalyzeInfixSuggestions, CoreAdminRequestStatusTest, TestLocalFSCloudBackupRestore, TolerantUpdateProcessorTest, TestSolrIndexConfig, TestTolerantUpdateProcessorCloud, TestUseDocValuesAsStored, RAMDirectoryFactoryTest, TestBlobHandler, TestStressUserVersions, SpellingQueryConverterTest, TestReplicaProperties, TestUninvertingReader, TestSearchPerf, TestManagedResource, TestMacroExpander, MissingSegmentRecoveryTest, TestCoreContainer, TestLegacyFieldCache, ZkSolrClientTest, SpellCheckCollatorTest, TestNoOpRegenerator, TestDistributedGrouping, TestPKIAuthenticationPlugin, JsonLoaderTest, TestScoreJoinQPScore, SliceStateTest, TestFieldCacheReopen, TestCloudRecovery, TestRecoveryHdfs, LeaderElectionContextKeyTest, TestRandomCollapseQParserPlugin, AtomicUpdatesTest, SmileWriterTest, DocumentBuilderTest, TestSuggestSpellingConverter, TestCorePropertiesReload, CdcrReplicationHandlerTest, TestRawTransformer, WrapperMergePolicyFactoryTest, HighlighterTest, CollectionsAPIDistributedZkTest, RankQueryTest, LeaderInitiatedRecoveryOnCommitTest, DistributedMLTComponentTest, CollectionReloadTest, TestRandomFlRTGCloud, TestJettySolrRunner, IgnoreCommitOptimizeUpdateProcessorFactoryTest, QueryResultKeyTest, TestTestInjection, OpenCloseCoreStressTest, SolrInfoMBeanTest, DocValuesNotIndexedTest, BigEndianAscendingWordSerializerTest, ShufflingReplicaListTransformerTest, TestComplexPhraseQParserPlugin, SoftAutoCommitTest, HdfsWriteToMultipleCollectionsTest, DateMathParserTest, ZkCLITest, TestMinMaxOnMultiValuedField, SimpleMLTQParserTest, TestHdfsUpdateLog, TestSubQueryTransformer, TestSchemaSimilarityResource, SortByFunctionTest, SuggesterFSTTest, TestSurroundQueryParser, LoggingHandlerTest, URLClassifyProcessorTest, TestCSVResponseWriter, MoreLikeThisHandlerTest, BJQParserTest, TestNonDefinedSimilarityFactory, TestSolrCoreParser, MetricsHandlerTest, DistributedTermsComponentTest, TestLMDirichletSimilarityFactory, HdfsThreadLeakTest, ConvertedLegacyTest, TestTrie, TestLeaderElectionWithEmptyReplica, SolrXmlInZkTest, BaseCdcrDistributedZkTest, DirectoryFactoryTest, AliasIntegrationTest, TestBM25SimilarityFactory, TriLevelCompositeIdRoutingTest, SpatialFilterTest, IndexBasedSpellCheckerTest, TestCollationFieldDocValues, SolrIndexSplitterTest, TestExactSharedStatsCache, CollectionsAPIAsyncDistributedZkTest, DistribJoinFromCollectionTest, TestBulkSchemaAPI, DistanceFunctionTest, SmileWriterTest, CSVRequestHandlerTest, TestSSLRandomization, IndexSchemaTest, TestCursorMarkWithoutUniqueKey, TestDistributedMissingSort, TestEmbeddedSolrServerConstructors, ConnectionReuseTest, ActionThrottleTest, CdcrBootstrapTest, CollectionsAPISolrJTest, CreateCollectionCleanupTest, DeleteLastCustomShardedReplicaTest, DeleteNodeTest, DeleteReplicaTest, DistribDocExpirationUpdateProcessorTest, HttpPartitionTest, LeaderFailoverAfterPartitionTest, OutOfBoxZkACLAndCredentialsProvidersTest, OverriddenZkACLAndCredentialsProvidersTest, OverseerCollectionConfigSetProcessorTest, OverseerModifyCollectionTest, OverseerRolesTest, OverseerStatusTest, PeerSyncReplicationTest, ReplicationFactorTest, RollingRestartTest, SharedFSAutoReplicaFailoverUtilsTest, SimpleCollectionCreateDeleteTest, SolrCloudExampleTest, TestAuthenticationFramework, TestCloudDeleteByQuery, TestCollectionAPI, TestConfigSetsAPI, TestDistribDocBasedVersion, TestExclusionRuleCollectionAccess, TestLockTree, TestMiniSolrCloudClusterSSL, TestSegmentSorting, TestShortCircuitedRequests, TestSolrCloudWithKerberosAlt, TestStressCloudBlindAtomicUpdates]
[junit4] Completed [563/683 (6!)] on J1 in 480.73s, 5 tests, 1 failure <<< FAILURES!
[...truncated 62797 lines...]
[JENKINS] Lucene-Solr-NightlyTests-6.x - Build # 273 - Still
Unstable
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.x/273/
9 tests failed.
FAILED: org.apache.lucene.search.TestFuzzyQuery.testRandom
Error Message:
Test abandoned because suite timeout was reached.
Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
at __randomizedtesting.SeedInfo.seed([9CC61896E2274FEF]:0)
FAILED: junit.framework.TestSuite.org.apache.lucene.search.TestFuzzyQuery
Error Message:
Suite timeout exceeded (>= 7200000 msec).
Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
at __randomizedtesting.SeedInfo.seed([9CC61896E2274FEF]:0)
FAILED: org.apache.solr.cloud.CdcrReplicationDistributedZkTest.testResilienceWithDeleteByQueryOnTarget
Error Message:
Timeout while trying to assert number of documents @ target_collection
Stack Trace:
java.lang.AssertionError: Timeout while trying to assert number of documents @ target_collection
at __randomizedtesting.SeedInfo.seed([9C36D7E0B4DB5132:3C54457A64829477]:0)
at org.apache.solr.cloud.BaseCdcrDistributedZkTest.assertNumDocs(BaseCdcrDistributedZkTest.java:271)
at org.apache.solr.cloud.CdcrReplicationDistributedZkTest.testResilienceWithDeleteByQueryOnTarget(CdcrReplicationDistributedZkTest.java:595)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.AssertionError: expected:<50> but was:<30>
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at org.apache.solr.cloud.BaseCdcrDistributedZkTest.assertNumDocs(BaseCdcrDistributedZkTest.java:262)
... 42 more
FAILED: org.apache.solr.cloud.CdcrReplicationDistributedZkTest.testReplicationAfterRestart
Error Message:
Timeout waiting for CDCR replication to complete @source_collection:shard2
Stack Trace:
java.lang.RuntimeException: Timeout waiting for CDCR replication to complete @source_collection:shard2
at __randomizedtesting.SeedInfo.seed([9C36D7E0B4DB5132:C02B30617AFBE504]:0)
at org.apache.solr.cloud.BaseCdcrDistributedZkTest.waitForReplicationToComplete(BaseCdcrDistributedZkTest.java:795)
at org.apache.solr.cloud.CdcrReplicationDistributedZkTest.testReplicationAfterRestart(CdcrReplicationDistributedZkTest.java:236)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates
Error Message:
1 thread leaked from SUITE scope at org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates: 1) Thread[id=1693, name=OverseerHdfsCoreFailoverThread-97390798401306652-127.0.0.1:49735_solr-n_0000000007, state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.] at java.lang.Thread.sleep(Native Method) at org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:139) at java.lang.Thread.run(Thread.java:745)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates:
1) Thread[id=1693, name=OverseerHdfsCoreFailoverThread-97390798401306652-127.0.0.1:49735_solr-n_0000000007, state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.]
at java.lang.Thread.sleep(Native Method)
at org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:139)
at java.lang.Thread.run(Thread.java:745)
at __randomizedtesting.SeedInfo.seed([9C36D7E0B4DB5132]:0)
FAILED: org.apache.solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest.test
Error Message:
There are still nodes recoverying - waited for 330 seconds
Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 330 seconds
at __randomizedtesting.SeedInfo.seed([9C36D7E0B4DB5132:1462E83A1A273CCA]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:187)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:144)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:139)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:850)
at org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest.test(ChaosMonkeyNothingIsSafeTest.java:124)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.hdfs.HdfsUnloadDistributedZkTest.test
Error Message:
Captured an uncaught exception in thread: Thread[id=2636, name=testExecutor-324-thread-2, state=RUNNABLE, group=TGRP-HdfsUnloadDistributedZkTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=2636, name=testExecutor-324-thread-2, state=RUNNABLE, group=TGRP-HdfsUnloadDistributedZkTest]
Caused by: java.lang.RuntimeException: org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:49380
at __randomizedtesting.SeedInfo.seed([9C36D7E0B4DB5132]:0)
at org.apache.solr.cloud.UnloadDistributedZkTest.lambda$testUnloadLotsOfCores$0(UnloadDistributedZkTest.java:412)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:49380
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:621)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:279)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:268)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
at org.apache.solr.cloud.UnloadDistributedZkTest.lambda$testUnloadLotsOfCores$0(UnloadDistributedZkTest.java:410)
... 4 more
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:170)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:515)
... 8 more
FAILED: org.apache.solr.handler.TestReplicationHandler.doTestReplicateAfterCoreReload
Error Message:
expected:<[{indexVersion=1486068551523,generation=2,filelist=[_5.fdt, _5.fdx, _5.fnm, _5.nvd, _5.nvm, _5.si, _5_LuceneVarGapDocFreqInterval_0.doc, _5_LuceneVarGapDocFreqInterval_0.tib, _5_LuceneVarGapDocFreqInterval_0.tiv, _6.fdt, _6.fdx, _6.fnm, _6.nvd, _6.nvm, _6.si, _6_LuceneVarGapDocFreqInterval_0.doc, _6_LuceneVarGapDocFreqInterval_0.tib, _6_LuceneVarGapDocFreqInterval_0.tiv, segments_2]}]> but was:<[{indexVersion=1486068551523,generation=2,filelist=[_5.fdt, _5.fdx, _5.fnm, _5.nvd, _5.nvm, _5.si, _5_LuceneVarGapDocFreqInterval_0.doc, _5_LuceneVarGapDocFreqInterval_0.tib, _5_LuceneVarGapDocFreqInterval_0.tiv, _6.fdt, _6.fdx, _6.fnm, _6.nvd, _6.nvm, _6.si, _6_LuceneVarGapDocFreqInterval_0.doc, _6_LuceneVarGapDocFreqInterval_0.tib, _6_LuceneVarGapDocFreqInterval_0.tiv, segments_2]}, {indexVersion=1486068551523,generation=3,filelist=[_7.cfe, _7.cfs, _7.si, segments_3]}]>
Stack Trace:
java.lang.AssertionError: expected:<[{indexVersion=1486068551523,generation=2,filelist=[_5.fdt, _5.fdx, _5.fnm, _5.nvd, _5.nvm, _5.si, _5_LuceneVarGapDocFreqInterval_0.doc, _5_LuceneVarGapDocFreqInterval_0.tib, _5_LuceneVarGapDocFreqInterval_0.tiv, _6.fdt, _6.fdx, _6.fnm, _6.nvd, _6.nvm, _6.si, _6_LuceneVarGapDocFreqInterval_0.doc, _6_LuceneVarGapDocFreqInterval_0.tib, _6_LuceneVarGapDocFreqInterval_0.tiv, segments_2]}]> but was:<[{indexVersion=1486068551523,generation=2,filelist=[_5.fdt, _5.fdx, _5.fnm, _5.nvd, _5.nvm, _5.si, _5_LuceneVarGapDocFreqInterval_0.doc, _5_LuceneVarGapDocFreqInterval_0.tib, _5_LuceneVarGapDocFreqInterval_0.tiv, _6.fdt, _6.fdx, _6.fnm, _6.nvd, _6.nvm, _6.si, _6_LuceneVarGapDocFreqInterval_0.doc, _6_LuceneVarGapDocFreqInterval_0.tib, _6_LuceneVarGapDocFreqInterval_0.tiv, segments_2]}, {indexVersion=1486068551523,generation=3,filelist=[_7.cfe, _7.cfs, _7.si, segments_3]}]>
at __randomizedtesting.SeedInfo.seed([9C36D7E0B4DB5132:B9E1CCD0C4935F31]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:147)
at org.apache.solr.handler.TestReplicationHandler.doTestReplicateAfterCoreReload(TestReplicationHandler.java:1245)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest.test
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([9C36D7E0B4DB5132:1462E83A1A273CCA]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertTrue(Assert.java:54)
at org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest.test(HdfsWriteToMultipleCollectionsTest.java:137)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 1736 lines...]
[junit4] Suite: org.apache.lucene.search.TestFuzzyQuery
[junit4] 2> Vas 02, 2017 2:48:38 PM com.carrotsearch.randomizedtesting.ThreadLeakControl$2 evaluate
[junit4] 2> WARNING: Suite execution timed out: org.apache.lucene.search.TestFuzzyQuery
[junit4] 2> 1) Thread[id=5577, name=SUITE-TestFuzzyQuery-seed#[9CC61896E2274FEF], state=RUNNABLE, group=TGRP-TestFuzzyQuery]
[junit4] 2> at java.lang.Thread.getStackTrace(Thread.java:1556)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$4.run(ThreadLeakControl.java:696)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$4.run(ThreadLeakControl.java:693)
[junit4] 2> at java.security.AccessController.doPrivileged(Native Method)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.getStackTrace(ThreadLeakControl.java:693)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.getThreadsWithTraces(ThreadLeakControl.java:709)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.formatThreadStacksFull(ThreadLeakControl.java:689)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.access$1000(ThreadLeakControl.java:65)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$2.evaluate(ThreadLeakControl.java:415)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:678)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.access$200(RandomizedRunner.java:140)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:598)
[junit4] 2> 2) Thread[id=1, name=main, state=WAITING, group=main]
[junit4] 2> at java.lang.Object.wait(Native Method)
[junit4] 2> at java.lang.Thread.join(Thread.java:1249)
[junit4] 2> at java.lang.Thread.join(Thread.java:1323)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:608)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.run(RandomizedRunner.java:457)
[junit4] 2> at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.execute(SlaveMain.java:244)
[junit4] 2> at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.main(SlaveMain.java:355)
[junit4] 2> at com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe.main(SlaveMainSafe.java:13)
[junit4] 2> 3) Thread[id=5578, name=TEST-TestFuzzyQuery.testRandom-seed#[9CC61896E2274FEF], state=RUNNABLE, group=TGRP-TestFuzzyQuery]
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedContext.current(RandomizedContext.java:134)
[junit4] 2> at org.apache.lucene.util.LuceneTestCase.random(LuceneTestCase.java:747)
[junit4] 2> at org.apache.lucene.search.TestFuzzyQuery.randomSimpleString(TestFuzzyQuery.java:506)
[junit4] 2> at org.apache.lucene.search.TestFuzzyQuery.testRandom(TestFuzzyQuery.java:517)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:498)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
[junit4] 2> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 4) Thread[id=9, name=JUnit4-serializer-daemon, state=TIMED_WAITING, group=main]
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at com.carrotsearch.ant.tasks.junit4.events.Serializer$1.run(Serializer.java:50)
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestFuzzyQuery -Dtests.method=testRandom -Dtests.seed=9CC61896E2274FEF -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/test-data/enwiki.random.lines.txt -Dtests.locale=lt -Dtests.timezone=America/Argentina/Rio_Gallegos -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] ERROR 7200s J0 | TestFuzzyQuery.testRandom <<<
[junit4] > Throwable #1: java.lang.Exception: Test abandoned because suite timeout was reached.
[junit4] > at __randomizedtesting.SeedInfo.seed([9CC61896E2274FEF]:0)
[junit4] 2> Vas 02, 2017 2:48:38 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> Vas 02, 2017 2:48:58 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> SEVERE: 1 thread leaked from SUITE scope at org.apache.lucene.search.TestFuzzyQuery:
[junit4] 2> 1) Thread[id=5578, name=TEST-TestFuzzyQuery.testRandom-seed#[9CC61896E2274FEF], state=RUNNABLE, group=TGRP-TestFuzzyQuery]
[junit4] 2> at com.carrotsearch.randomizedtesting.Xoroshiro128PlusRandom.next(Xoroshiro128PlusRandom.java:95)
[junit4] 2> at java.util.Random.nextInt(Random.java:390)
[junit4] 2> at com.carrotsearch.randomizedtesting.Xoroshiro128PlusRandom.nextInt(Xoroshiro128PlusRandom.java:73)
[junit4] 2> at com.carrotsearch.randomizedtesting.AssertingRandom.nextInt(AssertingRandom.java:87)
[junit4] 2> at org.apache.lucene.search.TestFuzzyQuery.randomSimpleString(TestFuzzyQuery.java:506)
[junit4] 2> at org.apache.lucene.search.TestFuzzyQuery.testRandom(TestFuzzyQuery.java:517)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:498)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
[junit4] 2> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> Vas 02, 2017 2:48:58 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> INFO: Starting to interrupt leaked threads:
[junit4] 2> 1) Thread[id=5578, name=TEST-TestFuzzyQuery.testRandom-seed#[9CC61896E2274FEF], state=RUNNABLE, group=TGRP-TestFuzzyQuery]
[junit4] 2> Vas 02, 2017 2:49:01 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> SEVERE: There are still zombie threads that couldn't be terminated:
[junit4] 2> 1) Thread[id=5578, name=TEST-TestFuzzyQuery.testRandom-seed#[9CC61896E2274FEF], state=RUNNABLE, group=TGRP-TestFuzzyQuery]
[junit4] 2> at java.lang.Object.hashCode(Native Method)
[junit4] 2> at java.util.WeakHashMap.hash(WeakHashMap.java:298)
[junit4] 2> at java.util.WeakHashMap.getEntry(WeakHashMap.java:426)
[junit4] 2> at java.util.WeakHashMap.containsKey(WeakHashMap.java:417)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedContext.context(RandomizedContext.java:258)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedContext.current(RandomizedContext.java:134)
[junit4] 2> at org.apache.lucene.util.LuceneTestCase.random(LuceneTestCase.java:747)
[junit4] 2> at org.apache.lucene.search.TestFuzzyQuery.randomSimpleString(TestFuzzyQuery.java:506)
[junit4] 2> at org.apache.lucene.search.TestFuzzyQuery.testRandom(TestFuzzyQuery.java:517)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:498)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
[junit4] 2> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene62): {field=Lucene50(blocksize=128)}, docValues:{}, maxPointsInLeafNode=374, maxMBSortInHeap=5.0293603415445585, sim=RandomSimilarity(queryNorm=true,coord=no): {field=IB SPL-D3(800.0)}, locale=lt, timezone=America/Argentina/Rio_Gallegos
[junit4] 2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_102 (64-bit)/cpus=4,threads=2,free=46266896,total=118489088
[junit4] 2> NOTE: All tests run in this JVM: [TestNearSpansOrdered, TestIOUtils, TestThreadedForceMerge, TestAddIndexes, TestLazyProxSkipping, TestBooleanRewrites, TestExitableDirectoryReader, TestFieldMaskingSpanQuery, TestIndexWriterWithThreads, TestPointValues, TestReqExclBulkScorer, TestIndexWriterOnVMError, TestDocumentWriter, TestBagOfPositions, TestSortedNumericSortField, TestConsistentFieldNumbers, TestDateTools, TestDocBoost, TestBasics, Test2BBinaryDocValues, TestIndexWriter, TestDocIdSetBuilder, TestNoDeletionPolicy, TestIntroSelector, TestIndexingSequenceNumbers, TestPrefixCodedTerms, TestLucene54DocValuesFormat, TestTragicIndexWriterDeadlock, TestFuzzyQuery]
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestFuzzyQuery -Dtests.seed=9CC61896E2274FEF -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/test-data/enwiki.random.lines.txt -Dtests.locale=lt -Dtests.timezone=America/Argentina/Rio_Gallegos -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] ERROR 0.00s J0 | TestFuzzyQuery (suite) <<<
[junit4] > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
[junit4] > at __randomizedtesting.SeedInfo.seed([9CC61896E2274FEF]:0)
[junit4] Completed [403/451 (1!)] on J0 in 7223.16s, 9 tests, 2 errors <<< FAILURES!
[...truncated 9845 lines...]
[junit4] Suite: org.apache.solr.cloud.hdfs.HdfsUnloadDistributedZkTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_9C36D7E0B4DB5132-001/init-core-data-001
[junit4] 2> 75942 INFO (SUITE-HdfsUnloadDistributedZkTest-seed#[9C36D7E0B4DB5132]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
[junit4] 2> 75942 INFO (SUITE-HdfsUnloadDistributedZkTest-seed#[9C36D7E0B4DB5132]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
[junit4] 2> 78301 WARN (SUITE-HdfsUnloadDistributedZkTest-seed#[9C36D7E0B4DB5132]-worker) [ ] o.a.h.u.NativeCodeLoader Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
[junit4] 1> Formatting using clusterid: testClusterID
[junit4] 2> 79880 WARN (SUITE-HdfsUnloadDistributedZkTest-seed#[9C36D7E0B4DB5132]-worker) [ ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
[junit4] 2> 81603 INFO (SUITE-HdfsUnloadDistributedZkTest-seed#[9C36D7E0B4DB5132]-worker) [ ] o.m.log Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
[junit4] 2> 81641 WARN (SUITE-HdfsUnloadDistributedZkTest-seed#[9C36D7E0B4DB5132]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 81769 INFO (SUITE-HdfsUnloadDistributedZkTest-seed#[9C36D7E0B4DB5132]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 81844 INFO (SUITE-HdfsUnloadDistributedZkTest-seed#[9C36D7E0B4DB5132]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.2-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_50547_hdfs____o0rj53/webapp
[junit4] 2> 87956 INFO (SUITE-HdfsUnloadDistributedZkTest-seed#[9C36D7E0B4DB5132]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:50547
[junit4] 2> 88974 WARN (SUITE-HdfsUnloadDistributedZkTest-seed#[9C36D7E0B4DB5132]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 88979 INFO (SUITE-HdfsUnloadDistributedZkTest-seed#[9C36D7E0B4DB5132]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 88991 INFO (SUITE-HdfsUnloadDistributedZkTest-seed#[9C36D7E0B4DB5132]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.2-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_43542_datanode____.1pj43p/webapp
[junit4] 2> 89555 INFO (SUITE-HdfsUnloadDistributedZkTest-seed#[9C36D7E0B4DB5132]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43542
[junit4] 2> 90338 WARN (SUITE-HdfsUnloadDistributedZkTest-seed#[9C36D7E0B4DB5132]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 90339 INFO (SUITE-HdfsUnloadDistributedZkTest-seed#[9C36D7E0B4DB5132]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 90361 INFO (SUITE-HdfsUnloadDistributedZkTest-seed#[9C36D7E0B4DB5132]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.2-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_55803_datanode____.yvz2ta/webapp
[junit4] 2> 91077 INFO (SUITE-HdfsUnloadDistributedZkTest-seed#[9C36D7E0B4DB5132]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:55803
[junit4] 2> 93320 INFO (IPC Server handler 6 on 50692) [ ] BlockStateChange BLOCK* processReport: from storage DS-7cdecd69-1c5f-490f-9f0a-185d4399cfc4 node DatanodeRegistration(127.0.0.1:34811, datanodeUuid=83473552-7022-4fd8-8024-4a88b9ed9318, infoPort=41165, infoSecurePort=0, ipcPort=43894, storageInfo=lv=-56;cid=testClusterID;nsid=1593778705;c=0), blocks: 0, hasStaleStorage: true, processing time: 1 msecs
[junit4] 2> 93321 INFO (IPC Server handler 6 on 50692) [ ] BlockStateChange BLOCK* processReport: from storage DS-ed084ac1-7dad-4126-8d79-ad26ac9393f7 node DatanodeRegistration(127.0.0.1:34811, datanodeUuid=83473552-7022-4fd8-8024-4a88b9ed9318, infoPort=41165, infoSecurePort=0, ipcPort=43894, storageInfo=lv=-56;cid=testClusterID;nsid=1593778705;c=0), blocks: 0, hasStaleStorage: false, processing time: 0 msecs
[junit4] 2> 93325 INFO (IPC Server handler 7 on 50692) [ ] BlockStateChange BLOCK* processReport: from storage DS-c3550468-dc3d-484a-a231-29fc907d8419 node DatanodeRegistration(127.0.0.1:57047, datanodeUuid=b37eb91a-486e-48ad-8a27-abf6e12546ea, infoPort=51324, infoSecurePort=0, ipcPort=52595, storageInfo=lv=-56;cid=testClusterID;nsid=1593778705;c=0), blocks: 0, hasStaleStorage: true, processing time: 12 msecs
[junit4] 2> 93325 INFO (IPC Server handler 7 on 50692) [ ] BlockStateChange BLOCK* processReport: from storage DS-e0e9cd75-b56e-4196-b3be-a98ab7c156a3 node DatanodeRegistration(127.0.0.1:57047, datanodeUuid=b37eb91a-486e-48ad-8a27-abf6e12546ea, infoPort=51324, infoSecurePort=0, ipcPort=52595, storageInfo=lv=-56;cid=testClusterID;nsid=1593778705;c=0), blocks: 0, hasStaleStorage: false, processing time: 0 msecs
[junit4] 2> 93736 INFO (TEST-HdfsUnloadDistributedZkTest.test-seed#[9C36D7E0B4DB5132]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 93751 INFO (Thread-192) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 93751 INFO (Thread-192) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 93846 INFO (TEST-HdfsUnloadDistributedZkTest.test-seed#[9C36D7E0B4DB5132]) [ ] o.a.s.c.ZkTestServer start zk server on port:40391
[junit4] 2> 93987 INFO (TEST-HdfsUnloadDistributedZkTest.test-seed#[9C36D7E0B4DB5132]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 93990 INFO (TEST-HdfsUnloadDistributedZkTest.test-seed#[9C36D7E0B4DB5132]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 93992 INFO (TEST-HdfsUnloadDistributedZkTest.test-seed#[9C36D7E0B4DB5132]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 93994 INFO (TEST-HdfsUnloadDistributedZkTest.test-seed#[9C36D7E0B4DB5132]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 93996 INFO (TEST-HdfsUnloadDistributedZkTest.test-seed#[9C36D7E0B4DB5132]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 93998 INFO (TEST-HdfsUnloadDistributedZkTest.test-seed#[9C36D7E0B4DB5132]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 93999 INFO (TEST-HdfsUnloadDistributedZkTest.test-seed#[9C36D7E0B4DB5132]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 94001 INFO (TEST-HdfsUnloadDistributedZkTest.test-seed#[9C36D7E0B4DB5132]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 94003 INFO (TEST-HdfsUnloadDistributedZkTest.test-seed#[9C36D7E0B4DB5132]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 94007 INFO (TEST-HdfsUnloadDistributedZkTest.test-seed#[9C36D7E0B4DB5132]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 94017 INFO (TEST-HdfsUnloadDistributedZkTest.test-seed#[9C36D7E0B4DB5132]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 94307 INFO (TEST-HdfsUnloadDistributedZkTest.test-seed#[9C36D7E0B4DB5132]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_9C36D7E0B4DB5132-001/control-001/cores/collection1
[junit4] 2> 94310 INFO (TEST-HdfsUnloadDistributedZkTest.test-seed#[9C36D7E0B4DB5132]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 94447 INFO (TEST-HdfsUnloadDistributedZkTest.test-seed#[9C36D7E0B4DB5132]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6e3cb670{/,null,AVAILABLE}
[junit4] 2> 94448 INFO (TEST-HdfsUnloadDistributedZkTest.test-seed#[9C36D7E0B4DB5132]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@3a697373{HTTP/1.1,[http/1.1]}{127.0.0.1:40426}
[junit4] 2> 94448 INFO (TEST-HdfsUnloadDistributedZkTest.test-seed#[9C36D7E0B4DB5132]) [ ] o.e.j.s.Server Started @98163ms
[junit4] 2> 94448 INFO (TEST-HdfsUnloadDistributedZkTest.test-seed#[9C36D7E0B4DB5132]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:50692/hdfs__localhost_50692__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-6.x_checkout_solr_build_solr-core_test_J0_temp_solr.cloud.hdfs.HdfsUnloadDistributedZkTest_9C36D7E0B4DB5132-001_tempDir-002_control_data, hostContext=/, hostPort=40426, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_9C36D7E0B4DB5132-001/control-001/cores}
[junit4] 2> 94449 ERROR (TEST-HdfsUnloadDistributedZkTest.test-seed#[9C36D7E0B4DB5132]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 94449 INFO (TEST-HdfsUnloadDistributedZkTest.test-seed#[9C36D7E0B4DB5132]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 6.5.0
[junit4] 2> 94449 INFO (TEST-HdfsUnloadDistributedZkTest.test-seed#[9C36D7E0B4DB5132]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 94449 INFO (TEST-HdfsUnloadDistributedZkTest.test-seed#[9C36D7E0B4DB5132]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 94449 INFO (TEST-HdfsUnloadDistributedZkTest.test-seed#[9C36D7E0B4DB5132]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-02-02T20:00:30.286Z
[junit4] 2> 94528 INFO (TEST-HdfsUnloadDistributedZkTest.test-seed#[9C36D7E0B4DB5132]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 94528 INFO (TEST-HdfsUnloadDistributedZkTest.test-seed#[9C36D7E0B4DB5132]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_9C36D7E0B4DB5132-001/control-001/solr.xml
[junit4] 2> 94583 INFO (TEST-HdfsUnloadDistributedZkTest.test-seed#[9C36D7E0B4DB5132]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 94601 INFO (TEST-HdfsUnloadDistributedZkTest.test-seed#[9C36D7E0B4DB5132]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40391/solr
[junit4] 2> 94785 INFO (TEST-HdfsUnloadDistributedZkTest.test-seed#[9C36D7E0B4DB5132]) [n:127.0.0.1:40426_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:40426_
[junit4] 2> 94786 INFO (TEST-HdfsUnloadDistributedZkTest.test-seed#[9C36D7E0B4DB5132]) [n:127.0.0.1:40426_ ] o.a.s.c.Overseer Overseer (id=97390797101203460-127.0.0.1:40426_-n_0000000000) starting
[junit4] 2> 94903 INFO (TEST-HdfsUnloadDistributedZkTest.test-seed#[9C36D7E0B4DB5132]) [n:127.0.0.1:40426_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40426_
[junit4] 2> 94910 INFO (zkCallback-65-thread-1-processing-n:127.0.0.1:40426_) [n:127.0.0.1:40426_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 95354 INFO (TEST-HdfsUnloadDistributedZkTest.test-seed#[9C36D7E0B4DB5132]) [n:127.0.0.1:40426_ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_9C36D7E0B4DB5132-001/control-001/cores
[junit4] 2> 95370 INFO (TEST-HdfsUnloadDistributedZkTest.test-seed#[9C36D7E0B4DB5132]) [n:127.0.0.1:40426_ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 95460 INFO (OverseerStateUpdate-97390797101203460-127.0.0.1:40426_-n_0000000000) [n:127.0.0.1:40426_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 96517 WARN (coreLoadExecutor-156-thread-1-processing-n:127.0.0.1:40426_) [n:127.0.0.1:40426_ c:control_collection x:collection1] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
[junit4] 2> 96519 INFO (coreLoadExecutor-156-thread-1-processing-n:127.0.0.1:40426_) [n:127.0.0.1:40426_ c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
[junit4] 2> 96652 INFO (coreLoadExecutor-156-thread-1-processing-n:127.0.0.1:40426_) [n:127.0.0.1:40426_ c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 97284 WARN (coreLoadExecutor-156-thread-1-processing-n:127.0.0.1:40426_) [n:127.0.0.1:40426_ c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 97325 INFO (coreLoadExecutor-156-thread-1-processing-n:127.0.0.1:40426_) [n:127.0.0.1:40426_ c:control_collection x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 97369 INFO (coreLoadExecutor-156-thread-1-processing-n:127.0.0.1:40426_) [n:127.0.0.1:40426_ c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 97380 INFO (coreLoadExecutor-156-thread-1-processing-n:127.0.0.1:40426_) [n:127.0.0.1:40426_ c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:50692/solr_hdfs_home
[junit4] 2> 97380 INFO (coreLoadExecutor-156-thread-1-processing-n:127.0.0.1:40426_) [n:127.0.0.1:40426_ c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 97380 INFO (coreLoadExecutor-156-thread-1-processing-n:127.0.0.1:40426_) [n:127.0.0.1:40426_ c:control_collection x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_9C36D7E0B4DB5132-001/control-001/cores/collection1], dataDir=[hdfs://localhost:50692/solr_hdfs_home/control_collection/core_node1/data/]
[junit4] 2> 97381 INFO (coreLoadExecutor-156-thread-1-processing-n:127.0.0.1:40426_) [n:127.0.0.1:40426_ c:control_collection x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@401889
[junit4] 2> 97381 INFO (coreLoadExecutor-156-thread-1-processing-n:127.0.0.1:40426_) [n:127.0.0.1:40426_ c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:50692/solr_hdfs_home/control_collection/core_node1/data/snapshot_metadata
[junit4] 2> 97450 INFO (coreLoadExecutor-156-thread-1-processing-n:127.0.0.1:40426_) [n:127.0.0.1:40426_ c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 97450 INFO (coreLoadExecutor-156-thread-1-processing-n:127.0.0.1:40426_) [n:127.0.0.1:40426_ c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
[junit4] 2> 97450 INFO (coreLoadExecutor-156-thread-1-processing-n:127.0.0.1:40426_) [n:127.0.0.1:40426_ c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Creating new global HDFS BlockCache
[junit4] 2> 102529 INFO (coreLoadExecutor-156-thread-1-processing-n:127.0.0.1:40426_) [n:127.0.0.1:40426_ c:control_collection x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 102541 INFO (coreLoadExecutor-156-thread-1-processing-n:127.0.0.1:40426_) [n:127.0.0.1:40426_ c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:50692/solr_hdfs_home/control_collection/core_node1/data
[junit4] 2> 102658 INFO (coreLoadExecutor-156-thread-1-processing-n:127.0.0.1:40426_) [n:127.0.0.1:40426_ c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:50692/solr_hdfs_home/control_collection/core_node1/data/index
[junit4] 2> 102687 INFO (coreLoadExecutor-156-thread-1-processing-n:127.0.0.1:40426_) [n:127.0.0.1:40426_ c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 102687 INFO (coreLoadExecutor-156-thread-1-processing-n:127.0.0.1:40426_) [n:127.0.0.1:40426_ c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
[junit4] 2> 102711 INFO (coreLoadExecutor-156-thread-1-processing-n:127.0.0.1:40426_) [n:127.0.0.1:40426_ c:control_collection x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 102712 INFO (coreLoadExecutor-156-thread-1-processing-n:127.0.0.1:40426_) [n:127.0.0.1:40426_ c:control_collection x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@3b044b66
[junit4] 2> 103623 INFO (IPC Server handler 7 on 50692) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34811 is added to blk_1073741825_1001{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-e0e9cd75-b56e-4196-b3be-a98ab7c156a3:NORMAL:127.0.0.1:57047|RBW], ReplicaUC[[DISK]DS-7cdecd69-1c5f-490f-9f0a-185d4399cfc4:NORMAL:127.0.0.1:34811|RBW]]} size 71
[junit4] 2> 103626 INFO (IPC Server handler 1 on 50692) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:57047 is added to blk_1073741825_1001 size 71
[junit4] 2> 104095 WARN (coreLoadExecutor-156-thread-1-processing-n:127.0.0.1:40426_) [n:127.0.0.1:40426_ c:control_collection x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 104193 INFO (coreLoadExecutor-156-thread-1-processing-n:127.0.0.1:40426_) [n:127.0.0.1:40426_ c:control_collection x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
[junit4] 2> 104193 INFO (coreLoadExecutor-156-thread-1-processing-n:127.0.0.1:40426_) [n:127.0.0.1:40426_ c:control_collection x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 104193 INFO (coreLoadExecutor-156-thread-1-processing-n:127.0.0.1:40426_) [n:127.0.0.1:40426_ c:control_collection x:collection1] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=2
[junit4] 2> 104252 INFO (coreLoadExecutor-156-thread-1-processing-n:127.0.0.1:40426_) [n:127.0.0.1:40426_ c:control_collection x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 104252 INFO (coreLoadExecutor-156-thread-1-processing-n:127.0.0.1:40426_) [n:127.0.0.1:40426_ c:control_collection x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 104310 INFO (coreLoadExecutor-156-thread-1-processing-n:127.0.0.1:40426_) [n:127.0.0.1:40426_ c:control_collection x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=9, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 104546 INFO (coreLoadExecutor-156-thread-1-processing-n:127.0.0.1:40426_) [n:127.0.0.1:40426_ c:control_collection x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@1d6b2834[collection1] main]
[junit4] 2> 104548 INFO (coreLoadExecutor-156-thread-1-processing-n:127.0.0.1:40426_) [n:127.0.0.1:40426_ c:control_collection x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 104549 INFO (coreLoadExecutor-156-thread-1-processing-n:127.0.0.1:40426_) [n:127.0.0.1:40426_ c:control_collection x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 104553 INFO (coreLoadExecutor-156-thread-1-processing-n:127.0.0.1:40426_) [n:127.0.0.1:40426_ c:control_collection x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 104559 INFO (searcherExecutor-157-thread-1-processing-n:127.0.0.1:40426_ x:collection1 c:control_collection) [n:127.0.0.1:40426_ c:control_collection x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@1d6b2834[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 104610 INFO (coreLoadExecutor-156-thread-1-processing-n:127.0.0.1:40426_) [n:127.0.0.1:40426_ c:control_collection x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1558252764997353472
[junit4] 2> 104644 INFO (coreZkRegister-149-thread-1-processing-n:127.0.0.1:40426_ x:collection1 c:control_collection) [n:127.0.0.1:40426_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 104644 INFO (coreZkRegister-149-thread-1-processing-n:127.0.0.1:40426_ x:collection1 c:control_collection) [n:127.0.0.1:40426_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 104644 INFO (coreZkRegister-149-thread-1-processing-n:127.0.0.1:40426_ x:collection1 c:control_collection) [n:127.0.0.1:40426_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:40426/collection1/
[junit4] 2> 104644 INFO (coreZkRegister-149-thread-1-processing-n:127.0.0.1:40426_ x:collection1 c:control_collection) [n:127.0.0.1:40426_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 104644 INFO (coreZkRegister-149-thread-1-processing-n:127.0.0.1:40426_ x:collection1 c:control_collection) [n:127.0.0.1:40426_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:40426/collection1/ has no replicas
[junit4] 2> 104651 INFO (coreZkRegister-149-thread-1-processing-n:127.0.0.1:40426_ x:collection1 c:control_collection) [n:127.0.0.1:40426_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:40426/collection1/ shard1
[junit4] 2> 104883 INFO (coreZkRegister-149-thread-1-processing-n:127.0.0.1:40426_ x:collection1 c:control_collection) [n:127.0.0.1:40426_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 105168 INFO (TEST-HdfsUnloadDistributedZkTest.test-seed#[9C36D7E0B4DB5132]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 105175 INFO (TEST-HdfsUnloadDistributedZkTest.test-seed#[9C36D7E0B4DB5132]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:40391/solr ready
[junit4] 2> 105178 INFO (TEST-HdfsUnloadDistributedZkTest.test-seed#[9C36D7E0B4DB5132]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 105560 INFO (TEST-HdfsUnloadDistributedZkTest.test-seed#[9C36D7E0B4DB5132]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_9C36D7E0B4DB5132-001/shard-1-001/cores/collection1
[junit4] 2> 105561 INFO (TEST-HdfsUnloadDistributedZkTest.test-seed#[9C36D7E0B4DB5132]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_9C36D7E0B4DB5132-001/shard-1-001
[junit4] 2> 105562 INFO (TEST-HdfsUnloadDistributedZkTest.test-seed#[9C36D7E0B4DB5132]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 105570 INFO (TEST-HdfsUnloadDistributedZkTest.test-seed#[9C36D7E0B4DB5132]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3454e595{/,null,AVAILABLE}
[junit4] 2> 105570 INFO (TEST-HdfsUnloadDistributedZkTest.test-seed#[9C36D7E0B4DB5132]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@2e60fa32{HTTP/1.1,[http/1.1]}{127.0.0.1:44242}
[junit4] 2> 105570 INFO (TEST-HdfsUnloadDistributedZkTest.test-seed#[9C36D7E0B4DB5132]) [ ] o.e.j.s.Server Started @109285ms
[junit4] 2> 105570 INFO (TEST-HdfsUnloadDistributedZkTest.test-seed#[9C36D7E0B4DB5132]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:50692/hdfs__localhost_50692__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-6.x_checkout_solr_build_solr-core_test_J0_temp_solr.cloud.hdfs.HdfsUnloadDistributedZkTest_9C36D7E0B4DB5132-001_tempDir-002_jetty1, solrconfig=solrconfig.xml, hostContext=/, hostPort=44242, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_9C36D7E0B4DB5132-001/shard-1-001/cores}
[junit4] 2> 105571 ERROR (TEST-HdfsUnloadDistributedZkTest.test-seed#[9C36D7E0B4DB5132]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 105573 INFO (TEST-HdfsUnloadDistributedZkTest.test-seed#[9C36D7E0B4DB5132]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 6.5.0
[junit4] 2> 105573 INFO (TEST-HdfsUnloadDistributedZkTest.test-seed#[9C36D7E0B4DB5132]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 105573 INFO (TEST-HdfsUnloadDistributedZkTest.test-seed#[9C36D7E0B4DB5132]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 105573 INFO (TEST-HdfsUnloadDistributedZkTest.test-seed#[9C36D7E0B4DB5132]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-02-02T20:00:41.410Z
[junit4] 2> 105591 INFO (TEST-HdfsUnloadDistributedZkTest.test-seed#[9C36D7E0B4DB5132]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 105591 INFO (TEST-HdfsUnloadDistributedZkTest.test-seed#[9C36D7E0B4DB5132]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_9C36D7E0B4DB5132-001/shard-1-001/solr.xml
[junit4] 2> 105602 INFO (TEST-HdfsUnloadDistributedZkTest.test-seed#[9C36D7E0B4DB5132]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 105605 INFO (TEST-HdfsUnloadDistributedZkTest.test-seed#[9C36D7E0B4DB5132]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40391/solr
[junit4] 2> 105656 INFO (TEST-HdfsUnloadDistributedZkTest.test-seed#[9C36D7E0B4DB5132]) [n:127.0.0.1:44242_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 105668 INFO (TEST-HdfsUnloadDistributedZkTest.test-seed#[9C36D7E0B4DB5132]) [n:127.0.0.1:44242_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44242_
[junit4] 2> 105671 INFO (zkCallback-65-thread-3-processing-n:127.0.0.1:40426_) [n:127.0.0.1:40426_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 105671 INFO (zkCallback-69-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 105704 INFO (zkCallback-74-thread-1-processing-n:127.0.0.1:44242_) [n:127.0.0.1:44242_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 105877 INFO (TEST-HdfsUnloadDistributedZkTest.test-seed#[9C36D7E0B4DB5132]) [n:127.0.0.1:44242_ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_9C36D7E0B4DB5132-001/shard-1-001/cores
[junit4] 2> 105877 INFO (TEST-HdfsUnloadDistributedZkTest.test-seed#[9C36D7E0B4DB5132]) [n:127.0.0.1:44242_ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 105896 INFO (OverseerStateUpdate-97390797101203460-127.0.0.1:40426_-n_0000000000) [n:127.0.0.1:40426_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2
[junit4] 2> 106937 WARN (coreLoadExecutor-167-thread-1-processing-n:127.0.0.1:44242_) [n:127.0.0.1:44242_ c:collection1 x:collection1] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
[junit4] 2> 106946 INFO (coreLoadExecutor-167-thread-1-processing-n:127.0.0.1:44242_) [n:127.0.0.1:44242_ c:collection1 x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
[junit4] 2> 107015 INFO (coreLoadExecutor-167-thread-1-processing-n:127.0.0.1:44242_) [n:127.0.0.1:44242_ c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 107129 WARN (coreLoadExecutor-167-thread-1-processing-n:127.0.0.1:44242_) [n:127.0.0.1:44242_ c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 107134 INFO (coreLoadExecutor-167-thread-1-processing-n:127.0.0.1:44242_) [n:127.0.0.1:44242_ c:collection1 x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 107188 INFO (coreLoadExecutor-167-thread-1-processing-n:127.0.0.1:44242_) [n:127.0.0.1:44242_ c:collection1 x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 107188 INFO (coreLoadExecutor-167-thread-1-processing-n:127.0.0.1:44242_) [n:127.0.0.1:44242_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:50692/solr_hdfs_home
[junit4] 2> 107188 INFO (coreLoadExecutor-167-thread-1-processing-n:127.0.0.1:44242_) [n:127.0.0.1:44242_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 107188 INFO (coreLoadExecutor-167-thread-1-processing-n:127.0.0.1:44242_) [n:127.0.0.1:44242_ c:collection1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_9C36D7E0B4DB5132-001/shard-1-001/cores/collection1], dataDir=[hdfs://localhost:50692/solr_hdfs_home/collection1/core_node1/data/]
[junit4] 2> 107189 INFO (coreLoadExecutor-167-thread-1-processing-n:127.0.0.1:44242_) [n:127.0.0.1:44242_ c:collection1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@401889
[junit4] 2> 107189 INFO (coreLoadExecutor-167-thread-1-processing-n:127.0.0.1:44242_) [n:127.0.0.1:44242_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:50692/solr_hdfs_home/collection1/core_node1/data/snapshot_metadata
[junit4] 2> 107253 INFO (coreLoadExecutor-167-thread-1-processing-n:127.0.0.1:44242_) [n:127.0.0.1:44242_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 107253 INFO (coreLoadExecutor-167-thread-1-processing-n:127.0.0.1:44242_) [n:127.0.0.1:44242_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
[junit4] 2> 107300 INFO (coreLoadExecutor-167-thread-1-processing-n:127.0.0.1:44242_) [n:127.0.0.1:44242_ c:collection1 x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 107302 INFO (coreLoadExecutor-167-thread-1-processing-n:127.0.0.1:44242_) [n:127.0.0.1:44242_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:50692/solr_hdfs_home/collection1/core_node1/data
[junit4] 2> 107369 INFO (coreLoadExecutor-167-thread-1-processing-n:127.0.0.1:44242_) [n:127.0.0.1:44242_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:50692/solr_hdfs_home/collection1/core_node1/data/index
[junit4] 2> 107389 INFO (coreLoadExecutor-167-thread-1-processing-n:127.0.0.1:44242_) [n:127.0.0.1:44242_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 107389 INFO (coreLoadExecutor-167-thread-1-processing-n:127.0.0.1:44242_) [n:127.0.0.1:44242_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
[junit4] 2> 107394 INFO (coreLoadExecutor-167-thread-1-processing-n:127.0.0.1:44242_) [n:127.0.0.1:44242_ c:collection1 x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 107402 INFO (coreLoadExecutor-167-thread-1-processing-n:127.0.0.1:44242_) [n:127.0.0.1:44242_ c:collectio
[...truncated too long message...]
unner$7.evaluate(RandomizedRunner.java:870)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> Caused by: java.lang.NullPointerException
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlocksMap.size(BlocksMap.java:203)
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.getTotalBlocks(BlockManager.java:3370)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlocksTotal(FSNamesystem.java:5729)
[junit4] 2> ... 53 more
[junit4] 2> 5304558 INFO (SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[9C36D7E0B4DB5132]-worker) [ ] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_9C36D7E0B4DB5132-001
[junit4] 2> Feb 02, 2017 9:27:20 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 34 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene62), sim=RandomSimilarity(queryNorm=true,coord=crazy): {}, locale=cs-CZ, timezone=Africa/Bangui
[junit4] 2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_102 (64-bit)/cpus=4,threads=2,free=340288816,total=530579456
[junit4] 2> NOTE: All tests run in this JVM: [TestCloudPseudoReturnFields, XsltUpdateRequestHandlerTest, TestSolrXml, TestSolrQueryParserDefaultOperatorResource, TestExportWriter, TestRawTransformer, BlobRepositoryCloudTest, TestComplexPhraseQParserPlugin, ActionThrottleTest, HdfsUnloadDistributedZkTest, QueryEqualityTest, DistribDocExpirationUpdateProcessorTest, TestDistributedSearch, TestAtomicUpdateErrorCases, AlternateDirectoryTest, TestJmxIntegration, TestFreeTextSuggestions, CdcrVersionReplicationTest, NumericFieldsTest, TestPerFieldSimilarity, TestCollectionAPI, TestDefaultSearchFieldResource, UniqFieldsUpdateProcessorFactoryTest, MigrateRouteKeyTest, SolrCoreTest, StandardRequestHandlerTest, LeaderFailureAfterFreshStartTest, TestInitParams, AnalyticsQueryTest, RankQueryTest, TestStressRecovery, HdfsChaosMonkeySafeLeaderTest, TestMacroExpander, RegexBoostProcessorTest, TestDynamicLoading, TestCloudDeleteByQuery, TestLeaderInitiatedRecoveryThread, FastVectorHighlighterTest, TestObjectReleaseTracker, SolrGraphiteReporterTest, TestFoldingMultitermQuery, TestLazyCores, SparseHLLTest, ConcurrentDeleteAndCreateCollectionTest, TestFieldCacheSortRandom, TestManagedSchemaThreadSafety, TestManagedResource, BJQParserTest, CurrencyFieldOpenExchangeTest, TestRestoreCore, IgnoreCommitOptimizeUpdateProcessorFactoryTest, RestartWhileUpdatingTest, TestExactSharedStatsCache, TestFieldTypeResource, HttpSolrCallGetCoreTest, TestAnalyzeInfixSuggestions, DistributedSuggestComponentTest, TestStressLucene, DisMaxRequestHandlerTest, HdfsDirectoryFactoryTest, CoreAdminCreateDiscoverTest, TestRandomFaceting, TestHighlightDedupGrouping, TestOmitPositions, SharedFSAutoReplicaFailoverUtilsTest, TestCodecSupport, ReturnFieldsTest, TestComponentsName, TestRemoteStreaming, TestNoOpRegenerator, TestSolrCoreParser, TestRebalanceLeaders, AsyncCallRequestStatusResponseTest, SolrMetricReporterTest, InfoHandlerTest, HdfsBasicDistributedZk2Test, TestClusterStateMutator, PreAnalyzedFieldManagedSchemaCloudTest, TestRandomCollapseQParserPlugin, DateFieldTest, BooleanFieldTest, PeerSyncTest, OutputWriterTest, BlockJoinFacetSimpleTest, TestFilteredDocIdSet, BigEndianAscendingWordSerializerTest, TestOnReconnectListenerSupport, CursorPagingTest, TestQuerySenderNoQuery, TestTestInjection, TestMinMaxOnMultiValuedField, TestPHPSerializedResponseWriter, DistributedQueryElevationComponentTest, DocumentAnalysisRequestHandlerTest, SmileWriterTest, TestDocumentBuilder, HdfsRecoverLeaseTest, TestRecoveryHdfs, ClassificationUpdateProcessorTest, HdfsSyncSliceTest, FileBasedSpellCheckerTest, BasicDistributedZkTest, RequiredFieldsTest, BasicAuthIntegrationTest, TestConfigSetsAPIZkFailure, TestFastLRUCache, TestShardHandlerFactory, TestHdfsBackupRestoreCore, DistributedSpellCheckComponentTest, ZkCLITest, TestRecovery, ZkControllerTest, TestRealTimeGet, TestReload, SimpleFacetsTest, TestSolr4Spatial, SpellCheckComponentTest, TestGroupingSearch, QueryElevationComponentTest, ConvertedLegacyTest, TestFiltering, TestFunctionQuery, BasicFunctionalityTest, DirectUpdateHandlerTest, TestBadConfig, TestIndexSearcher, SoftAutoCommitTest, ShowFileRequestHandlerTest, CurrencyFieldXmlFileTest, SolrIndexSplitterTest, TestCoreDiscovery, AnalysisAfterCoreReloadTest, SignatureUpdateProcessorFactoryTest, SpellCheckCollatorTest, SuggesterFSTTest, SolrRequestParserTest, SuggesterTSTTest, SpatialFilterTest, TestCSVLoader, PolyFieldTest, NoCacheHeaderTest, SchemaVersionSpecificBehaviorTest, TestPseudoReturnFields, FieldMutatingUpdateProcessorTest, DirectUpdateHandlerOptimizeTest, DefaultValueUpdateProcessorTest, StatelessScriptUpdateProcessorFactoryTest, SortByFunctionTest, DocValuesMultiTest, DistanceFunctionTest, TestSolrDeletionPolicy1, SolrInfoMBeanTest, DebugComponentTest, CacheHeaderTest, IndexBasedSpellCheckerTest, TestQueryUtils, TestWriterPerf, DirectSolrSpellCheckerTest, TestQueryTypes, TestValueSourceCache, PathHierarchyTokenizerFactoryTest, TermVectorComponentTest, TestIndexingPerformance, MoreLikeThisHandlerTest, FieldAnalysisRequestHandlerTest, IndexSchemaRuntimeFieldTest, IndexSchemaTest, UpdateRequestProcessorFactoryTest, TestCSVResponseWriter, MBeansHandlerTest, JsonLoaderTest, BinaryUpdateRequestHandlerTest, TestBinaryResponseWriter, HighlighterConfigTest, TestQuerySenderListener, UpdateParamsTest, CopyFieldTest, SolrIndexConfigTest, TestMergePolicyConfig, TestSolrDeletionPolicy2, MultiTermTest, TestDocSet, TestSearchPerf, MinimalSchemaTest, TestElisionMultitermQuery, TestFuzzyAnalyzedSuggestions, ExternalFileFieldSortTest, TestSolrCoreProperties, TestPostingsSolrHighlighter, NotRequiredUniqueKeyTest, TestLuceneMatchVersion, TestPhraseSuggestions, SpellPossibilityIteratorTest, TestCharFilters, SynonymTokenizerTest, TestXIncludeConfig, EchoParamsTest, TestSweetSpotSimilarityFactory, TestLMDirichletSimilarityFactory, TestIBSimilarityFactory, TestBM25SimilarityFactory, TestFastWriter, TestJmxMonitoredMap, ResourceLoaderTest, ScriptEngineTest, OpenExchangeRatesOrgProviderTest, URLClassifyProcessorTest, DateMathParserTest, ChaosMonkeyNothingIsSafeTest, PreAnalyzedFieldTest, TestSystemIdResolver, PrimUtilsTest, DOMUtilTest, RAMDirectoryFactoryTest, ClusterStateTest, TestLRUCache, ZkNodePropsTest, SliceStateTest, SystemInfoHandlerTest, UUIDFieldTest, FileUtilsTest, TestCrossCoreJoin, TestCursorMarkWithoutUniqueKey, TestSimpleTrackingShardHandler, TestTolerantSearch, TestEmbeddedSolrServerConstructors, ConnectionReuseTest, AliasIntegrationTest, BaseCdcrDistributedZkTest, CdcrBootstrapTest, CdcrReplicationHandlerTest, ConfigSetsAPITest, ConnectionManagerTest, CustomCollectionTest, DeleteShardTest, DistribJoinFromCollectionTest, DistributedVersionInfoTest, DocValuesNotIndexedTest, ForceLeaderTest, MultiThreadedOCPTest, OutOfBoxZkACLAndCredentialsProvidersTest, OverseerCollectionConfigSetProcessorTest, OverseerModifyCollectionTest, OverseerRolesTest, OverseerTaskQueueTest, RemoteQueryErrorTest, ReplaceNodeTest, SharedFSAutoReplicaFailoverTest, SolrCloudExampleTest, TestAuthenticationFramework, TestCloudPivotFacet, TestCloudRecovery, TestConfigSetsAPIExclusivity, TestCryptoKeys, TestDeleteCollectionOnDownNodes, TestDistribDocBasedVersion, TestDownShardTolerantSearch, TestExclusionRuleCollectionAccess, TestHdfsCloudBackupRestore, TestMiniSolrCloudClusterSSL, TestRequestStatusCollectionAPI, TestSegmentSorting, TestShortCircuitedRequests, TestSolrCloudWithKerberosAlt, TestStressLiveNodes, VMParamsZkACLAndCredentialsProvidersTest, HdfsBasicDistributedZkTest, HdfsChaosMonkeyNothingIsSafeTest]
[junit4] Completed [624/682 (6!)] on J0 in 392.74s, 1 test, 1 failure <<< FAILURES!
[...truncated 62634 lines...]
[JENKINS] Lucene-Solr-NightlyTests-6.x - Build # 272 - Still
Unstable
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.x/272/
3 tests failed.
FAILED: org.apache.solr.cloud.CdcrReplicationDistributedZkTest.testReplicationStartStop
Error Message:
Timeout while trying to assert number of documents @ target_collection
Stack Trace:
java.lang.AssertionError: Timeout while trying to assert number of documents @ target_collection
at __randomizedtesting.SeedInfo.seed([8E26F72D0F7E3A6B:DE529BE1BA6B1E2]:0)
at org.apache.solr.cloud.BaseCdcrDistributedZkTest.assertNumDocs(BaseCdcrDistributedZkTest.java:271)
at org.apache.solr.cloud.CdcrReplicationDistributedZkTest.testReplicationStartStop(CdcrReplicationDistributedZkTest.java:173)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.AssertionError: expected:<10> but was:<6>
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at org.apache.solr.cloud.BaseCdcrDistributedZkTest.assertNumDocs(BaseCdcrDistributedZkTest.java:262)
... 42 more
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.hdfs.HdfsRecoveryZkTest
Error Message:
ObjectTracker found 1 object(s) that were not released!!! [HdfsTransactionLog] org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:43) at org.apache.solr.update.HdfsTransactionLog.<init>(HdfsTransactionLog.java:130) at org.apache.solr.update.HdfsUpdateLog.init(HdfsUpdateLog.java:202) at org.apache.solr.update.UpdateHandler.<init>(UpdateHandler.java:137) at org.apache.solr.update.UpdateHandler.<init>(UpdateHandler.java:94) at org.apache.solr.update.DirectUpdateHandler2.<init>(DirectUpdateHandler2.java:102) at sun.reflect.GeneratedConstructorAccessor181.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.solr.core.SolrCore.createInstance(SolrCore.java:737) at org.apache.solr.core.SolrCore.createUpdateHandler(SolrCore.java:799) at org.apache.solr.core.SolrCore.initUpdateHandler(SolrCore.java:1049) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:914) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:807) at org.apache.solr.core.CoreContainer.create(CoreContainer.java:903) at org.apache.solr.core.CoreContainer.lambda$load$3(CoreContainer.java:554) at com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:197) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745)
Stack Trace:
java.lang.AssertionError: ObjectTracker found 1 object(s) that were not released!!! [HdfsTransactionLog]
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException
at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:43)
at org.apache.solr.update.HdfsTransactionLog.<init>(HdfsTransactionLog.java:130)
at org.apache.solr.update.HdfsUpdateLog.init(HdfsUpdateLog.java:202)
at org.apache.solr.update.UpdateHandler.<init>(UpdateHandler.java:137)
at org.apache.solr.update.UpdateHandler.<init>(UpdateHandler.java:94)
at org.apache.solr.update.DirectUpdateHandler2.<init>(DirectUpdateHandler2.java:102)
at sun.reflect.GeneratedConstructorAccessor181.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.solr.core.SolrCore.createInstance(SolrCore.java:737)
at org.apache.solr.core.SolrCore.createUpdateHandler(SolrCore.java:799)
at org.apache.solr.core.SolrCore.initUpdateHandler(SolrCore.java:1049)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:914)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:807)
at org.apache.solr.core.CoreContainer.create(CoreContainer.java:903)
at org.apache.solr.core.CoreContainer.lambda$load$3(CoreContainer.java:554)
at com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:197)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
at __randomizedtesting.SeedInfo.seed([8E26F72D0F7E3A6B]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNull(Assert.java:551)
at org.apache.solr.SolrTestCaseJ4.teardownTestCases(SolrTestCaseJ4.java:269)
at sun.reflect.GeneratedMethodAccessor24.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:870)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest.test
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([8E26F72D0F7E3A6B:672C8F7A1825793]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertTrue(Assert.java:54)
at org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest.test(HdfsWriteToMultipleCollectionsTest.java:137)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 11575 lines...]
[junit4] Suite: org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_8E26F72D0F7E3A6B-001/init-core-data-001
[junit4] 2> 589343 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[8E26F72D0F7E3A6B]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
[junit4] 2> 589343 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[8E26F72D0F7E3A6B]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /nk/b
[junit4] 1> Formatting using clusterid: testClusterID
[junit4] 2> 589391 WARN (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[8E26F72D0F7E3A6B]-worker) [ ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
[junit4] 2> 589401 WARN (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[8E26F72D0F7E3A6B]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 589404 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[8E26F72D0F7E3A6B]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 589417 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[8E26F72D0F7E3A6B]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.2-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_54043_hdfs____glgoka/webapp
[junit4] 2> 589792 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[8E26F72D0F7E3A6B]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:54043
[junit4] 2> 589886 WARN (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[8E26F72D0F7E3A6B]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 589888 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[8E26F72D0F7E3A6B]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 589902 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[8E26F72D0F7E3A6B]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.2-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_50923_datanode____fjdu06/webapp
[junit4] 2> 590301 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[8E26F72D0F7E3A6B]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:50923
[junit4] 2> 590359 WARN (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[8E26F72D0F7E3A6B]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 590361 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[8E26F72D0F7E3A6B]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 590386 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[8E26F72D0F7E3A6B]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.2-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_33967_datanode____ynk20x/webapp
[junit4] 2> 590459 INFO (IPC Server handler 3 on 58641) [ ] BlockStateChange BLOCK* processReport: from storage DS-19f94771-8c0c-4a6e-b754-607bf2b99d9e node DatanodeRegistration(127.0.0.1:35106, datanodeUuid=2a965fa4-ffb9-4ff4-a5d5-22fc59f44ab0, infoPort=37519, infoSecurePort=0, ipcPort=56343, storageInfo=lv=-56;cid=testClusterID;nsid=310104920;c=0), blocks: 0, hasStaleStorage: true, processing time: 1 msecs
[junit4] 2> 590459 INFO (IPC Server handler 3 on 58641) [ ] BlockStateChange BLOCK* processReport: from storage DS-051eb514-66a4-4458-b3d2-03c251034a97 node DatanodeRegistration(127.0.0.1:35106, datanodeUuid=2a965fa4-ffb9-4ff4-a5d5-22fc59f44ab0, infoPort=37519, infoSecurePort=0, ipcPort=56343, storageInfo=lv=-56;cid=testClusterID;nsid=310104920;c=0), blocks: 0, hasStaleStorage: false, processing time: 0 msecs
[junit4] 2> 590816 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[8E26F72D0F7E3A6B]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33967
[junit4] 2> 590934 INFO (IPC Server handler 5 on 58641) [ ] BlockStateChange BLOCK* processReport: from storage DS-e1fff327-0a7e-4188-b528-4bab76c547c4 node DatanodeRegistration(127.0.0.1:46247, datanodeUuid=420d9f3e-b3be-42c8-8743-08e58f580276, infoPort=49449, infoSecurePort=0, ipcPort=50866, storageInfo=lv=-56;cid=testClusterID;nsid=310104920;c=0), blocks: 0, hasStaleStorage: true, processing time: 0 msecs
[junit4] 2> 590934 INFO (IPC Server handler 5 on 58641) [ ] BlockStateChange BLOCK* processReport: from storage DS-184139e3-2c4c-42c8-85d9-c03764256434 node DatanodeRegistration(127.0.0.1:46247, datanodeUuid=420d9f3e-b3be-42c8-8743-08e58f580276, infoPort=49449, infoSecurePort=0, ipcPort=50866, storageInfo=lv=-56;cid=testClusterID;nsid=310104920;c=0), blocks: 0, hasStaleStorage: false, processing time: 0 msecs
[junit4] 2> 590992 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 590992 INFO (Thread-2033) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 590992 INFO (Thread-2033) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 591092 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.c.ZkTestServer start zk server on port:39009
[junit4] 2> 591110 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 591114 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 591116 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 591117 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 591119 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 591120 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 591122 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 591123 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 591125 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 591126 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 591128 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 591234 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_8E26F72D0F7E3A6B-001/control-001/cores/collection1
[junit4] 2> 591236 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 591237 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@33ec5345{/nk/b,null,AVAILABLE}
[junit4] 2> 591238 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@7b4c9e4a{HTTP/1.1,[http/1.1]}{127.0.0.1:42735}
[junit4] 2> 591238 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.e.j.s.Server Started @595101ms
[junit4] 2> 591238 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:58641/hdfs__localhost_58641__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-6.x_checkout_solr_build_solr-core_test_J1_temp_solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_8E26F72D0F7E3A6B-001_tempDir-002_control_data, hostContext=/nk/b, hostPort=42735, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_8E26F72D0F7E3A6B-001/control-001/cores}
[junit4] 2> 591238 ERROR (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 591238 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 6.5.0
[junit4] 2> 591238 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 591238 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 591238 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-02-01T06:59:50.582Z
[junit4] 2> 591244 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 591244 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_8E26F72D0F7E3A6B-001/control-001/solr.xml
[junit4] 2> 591251 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 591252 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39009/solr
[junit4] 2> 591275 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [n:127.0.0.1:42735_nk%2Fb ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:42735_nk%2Fb
[junit4] 2> 591276 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [n:127.0.0.1:42735_nk%2Fb ] o.a.s.c.Overseer Overseer (id=97382065133191172-127.0.0.1:42735_nk%2Fb-n_0000000000) starting
[junit4] 2> 591284 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [n:127.0.0.1:42735_nk%2Fb ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42735_nk%2Fb
[junit4] 2> 591296 INFO (OverseerStateUpdate-97382065133191172-127.0.0.1:42735_nk%2Fb-n_0000000000) [n:127.0.0.1:42735_nk%2Fb ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 591443 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [n:127.0.0.1:42735_nk%2Fb ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_8E26F72D0F7E3A6B-001/control-001/cores
[junit4] 2> 591443 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [n:127.0.0.1:42735_nk%2Fb ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 591446 INFO (OverseerStateUpdate-97382065133191172-127.0.0.1:42735_nk%2Fb-n_0000000000) [n:127.0.0.1:42735_nk%2Fb ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 591483 WARN (coreLoadExecutor-1521-thread-1-processing-n:127.0.0.1:42735_nk%2Fb) [n:127.0.0.1:42735_nk%2Fb c:control_collection x:collection1] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
[junit4] 2> 591484 INFO (coreLoadExecutor-1521-thread-1-processing-n:127.0.0.1:42735_nk%2Fb) [n:127.0.0.1:42735_nk%2Fb c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
[junit4] 2> 591497 INFO (coreLoadExecutor-1521-thread-1-processing-n:127.0.0.1:42735_nk%2Fb) [n:127.0.0.1:42735_nk%2Fb c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 591569 WARN (coreLoadExecutor-1521-thread-1-processing-n:127.0.0.1:42735_nk%2Fb) [n:127.0.0.1:42735_nk%2Fb c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 591571 INFO (coreLoadExecutor-1521-thread-1-processing-n:127.0.0.1:42735_nk%2Fb) [n:127.0.0.1:42735_nk%2Fb c:control_collection x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 591594 INFO (coreLoadExecutor-1521-thread-1-processing-n:127.0.0.1:42735_nk%2Fb) [n:127.0.0.1:42735_nk%2Fb c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 591604 INFO (coreLoadExecutor-1521-thread-1-processing-n:127.0.0.1:42735_nk%2Fb) [n:127.0.0.1:42735_nk%2Fb c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:58641/solr_hdfs_home
[junit4] 2> 591604 INFO (coreLoadExecutor-1521-thread-1-processing-n:127.0.0.1:42735_nk%2Fb) [n:127.0.0.1:42735_nk%2Fb c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 591605 INFO (coreLoadExecutor-1521-thread-1-processing-n:127.0.0.1:42735_nk%2Fb) [n:127.0.0.1:42735_nk%2Fb c:control_collection x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_8E26F72D0F7E3A6B-001/control-001/cores/collection1], dataDir=[hdfs://localhost:58641/solr_hdfs_home/control_collection/core_node1/data/]
[junit4] 2> 591605 INFO (coreLoadExecutor-1521-thread-1-processing-n:127.0.0.1:42735_nk%2Fb) [n:127.0.0.1:42735_nk%2Fb c:control_collection x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5417fb00
[junit4] 2> 591605 INFO (coreLoadExecutor-1521-thread-1-processing-n:127.0.0.1:42735_nk%2Fb) [n:127.0.0.1:42735_nk%2Fb c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:58641/solr_hdfs_home/control_collection/core_node1/data/snapshot_metadata
[junit4] 2> 591626 INFO (coreLoadExecutor-1521-thread-1-processing-n:127.0.0.1:42735_nk%2Fb) [n:127.0.0.1:42735_nk%2Fb c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 591626 INFO (coreLoadExecutor-1521-thread-1-processing-n:127.0.0.1:42735_nk%2Fb) [n:127.0.0.1:42735_nk%2Fb c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
[junit4] 2> 591626 INFO (coreLoadExecutor-1521-thread-1-processing-n:127.0.0.1:42735_nk%2Fb) [n:127.0.0.1:42735_nk%2Fb c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Creating new global HDFS BlockCache
[junit4] 2> 593292 WARN (coreLoadExecutor-1521-thread-1-processing-n:127.0.0.1:42735_nk%2Fb) [n:127.0.0.1:42735_nk%2Fb c:control_collection x:collection1] o.a.s.s.h.HdfsDirectory The NameNode is in SafeMode - Solr will wait 5 seconds and try again.
[junit4] 2> 598506 INFO (coreLoadExecutor-1521-thread-1-processing-n:127.0.0.1:42735_nk%2Fb) [n:127.0.0.1:42735_nk%2Fb c:control_collection x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 598514 INFO (coreLoadExecutor-1521-thread-1-processing-n:127.0.0.1:42735_nk%2Fb) [n:127.0.0.1:42735_nk%2Fb c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:58641/solr_hdfs_home/control_collection/core_node1/data
[junit4] 2> 598609 INFO (coreLoadExecutor-1521-thread-1-processing-n:127.0.0.1:42735_nk%2Fb) [n:127.0.0.1:42735_nk%2Fb c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:58641/solr_hdfs_home/control_collection/core_node1/data/index
[junit4] 2> 598621 INFO (coreLoadExecutor-1521-thread-1-processing-n:127.0.0.1:42735_nk%2Fb) [n:127.0.0.1:42735_nk%2Fb c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 598622 INFO (coreLoadExecutor-1521-thread-1-processing-n:127.0.0.1:42735_nk%2Fb) [n:127.0.0.1:42735_nk%2Fb c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
[junit4] 2> 598633 INFO (coreLoadExecutor-1521-thread-1-processing-n:127.0.0.1:42735_nk%2Fb) [n:127.0.0.1:42735_nk%2Fb c:control_collection x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 598634 INFO (coreLoadExecutor-1521-thread-1-processing-n:127.0.0.1:42735_nk%2Fb) [n:127.0.0.1:42735_nk%2Fb c:control_collection x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@755ea619
[junit4] 2> 598766 INFO (IPC Server handler 1 on 58641) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:46247 is added to blk_1073741825_1001{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-051eb514-66a4-4458-b3d2-03c251034a97:NORMAL:127.0.0.1:35106|RBW], ReplicaUC[[DISK]DS-184139e3-2c4c-42c8-85d9-c03764256434:NORMAL:127.0.0.1:46247|RBW]]} size 0
[junit4] 2> 598775 INFO (IPC Server handler 6 on 58641) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:35106 is added to blk_1073741825_1001{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-184139e3-2c4c-42c8-85d9-c03764256434:NORMAL:127.0.0.1:46247|RBW], ReplicaUC[[DISK]DS-19f94771-8c0c-4a6e-b754-607bf2b99d9e:NORMAL:127.0.0.1:35106|FINALIZED]]} size 0
[junit4] 2> 598820 WARN (coreLoadExecutor-1521-thread-1-processing-n:127.0.0.1:42735_nk%2Fb) [n:127.0.0.1:42735_nk%2Fb c:control_collection x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 598875 INFO (coreLoadExecutor-1521-thread-1-processing-n:127.0.0.1:42735_nk%2Fb) [n:127.0.0.1:42735_nk%2Fb c:control_collection x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
[junit4] 2> 598875 INFO (coreLoadExecutor-1521-thread-1-processing-n:127.0.0.1:42735_nk%2Fb) [n:127.0.0.1:42735_nk%2Fb c:control_collection x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 598875 INFO (coreLoadExecutor-1521-thread-1-processing-n:127.0.0.1:42735_nk%2Fb) [n:127.0.0.1:42735_nk%2Fb c:control_collection x:collection1] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=2
[junit4] 2> 598888 INFO (coreLoadExecutor-1521-thread-1-processing-n:127.0.0.1:42735_nk%2Fb) [n:127.0.0.1:42735_nk%2Fb c:control_collection x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 598888 INFO (coreLoadExecutor-1521-thread-1-processing-n:127.0.0.1:42735_nk%2Fb) [n:127.0.0.1:42735_nk%2Fb c:control_collection x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 598890 INFO (coreLoadExecutor-1521-thread-1-processing-n:127.0.0.1:42735_nk%2Fb) [n:127.0.0.1:42735_nk%2Fb c:control_collection x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=28, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.22416072621188388]
[junit4] 2> 598988 INFO (coreLoadExecutor-1521-thread-1-processing-n:127.0.0.1:42735_nk%2Fb) [n:127.0.0.1:42735_nk%2Fb c:control_collection x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@620a0cbb[collection1] main]
[junit4] 2> 598989 INFO (coreLoadExecutor-1521-thread-1-processing-n:127.0.0.1:42735_nk%2Fb) [n:127.0.0.1:42735_nk%2Fb c:control_collection x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 598989 INFO (coreLoadExecutor-1521-thread-1-processing-n:127.0.0.1:42735_nk%2Fb) [n:127.0.0.1:42735_nk%2Fb c:control_collection x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 598992 INFO (coreLoadExecutor-1521-thread-1-processing-n:127.0.0.1:42735_nk%2Fb) [n:127.0.0.1:42735_nk%2Fb c:control_collection x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 599000 INFO (searcherExecutor-1522-thread-1-processing-n:127.0.0.1:42735_nk%2Fb x:collection1 c:control_collection) [n:127.0.0.1:42735_nk%2Fb c:control_collection x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@620a0cbb[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 599008 INFO (coreLoadExecutor-1521-thread-1-processing-n:127.0.0.1:42735_nk%2Fb) [n:127.0.0.1:42735_nk%2Fb c:control_collection x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1558113050534346752
[junit4] 2> 599017 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 599018 INFO (coreZkRegister-1514-thread-1-processing-n:127.0.0.1:42735_nk%2Fb x:collection1 c:control_collection) [n:127.0.0.1:42735_nk%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 599018 INFO (coreZkRegister-1514-thread-1-processing-n:127.0.0.1:42735_nk%2Fb x:collection1 c:control_collection) [n:127.0.0.1:42735_nk%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 599018 INFO (coreZkRegister-1514-thread-1-processing-n:127.0.0.1:42735_nk%2Fb x:collection1 c:control_collection) [n:127.0.0.1:42735_nk%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:42735/nk/b/collection1/
[junit4] 2> 599018 INFO (coreZkRegister-1514-thread-1-processing-n:127.0.0.1:42735_nk%2Fb x:collection1 c:control_collection) [n:127.0.0.1:42735_nk%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 599018 INFO (coreZkRegister-1514-thread-1-processing-n:127.0.0.1:42735_nk%2Fb x:collection1 c:control_collection) [n:127.0.0.1:42735_nk%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:42735/nk/b/collection1/ has no replicas
[junit4] 2> 599019 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:39009/solr ready
[junit4] 2> 599019 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 599024 INFO (coreZkRegister-1514-thread-1-processing-n:127.0.0.1:42735_nk%2Fb x:collection1 c:control_collection) [n:127.0.0.1:42735_nk%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:42735/nk/b/collection1/ shard1
[junit4] 2> 599124 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_8E26F72D0F7E3A6B-001/shard-1-001/cores/collection1
[junit4] 2> 599124 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_8E26F72D0F7E3A6B-001/shard-1-001
[junit4] 2> 599125 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 599127 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@302f807d{/nk/b,null,AVAILABLE}
[junit4] 2> 599127 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@53670827{HTTP/1.1,[http/1.1]}{127.0.0.1:33074}
[junit4] 2> 599127 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.e.j.s.Server Started @602991ms
[junit4] 2> 599127 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:58641/hdfs__localhost_58641__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-6.x_checkout_solr_build_solr-core_test_J1_temp_solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_8E26F72D0F7E3A6B-001_tempDir-002_jetty1, solrconfig=solrconfig.xml, hostContext=/nk/b, hostPort=33074, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_8E26F72D0F7E3A6B-001/shard-1-001/cores}
[junit4] 2> 599128 ERROR (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 599128 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 6.5.0
[junit4] 2> 599128 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 599128 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 599128 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-02-01T06:59:58.472Z
[junit4] 2> 599131 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 599132 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_8E26F72D0F7E3A6B-001/shard-1-001/solr.xml
[junit4] 2> 599139 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 599140 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39009/solr
[junit4] 2> 599150 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [n:127.0.0.1:33074_nk%2Fb ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 599154 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [n:127.0.0.1:33074_nk%2Fb ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33074_nk%2Fb
[junit4] 2> 599156 INFO (zkCallback-670-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 599156 INFO (zkCallback-666-thread-2-processing-n:127.0.0.1:42735_nk%2Fb) [n:127.0.0.1:42735_nk%2Fb ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 599160 INFO (zkCallback-675-thread-1-processing-n:127.0.0.1:33074_nk%2Fb) [n:127.0.0.1:33074_nk%2Fb ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 599175 INFO (coreZkRegister-1514-thread-1-processing-n:127.0.0.1:42735_nk%2Fb x:collection1 c:control_collection) [n:127.0.0.1:42735_nk%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 599222 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [n:127.0.0.1:33074_nk%2Fb ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_8E26F72D0F7E3A6B-001/shard-1-001/cores
[junit4] 2> 599222 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [n:127.0.0.1:33074_nk%2Fb ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 599224 INFO (OverseerStateUpdate-97382065133191172-127.0.0.1:42735_nk%2Fb-n_0000000000) [n:127.0.0.1:42735_nk%2Fb ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 600237 WARN (coreLoadExecutor-1532-thread-1-processing-n:127.0.0.1:33074_nk%2Fb) [n:127.0.0.1:33074_nk%2Fb c:collection1 x:collection1] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
[junit4] 2> 600238 INFO (coreLoadExecutor-1532-thread-1-processing-n:127.0.0.1:33074_nk%2Fb) [n:127.0.0.1:33074_nk%2Fb c:collection1 x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
[junit4] 2> 600251 INFO (coreLoadExecutor-1532-thread-1-processing-n:127.0.0.1:33074_nk%2Fb) [n:127.0.0.1:33074_nk%2Fb c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 600332 WARN (coreLoadExecutor-1532-thread-1-processing-n:127.0.0.1:33074_nk%2Fb) [n:127.0.0.1:33074_nk%2Fb c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 600334 INFO (coreLoadExecutor-1532-thread-1-processing-n:127.0.0.1:33074_nk%2Fb) [n:127.0.0.1:33074_nk%2Fb c:collection1 x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 600351 INFO (coreLoadExecutor-1532-thread-1-processing-n:127.0.0.1:33074_nk%2Fb) [n:127.0.0.1:33074_nk%2Fb c:collection1 x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 600351 INFO (coreLoadExecutor-1532-thread-1-processing-n:127.0.0.1:33074_nk%2Fb) [n:127.0.0.1:33074_nk%2Fb c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:58641/solr_hdfs_home
[junit4] 2> 600351 INFO (coreLoadExecutor-1532-thread-1-processing-n:127.0.0.1:33074_nk%2Fb) [n:127.0.0.1:33074_nk%2Fb c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 600351 INFO (coreLoadExecutor-1532-thread-1-processing-n:127.0.0.1:33074_nk%2Fb) [n:127.0.0.1:33074_nk%2Fb c:collection1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_8E26F72D0F7E3A6B-001/shard-1-001/cores/collection1], dataDir=[hdfs://localhost:58641/solr_hdfs_home/collection1/core_node1/data/]
[junit4] 2> 600351 INFO (coreLoadExecutor-1532-thread-1-processing-n:127.0.0.1:33074_nk%2Fb) [n:127.0.0.1:33074_nk%2Fb c:collection1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5417fb00
[junit4] 2> 600352 INFO (coreLoadExecutor-1532-thread-1-processing-n:127.0.0.1:33074_nk%2Fb) [n:127.0.0.1:33074_nk%2Fb c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:58641/solr_hdfs_home/collection1/core_node1/data/snapshot_metadata
[junit4] 2> 600360 INFO (coreLoadExecutor-1532-thread-1-processing-n:127.0.0.1:33074_nk%2Fb) [n:127.0.0.1:33074_nk%2Fb c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 600360 INFO (coreLoadExecutor-1532-thread-1-processing-n:127.0.0.1:33074_nk%2Fb) [n:127.0.0.1:33074_nk%2Fb c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
[junit4] 2> 600376 INFO (coreLoadExecutor-1532-thread-1-processing-n:127.0.0.1:33074_nk%2Fb) [n:127.0.0.1:33074_nk%2Fb c:collection1 x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 600380 INFO (coreLoadExecutor-1532-thread-1-processing-n:127.0.0.1:33074_nk%2Fb) [n:127.0.0.1:33074_nk%2Fb c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:58641/solr_hdfs_home/collection1/core_node1/data
[junit4] 2> 600419 INFO (coreLoadExecutor-1532-thread-1-processing-n:127.0.0.1:33074_nk%2Fb) [n:127.0.0.1:33074_nk%2Fb c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:58641/solr_hdfs_home/collection1/core_node1/data/index
[junit4] 2> 600437 INFO (coreLoadExecutor-1532-thread-1-processing-n:127.0.0.1:33074_nk%2Fb) [n:127.0.0.1:33074_nk%2Fb c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 600437 INFO (coreLoadExecutor-1532-thread-1-processing-n:127.0.0.1:33074_nk%2Fb) [n:127.0.0.1:33074_nk%2Fb c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
[junit4] 2> 600445 INFO (coreLoadExecutor-1532-thread-1-processing-n:127.0.0.1:33074_nk%2Fb) [n:127.0.0.1:33074_nk%2Fb c:collection1 x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 600445 INFO (coreLoadExecutor-1532-thread-1-processing-n:127.0.0.1:33074_nk%2Fb) [n:127.0.0.1:33074_nk%2Fb c:collection1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@934a8ff
[junit4] 2> 600502 INFO (IPC Server handler 5 on 58641) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:46247 is added to blk_1073741826_1002{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-19f94771-8c0c-4a6e-b754-607bf2b99d9e:NORMAL:127.0.0.1:35106|RBW], ReplicaUC[[DISK]DS-e1fff327-0a7e-4188-b528-4bab76c547c4:NORMAL:127.0.0.1:46247|RBW]]} size 0
[junit4] 2> 600502 INFO (IPC Server handler 3 on 58641) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:35106 is added to blk_1073741826_1002{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-e1fff327-0a7e-4188-b528-4bab76c547c4:NORMAL:127.0.0.1:46247|RBW], ReplicaUC[[DISK]DS-051eb514-66a4-4458-b3d2-03c251034a97:NORMAL:127.0.0.1:35106|FINALIZED]]} size 0
[junit4] 2> 600529 WARN (coreLoadExecutor-1532-thread-1-processing-n:127.0.0.1:33074_nk%2Fb) [n:127.0.0.1:33074_nk%2Fb c:collection1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 600558 INFO (coreLoadExecutor-1532-thread-1-processing-n:127.0.0.1:33074_nk%2Fb) [n:127.0.0.1:33074_nk%2Fb c:collection1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
[junit4] 2> 600558 INFO (coreLoadExecutor-1532-thread-1-processing-n:127.0.0.1:33074_nk%2Fb) [n:127.0.0.1:33074_nk%2Fb c:collection1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 600559 INFO (coreLoadExecutor-1532-thread-1-processing-n:127.0.0.1:33074_nk%2Fb) [n:127.0.0.1:33074_nk%2Fb c:collection1 x:collection1] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=2
[junit4] 2> 600570 INFO (coreLoadExecutor-1532-thread-1-processing-n:127.0.0.1:33074_nk%2Fb) [n:127.0.0.1:33074_nk%2Fb c:collection1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 600570 INFO (coreLoadExecutor-1532-thread-1-processing-n:127.0.0.1:33074_nk%2Fb) [n:127.0.0.1:33074_nk%2Fb c:collection1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 600577 INFO (coreLoadExecutor-1532-thread-1-processing-n:127.0.0.1:33074_nk%2Fb) [n:127.0.0.1:33074_nk%2Fb c:collection1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=28, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.22416072621188388]
[junit4] 2> 600588 INFO (coreLoadExecutor-1532-thread-1-processing-n:127.0.0.1:33074_nk%2Fb) [n:127.0.0.1:33074_nk%2Fb c:collection1 x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@2ca120e2[collection1] main]
[junit4] 2> 600589 INFO (coreLoadExecutor-1532-thread-1-processing-n:127.0.0.1:33074_nk%2Fb) [n:127.0.0.1:33074_nk%2Fb c:collection1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 600590 INFO (coreLoadExecutor-1532-thread-1-processing-n:127.0.0.1:33074_nk%2Fb) [n:127.0.0.1:33074_nk%2Fb c:collection1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 600590 INFO (coreLoadExecutor-1532-thread-1-processing-n:127.0.0.1:33074_nk%2Fb) [n:127.0.0.1:33074_nk%2Fb c:collection1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 600591 INFO (searcherExecutor-1533-thread-1-processing-n:127.0.0.1:33074_nk%2Fb x:collection1 c:collection1) [n:127.0.0.1:33074_nk%2Fb c:collection1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@2ca120e2[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 600598 INFO (coreLoadExecutor-1532-thread-1-processing-n:127.0.0.1:33074_nk%2Fb) [n:127.0.0.1:33074_nk%2Fb c:collection1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1558113052201582592
[junit4] 2> 600605 INFO (coreZkRegister-1527-thread-1-processing-n:127.0.0.1:33074_nk%2Fb x:collection1 c:collection1) [n:127.0.0.1:33074_nk%2Fb c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 600605 INFO (coreZkRegister-1527-thread-1-processing-n:127.0.0.1:33074_nk%2Fb x:collection1 c:collection1) [n:127.0.0.1:33074_nk%2Fb c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 600605 INFO (coreZkRegister-1527-thread-1-processing-n:127.0.0.1:33074_nk%2Fb x:collection1 c:collection1) [n:127.0.0.1:33074_nk%2Fb c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:33074/nk/b/collection1/
[junit4] 2> 600605 INFO (coreZkRegister-1527-thread-1-processing-n:127.0.0.1:33074_nk%2Fb x:collection1 c:collection1) [n:127.0.0.1:33074_nk%2Fb c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 600605 INFO (coreZkRegister-1527-thread-1-processing-n:127.0.0.1:33074_nk%2Fb x:collection1 c:collection1) [n:127.0.0.1:33074_nk%2Fb c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:33074/nk/b/collection1/ has no replicas
[junit4] 2> 600609 INFO (coreZkRegister-1527-thread-1-processing-n:127.0.0.1:33074_nk%2Fb x:collection1 c:collection1) [n:127.0.0.1:33074_nk%2Fb c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:33074/nk/b/collection1/ shard1
[junit4] 2> 600760 INFO (coreZkRegister-1527-thread-1-processing-n:127.0.0.1:33074_nk%2Fb x:collection1 c:collection1) [n:127.0.0.1:33074_nk%2Fb c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 600877 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_8E26F72D0F7E3A6B-001/shard-2-001/cores/collection1
[junit4] 2> 600878 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_8E26F72D0F7E3A6B-001/shard-2-001
[junit4] 2> 600879 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 600883 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7a6ef6ae{/nk/b,null,AVAILABLE}
[junit4] 2> 600883 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@40c4cc0f{HTTP/1.1,[http/1.1]}{127.0.0.1:46740}
[junit4] 2> 600884 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.e.j.s.Server Started @604747ms
[junit4] 2> 600884 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:58641/hdfs__localhost_58641__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-6.x_checkout_solr_build_solr-core_test_J1_temp_solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_8E26F72D0F7E3A6B-001_tempDir-002_jetty2, solrconfig=solrconfig.xml, hostContext=/nk/b, hostPort=46740, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_8E26F72D0F7E3A6B-001/shard-2-001/cores}
[junit4] 2> 600884 ERROR (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 600884 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 6.5.0
[junit4] 2> 600884 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 600884 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 600884 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-02-01T07:00:00.228Z
[junit4] 2> 600889 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 600889 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_8E26F72D0F7E3A6B-001/shard-2-001/solr.xml
[junit4] 2> 600897 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 600898 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39009/solr
[junit4] 2> 600913 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [n:127.0.0.1:46740_nk%2Fb ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 600919 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [n:127.0.0.1:46740_nk%2Fb ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46740_nk%2Fb
[junit4] 2> 600921 INFO (zkCallback-675-thread-1-processing-n:127.0.0.1:33074_nk%2Fb) [n:127.0.0.1:33074_nk%2Fb ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 600921 INFO (zkCallback-670-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 600922 INFO (zkCallback-681-thread-1-processing-n:127.0.0.1:46740_nk%2Fb) [n:127.0.0.1:46740_nk%2Fb ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 600922 INFO (zkCallback-666-thread-3-processing-n:127.0.0.1:42735_nk%2Fb) [n:127.0.0.1:42735_nk%2Fb ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 600995 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [n:127.0.0.1:46740_nk%2Fb ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_8E26F72D0F7E3A6B-001/shard-2-001/cores
[junit4] 2> 600995 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [n:127.0.0.1:46740_nk%2Fb ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 601003 INFO (OverseerStateUpdate-97382065133191172-127.0.0.1:42735_nk%2Fb-n_0000000000) [n:127.0.0.1:42735_nk%2Fb ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 602019 WARN (coreLoadExecutor-1543-thread-1-processing-n:127.0.0.1:46740_nk%2Fb) [n:127.0.0.1:46740_nk%2Fb c:collection1 x:collection1] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
[junit4] 2> 602020 INFO (coreLoadExecutor-1543-thread-1-processing-n:127.0.0.1:46740_nk%2Fb) [n:127.0.0.1:46740_nk%2Fb c:collection1 x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
[junit4] 2> 602056 INFO (coreLoadExecutor-1543-thread-1-processing-n:127.0.0.1:46740_nk%2Fb) [n:127.0.0.1:46740_nk%2Fb c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 602141 WARN (coreLoadExecutor-1543-thread-1-processing-n:127.0.0.1:46740_nk%2Fb) [n:127.0.0.1:46740_nk%2Fb c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 602142 INFO (coreLoadExecutor-1543-thread-1-processing-n:127.0.0.1:46740_nk%2Fb) [n:127.0.0.1:46740_nk%2Fb c:collection1 x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 602160 INFO (coreLoadExecutor-1543-thread-1-processing-n:127.0.0.1:46740_nk%2Fb) [n:127.0.0.1:46740_nk%2Fb c:collection1 x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 602160 INFO (coreLoadExecutor-1543-thread-1-processing-n:127.0.0.1:46740_nk%2Fb) [n:127.0.0.1:46740_nk%2Fb c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:58641/solr_hdfs_home
[junit4] 2> 602161 INFO (coreLoadExecutor-1543-thread-1-processing-n:127.0.0.1:46740_nk%2Fb) [n:127.0.0.1:46740_nk%2Fb c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 602161 INFO (coreLoadExecutor-1543-thread-1-processing-n:127.0.0.1:46740_nk%2Fb) [n:127.0.0.1:46740_nk%2Fb c:collection1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_8E26F72D0F7E3A6B-001/shard-2-001/cores/collection1], dataDir=[hdfs://localhost:58641/solr_hdfs_home/collection1/core_node2/data/]
[junit4] 2> 602161 INFO (coreLoadExecutor-1543-thread-1-processing-n:127.0.0.1:46740_nk%2Fb) [n:127.0.0.1:46740_nk%2Fb c:collection1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5417fb00
[junit4] 2> 602161 INFO (coreLoadExecutor-1543-thread-1-processing-n:127.0.0.1:46740_nk%2Fb) [n:127.0.0.1:46740_nk%2Fb c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:58641/solr_hdfs_home/collection1/core_node2/data/snapshot_metadata
[junit4] 2> 602170 INFO (coreLoadExecutor-1543-thread-1-processing-n:127.0.0.1:46740_nk%2Fb) [n:127.0.0.1:46740_nk%2Fb c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 602170 INFO (coreLoadExecutor-1543-thread-1-processing-n:127.0.0.1:46740_nk%2Fb) [n:127.0.0.1:46740_nk%2Fb c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
[junit4] 2> 602176 INFO (coreLoadExecutor-1543-thread-1-processing-n:127.0.0.1:46740_nk%2Fb) [n:127.0.0.1:46740_nk%2Fb c:collection1 x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 602177 INFO (coreLoadExecutor-1543-thread-1-processing-n:127.0.0.1:46740_nk%2Fb) [n:127.0.0.1:46740_nk%2Fb c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:58641/solr_hdfs_home/collection1/core_node2/data
[junit4] 2> 602219 INFO (coreLoadExecutor-1543-thread-1-processing-n:127.0.0.1:46740_nk%2Fb) [n:127.0.0.1:46740_nk%2Fb c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:58641/solr_hdfs_home/collection1/core_node2/data/index
[junit4] 2> 602227 INFO (coreLoadExecutor-1543-thread-1-processing-n:127.0.0.1:46740_nk%2Fb) [n:127.0.0.1:46740_nk%2Fb c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 602227 INFO (coreLoadExecutor-1543-thread-1-processing-n:127.0.0.1:46740_nk%2Fb) [n:127.0.0.1:46740_nk%2Fb c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
[junit4] 2> 602243 INFO (coreLoadExecutor-1543-thread-1-processing-n:127.0.0.1:46740_nk%2Fb) [n:127.0.0.1:46740_nk%2Fb c:collection1 x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 602243 INFO (coreLoadExecutor-1543-thread-1-processing-n:127.0.0.1:46740_nk%2Fb) [n:127.0.0.1:46740_nk%2Fb c:collection1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@48902e79
[junit4] 2> 602311 INFO (IPC Server handler 4 on 58641) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:46247 is added to blk_1073741827_1003{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-19f94771-8c0c-4a6e-b754-607bf2b99d9e:NORMAL:127.0.0.1:35106|RBW], ReplicaUC[[DISK]DS-184139e3-2c4c-42c8-85d9-c03764256434:NORMAL:127.0.0.1:46247|RBW]]} size 0
[junit4] 2> 602323 INFO (IPC Server handler 5 on 58641) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:35106 is added to blk_1073741827_1003{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-19f94771-8c0c-4a6e-b754-607bf2b99d9e:NORMAL:127.0.0.1:35106|RBW], ReplicaUC[[DISK]DS-184139e3-2c4c-42c8-85d9-c03764256434:NORMAL:127.0.0.1:46247|RBW]]} size 0
[junit4] 2> 602349 WARN (coreLoadExecutor-1543-thread-1-processing-n:127.0.0.1:46740_nk%2Fb) [n:127.0.0.1:46740_nk%2Fb c:collection1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 602415 INFO (coreLoadExecutor-1543-thread-1-processing-n:127.0.0.1:46740_nk%2Fb) [n:127.0.0.1:46740_nk%2Fb c:collection1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
[junit4] 2> 602415 INFO (coreLoadExecutor-1543-thread-1-processing-n:127.0.0.1:46740_nk%2Fb) [n:127.0.0.1:46740_nk%2Fb c:collection1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 602415 INFO (coreLoadExecutor-1543-thread-1-processing-n:127.0.0.1:46740_nk%2Fb) [n:127.0.0.1:46740_nk%2Fb c:collection1 x:collection1] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=2
[junit4] 2> 602429 INFO (coreLoadExecutor-1543-thread-1-processing-n:127.0.0.1:46740_nk%2Fb) [n:127.0.0.1:46740_nk%2Fb c:collection1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 602429 INFO (coreLoadExecutor-1543-thread-1-processing-n:127.0.0.1:46740_nk%2Fb) [n:127.0.0.1:46740_nk%2Fb c:collection1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 602433 INFO (coreLoadExecutor-1543-thread-1-processing-n:127.0.0.1:46740_nk%2Fb) [n:127.0.0.1:46740_nk%2Fb c:collection1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=28, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.22416072621188388]
[junit4] 2> 602445 INFO (coreLoadExecutor-1543-thread-1-processing-n:127.0.0.1:46740_nk%2Fb) [n:127.0.0.1:46740_nk%2Fb c:collection1 x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@6fcc4987[collection1] main]
[junit4] 2> 602447 INFO (coreLoadExecutor-1543-thread-1-processing-n:127.0.0.1:46740_nk%2Fb) [n:127.0.0.1:46740_nk%2Fb c:collection1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 602447 INFO (coreLoadExecutor-1543-thread-1-processing-n:127.0.0.1:46740_nk%2Fb) [n:127.0.0.1:46740_nk%2Fb c:collection1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 602447 INFO (coreLoadExecutor-1543-thread-1-processing-n:127.0.0.1:46740_nk%2Fb) [n:127.0.0.1:46740_nk%2Fb c:collection1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 602449 INFO (searcherExecutor-1544-thread-1-processing-n:127.0.0.1:46740_nk%2Fb x:collection1 c:collection1) [n:127.0.0.1:46740_nk%2Fb c:collection1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@6fcc4987[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 602456 INFO (coreLoadExecutor-1543-thread-1-processing-n:127.0.0.1:46740_nk%2Fb) [n:127.0.0.1:46740_nk%2Fb c:collection1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1558113054149836800
[junit4] 2> 602464 INFO (coreZkRegister-1538-thread-1-processing-n:127.0.0.1:46740_nk%2Fb x:collection1 c:collection1) [n:127.0.0.1:46740_nk%2Fb c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.ZkController Core needs to recover:collection1
[junit4] 2> 602464 INFO (updateExecutor-678-thread-1-processing-n:127.0.0.1:46740_nk%2Fb x:collection1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:46740_nk%2Fb c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.u.DefaultSolrCoreState Running recovery
[junit4] 2> 602465 INFO (recoveryExecutor-679-thread-1-processing-n:127.0.0.1:46740_nk%2Fb x:collection1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:46740_nk%2Fb c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=true
[junit4] 2> 602465 INFO (recoveryExecutor-679-thread-1-processing-n:127.0.0.1:46740_nk%2Fb x:collection1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:46740_nk%2Fb c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.RecoveryStrategy ###### startupVersions=[[]]
[junit4] 2> 602466 INFO (recoveryExecutor-679-thread-1-processing-n:127.0.0.1:46740_nk%2Fb x:collection1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:46740_nk%2Fb c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.RecoveryStrategy Begin buffering updates. core=[collection1]
[junit4] 2> 602466 INFO (recoveryExecutor-679-thread-1-processing-n:127.0.0.1:46740_nk%2Fb x:collection1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:46740_nk%2Fb c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.u.UpdateLog Starting to buffer updates. HDFSUpdateLog{state=ACTIVE, tlog=null}
[junit4] 2> 602466 INFO (recoveryExecutor-679-thread-1-processing-n:127.0.0.1:46740_nk%2Fb x:collection1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:46740_nk%2Fb c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.RecoveryStrategy Publishing state of core [collection1] as recovering, leader is [http://127.0.0.1:33074/nk/b/collection1/] and I am [http://127.0.0.1:46740/nk/b/collection1/]
[junit4] 2> 602469 INFO (recoveryExecutor-679-thread-1-processing-n:127.0.0.1:46740_nk%2Fb x:collection1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:46740_nk%2Fb c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.RecoveryStrategy Sending prep recovery command to [http://127.0.0.1:33074/nk/b]; [WaitForState: action=PREPRECOVERY&core=collection1&nodeName=127.0.0.1:46740_nk%252Fb&coreNodeName=core_node2&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true]
[junit4] 2> 602484 INFO (qtp179559618-4926) [n:127.0.0.1:33074_nk%2Fb ] o.a.s.h.a.PrepRecoveryOp Going to wait for coreNodeName: core_node2, state: recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true
[junit4] 2> 602485 INFO (qtp179559618-4926) [n:127.0.0.1:33074_nk%2Fb ] o.a.s.h.a.PrepRecoveryOp Will wait a max of 183 seconds to see collection1 (shard1 of collection1) have state: recovering
[junit4] 2> 602485 INFO (qtp179559618-4926) [n:127.0.0.1:33074_nk%2Fb ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard1, thisCore=collection1, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=down, localState=active, nodeName=127.0.0.1:46740_nk%2Fb, coreNodeName=core_node2, onlyIfActiveCheckResult=false, nodeProps: core_node2:{"core":"collection1","base_url":"http://127.0.0.1:46740/nk/b","node_name":"127.0.0.1:46740_nk%2Fb","state":"down"}
[junit4] 2> 602684 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_8E26F72D0F7E3A6B-001/shard-3-001/cores/collection1
[junit4] 2> 602685 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_8E26F72D0F7E3A6B-001/shard-3-001
[junit4] 2> 602686 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 602688 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1c57d422{/nk/b,null,AVAILABLE}
[junit4] 2> 602688 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@e82affe{HTTP/1.1,[http/1.1]}{127.0.0.1:38615}
[junit4] 2> 602689 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.e.j.s.Server Started @606552ms
[junit4] 2> 602689 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:58641/hdfs__localhost_58641__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-6.x_checkout_solr_build_solr-core_test_J1_temp_solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_8E26F72D0F7E3A6B-001_tempDir-002_jetty3, solrconfig=solrconfig.xml, hostContext=/nk/b, hostPort=38615, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_8E26F72D0F7E3A6B-001/shard-3-001/cores}
[junit4] 2> 602689 ERROR (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 602689 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 6.5.0
[junit4] 2> 602689 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 602689 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 602690 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-02-01T07:00:02.034Z
[junit4] 2> 602693 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 602693 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_8E26F72D0F7E3A6B-001/shard-3-001/solr.xml
[junit4] 2> 602703 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 602704 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39009/solr
[junit4] 2> 602716 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [n:127.0.0.1:38615_nk%2Fb ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 602722 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [n:127.0.0.1:38615_nk%2Fb ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38615_nk%2Fb
[junit4] 2> 602725 INFO (zkCallback-670-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 602726 INFO (zkCallback-681-thread-1-processing-n:127.0.0.1:46740_nk%2Fb) [n:127.0.0.1:46740_nk%2Fb ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 602726 INFO (zkCallback-666-thread-2-processing-n:127.0.0.1:42735_nk%2Fb) [n:127.0.0.1:42735_nk%2Fb ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 602726 INFO (zkCallback-675-thread-1-processing-n:127.0.0.1:33074_nk%2Fb) [n:127.0.0.1:33074_nk%2Fb ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 602728 INFO (zkCallback-688-thread-1-processing-n:127.0.0.1:38615_nk%2Fb) [n:127.0.0.1:38615_nk%2Fb ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 602892 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [n:127.0.0.1:38615_nk%2Fb ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_8E26F72D0F7E3A6B-001/shard-3-001/cores
[junit4] 2> 602892 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[8E26F72D0F7E3A6B]) [n:127.0.0.1:38615_nk%2Fb ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 602894 INFO (OverseerStateUpdate-97382065133191172-127.0.0.1:42735_nk%2Fb-n_0000000000) [n:127.0.0.1:42735_nk%2Fb ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 603485 INFO (qtp179559618-4926) [n:127.0.0.1:33074_nk%2Fb ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard1, thisCore=collection1, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=recovering, localState=active, nodeName=127.0.0.1:46740_nk%2Fb, coreNodeName=core_node2, onlyIfActiveCheckResult=false, nodeProps: core_node2:{"core":"collection1","dataDir":"hdfs://localhost:58641/solr_hdfs_home/collection1/core_node2/data/","base_url":"http://127.0.0.1:46740/nk/b","node_name":"127.0.0.1:46740_nk%2Fb","state":"recovering","ulogDir":"hdfs://localhost:58641/solr_hdfs_home/collection1/core_node2/data/tlog"}
[junit4] 2> 603486 INFO (qtp179559618-4926) [n:127.0.0.1:33074_nk%2Fb ] o.a.s.h.a.PrepRecoveryOp Waited coreNodeName: core_node2, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4] 2> 603486 INFO (qtp179559618-4926) [n:127.0.0.1:33074_nk%2Fb ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={nodeName=127.0.0.1:46740_nk%252Fb&onlyIfLeaderActive=true&core=collection1&coreNodeName=core_node2&action=PREPRECOVERY&checkLive=true&state=recovering&onlyIfLeader=true&wt=javabin&version=2} status=0 QTime=1001
[junit4] 2> 603910 WARN (coreLoadExecutor-1554-thread-1-processing-n:127.0.0.1:38615_nk%2Fb) [n:127.0.0.1:38615_nk%2Fb c:collection1 x:collection1] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
[junit4] 2> 603910 INFO (coreLoadExecutor-1554-thread-1-processing-n:127.0.0.1:38615_nk%2Fb) [n:127.0.0.1:38615_nk%2Fb c:collection1 x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
[junit4] 2> 603923 INFO (coreLoadExecutor-1554-thread-1-processing-n:127.0.0.1:38615_nk%2Fb) [n:127.0.0.1:38615_nk%2Fb c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 603994 WARN (coreLoadExecutor-1554-thread-1-processing-n:127.0.0.1:38615_nk%2Fb) [n:127.0.0.1:38615_nk%2Fb c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 603996 INFO (coreLoadExecutor-1554-thread-1-processing-n:127.0.0.1:38615_nk%2Fb) [n:127.0.0.1:38615_nk%2Fb c:collection1 x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field i
[...truncated too long message...]
rrorCode = Session expired for /live_nodes]
[junit4] 2> 4740165 WARN (zkCallback-5081-thread-2-processing-n:127.0.0.1:56107_hk_hhq%2Fv) [n:127.0.0.1:56107_hk_hhq%2Fv c:target_collection s:shard2 r:core_node4 x:target_collection_shard2_replica1] o.a.s.c.SyncStrategy Closed, skipping sync up.
[junit4] 2> 4740165 INFO (zkCallback-5081-thread-2-processing-n:127.0.0.1:56107_hk_hhq%2Fv) [n:127.0.0.1:56107_hk_hhq%2Fv c:target_collection s:shard2 r:core_node4 x:target_collection_shard2_replica1] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 4740165 INFO (zkCallback-5081-thread-2-processing-n:127.0.0.1:56107_hk_hhq%2Fv) [n:127.0.0.1:56107_hk_hhq%2Fv c:target_collection s:shard2 r:core_node4 x:target_collection_shard2_replica1] o.a.s.c.SolrCore [target_collection_shard2_replica1] CLOSING SolrCore org.apache.solr.core.SolrCore@43124fd3
[junit4] 2> 4740165 INFO (zkCallback-5081-thread-2-processing-n:127.0.0.1:56107_hk_hhq%2Fv) [n:127.0.0.1:56107_hk_hhq%2Fv c:target_collection s:shard2 r:core_node4 x:target_collection_shard2_replica1] o.a.s.h.CdcrRequestHandler Solr core is being closed - shutting down CDCR handler @ target_collection:shard2
[junit4] 2> 4740195 INFO (zkCallback-5081-thread-2-processing-n:127.0.0.1:56107_hk_hhq%2Fv) [n:127.0.0.1:56107_hk_hhq%2Fv c:target_collection s:shard2 r:core_node4 x:target_collection_shard2_replica1] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.core.target_collection.shard2.replica1
[junit4] 2> 4740196 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.node
[junit4] 2> 4740196 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[8E26F72D0F7E3A6B]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@4d6f2586{SSL,[ssl, http/1.1]}{127.0.0.1:0}
[junit4] 2> 4740196 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[8E26F72D0F7E3A6B]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@65a9f8be{/hk_hhq/v,null,UNAVAILABLE}
[junit4] 2> 4740197 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testOps
[junit4] 2> 4740204 INFO (TEST-CdcrReplicationDistributedZkTest.testOps-seed#[8E26F72D0F7E3A6B]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:46613 46613
[junit4] 2> 4740290 INFO (Thread-24056) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:46613 46613
[junit4] 2> 4740291 WARN (Thread-24056) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 22 /solr/aliases.json
[junit4] 2> 16 /solr/configs/conf1
[junit4] 2> 8 /solr/collections/tmp_collection/state.json
[junit4] 2> 8 /solr/security.json
[junit4] 2> 4 /solr/collections/target_collection/leaders/shard1/leader
[junit4] 2> 3 /solr/collections/target_collection/leaders/shard2/leader
[junit4] 2> 2 /solr/collections/source_collection/leaders/shard2/leader
[junit4] 2> 2 /solr/collections/source_collection/leaders/shard1/leader
[junit4] 2> 2 /solr/collections/tmp_collection/leaders/shard2/leader
[junit4] 2> 2 /solr/collections/tmp_collection/leaders/shard1/leader
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 22 /solr/clusterprops.json
[junit4] 2> 22 /solr/clusterstate.json
[junit4] 2> 8 /solr/collections/tmp_collection/cdcr/state/process
[junit4] 2> 8 /solr/collections/tmp_collection/cdcr/state/buffer
[junit4] 2> 7 /solr/collections/target_collection/cdcr/state/buffer
[junit4] 2> 7 /solr/collections/target_collection/cdcr/state/process
[junit4] 2> 5 /solr/collections/source_collection/cdcr/state/process
[junit4] 2> 4 /solr/collections/source_collection/state.json
[junit4] 2> 4 /solr/collections/source_collection/cdcr/state/buffer
[junit4] 2> 4 /solr/collections/target_collection/state.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 79 /solr/overseer/queue
[junit4] 2> 48 /solr/overseer/collection-queue-work
[junit4] 2> 24 /solr/overseer/queue-work
[junit4] 2> 22 /solr/collections
[junit4] 2> 21 /solr/live_nodes
[junit4] 2>
[junit4] 2> 4740292 INFO (SUITE-CdcrReplicationDistributedZkTest-seed#[8E26F72D0F7E3A6B]-worker) [ ] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.CdcrReplicationDistributedZkTest_8E26F72D0F7E3A6B-001
[junit4] 2> Feb 01, 2017 8:09:00 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene62): {_version_=FSTOrd50, id=PostingsFormat(name=Memory doPackFST= true)}, docValues:{}, maxPointsInLeafNode=1832, maxMBSortInHeap=7.988072381990518, sim=RandomSimilarity(queryNorm=true,coord=crazy): {}, locale=es-SV, timezone=Africa/Banjul
[junit4] 2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_102 (64-bit)/cpus=4,threads=1,free=265748392,total=525860864
[junit4] 2> NOTE: All tests run in this JVM: [BigEndianAscendingWordSerializerTest, DeleteInactiveReplicaTest, TestCoreDiscovery, CollectionStateFormat2Test, PingRequestHandlerTest, CircularListTest, HdfsChaosMonkeyNothingIsSafeTest, InfoHandlerTest, TestSolrCoreParser, DOMUtilTest, DistributedFacetPivotLongTailTest, TestRandomRequestDistribution, TestSubQueryTransformer, TestExtendedDismaxParser, TestTolerantUpdateProcessorRandomCloud, TestWriterPerf, TestZkChroot, TestInfoStreamLogging, TermVectorComponentDistributedTest, ExitableDirectoryReaderTest, TestStressUserVersions, BasicDistributedZk2Test, OverseerCollectionConfigSetProcessorTest, TestConfigSetProperties, TestReloadAndDeleteDocs, StatelessScriptUpdateProcessorFactoryTest, TestSolrQueryParserDefaultOperatorResource, TestSort, RecoveryZkTest, TestUseDocValuesAsStored, ClassificationUpdateProcessorTest, TestSolrDynamicMBean, DebugComponentTest, TestFieldCacheSortRandom, TestReqParamsAPI, DeleteReplicaTest, TestMacroExpander, TestIndexingPerformance, TestPhraseSuggestions, TestHdfsUpdateLog, TestRawTransformer, AnalyticsQueryTest, BooleanFieldTest, UpdateParamsTest, OpenExchangeRatesOrgProviderTest, TestSchemaSimilarityResource, TestFieldCollectionResource, FullHLLTest, LeaderInitiatedRecoveryOnShardRestartTest, PreAnalyzedFieldManagedSchemaCloudTest, XmlUpdateRequestHandlerTest, PrimitiveFieldTypeTest, CurrencyFieldXmlFileTest, ResponseLogComponentTest, JSONWriterTest, OverseerTest, MultiThreadedOCPTest, UnloadDistributedZkTest, TestInitQParser, TestStressCloudBlindAtomicUpdates, TestPKIAuthenticationPlugin, TolerantUpdateProcessorTest, VMParamsZkACLAndCredentialsProvidersTest, CleanupOldIndexTest, TestDeleteCollectionOnDownNodes, SpellPossibilityIteratorTest, TestConfigSetsAPIExclusivity, TestManagedResource, AssignTest, RequestHandlersTest, BlockDirectoryTest, TestMiniSolrCloudClusterSSL, TestLFUCache, StressHdfsTest, NoCacheHeaderTest, TestCloudManagedSchema, TestDistributedMissingSort, CdcrUpdateLogTest, SolrMetricReporterTest, JvmMetricsTest, BJQParserTest, BasicAuthIntegrationTest, TestFreeTextSuggestions, RulesTest, SolrIndexMetricsTest, TestRecoveryHdfs, SimpleFacetsTest, TestTolerantSearch, BadIndexSchemaTest, TestLockTree, TestComplexPhraseQParserPlugin, TestObjectReleaseTracker, TestBulkSchemaAPI, SuggestComponentTest, AutoCommitTest, ReplicationFactorTest, TestPostingsSolrHighlighter, SolrGraphiteReporterTest, TestConfigReload, TestSimpleQParserPlugin, QueryParsingTest, TestFieldTypeResource, TestFilteredDocIdSet, BinaryUpdateRequestHandlerTest, TestScoreJoinQPScore, TestManagedSchemaThreadSafety, BlockJoinFacetSimpleTest, TestJavabinTupleStreamParser, DirectUpdateHandlerOptimizeTest, CoreAdminHandlerTest, BasicDistributedZkTest, CollectionsAPIDistributedZkTest, OpenCloseCoreStressTest, LeaderElectionTest, ZkCLITest, ShardRoutingCustomTest, TestFaceting, TestRecovery, DistributedSpellCheckComponentTest, TestRealTimeGet, TestStressReorder, TestJoin, TestReload, TestStressVersions, HardAutoCommitTest, TestRangeQuery, TestGroupingSearch, QueryElevationComponentTest, DirectUpdateHandlerTest, TestIndexSearcher, SoftAutoCommitTest, TestTrie, TestCSVLoader, WordBreakSolrSpellCheckerTest, SolrCoreCheckLockOnStartupTest, FieldMutatingUpdateProcessorTest, TestWordDelimiterFilterFactory, SortByFunctionTest, DocValuesMultiTest, TestSolrDeletionPolicy1, CacheHeaderTest, TestQueryUtils, TestReversedWildcardFilterFactory, DocumentAnalysisRequestHandlerTest, FileBasedSpellCheckerTest, MoreLikeThisHandlerTest, FieldAnalysisRequestHandlerTest, FastVectorHighlighterTest, RegexBoostProcessorTest, TestJmxIntegration, UpdateRequestProcessorFactoryTest, MBeansHandlerTest, TestPartialUpdateDeduplication, TestPHPSerializedResponseWriter, SearchHandlerTest, TestMergePolicyConfig, SampleTest, TestDocSet, TestBinaryField, TestSearchPerf, NumericFieldsTest, MinimalSchemaTest, TestElisionMultitermQuery, TestConfig, OutputWriterTest, ExternalFileFieldSortTest, NotRequiredUniqueKeyTest, TestLuceneMatchVersion, SynonymTokenizerTest, TestXIncludeConfig, TestSweetSpotSimilarityFactory, TestLMDirichletSimilarityFactory, TestIBSimilarityFactory, TimeZoneUtilsTest, ScriptEngineTest, PluginInfoTest, ChaosMonkeyNothingIsSafeTest, DistributedIntervalFacetingTest, CdcrReplicationDistributedZkTest]
[junit4] Completed [542/681 (3!)] on J2 in 1623.22s, 11 tests, 1 failure <<< FAILURES!
[...truncated 62900 lines...]
[JENKINS] Lucene-Solr-NightlyTests-6.x - Build # 271 - Still
unstable
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.x/271/
2 tests failed.
FAILED: org.apache.solr.cloud.hdfs.StressHdfsTest.test
Error Message:
Timeout occured while waiting response from server at: http://127.0.0.1:57802
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:57802
at __randomizedtesting.SeedInfo.seed([765495B8CB018238:FE00AA6265FDEFC0]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:621)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:279)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:268)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:435)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:387)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1344)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:1095)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:1037)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
at org.apache.solr.cloud.hdfs.StressHdfsTest.createAndDeleteCollection(StressHdfsTest.java:220)
at org.apache.solr.cloud.hdfs.StressHdfsTest.test(StressHdfsTest.java:103)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:170)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:515)
... 51 more
FAILED: org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest.test
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([765495B8CB018238:FE00AA6265FDEFC0]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertTrue(Assert.java:54)
at org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest.test(HdfsWriteToMultipleCollectionsTest.java:137)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 11649 lines...]
[junit4] Suite: org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_765495B8CB018238-001/init-core-data-001
[junit4] 2> 1140112 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[765495B8CB018238]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
[junit4] 2> 1140112 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[765495B8CB018238]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
[junit4] 2> 1141208 WARN (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[765495B8CB018238]-worker) [ ] o.a.h.u.NativeCodeLoader Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
[junit4] 1> Formatting using clusterid: testClusterID
[junit4] 2> 1142027 WARN (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[765495B8CB018238]-worker) [ ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
[junit4] 2> 1142457 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[765495B8CB018238]-worker) [ ] o.m.log Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
[junit4] 2> 1142519 WARN (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[765495B8CB018238]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 1142694 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[765495B8CB018238]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 1142801 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[765495B8CB018238]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.2-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_46308_hdfs____d71x0j/webapp
[junit4] 2> 1143785 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[765495B8CB018238]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46308
[junit4] 2> 1144821 ERROR (Finalizer) [ ] o.a.s.c.CoreContainer CoreContainer was not close prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!! instance=2140372790
[junit4] 2> 1145667 WARN (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[765495B8CB018238]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 1145672 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[765495B8CB018238]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 1145685 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[765495B8CB018238]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.2-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_40599_datanode____ivolts/webapp
[junit4] 2> 1146083 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[765495B8CB018238]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40599
[junit4] 2> 1146514 WARN (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[765495B8CB018238]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 1146517 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[765495B8CB018238]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 1146583 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[765495B8CB018238]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.2-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_34349_datanode____pp3pem/webapp
[junit4] 2> 1147132 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[765495B8CB018238]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34349
[junit4] 2> 1148588 INFO (IPC Server handler 9 on 40180) [ ] BlockStateChange BLOCK* processReport: from storage DS-11a74713-8e73-41df-9f4c-ab42e176baf9 node DatanodeRegistration(127.0.0.1:37960, datanodeUuid=8ab3a5b6-275a-4d69-8b39-7fe79ee55f09, infoPort=54896, infoSecurePort=0, ipcPort=43473, storageInfo=lv=-56;cid=testClusterID;nsid=97073154;c=0), blocks: 0, hasStaleStorage: true, processing time: 3 msecs
[junit4] 2> 1148588 INFO (IPC Server handler 9 on 40180) [ ] BlockStateChange BLOCK* processReport: from storage DS-659df4cb-91ea-4367-a007-b56c84862e7a node DatanodeRegistration(127.0.0.1:37960, datanodeUuid=8ab3a5b6-275a-4d69-8b39-7fe79ee55f09, infoPort=54896, infoSecurePort=0, ipcPort=43473, storageInfo=lv=-56;cid=testClusterID;nsid=97073154;c=0), blocks: 0, hasStaleStorage: false, processing time: 0 msecs
[junit4] 2> 1148591 INFO (IPC Server handler 0 on 40180) [ ] BlockStateChange BLOCK* processReport: from storage DS-eb907fae-6d6a-4936-8bbf-8d4eff1e29b5 node DatanodeRegistration(127.0.0.1:44103, datanodeUuid=d3c9b0e8-9a23-4136-92a7-79bf9f6f5ea7, infoPort=34010, infoSecurePort=0, ipcPort=44781, storageInfo=lv=-56;cid=testClusterID;nsid=97073154;c=0), blocks: 0, hasStaleStorage: true, processing time: 0 msecs
[junit4] 2> 1148595 INFO (IPC Server handler 0 on 40180) [ ] BlockStateChange BLOCK* processReport: from storage DS-ae22a632-cd5f-4c52-be91-c8876c0439cc node DatanodeRegistration(127.0.0.1:44103, datanodeUuid=d3c9b0e8-9a23-4136-92a7-79bf9f6f5ea7, infoPort=34010, infoSecurePort=0, ipcPort=44781, storageInfo=lv=-56;cid=testClusterID;nsid=97073154;c=0), blocks: 0, hasStaleStorage: false, processing time: 0 msecs
[junit4] 2> 1148651 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1148661 INFO (Thread-1530) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1148661 INFO (Thread-1530) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1148759 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.a.s.c.ZkTestServer start zk server on port:59338
[junit4] 2> 1148785 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 1148787 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 1148789 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1148790 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 1148791 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 1148792 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 1148794 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 1148795 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1148796 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1148797 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 1148798 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 1148905 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_765495B8CB018238-001/control-001/cores/collection1
[junit4] 2> 1148907 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 1148908 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@38faa9c6{/,null,AVAILABLE}
[junit4] 2> 1148909 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@1b1ed91b{HTTP/1.1,[http/1.1]}{127.0.0.1:33786}
[junit4] 2> 1148909 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.e.j.s.Server Started @1152802ms
[junit4] 2> 1148909 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:40180/hdfs__localhost_40180__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-6.x_checkout_solr_build_solr-core_test_J1_temp_solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_765495B8CB018238-001_tempDir-002_control_data, hostContext=/, hostPort=33786, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_765495B8CB018238-001/control-001/cores}
[junit4] 2> 1148909 ERROR (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1148909 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 6.5.0
[junit4] 2> 1148909 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1148909 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1148909 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-01-30T23:17:33.065Z
[junit4] 2> 1148916 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1148916 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_765495B8CB018238-001/control-001/solr.xml
[junit4] 2> 1148924 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1148925 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:59338/solr
[junit4] 2> 1148989 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [n:127.0.0.1:33786_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:33786_
[junit4] 2> 1148990 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [n:127.0.0.1:33786_ ] o.a.s.c.Overseer Overseer (id=97374585016745988-127.0.0.1:33786_-n_0000000000) starting
[junit4] 2> 1149016 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [n:127.0.0.1:33786_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33786_
[junit4] 2> 1149019 INFO (zkCallback-1497-thread-1-processing-n:127.0.0.1:33786_) [n:127.0.0.1:33786_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1149049 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [n:127.0.0.1:33786_ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_765495B8CB018238-001/control-001/cores
[junit4] 2> 1149049 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [n:127.0.0.1:33786_ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 1149063 INFO (OverseerStateUpdate-97374585016745988-127.0.0.1:33786_-n_0000000000) [n:127.0.0.1:33786_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 1150088 WARN (coreLoadExecutor-2151-thread-1-processing-n:127.0.0.1:33786_) [n:127.0.0.1:33786_ c:control_collection x:collection1] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
[junit4] 2> 1150089 INFO (coreLoadExecutor-2151-thread-1-processing-n:127.0.0.1:33786_) [n:127.0.0.1:33786_ c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
[junit4] 2> 1150105 INFO (coreLoadExecutor-2151-thread-1-processing-n:127.0.0.1:33786_) [n:127.0.0.1:33786_ c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 1150213 WARN (coreLoadExecutor-2151-thread-1-processing-n:127.0.0.1:33786_) [n:127.0.0.1:33786_ c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 1150214 INFO (coreLoadExecutor-2151-thread-1-processing-n:127.0.0.1:33786_) [n:127.0.0.1:33786_ c:control_collection x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 1150238 INFO (coreLoadExecutor-2151-thread-1-processing-n:127.0.0.1:33786_) [n:127.0.0.1:33786_ c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 1150249 INFO (coreLoadExecutor-2151-thread-1-processing-n:127.0.0.1:33786_) [n:127.0.0.1:33786_ c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:40180/solr_hdfs_home
[junit4] 2> 1150249 INFO (coreLoadExecutor-2151-thread-1-processing-n:127.0.0.1:33786_) [n:127.0.0.1:33786_ c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 1150249 INFO (coreLoadExecutor-2151-thread-1-processing-n:127.0.0.1:33786_) [n:127.0.0.1:33786_ c:control_collection x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_765495B8CB018238-001/control-001/cores/collection1], dataDir=[hdfs://localhost:40180/solr_hdfs_home/control_collection/core_node1/data/]
[junit4] 2> 1150250 INFO (coreLoadExecutor-2151-thread-1-processing-n:127.0.0.1:33786_) [n:127.0.0.1:33786_ c:control_collection x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2f136126
[junit4] 2> 1150250 INFO (coreLoadExecutor-2151-thread-1-processing-n:127.0.0.1:33786_) [n:127.0.0.1:33786_ c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:40180/solr_hdfs_home/control_collection/core_node1/data/snapshot_metadata
[junit4] 2> 1150268 INFO (coreLoadExecutor-2151-thread-1-processing-n:127.0.0.1:33786_) [n:127.0.0.1:33786_ c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 1150268 INFO (coreLoadExecutor-2151-thread-1-processing-n:127.0.0.1:33786_) [n:127.0.0.1:33786_ c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
[junit4] 2> 1150268 INFO (coreLoadExecutor-2151-thread-1-processing-n:127.0.0.1:33786_) [n:127.0.0.1:33786_ c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Creating new global HDFS BlockCache
[junit4] 2> 1152335 INFO (coreLoadExecutor-2151-thread-1-processing-n:127.0.0.1:33786_) [n:127.0.0.1:33786_ c:control_collection x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 1152345 INFO (coreLoadExecutor-2151-thread-1-processing-n:127.0.0.1:33786_) [n:127.0.0.1:33786_ c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:40180/solr_hdfs_home/control_collection/core_node1/data
[junit4] 2> 1152431 INFO (coreLoadExecutor-2151-thread-1-processing-n:127.0.0.1:33786_) [n:127.0.0.1:33786_ c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:40180/solr_hdfs_home/control_collection/core_node1/data/index
[junit4] 2> 1152453 INFO (coreLoadExecutor-2151-thread-1-processing-n:127.0.0.1:33786_) [n:127.0.0.1:33786_ c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 1152453 INFO (coreLoadExecutor-2151-thread-1-processing-n:127.0.0.1:33786_) [n:127.0.0.1:33786_ c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
[junit4] 2> 1152491 INFO (coreLoadExecutor-2151-thread-1-processing-n:127.0.0.1:33786_) [n:127.0.0.1:33786_ c:control_collection x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 1152493 INFO (coreLoadExecutor-2151-thread-1-processing-n:127.0.0.1:33786_) [n:127.0.0.1:33786_ c:control_collection x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1074057070, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 1152996 INFO (IPC Server handler 1 on 40180) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:37960 is added to blk_1073741825_1001{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-ae22a632-cd5f-4c52-be91-c8876c0439cc:NORMAL:127.0.0.1:44103|RBW], ReplicaUC[[DISK]DS-11a74713-8e73-41df-9f4c-ab42e176baf9:NORMAL:127.0.0.1:37960|RBW]]} size 71
[junit4] 2> 1152998 INFO (IPC Server handler 5 on 40180) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:44103 is added to blk_1073741825_1001 size 71
[junit4] 2> 1153419 WARN (coreLoadExecutor-2151-thread-1-processing-n:127.0.0.1:33786_) [n:127.0.0.1:33786_ c:control_collection x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 1153444 INFO (coreLoadExecutor-2151-thread-1-processing-n:127.0.0.1:33786_) [n:127.0.0.1:33786_ c:control_collection x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
[junit4] 2> 1153444 INFO (coreLoadExecutor-2151-thread-1-processing-n:127.0.0.1:33786_) [n:127.0.0.1:33786_ c:control_collection x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1153444 INFO (coreLoadExecutor-2151-thread-1-processing-n:127.0.0.1:33786_) [n:127.0.0.1:33786_ c:control_collection x:collection1] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=2
[junit4] 2> 1153637 INFO (coreLoadExecutor-2151-thread-1-processing-n:127.0.0.1:33786_) [n:127.0.0.1:33786_ c:control_collection x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1153637 INFO (coreLoadExecutor-2151-thread-1-processing-n:127.0.0.1:33786_) [n:127.0.0.1:33786_ c:control_collection x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1153641 INFO (coreLoadExecutor-2151-thread-1-processing-n:127.0.0.1:33786_) [n:127.0.0.1:33786_ c:control_collection x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=29, maxMergeAtOnceExplicit=45, maxMergedSegmentMB=1.0751953125, floorSegmentMB=0.625, forceMergeDeletesPctAllowed=3.7412116410685146, segmentsPerTier=48.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6234715550240746
[junit4] 2> 1153793 INFO (coreLoadExecutor-2151-thread-1-processing-n:127.0.0.1:33786_) [n:127.0.0.1:33786_ c:control_collection x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@793c5823[collection1] main]
[junit4] 2> 1153795 INFO (coreLoadExecutor-2151-thread-1-processing-n:127.0.0.1:33786_) [n:127.0.0.1:33786_ c:control_collection x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1153796 INFO (coreLoadExecutor-2151-thread-1-processing-n:127.0.0.1:33786_) [n:127.0.0.1:33786_ c:control_collection x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1153798 INFO (coreLoadExecutor-2151-thread-1-processing-n:127.0.0.1:33786_) [n:127.0.0.1:33786_ c:control_collection x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 1153800 INFO (searcherExecutor-2152-thread-1-processing-n:127.0.0.1:33786_ x:collection1 c:control_collection) [n:127.0.0.1:33786_ c:control_collection x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@793c5823[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1153810 INFO (coreLoadExecutor-2151-thread-1-processing-n:127.0.0.1:33786_) [n:127.0.0.1:33786_ c:control_collection x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1557993365664956416
[junit4] 2> 1153839 INFO (coreZkRegister-2144-thread-1-processing-n:127.0.0.1:33786_ x:collection1 c:control_collection) [n:127.0.0.1:33786_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1153839 INFO (coreZkRegister-2144-thread-1-processing-n:127.0.0.1:33786_ x:collection1 c:control_collection) [n:127.0.0.1:33786_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1153839 INFO (coreZkRegister-2144-thread-1-processing-n:127.0.0.1:33786_ x:collection1 c:control_collection) [n:127.0.0.1:33786_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:33786/collection1/
[junit4] 2> 1153839 INFO (coreZkRegister-2144-thread-1-processing-n:127.0.0.1:33786_ x:collection1 c:control_collection) [n:127.0.0.1:33786_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1153839 INFO (coreZkRegister-2144-thread-1-processing-n:127.0.0.1:33786_ x:collection1 c:control_collection) [n:127.0.0.1:33786_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:33786/collection1/ has no replicas
[junit4] 2> 1153842 INFO (coreZkRegister-2144-thread-1-processing-n:127.0.0.1:33786_ x:collection1 c:control_collection) [n:127.0.0.1:33786_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:33786/collection1/ shard1
[junit4] 2> 1154005 INFO (coreZkRegister-2144-thread-1-processing-n:127.0.0.1:33786_ x:collection1 c:control_collection) [n:127.0.0.1:33786_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1154308 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1154309 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:59338/solr ready
[junit4] 2> 1154309 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 1154310 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with stateFormat=2
[junit4] 2> 1154440 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_765495B8CB018238-001/shard-1-001/cores/collection1
[junit4] 2> 1154440 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_765495B8CB018238-001/shard-1-001
[junit4] 2> 1154441 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 1154443 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@27ae4844{/,null,AVAILABLE}
[junit4] 2> 1154443 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@3cfb9fa7{HTTP/1.1,[http/1.1]}{127.0.0.1:58111}
[junit4] 2> 1154443 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.e.j.s.Server Started @1158337ms
[junit4] 2> 1154443 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:40180/hdfs__localhost_40180__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-6.x_checkout_solr_build_solr-core_test_J1_temp_solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_765495B8CB018238-001_tempDir-002_jetty1, solrconfig=solrconfig.xml, hostContext=/, hostPort=58111, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_765495B8CB018238-001/shard-1-001/cores}
[junit4] 2> 1154444 ERROR (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1154446 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 6.5.0
[junit4] 2> 1154446 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1154446 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1154446 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-01-30T23:17:38.602Z
[junit4] 2> 1154451 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1154451 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_765495B8CB018238-001/shard-1-001/solr.xml
[junit4] 2> 1154458 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1154459 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:59338/solr
[junit4] 2> 1154473 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [n:127.0.0.1:58111_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1154480 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [n:127.0.0.1:58111_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58111_
[junit4] 2> 1154483 INFO (zkCallback-1501-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1154488 INFO (zkCallback-1497-thread-3-processing-n:127.0.0.1:33786_) [n:127.0.0.1:33786_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1154492 INFO (zkCallback-1507-thread-1-processing-n:127.0.0.1:58111_) [n:127.0.0.1:58111_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1154590 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [n:127.0.0.1:58111_ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_765495B8CB018238-001/shard-1-001/cores
[junit4] 2> 1154590 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [n:127.0.0.1:58111_ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 1154600 INFO (OverseerStateUpdate-97374585016745988-127.0.0.1:33786_-n_0000000000) [n:127.0.0.1:33786_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 1154703 INFO (zkCallback-1507-thread-1-processing-n:127.0.0.1:58111_) [n:127.0.0.1:58111_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1155614 WARN (coreLoadExecutor-2162-thread-1-processing-n:127.0.0.1:58111_) [n:127.0.0.1:58111_ c:collection1 x:collection1] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
[junit4] 2> 1155615 INFO (coreLoadExecutor-2162-thread-1-processing-n:127.0.0.1:58111_) [n:127.0.0.1:58111_ c:collection1 x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
[junit4] 2> 1155633 INFO (coreLoadExecutor-2162-thread-1-processing-n:127.0.0.1:58111_) [n:127.0.0.1:58111_ c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 1155761 WARN (coreLoadExecutor-2162-thread-1-processing-n:127.0.0.1:58111_) [n:127.0.0.1:58111_ c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 1155763 INFO (coreLoadExecutor-2162-thread-1-processing-n:127.0.0.1:58111_) [n:127.0.0.1:58111_ c:collection1 x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 1155779 INFO (coreLoadExecutor-2162-thread-1-processing-n:127.0.0.1:58111_) [n:127.0.0.1:58111_ c:collection1 x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 1155780 INFO (coreLoadExecutor-2162-thread-1-processing-n:127.0.0.1:58111_) [n:127.0.0.1:58111_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:40180/solr_hdfs_home
[junit4] 2> 1155781 INFO (coreLoadExecutor-2162-thread-1-processing-n:127.0.0.1:58111_) [n:127.0.0.1:58111_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 1155781 INFO (coreLoadExecutor-2162-thread-1-processing-n:127.0.0.1:58111_) [n:127.0.0.1:58111_ c:collection1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_765495B8CB018238-001/shard-1-001/cores/collection1], dataDir=[hdfs://localhost:40180/solr_hdfs_home/collection1/core_node1/data/]
[junit4] 2> 1155781 INFO (coreLoadExecutor-2162-thread-1-processing-n:127.0.0.1:58111_) [n:127.0.0.1:58111_ c:collection1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2f136126
[junit4] 2> 1155783 INFO (coreLoadExecutor-2162-thread-1-processing-n:127.0.0.1:58111_) [n:127.0.0.1:58111_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:40180/solr_hdfs_home/collection1/core_node1/data/snapshot_metadata
[junit4] 2> 1155795 INFO (coreLoadExecutor-2162-thread-1-processing-n:127.0.0.1:58111_) [n:127.0.0.1:58111_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 1155795 INFO (coreLoadExecutor-2162-thread-1-processing-n:127.0.0.1:58111_) [n:127.0.0.1:58111_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
[junit4] 2> 1155805 INFO (coreLoadExecutor-2162-thread-1-processing-n:127.0.0.1:58111_) [n:127.0.0.1:58111_ c:collection1 x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 1155809 INFO (coreLoadExecutor-2162-thread-1-processing-n:127.0.0.1:58111_) [n:127.0.0.1:58111_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:40180/solr_hdfs_home/collection1/core_node1/data
[junit4] 2> 1155866 INFO (coreLoadExecutor-2162-thread-1-processing-n:127.0.0.1:58111_) [n:127.0.0.1:58111_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:40180/solr_hdfs_home/collection1/core_node1/data/index
[junit4] 2> 1155918 INFO (coreLoadExecutor-2162-thread-1-processing-n:127.0.0.1:58111_) [n:127.0.0.1:58111_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 1155919 INFO (coreLoadExecutor-2162-thread-1-processing-n:127.0.0.1:58111_) [n:127.0.0.1:58111_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
[junit4] 2> 1155942 INFO (coreLoadExecutor-2162-thread-1-processing-n:127.0.0.1:58111_) [n:127.0.0.1:58111_ c:collection1 x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 1155948 INFO (coreLoadExecutor-2162-thread-1-processing-n:127.0.0.1:58111_) [n:127.0.0.1:58111_ c:collection1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1074057070, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 1156119 INFO (IPC Server handler 5 on 40180) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:37960 is added to blk_1073741826_1002{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-eb907fae-6d6a-4936-8bbf-8d4eff1e29b5:NORMAL:127.0.0.1:44103|RBW], ReplicaUC[[DISK]DS-11a74713-8e73-41df-9f4c-ab42e176baf9:NORMAL:127.0.0.1:37960|FINALIZED]]} size 0
[junit4] 2> 1156124 INFO (IPC Server handler 7 on 40180) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:44103 is added to blk_1073741826_1002{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-eb907fae-6d6a-4936-8bbf-8d4eff1e29b5:NORMAL:127.0.0.1:44103|RBW], ReplicaUC[[DISK]DS-11a74713-8e73-41df-9f4c-ab42e176baf9:NORMAL:127.0.0.1:37960|FINALIZED]]} size 0
[junit4] 2> 1156168 WARN (coreLoadExecutor-2162-thread-1-processing-n:127.0.0.1:58111_) [n:127.0.0.1:58111_ c:collection1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 1156279 INFO (coreLoadExecutor-2162-thread-1-processing-n:127.0.0.1:58111_) [n:127.0.0.1:58111_ c:collection1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
[junit4] 2> 1156279 INFO (coreLoadExecutor-2162-thread-1-processing-n:127.0.0.1:58111_) [n:127.0.0.1:58111_ c:collection1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1156279 INFO (coreLoadExecutor-2162-thread-1-processing-n:127.0.0.1:58111_) [n:127.0.0.1:58111_ c:collection1 x:collection1] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=2
[junit4] 2> 1156315 INFO (coreLoadExecutor-2162-thread-1-processing-n:127.0.0.1:58111_) [n:127.0.0.1:58111_ c:collection1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1156316 INFO (coreLoadExecutor-2162-thread-1-processing-n:127.0.0.1:58111_) [n:127.0.0.1:58111_ c:collection1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1156321 INFO (coreLoadExecutor-2162-thread-1-processing-n:127.0.0.1:58111_) [n:127.0.0.1:58111_ c:collection1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=29, maxMergeAtOnceExplicit=45, maxMergedSegmentMB=1.0751953125, floorSegmentMB=0.625, forceMergeDeletesPctAllowed=3.7412116410685146, segmentsPerTier=48.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6234715550240746
[junit4] 2> 1156386 INFO (coreLoadExecutor-2162-thread-1-processing-n:127.0.0.1:58111_) [n:127.0.0.1:58111_ c:collection1 x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@7f46abb2[collection1] main]
[junit4] 2> 1156387 INFO (coreLoadExecutor-2162-thread-1-processing-n:127.0.0.1:58111_) [n:127.0.0.1:58111_ c:collection1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1156387 INFO (coreLoadExecutor-2162-thread-1-processing-n:127.0.0.1:58111_) [n:127.0.0.1:58111_ c:collection1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1156387 INFO (coreLoadExecutor-2162-thread-1-processing-n:127.0.0.1:58111_) [n:127.0.0.1:58111_ c:collection1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 1156389 INFO (searcherExecutor-2163-thread-1-processing-n:127.0.0.1:58111_ x:collection1 c:collection1) [n:127.0.0.1:58111_ c:collection1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@7f46abb2[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1156397 INFO (coreLoadExecutor-2162-thread-1-processing-n:127.0.0.1:58111_) [n:127.0.0.1:58111_ c:collection1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1557993368377622528
[junit4] 2> 1156428 INFO (coreZkRegister-2157-thread-1-processing-n:127.0.0.1:58111_ x:collection1 c:collection1) [n:127.0.0.1:58111_ c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1156428 INFO (coreZkRegister-2157-thread-1-processing-n:127.0.0.1:58111_ x:collection1 c:collection1) [n:127.0.0.1:58111_ c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1156428 INFO (coreZkRegister-2157-thread-1-processing-n:127.0.0.1:58111_ x:collection1 c:collection1) [n:127.0.0.1:58111_ c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:58111/collection1/
[junit4] 2> 1156428 INFO (coreZkRegister-2157-thread-1-processing-n:127.0.0.1:58111_ x:collection1 c:collection1) [n:127.0.0.1:58111_ c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1156428 INFO (coreZkRegister-2157-thread-1-processing-n:127.0.0.1:58111_ x:collection1 c:collection1) [n:127.0.0.1:58111_ c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:58111/collection1/ has no replicas
[junit4] 2> 1156431 INFO (zkCallback-1507-thread-1-processing-n:127.0.0.1:58111_) [n:127.0.0.1:58111_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1156436 INFO (coreZkRegister-2157-thread-1-processing-n:127.0.0.1:58111_ x:collection1 c:collection1) [n:127.0.0.1:58111_ c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:58111/collection1/ shard1
[junit4] 2> 1156537 INFO (zkCallback-1507-thread-1-processing-n:127.0.0.1:58111_) [n:127.0.0.1:58111_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1156587 INFO (coreZkRegister-2157-thread-1-processing-n:127.0.0.1:58111_ x:collection1 c:collection1) [n:127.0.0.1:58111_ c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1156692 INFO (zkCallback-1507-thread-1-processing-n:127.0.0.1:58111_) [n:127.0.0.1:58111_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1156934 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_765495B8CB018238-001/shard-2-001/cores/collection1
[junit4] 2> 1156935 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_765495B8CB018238-001/shard-2-001
[junit4] 2> 1156937 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 1156939 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7d03d0be{/,null,AVAILABLE}
[junit4] 2> 1156939 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@a111853{HTTP/1.1,[http/1.1]}{127.0.0.1:51691}
[junit4] 2> 1156939 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.e.j.s.Server Started @1160833ms
[junit4] 2> 1156939 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:40180/hdfs__localhost_40180__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-6.x_checkout_solr_build_solr-core_test_J1_temp_solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_765495B8CB018238-001_tempDir-002_jetty2, solrconfig=solrconfig.xml, hostContext=/, hostPort=51691, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_765495B8CB018238-001/shard-2-001/cores}
[junit4] 2> 1156940 ERROR (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1156941 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 6.5.0
[junit4] 2> 1156941 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1156941 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1156941 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-01-30T23:17:41.097Z
[junit4] 2> 1156946 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1156946 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_765495B8CB018238-001/shard-2-001/solr.xml
[junit4] 2> 1156953 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1156954 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:59338/solr
[junit4] 2> 1156966 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [n:127.0.0.1:51691_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1156985 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [n:127.0.0.1:51691_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51691_
[junit4] 2> 1156993 INFO (zkCallback-1513-thread-1-processing-n:127.0.0.1:51691_) [n:127.0.0.1:51691_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1157000 INFO (zkCallback-1507-thread-1-processing-n:127.0.0.1:58111_) [n:127.0.0.1:58111_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1157000 INFO (zkCallback-1501-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1157000 INFO (zkCallback-1497-thread-3-processing-n:127.0.0.1:33786_) [n:127.0.0.1:33786_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1157056 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [n:127.0.0.1:51691_ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_765495B8CB018238-001/shard-2-001/cores
[junit4] 2> 1157056 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [n:127.0.0.1:51691_ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 1157070 INFO (OverseerStateUpdate-97374585016745988-127.0.0.1:33786_-n_0000000000) [n:127.0.0.1:33786_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 1157172 INFO (zkCallback-1507-thread-1-processing-n:127.0.0.1:58111_) [n:127.0.0.1:58111_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 1157172 INFO (zkCallback-1513-thread-1-processing-n:127.0.0.1:51691_) [n:127.0.0.1:51691_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 1158102 WARN (coreLoadExecutor-2173-thread-1-processing-n:127.0.0.1:51691_) [n:127.0.0.1:51691_ c:collection1 x:collection1] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
[junit4] 2> 1158103 INFO (coreLoadExecutor-2173-thread-1-processing-n:127.0.0.1:51691_) [n:127.0.0.1:51691_ c:collection1 x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
[junit4] 2> 1158117 INFO (coreLoadExecutor-2173-thread-1-processing-n:127.0.0.1:51691_) [n:127.0.0.1:51691_ c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 1158220 WARN (coreLoadExecutor-2173-thread-1-processing-n:127.0.0.1:51691_) [n:127.0.0.1:51691_ c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 1158222 INFO (coreLoadExecutor-2173-thread-1-processing-n:127.0.0.1:51691_) [n:127.0.0.1:51691_ c:collection1 x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 1158240 INFO (coreLoadExecutor-2173-thread-1-processing-n:127.0.0.1:51691_) [n:127.0.0.1:51691_ c:collection1 x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 1158240 INFO (coreLoadExecutor-2173-thread-1-processing-n:127.0.0.1:51691_) [n:127.0.0.1:51691_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:40180/solr_hdfs_home
[junit4] 2> 1158240 INFO (coreLoadExecutor-2173-thread-1-processing-n:127.0.0.1:51691_) [n:127.0.0.1:51691_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 1158240 INFO (coreLoadExecutor-2173-thread-1-processing-n:127.0.0.1:51691_) [n:127.0.0.1:51691_ c:collection1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_765495B8CB018238-001/shard-2-001/cores/collection1], dataDir=[hdfs://localhost:40180/solr_hdfs_home/collection1/core_node2/data/]
[junit4] 2> 1158240 INFO (coreLoadExecutor-2173-thread-1-processing-n:127.0.0.1:51691_) [n:127.0.0.1:51691_ c:collection1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2f136126
[junit4] 2> 1158241 INFO (coreLoadExecutor-2173-thread-1-processing-n:127.0.0.1:51691_) [n:127.0.0.1:51691_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:40180/solr_hdfs_home/collection1/core_node2/data/snapshot_metadata
[junit4] 2> 1158251 INFO (coreLoadExecutor-2173-thread-1-processing-n:127.0.0.1:51691_) [n:127.0.0.1:51691_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 1158251 INFO (coreLoadExecutor-2173-thread-1-processing-n:127.0.0.1:51691_) [n:127.0.0.1:51691_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
[junit4] 2> 1158260 INFO (coreLoadExecutor-2173-thread-1-processing-n:127.0.0.1:51691_) [n:127.0.0.1:51691_ c:collection1 x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 1158261 INFO (coreLoadExecutor-2173-thread-1-processing-n:127.0.0.1:51691_) [n:127.0.0.1:51691_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:40180/solr_hdfs_home/collection1/core_node2/data
[junit4] 2> 1158284 INFO (coreLoadExecutor-2173-thread-1-processing-n:127.0.0.1:51691_) [n:127.0.0.1:51691_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:40180/solr_hdfs_home/collection1/core_node2/data/index
[junit4] 2> 1158291 INFO (coreLoadExecutor-2173-thread-1-processing-n:127.0.0.1:51691_) [n:127.0.0.1:51691_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 1158291 INFO (coreLoadExecutor-2173-thread-1-processing-n:127.0.0.1:51691_) [n:127.0.0.1:51691_ c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
[junit4] 2> 1158304 INFO (coreLoadExecutor-2173-thread-1-processing-n:127.0.0.1:51691_) [n:127.0.0.1:51691_ c:collection1 x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 1158305 INFO (coreLoadExecutor-2173-thread-1-processing-n:127.0.0.1:51691_) [n:127.0.0.1:51691_ c:collection1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1074057070, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 1158356 INFO (IPC Server handler 1 on 40180) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:44103 is added to blk_1073741827_1003{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-659df4cb-91ea-4367-a007-b56c84862e7a:NORMAL:127.0.0.1:37960|RBW], ReplicaUC[[DISK]DS-ae22a632-cd5f-4c52-be91-c8876c0439cc:NORMAL:127.0.0.1:44103|FINALIZED]]} size 0
[junit4] 2> 1158363 INFO (IPC Server handler 5 on 40180) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:37960 is added to blk_1073741827_1003{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-659df4cb-91ea-4367-a007-b56c84862e7a:NORMAL:127.0.0.1:37960|RBW], ReplicaUC[[DISK]DS-ae22a632-cd5f-4c52-be91-c8876c0439cc:NORMAL:127.0.0.1:44103|FINALIZED]]} size 0
[junit4] 2> 1158377 WARN (coreLoadExecutor-2173-thread-1-processing-n:127.0.0.1:51691_) [n:127.0.0.1:51691_ c:collection1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 1158423 INFO (coreLoadExecutor-2173-thread-1-processing-n:127.0.0.1:51691_) [n:127.0.0.1:51691_ c:collection1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
[junit4] 2> 1158423 INFO (coreLoadExecutor-2173-thread-1-processing-n:127.0.0.1:51691_) [n:127.0.0.1:51691_ c:collection1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1158423 INFO (coreLoadExecutor-2173-thread-1-processing-n:127.0.0.1:51691_) [n:127.0.0.1:51691_ c:collection1 x:collection1] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=2
[junit4] 2> 1158446 INFO (coreLoadExecutor-2173-thread-1-processing-n:127.0.0.1:51691_) [n:127.0.0.1:51691_ c:collection1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1158446 INFO (coreLoadExecutor-2173-thread-1-processing-n:127.0.0.1:51691_) [n:127.0.0.1:51691_ c:collection1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1158455 INFO (coreLoadExecutor-2173-thread-1-processing-n:127.0.0.1:51691_) [n:127.0.0.1:51691_ c:collection1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=29, maxMergeAtOnceExplicit=45, maxMergedSegmentMB=1.0751953125, floorSegmentMB=0.625, forceMergeDeletesPctAllowed=3.7412116410685146, segmentsPerTier=48.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6234715550240746
[junit4] 2> 1158481 INFO (coreLoadExecutor-2173-thread-1-processing-n:127.0.0.1:51691_) [n:127.0.0.1:51691_ c:collection1 x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@303b7da1[collection1] main]
[junit4] 2> 1158484 INFO (coreLoadExecutor-2173-thread-1-processing-n:127.0.0.1:51691_) [n:127.0.0.1:51691_ c:collection1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1158485 INFO (coreLoadExecutor-2173-thread-1-processing-n:127.0.0.1:51691_) [n:127.0.0.1:51691_ c:collection1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1158485 INFO (coreLoadExecutor-2173-thread-1-processing-n:127.0.0.1:51691_) [n:127.0.0.1:51691_ c:collection1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 1158486 INFO (searcherExecutor-2174-thread-1-processing-n:127.0.0.1:51691_ x:collection1 c:collection1) [n:127.0.0.1:51691_ c:collection1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@303b7da1[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1158497 INFO (coreLoadExecutor-2173-thread-1-processing-n:127.0.0.1:51691_) [n:127.0.0.1:51691_ c:collection1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1557993370579632128
[junit4] 2> 1158502 INFO (coreZkRegister-2168-thread-1-processing-n:127.0.0.1:51691_ x:collection1 c:collection1) [n:127.0.0.1:51691_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.ZkController Core needs to recover:collection1
[junit4] 2> 1158503 INFO (updateExecutor-1510-thread-1-processing-n:127.0.0.1:51691_ x:collection1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:51691_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.u.DefaultSolrCoreState Running recovery
[junit4] 2> 1158504 INFO (recoveryExecutor-1511-thread-1-processing-n:127.0.0.1:51691_ x:collection1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:51691_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=true
[junit4] 2> 1158504 INFO (recoveryExecutor-1511-thread-1-processing-n:127.0.0.1:51691_ x:collection1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:51691_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.RecoveryStrategy ###### startupVersions=[[]]
[junit4] 2> 1158504 INFO (recoveryExecutor-1511-thread-1-processing-n:127.0.0.1:51691_ x:collection1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:51691_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.RecoveryStrategy Begin buffering updates. core=[collection1]
[junit4] 2> 1158505 INFO (recoveryExecutor-1511-thread-1-processing-n:127.0.0.1:51691_ x:collection1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:51691_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.u.UpdateLog Starting to buffer updates. HDFSUpdateLog{state=ACTIVE, tlog=null}
[junit4] 2> 1158505 INFO (recoveryExecutor-1511-thread-1-processing-n:127.0.0.1:51691_ x:collection1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:51691_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.RecoveryStrategy Publishing state of core [collection1] as recovering, leader is [http://127.0.0.1:58111/collection1/] and I am [http://127.0.0.1:51691/collection1/]
[junit4] 2> 1158515 INFO (recoveryExecutor-1511-thread-1-processing-n:127.0.0.1:51691_ x:collection1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:51691_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.RecoveryStrategy Sending prep recovery command to [http://127.0.0.1:58111]; [WaitForState: action=PREPRECOVERY&core=collection1&nodeName=127.0.0.1:51691_&coreNodeName=core_node2&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true]
[junit4] 2> 1158517 INFO (qtp657363498-6186) [n:127.0.0.1:58111_ ] o.a.s.h.a.PrepRecoveryOp Going to wait for coreNodeName: core_node2, state: recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true
[junit4] 2> 1158518 INFO (qtp657363498-6186) [n:127.0.0.1:58111_ ] o.a.s.h.a.PrepRecoveryOp Will wait a max of 183 seconds to see collection1 (shard1 of collection1) have state: recovering
[junit4] 2> 1158518 INFO (qtp657363498-6186) [n:127.0.0.1:58111_ ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard1, thisCore=collection1, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=down, localState=active, nodeName=127.0.0.1:51691_, coreNodeName=core_node2, onlyIfActiveCheckResult=false, nodeProps: core_node2:{"core":"collection1","base_url":"http://127.0.0.1:51691","node_name":"127.0.0.1:51691_","state":"down"}
[junit4] 2> 1158609 INFO (zkCallback-1507-thread-1-processing-n:127.0.0.1:58111_) [n:127.0.0.1:58111_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 1158609 INFO (zkCallback-1513-thread-1-processing-n:127.0.0.1:51691_) [n:127.0.0.1:51691_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 1158820 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_765495B8CB018238-001/shard-3-001/cores/collection1
[junit4] 2> 1158820 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_765495B8CB018238-001/shard-3-001
[junit4] 2> 1158821 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 1158831 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5eca55b2{/,null,AVAILABLE}
[junit4] 2> 1158831 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@70122c34{HTTP/1.1,[http/1.1]}{127.0.0.1:44901}
[junit4] 2> 1158831 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.e.j.s.Server Started @1162725ms
[junit4] 2> 1158832 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:40180/hdfs__localhost_40180__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-6.x_checkout_solr_build_solr-core_test_J1_temp_solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_765495B8CB018238-001_tempDir-002_jetty3, solrconfig=solrconfig.xml, hostContext=/, hostPort=44901, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_765495B8CB018238-001/shard-3-001/cores}
[junit4] 2> 1158832 ERROR (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1158841 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 6.5.0
[junit4] 2> 1158841 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1158841 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1158842 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-01-30T23:17:42.997Z
[junit4] 2> 1158866 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1158866 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_765495B8CB018238-001/shard-3-001/solr.xml
[junit4] 2> 1158891 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1158892 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:59338/solr
[junit4] 2> 1158919 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [n:127.0.0.1:44901_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 1158923 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [n:127.0.0.1:44901_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44901_
[junit4] 2> 1158937 INFO (zkCallback-1501-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1158937 INFO (zkCallback-1513-thread-1-processing-n:127.0.0.1:51691_) [n:127.0.0.1:51691_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1158938 INFO (zkCallback-1507-thread-1-processing-n:127.0.0.1:58111_) [n:127.0.0.1:58111_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1158937 INFO (zkCallback-1497-thread-2-processing-n:127.0.0.1:33786_) [n:127.0.0.1:33786_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1158952 INFO (zkCallback-1520-thread-2-processing-n:127.0.0.1:44901_) [n:127.0.0.1:44901_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1159029 INFO (zkCallback-1513-thread-1-processing-n:127.0.0.1:51691_) [n:127.0.0.1:51691_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1159029 INFO (zkCallback-1507-thread-1-processing-n:127.0.0.1:58111_) [n:127.0.0.1:58111_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1159048 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [n:127.0.0.1:44901_ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_765495B8CB018238-001/shard-3-001/cores
[junit4] 2> 1159048 INFO (TEST-HdfsWriteToMultipleCollectionsTest.test-seed#[765495B8CB018238]) [n:127.0.0.1:44901_ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 1159053 INFO (OverseerStateUpdate-97374585016745988-127.0.0.1:33786_-n_0000000000) [n:127.0.0.1:33786_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 1159155 INFO (zkCallback-1507-thread-1-processing-n:127.0.0.1:58111_) [n:127.0.0.1:58111_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1159156 INFO (zkCallback-1513-thread-1-processing-n:127.0.0.1:51691_) [n:127.0.0.1:51691_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1159156 INFO (zkCallback-1520-thread-2-processing-n:127.0.0.1:44901_) [n:127.0.0.1:44901_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1159518 INFO (qtp657363498-6186) [n:127.0.0.1:58111_ ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard1, thisCore=collection1, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=recovering, localState=active, nodeName=127.0.0.1:51691_, coreNodeName=core_node2, onlyIfActiveCheckResult=false, nodeProps: core_node2:{"core":"collection1","dataDir":"hdfs://localhost:40180/solr_hdfs_home/collection1/core_node2/data/","base_url":"http://127.0.0.1:51691","node_name":"127.0.0.1:51691_","state":"recovering","ulogDir":"hdfs://localhost:40180/solr_hdfs_home/collection1/core_node2/data/tlog"}
[junit4] 2> 1159518 INFO (qtp657363498-6186) [n:127.0.0.1:58111_ ] o.a.s.h.a.PrepRecoveryOp Waited coreNodeName: core_node2, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4] 2> 1159518 INFO (qtp657363498-6186) [n:127.0.0.1:58111_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={nodeName=127.0.0.1:51691_&onlyIfLeaderActive=true&core=collection1&coreNodeName=core_node2&action=PREPRECOVERY&checkLive=true&state=recovering&onlyIfLeader=true&wt=javabin&version=2} status=0 QTime=1001
[junit4] 2> 1160077 WARN (coreLoadExecutor-2184-thread-1-processing-n:127.0.0.1:44901_) [n:127.0.0.1:44901_ c:collection1 x:collection1] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
[junit4] 2> 1160078 INFO (coreLoadExecutor-2184-thread-1-processing-n:127.0.0.1:44901_) [n:127.0.0.1:44901_ c:collection1 x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
[junit4] 2> 1160102 INFO (coreLoadExecutor-2184-thread-1-processing-n:127.0.0.1:44901_) [n:127.0.0.1:44901_ c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 1160230 WARN (coreLoadExecutor-2184-thread-1-processing-n:127.0.0.1:44901_) [n:127.0.0.1:44901_ c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 1160231 INFO (coreLoadExecutor-2184-thread-1-processing-n:127.0.0.1:44901_) [n:127.0.0.1:44901_ c:collection1 x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 1160249 INFO (coreLoadExecutor-2184-thread-1-processing-n:127.0.0.1:44901_) [n:127.0.0.1:44901_ c:collection1 x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 1160249 INFO (coreLoadExecutor-2184-thread-1-processing-n:127.0.0.1:44901_) [n:127.0.0.1:44901_ c:collect
[...truncated too long message...]
junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stop(MetricsSystemImpl.java:213)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.shutdown(MetricsSystemImpl.java:594)
[junit4] 2> at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdownInstance(DefaultMetricsSystem.java:72)
[junit4] 2> at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdown(DefaultMetricsSystem.java:68)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.metrics.NameNodeMetrics.shutdown(NameNodeMetrics.java:171)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.NameNode.stop(NameNode.java:872)
[junit4] 2> at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1726)
[junit4] 2> at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1705)
[junit4] 2> at org.apache.solr.cloud.hdfs.HdfsTestUtil.teardownClass(HdfsTestUtil.java:198)
[junit4] 2> at org.apache.solr.cloud.hdfs.StressHdfsTest.teardownClass(StressHdfsTest.java:77)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:498)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:870)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> Caused by: java.lang.NullPointerException
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlocksMap.size(BlocksMap.java:203)
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.getTotalBlocks(BlockManager.java:3370)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlocksTotal(FSNamesystem.java:5729)
[junit4] 2> ... 53 more
[junit4] 2> 5339426 INFO (SUITE-StressHdfsTest-seed#[765495B8CB018238]-worker) [ ] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.StressHdfsTest_765495B8CB018238-001
[junit4] 2> Jan 31, 2017 12:27:23 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 35 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene62): {range_facet_l_dv=PostingsFormat(name=Memory doPackFST= true), _version_=PostingsFormat(name=Memory doPackFST= false), multiDefault=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), intDefault=PostingsFormat(name=Memory doPackFST= false), id=PostingsFormat(name=Memory doPackFST= true), range_facet_i_dv=PostingsFormat(name=Memory doPackFST= false), text=FST50, range_facet_l=PostingsFormat(name=Memory doPackFST= false), timestamp=PostingsFormat(name=Memory doPackFST= false), txt_t=FST50}, docValues:{range_facet_l_dv=DocValuesFormat(name=Lucene54), range_facet_i_dv=DocValuesFormat(name=Lucene54), timestamp=DocValuesFormat(name=Lucene54)}, maxPointsInLeafNode=561, maxMBSortInHeap=7.02527385553887, sim=RandomSimilarity(queryNorm=true,coord=yes): {}, locale=ar-JO, timezone=Canada/Newfoundland
[junit4] 2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_102 (64-bit)/cpus=4,threads=2,free=245339256,total=535298048
[junit4] 2> NOTE: All tests run in this JVM: [TestXIncludeConfig, TestFieldCacheSortRandom, TestMinMaxOnMultiValuedField, CoreAdminCreateDiscoverTest, ConnectionManagerTest, PrimUtilsTest, TestUtils, DistributedExpandComponentTest, TestExactSharedStatsCache, DistributedSuggestComponentTest, TestRawTransformer, DocValuesMissingTest, TestPhraseSuggestions, TestGroupingSearch, RulesTest, TestConfigSetsAPIExclusivity, TestReloadAndDeleteDocs, HdfsLockFactoryTest, TestConfigReload, SharedFSAutoReplicaFailoverTest, TestRandomCollapseQParserPlugin, TestMiniSolrCloudClusterSSL, OverseerStatusTest, DistributedFacetPivotLongTailTest, TestDeleteCollectionOnDownNodes, SSLMigrationTest, CdcrBootstrapTest, BasicAuthIntegrationTest, TestSolrCoreSnapshots, TestStressUserVersions, HdfsRestartWhileUpdatingTest, ZkStateWriterTest, TestClusterProperties, MinimalSchemaTest, TestCollationField, TestLegacyFieldCache, ReplicationFactorTest, HdfsChaosMonkeyNothingIsSafeTest, TestPKIAuthenticationPlugin, TolerantUpdateProcessorTest, SmileWriterTest, DOMUtilTest, QueryParsingTest, HdfsNNFailoverTest, IgnoreCommitOptimizeUpdateProcessorFactoryTest, UpdateParamsTest, DirectUpdateHandlerOptimizeTest, OverseerCollectionConfigSetProcessorTest, TestExtendedDismaxParser, TestReversedWildcardFilterFactory, AssignTest, TestAuthenticationFramework, DistribCursorPagingTest, TestTolerantUpdateProcessorRandomCloud, TestIndexingPerformance, TestCoreDiscovery, DocValuesMultiTest, HighlighterMaxOffsetTest, TestAnalyzedSuggestions, LukeRequestHandlerTest, TestSQLHandlerNonCloud, SuggesterTSTTest, TestFieldTypeResource, TestAnalyzeInfixSuggestions, TestFreeTextSuggestions, TestSolrQueryParser, DebugComponentTest, SuggesterTest, TestBulkSchemaAPI, TestStressCloudBlindAtomicUpdates, TestIndexSearcher, RecoveryZkTest, TestJmxMonitoredMap, TestZkChroot, BadIndexSchemaTest, SimpleFacetsTest, ResponseLogComponentTest, TestSolrQueryParserDefaultOperatorResource, TestLFUCache, TestConfig, TestDistributedMissingSort, TestFieldCacheReopen, SolrTestCaseJ4Test, PluginInfoTest, TestDefaultSearchFieldResource, TestExclusionRuleCollectionAccess, TestSolrDeletionPolicy1, OverseerTest, DistributedQueueTest, LeaderFailoverAfterPartitionTest, TestManagedSchemaThreadSafety, TestRecovery, StatelessScriptUpdateProcessorFactoryTest, TestUninvertingReader, RecoveryAfterSoftCommitTest, DeleteInactiveReplicaTest, OpenExchangeRatesOrgProviderTest, TestRequestForwarding, ShufflingReplicaListTransformerTest, LeaderInitiatedRecoveryOnShardRestartTest, CollectionStateFormat2Test, TestCloudManagedSchema, CollectionsAPISolrJTest, CurrencyFieldXmlFileTest, BJQParserTest, RequestHandlersTest, SegmentsInfoRequestHandlerTest, TestSchemaSimilarityResource, ChaosMonkeySafeLeaderTest, BasicDistributedZk2Test, UnloadDistributedZkTest, CollectionsAPIDistributedZkTest, SyncSliceTest, LeaderElectionIntegrationTest, FullSolrCloudDistribCmdsTest, ShardRoutingCustomTest, AutoCommitTest, TestDistributedGrouping, TermVectorComponentDistributedTest, TestStressReorder, DistributedTermsComponentTest, SolrCoreTest, SpellCheckComponentTest, ConvertedLegacyTest, TestSort, ShowFileRequestHandlerTest, CurrencyFieldOpenExchangeTest, SolrRequestParserTest, TestStressLucene, TestTrie, SuggesterWFSTTest, SolrCoreCheckLockOnStartupTest, FieldMutatingUpdateProcessorTest, TestRemoteStreaming, DisMaxRequestHandlerTest, PrimitiveFieldTypeTest, TestOmitPositions, XmlUpdateRequestHandlerTest, RequiredFieldsTest, RegexBoostProcessorTest, SolrPluginUtilsTest, ReturnFieldsTest, MBeansHandlerTest, CSVRequestHandlerTest, SOLR749Test, TestQuerySenderListener, AlternateDirectoryTest, TestSolrIndexConfig, CopyFieldTest, SolrIndexConfigTest, BadComponentTest, TestStressRecovery, TestTolerantSearch, ConnectionReuseTest, CdcrRequestHandlerTest, ConfigSetsAPITest, CustomCollectionTest, DeleteLastCustomShardedReplicaTest, DeleteShardTest, DeleteStatusTest, DistribJoinFromCollectionTest, DistributedVersionInfoTest, HttpPartitionTest, OverriddenZkACLAndCredentialsProvidersTest, OverseerModifyCollectionTest, PeerSyncReplicationTest, ShardSplitTest, TestRandomRequestDistribution, TestSegmentSorting, TlogReplayBufferedWhileIndexingTest, HdfsThreadLeakTest, HdfsTlogReplayBufferedWhileIndexingTest, StressHdfsTest]
[junit4] Completed [552/681 (2!)] on J2 in 191.14s, 1 test, 1 error <<< FAILURES!
[...truncated 62826 lines...]
[JENKINS] Lucene-Solr-NightlyTests-6.x - Build # 270 - Failure
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.x/270/
13 tests failed.
FAILED: org.apache.lucene.index.TestDuelingCodecsAtNight.testBigEquals
Error Message:
this IndexWriter is closed
Stack Trace:
org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed
at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:753)
at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:767)
at org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1388)
at org.apache.lucene.index.IndexWriter.addDocuments(IndexWriter.java:1368)
at org.apache.lucene.index.RandomIndexWriter.addDocument(RandomIndexWriter.java:141)
at org.apache.lucene.index.TestDuelingCodecs.createRandomIndex(TestDuelingCodecs.java:139)
at org.apache.lucene.index.TestDuelingCodecsAtNight.testBigEquals(TestDuelingCodecsAtNight.java:34)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.OutOfMemoryError: Java heap space
at org.apache.lucene.util.fst.FST.<init>(FST.java:387)
at org.apache.lucene.util.fst.FST.<init>(FST.java:313)
at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsReader.<init>(MemoryPostingsFormat.java:894)
at org.apache.lucene.codecs.memory.MemoryPostingsFormat.fieldsProducer(MemoryPostingsFormat.java:977)
at org.apache.lucene.codecs.perfield.PerFieldPostingsFormat$FieldsReader.<init>(PerFieldPostingsFormat.java:292)
at org.apache.lucene.codecs.perfield.PerFieldPostingsFormat.fieldsProducer(PerFieldPostingsFormat.java:372)
at org.apache.lucene.index.SegmentCoreReaders.<init>(SegmentCoreReaders.java:109)
at org.apache.lucene.index.SegmentReader.<init>(SegmentReader.java:74)
at org.apache.lucene.index.ReadersAndUpdates.getReader(ReadersAndUpdates.java:145)
at org.apache.lucene.index.ReadersAndUpdates.getReaderForMerge(ReadersAndUpdates.java:617)
at org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4293)
at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3940)
at org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:588)
at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:626)
FAILED: org.apache.solr.cloud.CdcrReplicationDistributedZkTest.testResilienceWithDeleteByQueryOnTarget
Error Message:
Timeout waiting for CDCR replication to complete @source_collection:shard1
Stack Trace:
java.lang.RuntimeException: Timeout waiting for CDCR replication to complete @source_collection:shard1
at __randomizedtesting.SeedInfo.seed([3B9331F093ABD89B:9BF1A36A43F21DDE]:0)
at org.apache.solr.cloud.BaseCdcrDistributedZkTest.waitForReplicationToComplete(BaseCdcrDistributedZkTest.java:795)
at org.apache.solr.cloud.CdcrReplicationDistributedZkTest.testResilienceWithDeleteByQueryOnTarget(CdcrReplicationDistributedZkTest.java:588)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates.test_dv_idx
Error Message:
There are still nodes recoverying - waited for 330 seconds
Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 330 seconds
at __randomizedtesting.SeedInfo.seed([3B9331F093ABD89B:AEEF44384F77757A]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:187)
at org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates.waitForRecoveriesToFinish(TestStressCloudBlindAtomicUpdates.java:459)
at org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates.checkField(TestStressCloudBlindAtomicUpdates.java:304)
at org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates.test_dv_idx(TestStressCloudBlindAtomicUpdates.java:224)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest
Error Message:
ObjectTracker found 1 object(s) that were not released!!! [HdfsTransactionLog] org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:43) at org.apache.solr.update.HdfsTransactionLog.<init>(HdfsTransactionLog.java:130) at org.apache.solr.update.HdfsTransactionLog.<init>(HdfsTransactionLog.java:74) at org.apache.solr.update.HdfsUpdateLog.ensureLog(HdfsUpdateLog.java:313) at org.apache.solr.update.UpdateLog.deleteByQuery(UpdateLog.java:543) at org.apache.solr.update.DirectUpdateHandler2.deleteByQuery(DirectUpdateHandler2.java:464) at org.apache.solr.update.processor.RunUpdateProcessor.processDelete(RunUpdateProcessorFactory.java:78) at org.apache.solr.update.processor.UpdateRequestProcessor.processDelete(UpdateRequestProcessor.java:52) at org.apache.solr.update.processor.DistributedUpdateProcessor.doLocalDelete(DistributedUpdateProcessor.java:960) at org.apache.solr.update.processor.DistributedUpdateProcessor.versionDeleteByQuery(DistributedUpdateProcessor.java:1455) at org.apache.solr.update.processor.DistributedUpdateProcessor.doDeleteByQuery(DistributedUpdateProcessor.java:1348) at org.apache.solr.update.processor.DistributedUpdateProcessor.processDelete(DistributedUpdateProcessor.java:1157) at org.apache.solr.update.processor.LogUpdateProcessorFactory$LogUpdateProcessor.processDelete(LogUpdateProcessorFactory.java:124) at org.apache.solr.handler.loader.JavabinLoader.delete(JavabinLoader.java:159) at org.apache.solr.handler.loader.JavabinLoader.parseAndLoadDocs(JavabinLoader.java:112) at org.apache.solr.handler.loader.JavabinLoader.load(JavabinLoader.java:54) at org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:97) at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:68) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:166) at org.apache.solr.core.SolrCore.execute(SolrCore.java:2384) at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:658) at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:464) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:345) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:296) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1699) at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:110) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1699) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:395) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134) at org.eclipse.jetty.server.Server.handle(Server.java:534) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:273) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:202) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:273) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95) at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) at java.lang.Thread.run(Thread.java:745)
Stack Trace:
java.lang.AssertionError: ObjectTracker found 1 object(s) that were not released!!! [HdfsTransactionLog]
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException
at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:43)
at org.apache.solr.update.HdfsTransactionLog.<init>(HdfsTransactionLog.java:130)
at org.apache.solr.update.HdfsTransactionLog.<init>(HdfsTransactionLog.java:74)
at org.apache.solr.update.HdfsUpdateLog.ensureLog(HdfsUpdateLog.java:313)
at org.apache.solr.update.UpdateLog.deleteByQuery(UpdateLog.java:543)
at org.apache.solr.update.DirectUpdateHandler2.deleteByQuery(DirectUpdateHandler2.java:464)
at org.apache.solr.update.processor.RunUpdateProcessor.processDelete(RunUpdateProcessorFactory.java:78)
at org.apache.solr.update.processor.UpdateRequestProcessor.processDelete(UpdateRequestProcessor.java:52)
at org.apache.solr.update.processor.DistributedUpdateProcessor.doLocalDelete(DistributedUpdateProcessor.java:960)
at org.apache.solr.update.processor.DistributedUpdateProcessor.versionDeleteByQuery(DistributedUpdateProcessor.java:1455)
at org.apache.solr.update.processor.DistributedUpdateProcessor.doDeleteByQuery(DistributedUpdateProcessor.java:1348)
at org.apache.solr.update.processor.DistributedUpdateProcessor.processDelete(DistributedUpdateProcessor.java:1157)
at org.apache.solr.update.processor.LogUpdateProcessorFactory$LogUpdateProcessor.processDelete(LogUpdateProcessorFactory.java:124)
at org.apache.solr.handler.loader.JavabinLoader.delete(JavabinLoader.java:159)
at org.apache.solr.handler.loader.JavabinLoader.parseAndLoadDocs(JavabinLoader.java:112)
at org.apache.solr.handler.loader.JavabinLoader.load(JavabinLoader.java:54)
at org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:97)
at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:68)
at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:166)
at org.apache.solr.core.SolrCore.execute(SolrCore.java:2384)
at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:658)
at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:464)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:345)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:296)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1699)
at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:110)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1699)
at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:395)
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
at org.eclipse.jetty.server.Server.handle(Server.java:534)
at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:273)
at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)
at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:202)
at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:273)
at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)
at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
at java.lang.Thread.run(Thread.java:745)
at __randomizedtesting.SeedInfo.seed([3B9331F093ABD89B]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNull(Assert.java:551)
at org.apache.solr.SolrTestCaseJ4.teardownTestCases(SolrTestCaseJ4.java:269)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:870)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.addReplicaTest
Error Message:
Could not find collection : addReplicaColl
Stack Trace:
org.apache.solr.common.SolrException: Could not find collection : addReplicaColl
at __randomizedtesting.SeedInfo.seed([3B9331F093ABD89B:A83366D61DA3934A]:0)
at org.apache.solr.common.cloud.ClusterState.getCollection(ClusterState.java:194)
at org.apache.solr.cloud.SolrCloudTestCase.getCollectionState(SolrCloudTestCase.java:245)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.addReplicaTest(CollectionsAPIDistributedZkTest.java:666)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.testDeleteNonExistentCollection
Error Message:
Collection creation after a bad delete failed null Last available state: null
Stack Trace:
java.lang.AssertionError: Collection creation after a bad delete failed
null
Last available state: null
at __randomizedtesting.SeedInfo.seed([3B9331F093ABD89B:DCB421CD84C8A762]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.SolrCloudTestCase.waitForState(SolrCloudTestCase.java:265)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testDeleteNonExistentCollection(CollectionsAPIDistributedZkTest.java:418)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.deleteCollectionOnlyInZk
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([3B9331F093ABD89B:8F736D7165AD788A]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertTrue(Assert.java:54)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.deleteCollectionOnlyInZk(CollectionsAPIDistributedZkTest.java:184)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.testNoCollectionSpecified
Error Message:
Error from server at http://127.0.0.1:47939/solr: Error CREATEing SolrCore 'corewithnocollection': Unable to create core [corewithnocollection] Caused by: Direct buffer memory
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:47939/solr: Error CREATEing SolrCore 'corewithnocollection': Unable to create core [corewithnocollection] Caused by: Direct buffer memory
at __randomizedtesting.SeedInfo.seed([3B9331F093ABD89B:4830B10027C38DB9]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:610)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:279)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:268)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:435)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:387)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1344)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:1095)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:1037)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testNoCollectionSpecified(CollectionsAPIDistributedZkTest.java:333)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.testCollectionReload
Error Message:
Could not find collection : reloaded_collection
Stack Trace:
org.apache.solr.common.SolrException: Could not find collection : reloaded_collection
at __randomizedtesting.SeedInfo.seed([3B9331F093ABD89B:3A2A1DCE46247704]:0)
at org.apache.solr.common.cloud.ClusterState.getCollection(ClusterState.java:194)
at org.apache.solr.cloud.SolrCloudTestCase.getCollectionState(SolrCloudTestCase.java:245)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.collectStartTimes(CollectionsAPIDistributedZkTest.java:588)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionReload(CollectionsAPIDistributedZkTest.java:529)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.deletePartiallyCreatedCollection
Error Message:
Error from server at http://127.0.0.1:47939/solr: Error CREATEing SolrCore 'halfdeletedcollection_shard1_replica1': Unable to create core [halfdeletedcollection_shard1_replica1] Caused by: Direct buffer memory
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:47939/solr: Error CREATEing SolrCore 'halfdeletedcollection_shard1_replica1': Unable to create core [halfdeletedcollection_shard1_replica1] Caused by: Direct buffer memory
at __randomizedtesting.SeedInfo.seed([3B9331F093ABD89B:11135D152471F853]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:610)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:279)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:268)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:435)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:387)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1344)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:1095)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:1037)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:149)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:166)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.deletePartiallyCreatedCollection(CollectionsAPIDistributedZkTest.java:155)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.testCoresAreDistributedAcrossNodes
Error Message:
Could not find collection : nodes_used_collection
Stack Trace:
org.apache.solr.common.SolrException: Could not find collection : nodes_used_collection
at __randomizedtesting.SeedInfo.seed([3B9331F093ABD89B:5FD3E49C2865508A]:0)
at org.apache.solr.common.cloud.ClusterState.getCollection(ClusterState.java:194)
at org.apache.solr.cloud.SolrCloudTestCase.getCollectionState(SolrCloudTestCase.java:245)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCoresAreDistributedAcrossNodes(CollectionsAPIDistributedZkTest.java:397)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.core.HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig
Error Message:
The max direct memory is likely too low. Either increase it (by adding -XX:MaxDirectMemorySize=<size>g -XX:+UseLargePages to your containers startup args) or disable direct allocation using solr.hdfs.blockcache.direct.memory.allocation=false in solrconfig.xml. If you are putting the block cache on the heap, your java heap size might not be large enough. Failed allocating ~134.217728 MB.
Stack Trace:
java.lang.RuntimeException: The max direct memory is likely too low. Either increase it (by adding -XX:MaxDirectMemorySize=<size>g -XX:+UseLargePages to your containers startup args) or disable direct allocation using solr.hdfs.blockcache.direct.memory.allocation=false in solrconfig.xml. If you are putting the block cache on the heap, your java heap size might not be large enough. Failed allocating ~134.217728 MB.
at __randomizedtesting.SeedInfo.seed([3B9331F093ABD89B:CC3CF8DB6E2232B0]:0)
at org.apache.solr.core.HdfsDirectoryFactory.createBlockCache(HdfsDirectoryFactory.java:307)
at org.apache.solr.core.HdfsDirectoryFactory.getBlockDirectoryCache(HdfsDirectoryFactory.java:283)
at org.apache.solr.core.HdfsDirectoryFactory.create(HdfsDirectoryFactory.java:223)
at org.apache.solr.core.HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig(HdfsDirectoryFactoryTest.java:108)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.OutOfMemoryError: Direct buffer memory
at java.nio.Bits.reserveMemory(Bits.java:693)
at java.nio.DirectByteBuffer.<init>(DirectByteBuffer.java:123)
at java.nio.ByteBuffer.allocateDirect(ByteBuffer.java:311)
at org.apache.solr.store.blockcache.BlockCache.<init>(BlockCache.java:68)
at org.apache.solr.core.HdfsDirectoryFactory.createBlockCache(HdfsDirectoryFactory.java:305)
... 42 more
FAILED: org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest.test
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([3B9331F093ABD89B:B3C70E2A3D57B563]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertTrue(Assert.java:54)
at org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest.test(HdfsWriteToMultipleCollectionsTest.java:137)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 1769 lines...]
[junit4] Suite: org.apache.lucene.index.TestDuelingCodecsAtNight
[junit4] 2> Jan 29, 2017 5:58:28 PM com.carrotsearch.randomizedtesting.RandomizedRunner$QueueUncaughtExceptionsHandler uncaughtException
[junit4] 2> WARNING: Uncaught exception in thread: Thread[Lucene Merge Thread #68,5,TGRP-TestDuelingCodecsAtNight]
[junit4] 2> org.apache.lucene.index.MergePolicy$MergeException: java.lang.OutOfMemoryError: GC overhead limit exceeded
[junit4] 2> at __randomizedtesting.SeedInfo.seed([33A86C2D6AE828D0]:0)
[junit4] 2> at org.apache.lucene.index.ConcurrentMergeScheduler.handleMergeException(ConcurrentMergeScheduler.java:668)
[junit4] 2> at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:648)
[junit4] 2> Caused by: java.lang.OutOfMemoryError: GC overhead limit exceeded
[junit4] 2> at org.apache.lucene.util.BytesRef.deepCopyOf(BytesRef.java:206)
[junit4] 2> at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finishTerm(MemoryPostingsFormat.java:254)
[junit4] 2> at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.access$500(MemoryPostingsFormat.java:109)
[junit4] 2> at org.apache.lucene.codecs.memory.MemoryPostingsFormat$MemoryFieldsConsumer.write(MemoryPostingsFormat.java:396)
[junit4] 2> at org.apache.lucene.codecs.FieldsConsumer.merge(FieldsConsumer.java:105)
[junit4] 2> at org.apache.lucene.codecs.perfield.PerFieldPostingsFormat$FieldsWriter.merge(PerFieldPostingsFormat.java:164)
[junit4] 2> at org.apache.lucene.index.SegmentMerger.mergeTerms(SegmentMerger.java:216)
[junit4] 2> at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:101)
[junit4] 2> at org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4363)
[junit4] 2> at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3940)
[junit4] 2> at org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:588)
[junit4] 2> at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:626)
[junit4] 2>
[junit4] 2> Jan 29, 2017 5:58:28 PM com.carrotsearch.randomizedtesting.RandomizedRunner$QueueUncaughtExceptionsHandler uncaughtException
[junit4] 2> WARNING: Uncaught exception in thread: Thread[Lucene Merge Thread #69,5,TGRP-TestDuelingCodecsAtNight]
[junit4] 2> org.apache.lucene.index.MergePolicy$MergeException: java.lang.OutOfMemoryError: Java heap space
[junit4] 2> at __randomizedtesting.SeedInfo.seed([33A86C2D6AE828D0]:0)
[junit4] 2> at org.apache.lucene.index.ConcurrentMergeScheduler.handleMergeException(ConcurrentMergeScheduler.java:668)
[junit4] 2> at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:648)
[junit4] 2> Caused by: java.lang.OutOfMemoryError: Java heap space
[junit4] 2> at org.apache.lucene.util.fst.FST.<init>(FST.java:387)
[junit4] 2> at org.apache.lucene.util.fst.FST.<init>(FST.java:313)
[junit4] 2> at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsReader.<init>(MemoryPostingsFormat.java:894)
[junit4] 2> at org.apache.lucene.codecs.memory.MemoryPostingsFormat.fieldsProducer(MemoryPostingsFormat.java:977)
[junit4] 2> at org.apache.lucene.codecs.perfield.PerFieldPostingsFormat$FieldsReader.<init>(PerFieldPostingsFormat.java:292)
[junit4] 2> at org.apache.lucene.codecs.perfield.PerFieldPostingsFormat.fieldsProducer(PerFieldPostingsFormat.java:372)
[junit4] 2> at org.apache.lucene.index.SegmentCoreReaders.<init>(SegmentCoreReaders.java:109)
[junit4] 2> at org.apache.lucene.index.SegmentReader.<init>(SegmentReader.java:74)
[junit4] 2> at org.apache.lucene.index.ReadersAndUpdates.getReader(ReadersAndUpdates.java:145)
[junit4] 2> at org.apache.lucene.index.ReadersAndUpdates.getReaderForMerge(ReadersAndUpdates.java:617)
[junit4] 2> at org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4293)
[junit4] 2> at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3940)
[junit4] 2> at org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:588)
[junit4] 2> at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:626)
[junit4] 2>
[junit4] 2> Jan 29, 2017 5:58:28 PM com.carrotsearch.randomizedtesting.RandomizedRunner$QueueUncaughtExceptionsHandler uncaughtException
[junit4] 2> WARNING: Uncaught exception in thread: Thread[Lucene Merge Thread #64,5,TGRP-TestDuelingCodecsAtNight]
[junit4] 2> org.apache.lucene.index.MergePolicy$MergeException: java.lang.OutOfMemoryError: Java heap space
[junit4] 2> at __randomizedtesting.SeedInfo.seed([33A86C2D6AE828D0]:0)
[junit4] 2> at org.apache.lucene.index.ConcurrentMergeScheduler.handleMergeException(ConcurrentMergeScheduler.java:668)
[junit4] 2> at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:648)
[junit4] 2> Caused by: java.lang.OutOfMemoryError: Java heap space
[junit4] 2> at org.apache.lucene.util.fst.BytesStore.skipBytes(BytesStore.java:307)
[junit4] 2> at org.apache.lucene.util.fst.FST.addNode(FST.java:792)
[junit4] 2> at org.apache.lucene.util.fst.NodeHash.add(NodeHash.java:126)
[junit4] 2> at org.apache.lucene.util.fst.Builder.compileNode(Builder.java:214)
[junit4] 2> at org.apache.lucene.util.fst.Builder.freezeTail(Builder.java:310)
[junit4] 2> at org.apache.lucene.util.fst.Builder.add(Builder.java:414)
[junit4] 2> at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finishTerm(MemoryPostingsFormat.java:254)
[junit4] 2> at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.access$500(MemoryPostingsFormat.java:109)
[junit4] 2> at org.apache.lucene.codecs.memory.MemoryPostingsFormat$MemoryFieldsConsumer.write(MemoryPostingsFormat.java:396)
[junit4] 2> at org.apache.lucene.codecs.FieldsConsumer.merge(FieldsConsumer.java:105)
[junit4] 2> at org.apache.lucene.codecs.perfield.PerFieldPostingsFormat$FieldsWriter.merge(PerFieldPostingsFormat.java:164)
[junit4] 2> at org.apache.lucene.index.SegmentMerger.mergeTerms(SegmentMerger.java:216)
[junit4] 2> at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:101)
[junit4] 2> at org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4363)
[junit4] 2> at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3940)
[junit4] 2> at org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:588)
[junit4] 2> at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:626)
[junit4] 2>
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestDuelingCodecsAtNight -Dtests.method=testBigEquals -Dtests.seed=33A86C2D6AE828D0 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/test-data/enwiki.random.lines.txt -Dtests.locale=en-ZA -Dtests.timezone=America/Thule -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[junit4] ERROR 1624s J1 | TestDuelingCodecsAtNight.testBigEquals <<<
[junit4] > Throwable #1: org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed
[junit4] > at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:753)
[junit4] > at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:767)
[junit4] > at org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1388)
[junit4] > at org.apache.lucene.index.IndexWriter.addDocuments(IndexWriter.java:1368)
[junit4] > at org.apache.lucene.index.RandomIndexWriter.addDocument(RandomIndexWriter.java:141)
[junit4] > at org.apache.lucene.index.TestDuelingCodecs.createRandomIndex(TestDuelingCodecs.java:139)
[junit4] > at org.apache.lucene.index.TestDuelingCodecsAtNight.testBigEquals(TestDuelingCodecsAtNight.java:34)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > Caused by: java.lang.OutOfMemoryError: Java heap space
[junit4] > at org.apache.lucene.util.fst.FST.<init>(FST.java:387)
[junit4] > at org.apache.lucene.util.fst.FST.<init>(FST.java:313)
[junit4] > at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsReader.<init>(MemoryPostingsFormat.java:894)
[junit4] > at org.apache.lucene.codecs.memory.MemoryPostingsFormat.fieldsProducer(MemoryPostingsFormat.java:977)
[junit4] > at org.apache.lucene.codecs.perfield.PerFieldPostingsFormat$FieldsReader.<init>(PerFieldPostingsFormat.java:292)
[junit4] > at org.apache.lucene.codecs.perfield.PerFieldPostingsFormat.fieldsProducer(PerFieldPostingsFormat.java:372)
[junit4] > at org.apache.lucene.index.SegmentCoreReaders.<init>(SegmentCoreReaders.java:109)
[junit4] > at org.apache.lucene.index.SegmentReader.<init>(SegmentReader.java:74)
[junit4] > at org.apache.lucene.index.ReadersAndUpdates.getReader(ReadersAndUpdates.java:145)
[junit4] > at org.apache.lucene.index.ReadersAndUpdates.getReaderForMerge(ReadersAndUpdates.java:617)
[junit4] > at org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4293)
[junit4] > at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3940)
[junit4] > at org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:588)
[junit4] > at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:626)Throwable #2: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=22771, name=Lucene Merge Thread #68, state=RUNNABLE, group=TGRP-TestDuelingCodecsAtNight]
[junit4] > Caused by: org.apache.lucene.index.MergePolicy$MergeException: java.lang.OutOfMemoryError: GC overhead limit exceeded
[junit4] > at __randomizedtesting.SeedInfo.seed([33A86C2D6AE828D0]:0)
[junit4] > at org.apache.lucene.index.ConcurrentMergeScheduler.handleMergeException(ConcurrentMergeScheduler.java:668)
[junit4] > at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:648)
[junit4] > Caused by: java.lang.OutOfMemoryError: GC overhead limit exceeded
[junit4] > at org.apache.lucene.util.BytesRef.deepCopyOf(BytesRef.java:206)
[junit4] > at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finishTerm(MemoryPostingsFormat.java:254)
[junit4] > at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.access$500(MemoryPostingsFormat.java:109)
[junit4] > at org.apache.lucene.codecs.memory.MemoryPostingsFormat$MemoryFieldsConsumer.write(MemoryPostingsFormat.java:396)
[junit4] > at org.apache.lucene.codecs.FieldsConsumer.merge(FieldsConsumer.java:105)
[junit4] > at org.apache.lucene.codecs.perfield.PerFieldPostingsFormat$FieldsWriter.merge(PerFieldPostingsFormat.java:164)
[junit4] > at org.apache.lucene.index.SegmentMerger.mergeTerms(SegmentMerger.java:216)
[junit4] > at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:101)
[junit4] > at org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4363)
[junit4] > at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3940)
[junit4] > at org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:588)
[junit4] > at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:626)Throwable #3: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=22767, name=Lucene Merge Thread #64, state=RUNNABLE, group=TGRP-TestDuelingCodecsAtNight]
[junit4] > Caused by: org.apache.lucene.index.MergePolicy$MergeException: java.lang.OutOfMemoryError: Java heap space
[junit4] > at __randomizedtesting.SeedInfo.seed([33A86C2D6AE828D0]:0)
[junit4] > at org.apache.lucene.index.ConcurrentMergeScheduler.handleMergeException(ConcurrentMergeScheduler.java:668)
[junit4] > at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:648)
[junit4] > Caused by: java.lang.OutOfMemoryError: Java heap space
[junit4] > at org.apache.lucene.util.fst.BytesStore.skipBytes(BytesStore.java:307)
[junit4] > at org.apache.lucene.util.fst.FST.addNode(FST.java:792)
[junit4] > at org.apache.lucene.util.fst.NodeHash.add(NodeHash.java:126)
[junit4] > at org.apache.lucene.util.fst.Builder.compileNode(Builder.java:214)
[junit4] > at org.apache.lucene.util.fst.Builder.freezeTail(Builder.java:310)
[junit4] > at org.apache.lucene.util.fst.Builder.add(Builder.java:414)
[junit4] > at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finishTerm(MemoryPostingsFormat.java:254)
[junit4] > at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.access$500(MemoryPostingsFormat.java:109)
[junit4] > at org.apache.lucene.codecs.memory.MemoryPostingsFormat$MemoryFieldsConsumer.write(MemoryPostingsFormat.java:396)
[junit4] > at org.apache.lucene.codecs.FieldsConsumer.merge(FieldsConsumer.java:105)
[junit4] > at org.apache.lucene.codecs.perfield.PerFieldPostingsFormat$FieldsWriter.merge(PerFieldPostingsFormat.java:164)
[junit4] > at org.apache.lucene.index.SegmentMerger.mergeTerms(SegmentMerger.java:216)
[junit4] > at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:101)
[junit4] > at org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4363)
[junit4] > at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3940)
[junit4] > at org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:588)
[junit4] > at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:626)Throwable #4: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=22772, name=Lucene Merge Thread #69, state=RUNNABLE, group=TGRP-TestDuelingCodecsAtNight]
[junit4] > Caused by: org.apache.lucene.index.MergePolicy$MergeException: java.lang.OutOfMemoryError: Java heap space
[junit4] > at __randomizedtesting.SeedInfo.seed([33A86C2D6AE828D0]:0)
[junit4] > at org.apache.lucene.index.ConcurrentMergeScheduler.handleMergeException(ConcurrentMergeScheduler.java:668)
[junit4] > at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:648)
[junit4] > Caused by: java.lang.OutOfMemoryError: Java heap space
[junit4] > at org.apache.lucene.util.fst.FST.<init>(FST.java:387)
[junit4] > at org.apache.lucene.util.fst.FST.<init>(FST.java:313)
[junit4] > at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsReader.<init>(MemoryPostingsFormat.java:894)
[junit4] > at org.apache.lucene.codecs.memory.MemoryPostingsFormat.fieldsProducer(MemoryPostingsFormat.java:977)
[junit4] > at org.apache.lucene.codecs.perfield.PerFieldPostingsFormat$FieldsReader.<init>(PerFieldPostingsFormat.java:292)
[junit4] > at org.apache.lucene.codecs.perfield.PerFieldPostingsFormat.fieldsProducer(PerFieldPostingsFormat.java:372)
[junit4] > at org.apache.lucene.index.SegmentCoreReaders.<init>(SegmentCoreReaders.java:109)
[junit4] > at org.apache.lucene.index.SegmentReader.<init>(SegmentReader.java:74)
[junit4] > at org.apache.lucene.index.ReadersAndUpdates.getReader(ReadersAndUpdates.java:145)
[junit4] > at org.apache.lucene.index.ReadersAndUpdates.getReaderForMerge(ReadersAndUpdates.java:617)
[junit4] > at org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4293)
[junit4] > at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3940)
[junit4] > at org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:588)
[junit4] > at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:626)
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/lucene/build/core/test/J1/temp/lucene.index.TestDuelingCodecsAtNight_33A86C2D6AE828D0-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene62): {}, docValues:{}, maxPointsInLeafNode=1962, maxMBSortInHeap=6.273721702813568, sim=RandomSimilarity(queryNorm=false,coord=crazy): {titleTokenized=DFR GLZ(0.3), body=IB LL-LZ(0.3)}, locale=en-ZA, timezone=America/Thule
[junit4] 2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_102 (64-bit)/cpus=4,threads=1,free=284153608,total=465043456
[junit4] 2> NOTE: All tests run in this JVM: [TestTermScorer, TestTransactionRollback, TestFilterIterator, TermInSetQueryTest, TestSimpleAttributeImpl, Test2BSortedDocValuesOrds, TestMultiThreadTermVectors, TestUnicodeUtil, TestLucene50StoredFieldsFormat, TestMultiPhraseEnum, TestIndexWriterOnDiskFull, TestIndexSearcher, TestReusableStringReader, TestTermQuery, TestDocIDMerger, TestFastDecompressionMode, TestMutableValues, TestSortRandom, TestNorms, TestIsCurrent, TestReaderClosed, TestNotDocIdSet, TestVirtualMethod, TestSearchAfter, TestGeoEncodingUtils, TestFSTs, TestRecyclingByteBlockAllocator, TestSortedSetDocValues, TestNGramPhraseQuery, TestLegacyNumericUtils, TestDocumentsWriterDeleteQueue, Test4GBStoredFields, TestCloseableThreadLocal, TestTermsEnum, TestTermVectors, TestSizeBoundedForceMerge, TestNoMergePolicy, TestDocValuesQueries, TestDateSort, TestMultiMMap, TestBinaryTerms, Test2BTerms, TestRateLimiter, TestSpanExplanations, TestSimpleExplanationsWithFillerDocs, TestMatchNoDocsQuery, TestAllFilesHaveChecksumFooter, TestMixedDocValuesUpdates, TestParallelLeafReader, TestQueryBuilder, TestDeterminism, TestFixedBitSet, TestBoostQuery, TestTerm, TestCharArraySet, TestPackedInts, TestDocValuesIndexing, TestInfoStream, TestCodecUtil, TestConstantScoreQuery, TestCheckIndex, TestLucene60FieldInfoFormat, TestPointQueries, TestForTooMuchCloning, TestIndexSorting, TestMmapDirectory, TestNeverDelete, TestPagedBytes, TestBytesRef, TestPolygon2D, TestRegexpRandom, TestSumDocFreq, TestFieldReuse, TestSimpleSearchEquivalence, TestIndexWriterMergePolicy, TestLucene60PointsFormat, TestFieldType, TestGeoUtils, TestPolygon, Test2BPoints, Test2BSortedDocValuesFixedSorted, TestDocValues, TestDuelingCodecsAtNight]
[junit4] Completed [451/451 (1!)] on J1 in 1657.68s, 3 tests, 1 error <<< FAILURES!
[...truncated 1 lines...]
[junit4] JVM J1: stdout was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/lucene/build/core/test/temp/junit4-J1-20170129_205456_2097352647137904066010.sysout
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] java.lang.OutOfMemoryError: Java heap space
[junit4] Dumping heap to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/heapdumps/java_pid16637.hprof ...
[junit4] Heap dump file created [404687307 bytes in 0.617 secs]
[junit4] <<< JVM J1: EOF ----
[...truncated 9693 lines...]
[junit4] Suite: org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_3B9331F093ABD89B-001/init-core-data-001
[junit4] 2> 116535 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[3B9331F093ABD89B]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-
[...truncated too long message...]
odAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:498)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:870)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> Caused by: java.lang.NullPointerException
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlocksMap.size(BlocksMap.java:203)
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.getTotalBlocks(BlockManager.java:3370)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlocksTotal(FSNamesystem.java:5729)
[junit4] 2> ... 54 more
[junit4] 2> 4990427 INFO (SUITE-HdfsDirectoryFactoryTest-seed#[3B9331F093ABD89B]-worker) [ ] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.core.HdfsDirectoryFactoryTest_3B9331F093ABD89B-001
[junit4] 2> Jan 30, 2017 2:05:21 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 34 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene62): {}, docValues:{}, maxPointsInLeafNode=1553, maxMBSortInHeap=6.340680178264769, sim=RandomSimilarity(queryNorm=false,coord=yes): {}, locale=ko, timezone=SystemV/CST6
[junit4] 2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_102 (64-bit)/cpus=4,threads=2,free=349559904,total=523239424
[junit4] 2> NOTE: All tests run in this JVM: [DateMathParserTest, TestNumericTerms64, SuggesterFSTTest, AnalyticsMergeStrategyTest, SolrMetricManagerTest, TestDownShardTolerantSearch, TestSearchPerf, ConfigSetsAPITest, TestSimpleTrackingShardHandler, SpellCheckCollatorTest, SimplePostToolTest, TestCloudInspectUtil, SolrGangliaReporterTest, TestSerializedLuceneMatchVersion, TestLuceneMatchVersion, CollectionsAPIAsyncDistributedZkTest, BaseCdcrDistributedZkTest, HdfsWriteToMultipleCollectionsTest, TestSolrConfigHandlerConcurrent, TestDistributedGrouping, TestCustomDocTransformer, ShardRoutingTest, HdfsRecoveryZkTest, DistanceFunctionTest, TestExceedMaxTermLength, LoggingHandlerTest, TestFieldCacheWithThreads, TestNRTOpen, CopyFieldTest, TestStandardQParsers, TestSSLRandomization, ChaosMonkeySafeLeaderTest, LeaderInitiatedRecoveryOnCommitTest, TestQueryWrapperFilter, TestDynamicFieldResource, TestCSVResponseWriter, SuggestComponentContextFilterQueryTest, TestCloudRecovery, TermsComponentTest, IndexBasedSpellCheckerTest, TestAddFieldRealTimeGet, HdfsDirectoryTest, TestReplicaProperties, DistributedDebugComponentTest, FileUtilsTest, TestCopyFieldCollectionResource, TestImplicitCoreProperties, TestElisionMultitermQuery, SpellingQueryConverterTest, TestQuerySenderListener, TestQueryUtils, TestLRUCache, SolrSlf4jReporterTest, RollingRestartTest, ZkControllerTest, TestExpandComponent, DistributedFacetPivotSmallTest, AnalysisErrorHandlingTest, TestGraphMLResponseWriter, URLClassifyProcessorTest, DistributedFacetPivotLargeTest, SolrCmdDistributorTest, TestSuggestSpellingConverter, BadCopyFieldTest, TestNamedUpdateProcessors, TestSolrCloudWithHadoopAuthPlugin, RAMDirectoryFactoryTest, BasicFunctionalityTest, SolrIndexSplitterTest, TestSlowCompositeReaderWrapper, CoreMergeIndexesAdminHandlerTest, RuleEngineTest, MergeStrategyTest, DistanceUnitsTest, SoftAutoCommitTest, ConvertedLegacyTest, TestSystemIdResolver, DistribJoinFromCollectionTest, DateRangeFieldTest, DeleteNodeTest, SimpleCollectionCreateDeleteTest, DocumentBuilderTest, SpatialFilterTest, HighlighterTest, TestSubQueryTransformerDistrib, TestIntervalFaceting, TestFiltering, TestLeaderElectionWithEmptyReplica, BlockJoinFacetRandomTest, TestJettySolrRunner, TestConfigSetsAPI, TestFuzzyAnalyzedSuggestions, DirectSolrSpellCheckerTest, TestChildDocTransformer, DocExpirationUpdateProcessorFactoryTest, DeleteStatusTest, TestSha256AuthenticationProvider, TestCharFilters, SolrIndexConfigTest, JSONWriterTest, DistributedIntervalFacetingTest, TestSolr4Spatial2, TestSchemaResource, TestMissingGroups, TestReRankQParserPlugin, TestLMDirichletSimilarityFactory, TestFileDictionaryLookup, MissingSegmentRecoveryTest, CustomCollectionTest, CSVRequestHandlerTest, UnloadDistributedZkTest, CollectionsAPIDistributedZkTest, OpenCloseCoreStressTest, LeaderElectionIntegrationTest, BasicZkTest, TestReplicationHandler, AutoCommitTest, TestFaceting, TestRecovery, TestHashPartitioner, TermVectorComponentDistributedTest, TestReload, TestStressVersions, HardAutoCommitTest, DistributedTermsComponentTest, TestRangeQuery, TestCoreContainer, TestSolr4Spatial, StatsComponentTest, SpellCheckComponentTest, TestGroupingSearch, QueryElevationComponentTest, BadIndexSchemaTest, TestSort, TestBadConfig, TestIndexSearcher, TestCoreDiscovery, AnalysisAfterCoreReloadTest, SignatureUpdateProcessorFactoryTest, TestExtendedDismaxParser, CoreAdminHandlerTest, SolrRequestParserTest, DocValuesTest, SuggesterTest, TestCSVLoader, WordBreakSolrSpellCheckerTest, SolrCoreCheckLockOnStartupTest, TestUpdate, TestWordDelimiterFilterFactory, DirectUpdateHandlerOptimizeTest, StatelessScriptUpdateProcessorFactoryTest, DebugComponentTest, LukeRequestHandlerTest, TestReversedWildcardFilterFactory, TestOmitPositions, RequestHandlersTest, TermVectorComponentTest, MoreLikeThisHandlerTest, FastVectorHighlighterTest, SolrPluginUtilsTest, TestJmxIntegration, JSONWriterTest, UniqFieldsUpdateProcessorFactoryTest, TestPartialUpdateDeduplication, SearchHandlerTest, HighlighterConfigTest, TestSolrIndexConfig, TestQuerySenderNoQuery, BadComponentTest, MultiTermTest, SampleTest, TestDocSet, TestBinaryField, NumericFieldsTest, DirectSolrConnectionTest, NotRequiredUniqueKeyTest, SynonymTokenizerTest, TestXIncludeConfig, EchoParamsTest, TestSweetSpotSimilarityFactory, TestPerFieldSimilarity, TestIBSimilarityFactory, TestBM25SimilarityFactory, TestFastWriter, TestFastOutputStream, ScriptEngineTest, ChaosMonkeyNothingIsSafeTest, PrimUtilsTest, DOMUtilTest, ClusterStateTest, TestSolrJ, TestUtils, TestDocumentBuilder, ZkNodePropsTest, SliceStateTest, SystemInfoHandlerTest, UUIDFieldTest, CircularListTest, DistributedMLTComponentTest, TestRTGBase, CursorPagingTest, CdcrReplicationHandlerTest, CloudExitableDirectoryReaderTest, CollectionsAPISolrJTest, CreateCollectionCleanupTest, DeleteLastCustomShardedReplicaTest, DocValuesNotIndexedTest, LeaderElectionContextKeyTest, LeaderFailureAfterFreshStartTest, MultiThreadedOCPTest, RecoveryAfterSoftCommitTest, ReplaceNodeTest, SharedFSAutoReplicaFailoverTest, TestCryptoKeys, TestLeaderElectionZkExpiry, TestLocalFSCloudBackupRestore, TestMiniSolrCloudClusterSSL, TestRebalanceLeaders, TestRequestStatusCollectionAPI, TestSegmentSorting, TestShortCircuitedRequests, TestSizeLimitedDistributedMap, TestSolrCloudWithDelegationTokens, TestSolrCloudWithKerberosAlt, TestTolerantUpdateProcessorCloud, TriLevelCompositeIdRoutingTest, VMParamsZkACLAndCredentialsProvidersTest, HdfsBasicDistributedZkTest, ZkStateReaderTest, ZkStateWriterTest, RulesTest, CachingDirectoryFactoryTest, CoreSorterTest, DirectoryFactoryTest, HdfsDirectoryFactoryTest]
[junit4] Completed [547/681 (6!)] on J1 in 13.31s, 3 tests, 1 error <<< FAILURES!
[...truncated 12094 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/build.xml:783: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/build.xml:727: Some of the tests produced a heap dump, but did not fail. Maybe a suppressed OutOfMemoryError? Dumps created:
* java_pid16637.hprof
Total time: 331 minutes 9 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-6.x - Build # 269 - Still
Unstable
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.x/269/
3 tests failed.
FAILED: org.apache.solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest.test
Error Message:
There were too many update fails (68 > 60) - we expect it can happen, but shouldn't easily
Stack Trace:
java.lang.AssertionError: There were too many update fails (68 > 60) - we expect it can happen, but shouldn't easily
at __randomizedtesting.SeedInfo.seed([3BD7CAACFABD75FE:B383F57654411806]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertFalse(Assert.java:68)
at org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest.test(ChaosMonkeyNothingIsSafeTest.java:218)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.handler.TestReplicationHandler.doTestReplicateAfterCoreReload
Error Message:
expected:<[{indexVersion=1485619511385,generation=2,filelist=[_2x.cfe, _2x.cfs, _2x.si, _5u.cfe, _5u.cfs, _5u.si, _8r.cfe, _8r.cfs, _8r.si, _bo.cfe, _bo.cfs, _bo.si, _el.cfe, _el.cfs, _el.si, _hi.cfe, _hi.cfs, _hi.si, _kf.cfe, _kf.cfs, _kf.si, _nc.cfe, _nc.cfs, _nc.si, _q9.cfe, _q9.cfs, _q9.si, _t6.cfe, _t6.cfs, _t6.si, _vc.cfe, _vc.cfs, _vc.si, _vd.cfe, _vd.cfs, _vd.si, _ve.cfe, _ve.cfs, _ve.si, _vf.cfe, _vf.cfs, _vf.si, _vg.cfe, _vg.cfs, _vg.si, _vh.cfe, _vh.cfs, _vh.si, _vi.cfe, _vi.cfs, _vi.si, _vj.cfe, _vj.cfs, _vj.si, _vk.cfe, _vk.cfs, _vk.si, _vl.cfe, _vl.cfs, _vl.si, _vm.cfe, _vm.cfs, _vm.si, _vn.cfe, _vn.cfs, _vn.si, _vo.cfe, _vo.cfs, _vo.si, _vp.cfe, _vp.cfs, _vp.si, _vq.cfe, _vq.cfs, _vq.si, _vr.cfe, _vr.cfs, _vr.si, _vs.cfe, _vs.cfs, _vs.si, _vt.cfe, _vt.cfs, _vt.si, _vu.cfe, _vu.cfs, _vu.si, _vv.cfe, _vv.cfs, _vv.si, _vw.cfe, _vw.cfs, _vw.si, _vx.cfe, _vx.cfs, _vx.si, _vy.cfe, _vy.cfs, _vy.si, _vz.cfe, _vz.cfs, _vz.si, _w0.cfe, _w0.cfs, _w0.si, _w1.cfe, _w1.cfs, _w1.si, _w2.cfe, _w2.cfs, _w2.si, segments_2]}]> but was:<[{indexVersion=1485619511385,generation=2,filelist=[_2x.cfe, _2x.cfs, _2x.si, _5u.cfe, _5u.cfs, _5u.si, _8r.cfe, _8r.cfs, _8r.si, _bo.cfe, _bo.cfs, _bo.si, _el.cfe, _el.cfs, _el.si, _hi.cfe, _hi.cfs, _hi.si, _kf.cfe, _kf.cfs, _kf.si, _nc.cfe, _nc.cfs, _nc.si, _q9.cfe, _q9.cfs, _q9.si, _t6.cfe, _t6.cfs, _t6.si, _vc.cfe, _vc.cfs, _vc.si, _vd.cfe, _vd.cfs, _vd.si, _ve.cfe, _ve.cfs, _ve.si, _vf.cfe, _vf.cfs, _vf.si, _vg.cfe, _vg.cfs, _vg.si, _vh.cfe, _vh.cfs, _vh.si, _vi.cfe, _vi.cfs, _vi.si, _vj.cfe, _vj.cfs, _vj.si, _vk.cfe, _vk.cfs, _vk.si, _vl.cfe, _vl.cfs, _vl.si, _vm.cfe, _vm.cfs, _vm.si, _vn.cfe, _vn.cfs, _vn.si, _vo.cfe, _vo.cfs, _vo.si, _vp.cfe, _vp.cfs, _vp.si, _vq.cfe, _vq.cfs, _vq.si, _vr.cfe, _vr.cfs, _vr.si, _vs.cfe, _vs.cfs, _vs.si, _vt.cfe, _vt.cfs, _vt.si, _vu.cfe, _vu.cfs, _vu.si, _vv.cfe, _vv.cfs, _vv.si, _vw.cfe, _vw.cfs, _vw.si, _vx.cfe, _vx.cfs, _vx.si, _vy.cfe, _vy.cfs, _vy.si, _vz.cfe, _vz.cfs, _vz.si, _w0.cfe, _w0.cfs, _w0.si, _w1.cfe, _w1.cfs, _w1.si, _w2.cfe, _w2.cfs, _w2.si, segments_2]}, {indexVersion=1485619511385,generation=3,filelist=[_2x.cfe, _2x.cfs, _2x.si, _5u.cfe, _5u.cfs, _5u.si, _8r.cfe, _8r.cfs, _8r.si, _bo.cfe, _bo.cfs, _bo.si, _el.cfe, _el.cfs, _el.si, _hi.cfe, _hi.cfs, _hi.si, _kf.cfe, _kf.cfs, _kf.si, _nc.cfe, _nc.cfs, _nc.si, _q9.cfe, _q9.cfs, _q9.si, _t6.cfe, _t6.cfs, _t6.si, _w2.cfe, _w2.cfs, _w2.si, _w3.cfe, _w3.cfs, _w3.si, segments_3]}]>
Stack Trace:
java.lang.AssertionError: expected:<[{indexVersion=1485619511385,generation=2,filelist=[_2x.cfe, _2x.cfs, _2x.si, _5u.cfe, _5u.cfs, _5u.si, _8r.cfe, _8r.cfs, _8r.si, _bo.cfe, _bo.cfs, _bo.si, _el.cfe, _el.cfs, _el.si, _hi.cfe, _hi.cfs, _hi.si, _kf.cfe, _kf.cfs, _kf.si, _nc.cfe, _nc.cfs, _nc.si, _q9.cfe, _q9.cfs, _q9.si, _t6.cfe, _t6.cfs, _t6.si, _vc.cfe, _vc.cfs, _vc.si, _vd.cfe, _vd.cfs, _vd.si, _ve.cfe, _ve.cfs, _ve.si, _vf.cfe, _vf.cfs, _vf.si, _vg.cfe, _vg.cfs, _vg.si, _vh.cfe, _vh.cfs, _vh.si, _vi.cfe, _vi.cfs, _vi.si, _vj.cfe, _vj.cfs, _vj.si, _vk.cfe, _vk.cfs, _vk.si, _vl.cfe, _vl.cfs, _vl.si, _vm.cfe, _vm.cfs, _vm.si, _vn.cfe, _vn.cfs, _vn.si, _vo.cfe, _vo.cfs, _vo.si, _vp.cfe, _vp.cfs, _vp.si, _vq.cfe, _vq.cfs, _vq.si, _vr.cfe, _vr.cfs, _vr.si, _vs.cfe, _vs.cfs, _vs.si, _vt.cfe, _vt.cfs, _vt.si, _vu.cfe, _vu.cfs, _vu.si, _vv.cfe, _vv.cfs, _vv.si, _vw.cfe, _vw.cfs, _vw.si, _vx.cfe, _vx.cfs, _vx.si, _vy.cfe, _vy.cfs, _vy.si, _vz.cfe, _vz.cfs, _vz.si, _w0.cfe, _w0.cfs, _w0.si, _w1.cfe, _w1.cfs, _w1.si, _w2.cfe, _w2.cfs, _w2.si, segments_2]}]> but was:<[{indexVersion=1485619511385,generation=2,filelist=[_2x.cfe, _2x.cfs, _2x.si, _5u.cfe, _5u.cfs, _5u.si, _8r.cfe, _8r.cfs, _8r.si, _bo.cfe, _bo.cfs, _bo.si, _el.cfe, _el.cfs, _el.si, _hi.cfe, _hi.cfs, _hi.si, _kf.cfe, _kf.cfs, _kf.si, _nc.cfe, _nc.cfs, _nc.si, _q9.cfe, _q9.cfs, _q9.si, _t6.cfe, _t6.cfs, _t6.si, _vc.cfe, _vc.cfs, _vc.si, _vd.cfe, _vd.cfs, _vd.si, _ve.cfe, _ve.cfs, _ve.si, _vf.cfe, _vf.cfs, _vf.si, _vg.cfe, _vg.cfs, _vg.si, _vh.cfe, _vh.cfs, _vh.si, _vi.cfe, _vi.cfs, _vi.si, _vj.cfe, _vj.cfs, _vj.si, _vk.cfe, _vk.cfs, _vk.si, _vl.cfe, _vl.cfs, _vl.si, _vm.cfe, _vm.cfs, _vm.si, _vn.cfe, _vn.cfs, _vn.si, _vo.cfe, _vo.cfs, _vo.si, _vp.cfe, _vp.cfs, _vp.si, _vq.cfe, _vq.cfs, _vq.si, _vr.cfe, _vr.cfs, _vr.si, _vs.cfe, _vs.cfs, _vs.si, _vt.cfe, _vt.cfs, _vt.si, _vu.cfe, _vu.cfs, _vu.si, _vv.cfe, _vv.cfs, _vv.si, _vw.cfe, _vw.cfs, _vw.si, _vx.cfe, _vx.cfs, _vx.si, _vy.cfe, _vy.cfs, _vy.si, _vz.cfe, _vz.cfs, _vz.si, _w0.cfe, _w0.cfs, _w0.si, _w1.cfe, _w1.cfs, _w1.si, _w2.cfe, _w2.cfs, _w2.si, segments_2]}, {indexVersion=1485619511385,generation=3,filelist=[_2x.cfe, _2x.cfs, _2x.si, _5u.cfe, _5u.cfs, _5u.si, _8r.cfe, _8r.cfs, _8r.si, _bo.cfe, _bo.cfs, _bo.si, _el.cfe, _el.cfs, _el.si, _hi.cfe, _hi.cfs, _hi.si, _kf.cfe, _kf.cfs, _kf.si, _nc.cfe, _nc.cfs, _nc.si, _q9.cfe, _q9.cfs, _q9.si, _t6.cfe, _t6.cfs, _t6.si, _w2.cfe, _w2.cfs, _w2.si, _w3.cfe, _w3.cfs, _w3.si, segments_3]}]>
at __randomizedtesting.SeedInfo.seed([3BD7CAACFABD75FE:1E00D19C8AF57BFD]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:147)
at org.apache.solr.handler.TestReplicationHandler.doTestReplicateAfterCoreReload(TestReplicationHandler.java:1245)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest.test
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([3BD7CAACFABD75FE:B383F57654411806]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertTrue(Assert.java:54)
at org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest.test(HdfsWriteToMultipleCollectionsTest.java:137)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 11717 lines...]
[junit4] Suite: org.apache.solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_3BD7CAACFABD75FE-001/init-core-data-001
[junit4] 2> 930635 INFO (SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[3BD7CAACFABD75FE]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
[junit4] 2> 930635 INFO (SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[3BD7CAACFABD75FE]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /_rsb/de
[junit4] 1> Formatting using clusterid: testClusterID
[junit4] 2> 930674 WARN (SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[3BD7CAACFABD75FE]-worker) [ ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
[junit4] 2> 930691 WARN (SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[3BD7CAACFABD75FE]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 930693 INFO (SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[3BD7CAACFABD75FE]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 930716 INFO (SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[3BD7CAACFABD75FE]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.2-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_55755_hdfs____vsj95t/webapp
[junit4] 2> 931147 INFO (SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[3BD7CAACFABD75FE]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:55755
[junit4] 2> 931218 WARN (SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[3BD7CAACFABD75FE]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 931223 INFO (SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[3BD7CAACFABD75FE]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 931238 INFO (SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[3BD7CAACFABD75FE]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.2-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_49331_datanode____.hzlsdp/webapp
[junit4] 2> 931676 INFO (SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[3BD7CAACFABD75FE]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:49331
[junit4] 2> 931791 WARN (SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[3BD7CAACFABD75FE]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 931792 INFO (SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[3BD7CAACFABD75FE]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 931810 INFO (SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[3BD7CAACFABD75FE]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.2-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_58030_datanode____dx7coh/webapp
[junit4] 2> 931887 INFO (IPC Server handler 4 on 37858) [ ] BlockStateChange BLOCK* processReport: from storage DS-c4c902f9-e6fb-4a77-83c0-4099bccf5c0e node DatanodeRegistration(127.0.0.1:50157, datanodeUuid=254f28a6-06dc-4724-a708-c271c64dd987, infoPort=52595, infoSecurePort=0, ipcPort=47979, storageInfo=lv=-56;cid=testClusterID;nsid=1015618064;c=0), blocks: 0, hasStaleStorage: true, processing time: 1 msecs
[junit4] 2> 931888 INFO (IPC Server handler 4 on 37858) [ ] BlockStateChange BLOCK* processReport: from storage DS-30339dcb-6bc9-46f5-8393-d4b23aae8f2a node DatanodeRegistration(127.0.0.1:50157, datanodeUuid=254f28a6-06dc-4724-a708-c271c64dd987, infoPort=52595, infoSecurePort=0, ipcPort=47979, storageInfo=lv=-56;cid=testClusterID;nsid=1015618064;c=0), blocks: 0, hasStaleStorage: false, processing time: 0 msecs
[junit4] 2> 932227 INFO (SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[3BD7CAACFABD75FE]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:58030
[junit4] 2> 932388 INFO (IPC Server handler 8 on 37858) [ ] BlockStateChange BLOCK* processReport: from storage DS-0fe0fe47-f40a-4383-8649-a2417129c4fb node DatanodeRegistration(127.0.0.1:35099, datanodeUuid=80094b17-95a8-4e5b-9491-a5eeb3649e6e, infoPort=50236, infoSecurePort=0, ipcPort=50841, storageInfo=lv=-56;cid=testClusterID;nsid=1015618064;c=0), blocks: 0, hasStaleStorage: true, processing time: 1 msecs
[junit4] 2> 932389 INFO (IPC Server handler 8 on 37858) [ ] BlockStateChange BLOCK* processReport: from storage DS-9e565227-96fe-444a-a993-1ce9dc7f705a node DatanodeRegistration(127.0.0.1:35099, datanodeUuid=80094b17-95a8-4e5b-9491-a5eeb3649e6e, infoPort=50236, infoSecurePort=0, ipcPort=50841, storageInfo=lv=-56;cid=testClusterID;nsid=1015618064;c=0), blocks: 0, hasStaleStorage: false, processing time: 0 msecs
[junit4] 2> 932509 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 932510 INFO (Thread-8327) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 932510 INFO (Thread-8327) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 932610 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.a.s.c.ZkTestServer start zk server on port:53542
[junit4] 2> 932624 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 932626 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 932628 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 932629 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 932631 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 932633 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 932635 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 932636 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 932638 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 932640 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 932642 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 932749 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_3BD7CAACFABD75FE-001/control-001/cores/collection1
[junit4] 2> 932751 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 932753 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4e08b035{/_rsb/de,null,AVAILABLE}
[junit4] 2> 932753 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@7ea224f9{HTTP/1.1,[http/1.1]}{127.0.0.1:53126}
[junit4] 2> 932753 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.e.j.s.Server Started @936849ms
[junit4] 2> 932753 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:37858/hdfs__localhost_37858__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-6.x_checkout_solr_build_solr-core_test_J2_temp_solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_3BD7CAACFABD75FE-001_tempDir-002_control_data, hostContext=/_rsb/de, hostPort=53126, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_3BD7CAACFABD75FE-001/control-001/cores}
[junit4] 2> 932759 ERROR (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 932759 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 6.5.0
[junit4] 2> 932759 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 932760 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 932760 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-01-28T16:01:56.248Z
[junit4] 2> 932767 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 932767 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_3BD7CAACFABD75FE-001/control-001/solr.xml
[junit4] 2> 932774 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 932774 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:53542/solr
[junit4] 2> 932793 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [n:127.0.0.1:53126__rsb%2Fde ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:53126__rsb%2Fde
[junit4] 2> 932794 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [n:127.0.0.1:53126__rsb%2Fde ] o.a.s.c.Overseer Overseer (id=97361547493310468-127.0.0.1:53126__rsb%2Fde-n_0000000000) starting
[junit4] 2> 932805 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [n:127.0.0.1:53126__rsb%2Fde ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53126__rsb%2Fde
[junit4] 2> 932807 INFO (zkCallback-1126-thread-1-processing-n:127.0.0.1:53126__rsb%2Fde) [n:127.0.0.1:53126__rsb%2Fde ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 932834 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [n:127.0.0.1:53126__rsb%2Fde ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_3BD7CAACFABD75FE-001/control-001/cores
[junit4] 2> 932834 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [n:127.0.0.1:53126__rsb%2Fde ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 932850 INFO (OverseerStateUpdate-97361547493310468-127.0.0.1:53126__rsb%2Fde-n_0000000000) [n:127.0.0.1:53126__rsb%2Fde ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 933867 INFO (coreLoadExecutor-2092-thread-1-processing-n:127.0.0.1:53126__rsb%2Fde) [n:127.0.0.1:53126__rsb%2Fde c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
[junit4] 2> 933883 INFO (coreLoadExecutor-2092-thread-1-processing-n:127.0.0.1:53126__rsb%2Fde) [n:127.0.0.1:53126__rsb%2Fde c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 934508 WARN (coreLoadExecutor-2092-thread-1-processing-n:127.0.0.1:53126__rsb%2Fde) [n:127.0.0.1:53126__rsb%2Fde c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 934510 INFO (coreLoadExecutor-2092-thread-1-processing-n:127.0.0.1:53126__rsb%2Fde) [n:127.0.0.1:53126__rsb%2Fde c:control_collection x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 934529 INFO (coreLoadExecutor-2092-thread-1-processing-n:127.0.0.1:53126__rsb%2Fde) [n:127.0.0.1:53126__rsb%2Fde c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 934530 INFO (coreLoadExecutor-2092-thread-1-processing-n:127.0.0.1:53126__rsb%2Fde) [n:127.0.0.1:53126__rsb%2Fde c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:37858/solr_hdfs_home
[junit4] 2> 934530 INFO (coreLoadExecutor-2092-thread-1-processing-n:127.0.0.1:53126__rsb%2Fde) [n:127.0.0.1:53126__rsb%2Fde c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 934530 INFO (coreLoadExecutor-2092-thread-1-processing-n:127.0.0.1:53126__rsb%2Fde) [n:127.0.0.1:53126__rsb%2Fde c:control_collection x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_3BD7CAACFABD75FE-001/control-001/cores/collection1], dataDir=[hdfs://localhost:37858/solr_hdfs_home/control_collection/core_node1/data/]
[junit4] 2> 934530 INFO (coreLoadExecutor-2092-thread-1-processing-n:127.0.0.1:53126__rsb%2Fde) [n:127.0.0.1:53126__rsb%2Fde c:control_collection x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@55f13e17
[junit4] 2> 934531 INFO (coreLoadExecutor-2092-thread-1-processing-n:127.0.0.1:53126__rsb%2Fde) [n:127.0.0.1:53126__rsb%2Fde c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:37858/solr_hdfs_home/control_collection/core_node1/data/snapshot_metadata
[junit4] 2> 934539 INFO (coreLoadExecutor-2092-thread-1-processing-n:127.0.0.1:53126__rsb%2Fde) [n:127.0.0.1:53126__rsb%2Fde c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 934539 INFO (coreLoadExecutor-2092-thread-1-processing-n:127.0.0.1:53126__rsb%2Fde) [n:127.0.0.1:53126__rsb%2Fde c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
[junit4] 2> 934539 INFO (coreLoadExecutor-2092-thread-1-processing-n:127.0.0.1:53126__rsb%2Fde) [n:127.0.0.1:53126__rsb%2Fde c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Creating new global HDFS BlockCache
[junit4] 2> 934706 INFO (coreLoadExecutor-2092-thread-1-processing-n:127.0.0.1:53126__rsb%2Fde) [n:127.0.0.1:53126__rsb%2Fde c:control_collection x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 934707 INFO (coreLoadExecutor-2092-thread-1-processing-n:127.0.0.1:53126__rsb%2Fde) [n:127.0.0.1:53126__rsb%2Fde c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:37858/solr_hdfs_home/control_collection/core_node1/data
[junit4] 2> 934752 INFO (coreLoadExecutor-2092-thread-1-processing-n:127.0.0.1:53126__rsb%2Fde) [n:127.0.0.1:53126__rsb%2Fde c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:37858/solr_hdfs_home/control_collection/core_node1/data/index
[junit4] 2> 934763 INFO (coreLoadExecutor-2092-thread-1-processing-n:127.0.0.1:53126__rsb%2Fde) [n:127.0.0.1:53126__rsb%2Fde c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 934763 INFO (coreLoadExecutor-2092-thread-1-processing-n:127.0.0.1:53126__rsb%2Fde) [n:127.0.0.1:53126__rsb%2Fde c:control_collection x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
[junit4] 2> 934769 INFO (coreLoadExecutor-2092-thread-1-processing-n:127.0.0.1:53126__rsb%2Fde) [n:127.0.0.1:53126__rsb%2Fde c:control_collection x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 934770 INFO (coreLoadExecutor-2092-thread-1-processing-n:127.0.0.1:53126__rsb%2Fde) [n:127.0.0.1:53126__rsb%2Fde c:control_collection x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=32, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1487613265856859]
[junit4] 2> 934811 INFO (IPC Server handler 7 on 37858) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50157 is added to blk_1073741825_1001{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-9e565227-96fe-444a-a993-1ce9dc7f705a:NORMAL:127.0.0.1:35099|RBW], ReplicaUC[[DISK]DS-30339dcb-6bc9-46f5-8393-d4b23aae8f2a:NORMAL:127.0.0.1:50157|FINALIZED]]} size 0
[junit4] 2> 934817 INFO (IPC Server handler 6 on 37858) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:35099 is added to blk_1073741825_1001{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-9e565227-96fe-444a-a993-1ce9dc7f705a:NORMAL:127.0.0.1:35099|RBW], ReplicaUC[[DISK]DS-30339dcb-6bc9-46f5-8393-d4b23aae8f2a:NORMAL:127.0.0.1:50157|FINALIZED]]} size 0
[junit4] 2> 934828 WARN (coreLoadExecutor-2092-thread-1-processing-n:127.0.0.1:53126__rsb%2Fde) [n:127.0.0.1:53126__rsb%2Fde c:control_collection x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 934839 INFO (coreLoadExecutor-2092-thread-1-processing-n:127.0.0.1:53126__rsb%2Fde) [n:127.0.0.1:53126__rsb%2Fde c:control_collection x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
[junit4] 2> 934839 INFO (coreLoadExecutor-2092-thread-1-processing-n:127.0.0.1:53126__rsb%2Fde) [n:127.0.0.1:53126__rsb%2Fde c:control_collection x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 934840 INFO (coreLoadExecutor-2092-thread-1-processing-n:127.0.0.1:53126__rsb%2Fde) [n:127.0.0.1:53126__rsb%2Fde c:control_collection x:collection1] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=2
[junit4] 2> 934849 INFO (coreLoadExecutor-2092-thread-1-processing-n:127.0.0.1:53126__rsb%2Fde) [n:127.0.0.1:53126__rsb%2Fde c:control_collection x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: if uncommited for 15000ms;
[junit4] 2> 934849 INFO (coreLoadExecutor-2092-thread-1-processing-n:127.0.0.1:53126__rsb%2Fde) [n:127.0.0.1:53126__rsb%2Fde c:control_collection x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 934851 INFO (coreLoadExecutor-2092-thread-1-processing-n:127.0.0.1:53126__rsb%2Fde) [n:127.0.0.1:53126__rsb%2Fde c:control_collection x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=5, maxMergeAtOnceExplicit=9, maxMergedSegmentMB=40.2119140625, floorSegmentMB=1.5556640625, forceMergeDeletesPctAllowed=20.293514544785463, segmentsPerTier=42.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 934862 INFO (coreLoadExecutor-2092-thread-1-processing-n:127.0.0.1:53126__rsb%2Fde) [n:127.0.0.1:53126__rsb%2Fde c:control_collection x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@7b6a61c4[collection1] main]
[junit4] 2> 934863 INFO (coreLoadExecutor-2092-thread-1-processing-n:127.0.0.1:53126__rsb%2Fde) [n:127.0.0.1:53126__rsb%2Fde c:control_collection x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 934864 INFO (coreLoadExecutor-2092-thread-1-processing-n:127.0.0.1:53126__rsb%2Fde) [n:127.0.0.1:53126__rsb%2Fde c:control_collection x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 934864 INFO (coreLoadExecutor-2092-thread-1-processing-n:127.0.0.1:53126__rsb%2Fde) [n:127.0.0.1:53126__rsb%2Fde c:control_collection x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 934866 INFO (searcherExecutor-2093-thread-1-processing-n:127.0.0.1:53126__rsb%2Fde x:collection1 c:control_collection) [n:127.0.0.1:53126__rsb%2Fde c:control_collection x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@7b6a61c4[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 934869 INFO (coreLoadExecutor-2092-thread-1-processing-n:127.0.0.1:53126__rsb%2Fde) [n:127.0.0.1:53126__rsb%2Fde c:control_collection x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1557784762365509632
[junit4] 2> 934882 INFO (coreZkRegister-2085-thread-1-processing-n:127.0.0.1:53126__rsb%2Fde x:collection1 c:control_collection) [n:127.0.0.1:53126__rsb%2Fde c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 934882 INFO (coreZkRegister-2085-thread-1-processing-n:127.0.0.1:53126__rsb%2Fde x:collection1 c:control_collection) [n:127.0.0.1:53126__rsb%2Fde c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 934882 INFO (coreZkRegister-2085-thread-1-processing-n:127.0.0.1:53126__rsb%2Fde x:collection1 c:control_collection) [n:127.0.0.1:53126__rsb%2Fde c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:53126/_rsb/de/collection1/
[junit4] 2> 934882 INFO (coreZkRegister-2085-thread-1-processing-n:127.0.0.1:53126__rsb%2Fde x:collection1 c:control_collection) [n:127.0.0.1:53126__rsb%2Fde c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 934882 INFO (coreZkRegister-2085-thread-1-processing-n:127.0.0.1:53126__rsb%2Fde x:collection1 c:control_collection) [n:127.0.0.1:53126__rsb%2Fde c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:53126/_rsb/de/collection1/ has no replicas
[junit4] 2> 934891 INFO (coreZkRegister-2085-thread-1-processing-n:127.0.0.1:53126__rsb%2Fde x:collection1 c:control_collection) [n:127.0.0.1:53126__rsb%2Fde c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:53126/_rsb/de/collection1/ shard1
[junit4] 2> 934967 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 934974 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:53542/solr ready
[junit4] 2> 934974 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 935042 INFO (coreZkRegister-2085-thread-1-processing-n:127.0.0.1:53126__rsb%2Fde x:collection1 c:control_collection) [n:127.0.0.1:53126__rsb%2Fde c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 935076 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_3BD7CAACFABD75FE-001/shard-1-001/cores/collection1
[junit4] 2> 935076 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_3BD7CAACFABD75FE-001/shard-1-001
[junit4] 2> 935077 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 935079 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4fb7492a{/_rsb/de,null,AVAILABLE}
[junit4] 2> 935079 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@302330d6{HTTP/1.1,[http/1.1]}{127.0.0.1:50575}
[junit4] 2> 935084 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.e.j.s.Server Started @939179ms
[junit4] 2> 935084 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:37858/hdfs__localhost_37858__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-6.x_checkout_solr_build_solr-core_test_J2_temp_solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_3BD7CAACFABD75FE-001_tempDir-002_jetty1, solrconfig=solrconfig.xml, hostContext=/_rsb/de, hostPort=50575, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_3BD7CAACFABD75FE-001/shard-1-001/cores}
[junit4] 2> 935084 ERROR (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 935085 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 6.5.0
[junit4] 2> 935085 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 935085 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 935085 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-01-28T16:01:58.573Z
[junit4] 2> 935087 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 935088 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_3BD7CAACFABD75FE-001/shard-1-001/solr.xml
[junit4] 2> 935095 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 935096 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:53542/solr
[junit4] 2> 935106 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [n:127.0.0.1:50575__rsb%2Fde ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 935112 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [n:127.0.0.1:50575__rsb%2Fde ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50575__rsb%2Fde
[junit4] 2> 935113 INFO (zkCallback-1130-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 935113 INFO (zkCallback-1126-thread-2-processing-n:127.0.0.1:53126__rsb%2Fde) [n:127.0.0.1:53126__rsb%2Fde ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 935115 INFO (zkCallback-1135-thread-1-processing-n:127.0.0.1:50575__rsb%2Fde) [n:127.0.0.1:50575__rsb%2Fde ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 935138 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [n:127.0.0.1:50575__rsb%2Fde ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_3BD7CAACFABD75FE-001/shard-1-001/cores
[junit4] 2> 935138 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [n:127.0.0.1:50575__rsb%2Fde ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 935140 INFO (OverseerStateUpdate-97361547493310468-127.0.0.1:53126__rsb%2Fde-n_0000000000) [n:127.0.0.1:53126__rsb%2Fde ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2
[junit4] 2> 936156 INFO (coreLoadExecutor-2103-thread-1-processing-n:127.0.0.1:50575__rsb%2Fde) [n:127.0.0.1:50575__rsb%2Fde c:collection1 x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
[junit4] 2> 936170 INFO (coreLoadExecutor-2103-thread-1-processing-n:127.0.0.1:50575__rsb%2Fde) [n:127.0.0.1:50575__rsb%2Fde c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 936242 WARN (coreLoadExecutor-2103-thread-1-processing-n:127.0.0.1:50575__rsb%2Fde) [n:127.0.0.1:50575__rsb%2Fde c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 936243 INFO (coreLoadExecutor-2103-thread-1-processing-n:127.0.0.1:50575__rsb%2Fde) [n:127.0.0.1:50575__rsb%2Fde c:collection1 x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 936263 INFO (coreLoadExecutor-2103-thread-1-processing-n:127.0.0.1:50575__rsb%2Fde) [n:127.0.0.1:50575__rsb%2Fde c:collection1 x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 936263 INFO (coreLoadExecutor-2103-thread-1-processing-n:127.0.0.1:50575__rsb%2Fde) [n:127.0.0.1:50575__rsb%2Fde c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:37858/solr_hdfs_home
[junit4] 2> 936263 INFO (coreLoadExecutor-2103-thread-1-processing-n:127.0.0.1:50575__rsb%2Fde) [n:127.0.0.1:50575__rsb%2Fde c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 936263 INFO (coreLoadExecutor-2103-thread-1-processing-n:127.0.0.1:50575__rsb%2Fde) [n:127.0.0.1:50575__rsb%2Fde c:collection1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_3BD7CAACFABD75FE-001/shard-1-001/cores/collection1], dataDir=[hdfs://localhost:37858/solr_hdfs_home/collection1/core_node1/data/]
[junit4] 2> 936263 INFO (coreLoadExecutor-2103-thread-1-processing-n:127.0.0.1:50575__rsb%2Fde) [n:127.0.0.1:50575__rsb%2Fde c:collection1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@55f13e17
[junit4] 2> 936264 INFO (coreLoadExecutor-2103-thread-1-processing-n:127.0.0.1:50575__rsb%2Fde) [n:127.0.0.1:50575__rsb%2Fde c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:37858/solr_hdfs_home/collection1/core_node1/data/snapshot_metadata
[junit4] 2> 936272 INFO (coreLoadExecutor-2103-thread-1-processing-n:127.0.0.1:50575__rsb%2Fde) [n:127.0.0.1:50575__rsb%2Fde c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 936272 INFO (coreLoadExecutor-2103-thread-1-processing-n:127.0.0.1:50575__rsb%2Fde) [n:127.0.0.1:50575__rsb%2Fde c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
[junit4] 2> 936278 INFO (coreLoadExecutor-2103-thread-1-processing-n:127.0.0.1:50575__rsb%2Fde) [n:127.0.0.1:50575__rsb%2Fde c:collection1 x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 936279 INFO (coreLoadExecutor-2103-thread-1-processing-n:127.0.0.1:50575__rsb%2Fde) [n:127.0.0.1:50575__rsb%2Fde c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:37858/solr_hdfs_home/collection1/core_node1/data
[junit4] 2> 936298 INFO (coreLoadExecutor-2103-thread-1-processing-n:127.0.0.1:50575__rsb%2Fde) [n:127.0.0.1:50575__rsb%2Fde c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:37858/solr_hdfs_home/collection1/core_node1/data/index
[junit4] 2> 936304 INFO (coreLoadExecutor-2103-thread-1-processing-n:127.0.0.1:50575__rsb%2Fde) [n:127.0.0.1:50575__rsb%2Fde c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 936304 INFO (coreLoadExecutor-2103-thread-1-processing-n:127.0.0.1:50575__rsb%2Fde) [n:127.0.0.1:50575__rsb%2Fde c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
[junit4] 2> 936307 INFO (coreLoadExecutor-2103-thread-1-processing-n:127.0.0.1:50575__rsb%2Fde) [n:127.0.0.1:50575__rsb%2Fde c:collection1 x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 936307 INFO (coreLoadExecutor-2103-thread-1-processing-n:127.0.0.1:50575__rsb%2Fde) [n:127.0.0.1:50575__rsb%2Fde c:collection1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=32, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1487613265856859]
[junit4] 2> 936326 INFO (IPC Server handler 1 on 37858) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:35099 is added to blk_1073741826_1002{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-30339dcb-6bc9-46f5-8393-d4b23aae8f2a:NORMAL:127.0.0.1:50157|RBW], ReplicaUC[[DISK]DS-0fe0fe47-f40a-4383-8649-a2417129c4fb:NORMAL:127.0.0.1:35099|RBW]]} size 0
[junit4] 2> 936328 INFO (IPC Server handler 0 on 37858) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50157 is added to blk_1073741826_1002{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-0fe0fe47-f40a-4383-8649-a2417129c4fb:NORMAL:127.0.0.1:35099|RBW], ReplicaUC[[DISK]DS-c4c902f9-e6fb-4a77-83c0-4099bccf5c0e:NORMAL:127.0.0.1:50157|FINALIZED]]} size 0
[junit4] 2> 936344 WARN (coreLoadExecutor-2103-thread-1-processing-n:127.0.0.1:50575__rsb%2Fde) [n:127.0.0.1:50575__rsb%2Fde c:collection1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 936361 INFO (coreLoadExecutor-2103-thread-1-processing-n:127.0.0.1:50575__rsb%2Fde) [n:127.0.0.1:50575__rsb%2Fde c:collection1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
[junit4] 2> 936361 INFO (coreLoadExecutor-2103-thread-1-processing-n:127.0.0.1:50575__rsb%2Fde) [n:127.0.0.1:50575__rsb%2Fde c:collection1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 936361 INFO (coreLoadExecutor-2103-thread-1-processing-n:127.0.0.1:50575__rsb%2Fde) [n:127.0.0.1:50575__rsb%2Fde c:collection1 x:collection1] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=2
[junit4] 2> 936371 INFO (coreLoadExecutor-2103-thread-1-processing-n:127.0.0.1:50575__rsb%2Fde) [n:127.0.0.1:50575__rsb%2Fde c:collection1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: if uncommited for 15000ms;
[junit4] 2> 936371 INFO (coreLoadExecutor-2103-thread-1-processing-n:127.0.0.1:50575__rsb%2Fde) [n:127.0.0.1:50575__rsb%2Fde c:collection1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 936373 INFO (coreLoadExecutor-2103-thread-1-processing-n:127.0.0.1:50575__rsb%2Fde) [n:127.0.0.1:50575__rsb%2Fde c:collection1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=5, maxMergeAtOnceExplicit=9, maxMergedSegmentMB=40.2119140625, floorSegmentMB=1.5556640625, forceMergeDeletesPctAllowed=20.293514544785463, segmentsPerTier=42.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 936378 INFO (coreLoadExecutor-2103-thread-1-processing-n:127.0.0.1:50575__rsb%2Fde) [n:127.0.0.1:50575__rsb%2Fde c:collection1 x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@668a2a5[collection1] main]
[junit4] 2> 936379 INFO (coreLoadExecutor-2103-thread-1-processing-n:127.0.0.1:50575__rsb%2Fde) [n:127.0.0.1:50575__rsb%2Fde c:collection1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 936380 INFO (coreLoadExecutor-2103-thread-1-processing-n:127.0.0.1:50575__rsb%2Fde) [n:127.0.0.1:50575__rsb%2Fde c:collection1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 936380 INFO (coreLoadExecutor-2103-thread-1-processing-n:127.0.0.1:50575__rsb%2Fde) [n:127.0.0.1:50575__rsb%2Fde c:collection1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 936381 INFO (searcherExecutor-2104-thread-1-processing-n:127.0.0.1:50575__rsb%2Fde x:collection1 c:collection1) [n:127.0.0.1:50575__rsb%2Fde c:collection1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@668a2a5[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 936388 INFO (coreLoadExecutor-2103-thread-1-processing-n:127.0.0.1:50575__rsb%2Fde) [n:127.0.0.1:50575__rsb%2Fde c:collection1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1557784763958296576
[junit4] 2> 936396 INFO (coreZkRegister-2098-thread-1-processing-n:127.0.0.1:50575__rsb%2Fde x:collection1 c:collection1) [n:127.0.0.1:50575__rsb%2Fde c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 936396 INFO (coreZkRegister-2098-thread-1-processing-n:127.0.0.1:50575__rsb%2Fde x:collection1 c:collection1) [n:127.0.0.1:50575__rsb%2Fde c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 936396 INFO (coreZkRegister-2098-thread-1-processing-n:127.0.0.1:50575__rsb%2Fde x:collection1 c:collection1) [n:127.0.0.1:50575__rsb%2Fde c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:50575/_rsb/de/collection1/
[junit4] 2> 936396 INFO (coreZkRegister-2098-thread-1-processing-n:127.0.0.1:50575__rsb%2Fde x:collection1 c:collection1) [n:127.0.0.1:50575__rsb%2Fde c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 936396 INFO (coreZkRegister-2098-thread-1-processing-n:127.0.0.1:50575__rsb%2Fde x:collection1 c:collection1) [n:127.0.0.1:50575__rsb%2Fde c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:50575/_rsb/de/collection1/ has no replicas
[junit4] 2> 936401 INFO (coreZkRegister-2098-thread-1-processing-n:127.0.0.1:50575__rsb%2Fde x:collection1 c:collection1) [n:127.0.0.1:50575__rsb%2Fde c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:50575/_rsb/de/collection1/ shard2
[junit4] 2> 936552 INFO (coreZkRegister-2098-thread-1-processing-n:127.0.0.1:50575__rsb%2Fde x:collection1 c:collection1) [n:127.0.0.1:50575__rsb%2Fde c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 936919 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_3BD7CAACFABD75FE-001/shard-2-001/cores/collection1
[junit4] 2> 936920 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_3BD7CAACFABD75FE-001/shard-2-001
[junit4] 2> 936921 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 936922 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@65758abb{/_rsb/de,null,AVAILABLE}
[junit4] 2> 936923 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@7f01130f{HTTP/1.1,[http/1.1]}{127.0.0.1:43446}
[junit4] 2> 936923 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.e.j.s.Server Started @941018ms
[junit4] 2> 936923 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:37858/hdfs__localhost_37858__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-6.x_checkout_solr_build_solr-core_test_J2_temp_solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_3BD7CAACFABD75FE-001_tempDir-002_jetty2, solrconfig=solrconfig.xml, hostContext=/_rsb/de, hostPort=43446, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_3BD7CAACFABD75FE-001/shard-2-001/cores}
[junit4] 2> 936923 ERROR (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 936924 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 6.5.0
[junit4] 2> 936924 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 936924 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 936924 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-01-28T16:02:00.412Z
[junit4] 2> 936928 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 936928 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_3BD7CAACFABD75FE-001/shard-2-001/solr.xml
[junit4] 2> 936934 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 936935 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:53542/solr
[junit4] 2> 936945 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [n:127.0.0.1:43446__rsb%2Fde ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 936951 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [n:127.0.0.1:43446__rsb%2Fde ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43446__rsb%2Fde
[junit4] 2> 936952 INFO (zkCallback-1135-thread-1-processing-n:127.0.0.1:50575__rsb%2Fde) [n:127.0.0.1:50575__rsb%2Fde ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 936953 INFO (zkCallback-1130-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 936954 INFO (zkCallback-1126-thread-1-processing-n:127.0.0.1:53126__rsb%2Fde) [n:127.0.0.1:53126__rsb%2Fde ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 936954 INFO (zkCallback-1141-thread-1-processing-n:127.0.0.1:43446__rsb%2Fde) [n:127.0.0.1:43446__rsb%2Fde ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 937015 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [n:127.0.0.1:43446__rsb%2Fde ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_3BD7CAACFABD75FE-001/shard-2-001/cores
[junit4] 2> 937015 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [n:127.0.0.1:43446__rsb%2Fde ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 937022 INFO (OverseerStateUpdate-97361547493310468-127.0.0.1:53126__rsb%2Fde-n_0000000000) [n:127.0.0.1:53126__rsb%2Fde ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard3
[junit4] 2> 938035 INFO (coreLoadExecutor-2114-thread-1-processing-n:127.0.0.1:43446__rsb%2Fde) [n:127.0.0.1:43446__rsb%2Fde c:collection1 x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
[junit4] 2> 938048 INFO (coreLoadExecutor-2114-thread-1-processing-n:127.0.0.1:43446__rsb%2Fde) [n:127.0.0.1:43446__rsb%2Fde c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 938124 WARN (coreLoadExecutor-2114-thread-1-processing-n:127.0.0.1:43446__rsb%2Fde) [n:127.0.0.1:43446__rsb%2Fde c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 938125 INFO (coreLoadExecutor-2114-thread-1-processing-n:127.0.0.1:43446__rsb%2Fde) [n:127.0.0.1:43446__rsb%2Fde c:collection1 x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 938143 INFO (coreLoadExecutor-2114-thread-1-processing-n:127.0.0.1:43446__rsb%2Fde) [n:127.0.0.1:43446__rsb%2Fde c:collection1 x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 938143 INFO (coreLoadExecutor-2114-thread-1-processing-n:127.0.0.1:43446__rsb%2Fde) [n:127.0.0.1:43446__rsb%2Fde c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:37858/solr_hdfs_home
[junit4] 2> 938143 INFO (coreLoadExecutor-2114-thread-1-processing-n:127.0.0.1:43446__rsb%2Fde) [n:127.0.0.1:43446__rsb%2Fde c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 938143 INFO (coreLoadExecutor-2114-thread-1-processing-n:127.0.0.1:43446__rsb%2Fde) [n:127.0.0.1:43446__rsb%2Fde c:collection1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_3BD7CAACFABD75FE-001/shard-2-001/cores/collection1], dataDir=[hdfs://localhost:37858/solr_hdfs_home/collection1/core_node2/data/]
[junit4] 2> 938144 INFO (coreLoadExecutor-2114-thread-1-processing-n:127.0.0.1:43446__rsb%2Fde) [n:127.0.0.1:43446__rsb%2Fde c:collection1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@55f13e17
[junit4] 2> 938144 INFO (coreLoadExecutor-2114-thread-1-processing-n:127.0.0.1:43446__rsb%2Fde) [n:127.0.0.1:43446__rsb%2Fde c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:37858/solr_hdfs_home/collection1/core_node2/data/snapshot_metadata
[junit4] 2> 938152 INFO (coreLoadExecutor-2114-thread-1-processing-n:127.0.0.1:43446__rsb%2Fde) [n:127.0.0.1:43446__rsb%2Fde c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 938152 INFO (coreLoadExecutor-2114-thread-1-processing-n:127.0.0.1:43446__rsb%2Fde) [n:127.0.0.1:43446__rsb%2Fde c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
[junit4] 2> 938157 INFO (coreLoadExecutor-2114-thread-1-processing-n:127.0.0.1:43446__rsb%2Fde) [n:127.0.0.1:43446__rsb%2Fde c:collection1 x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 938157 INFO (coreLoadExecutor-2114-thread-1-processing-n:127.0.0.1:43446__rsb%2Fde) [n:127.0.0.1:43446__rsb%2Fde c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:37858/solr_hdfs_home/collection1/core_node2/data
[junit4] 2> 938176 INFO (coreLoadExecutor-2114-thread-1-processing-n:127.0.0.1:43446__rsb%2Fde) [n:127.0.0.1:43446__rsb%2Fde c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:37858/solr_hdfs_home/collection1/core_node2/data/index
[junit4] 2> 938183 INFO (coreLoadExecutor-2114-thread-1-processing-n:127.0.0.1:43446__rsb%2Fde) [n:127.0.0.1:43446__rsb%2Fde c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 938183 INFO (coreLoadExecutor-2114-thread-1-processing-n:127.0.0.1:43446__rsb%2Fde) [n:127.0.0.1:43446__rsb%2Fde c:collection1 x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
[junit4] 2> 938185 INFO (coreLoadExecutor-2114-thread-1-processing-n:127.0.0.1:43446__rsb%2Fde) [n:127.0.0.1:43446__rsb%2Fde c:collection1 x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 938186 INFO (coreLoadExecutor-2114-thread-1-processing-n:127.0.0.1:43446__rsb%2Fde) [n:127.0.0.1:43446__rsb%2Fde c:collection1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=32, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1487613265856859]
[junit4] 2> 938198 INFO (IPC Server handler 1 on 37858) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:35099 is added to blk_1073741827_1003{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-30339dcb-6bc9-46f5-8393-d4b23aae8f2a:NORMAL:127.0.0.1:50157|RBW], ReplicaUC[[DISK]DS-9e565227-96fe-444a-a993-1ce9dc7f705a:NORMAL:127.0.0.1:35099|RBW]]} size 0
[junit4] 2> 938199 INFO (IPC Server handler 0 on 37858) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50157 is added to blk_1073741827_1003{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-30339dcb-6bc9-46f5-8393-d4b23aae8f2a:NORMAL:127.0.0.1:50157|RBW], ReplicaUC[[DISK]DS-9e565227-96fe-444a-a993-1ce9dc7f705a:NORMAL:127.0.0.1:35099|RBW]]} size 0
[junit4] 2> 938206 WARN (coreLoadExecutor-2114-thread-1-processing-n:127.0.0.1:43446__rsb%2Fde) [n:127.0.0.1:43446__rsb%2Fde c:collection1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 938242 INFO (coreLoadExecutor-2114-thread-1-processing-n:127.0.0.1:43446__rsb%2Fde) [n:127.0.0.1:43446__rsb%2Fde c:collection1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
[junit4] 2> 938242 INFO (coreLoadExecutor-2114-thread-1-processing-n:127.0.0.1:43446__rsb%2Fde) [n:127.0.0.1:43446__rsb%2Fde c:collection1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 938242 INFO (coreLoadExecutor-2114-thread-1-processing-n:127.0.0.1:43446__rsb%2Fde) [n:127.0.0.1:43446__rsb%2Fde c:collection1 x:collection1] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=2
[junit4] 2> 938254 INFO (coreLoadExecutor-2114-thread-1-processing-n:127.0.0.1:43446__rsb%2Fde) [n:127.0.0.1:43446__rsb%2Fde c:collection1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: if uncommited for 15000ms;
[junit4] 2> 938254 INFO (coreLoadExecutor-2114-thread-1-processing-n:127.0.0.1:43446__rsb%2Fde) [n:127.0.0.1:43446__rsb%2Fde c:collection1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 938256 INFO (coreLoadExecutor-2114-thread-1-processing-n:127.0.0.1:43446__rsb%2Fde) [n:127.0.0.1:43446__rsb%2Fde c:collection1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=5, maxMergeAtOnceExplicit=9, maxMergedSegmentMB=40.2119140625, floorSegmentMB=1.5556640625, forceMergeDeletesPctAllowed=20.293514544785463, segmentsPerTier=42.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 938262 INFO (coreLoadExecutor-2114-thread-1-processing-n:127.0.0.1:43446__rsb%2Fde) [n:127.0.0.1:43446__rsb%2Fde c:collection1 x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@5f7200da[collection1] main]
[junit4] 2> 938263 INFO (coreLoadExecutor-2114-thread-1-processing-n:127.0.0.1:43446__rsb%2Fde) [n:127.0.0.1:43446__rsb%2Fde c:collection1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 938263 INFO (coreLoadExecutor-2114-thread-1-processing-n:127.0.0.1:43446__rsb%2Fde) [n:127.0.0.1:43446__rsb%2Fde c:collection1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 938263 INFO (coreLoadExecutor-2114-thread-1-processing-n:127.0.0.1:43446__rsb%2Fde) [n:127.0.0.1:43446__rsb%2Fde c:collection1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 938265 INFO (searcherExecutor-2115-thread-1-processing-n:127.0.0.1:43446__rsb%2Fde x:collection1 c:collection1) [n:127.0.0.1:43446__rsb%2Fde c:collection1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@5f7200da[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 938268 INFO (coreLoadExecutor-2114-thread-1-processing-n:127.0.0.1:43446__rsb%2Fde) [n:127.0.0.1:43446__rsb%2Fde c:collection1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1557784765929619456
[junit4] 2> 938276 INFO (coreZkRegister-2109-thread-1-processing-n:127.0.0.1:43446__rsb%2Fde x:collection1 c:collection1) [n:127.0.0.1:43446__rsb%2Fde c:collection1 s:shard3 r:core_node2 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 938276 INFO (coreZkRegister-2109-thread-1-processing-n:127.0.0.1:43446__rsb%2Fde x:collection1 c:collection1) [n:127.0.0.1:43446__rsb%2Fde c:collection1 s:shard3 r:core_node2 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 938276 INFO (coreZkRegister-2109-thread-1-processing-n:127.0.0.1:43446__rsb%2Fde x:collection1 c:collection1) [n:127.0.0.1:43446__rsb%2Fde c:collection1 s:shard3 r:core_node2 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:43446/_rsb/de/collection1/
[junit4] 2> 938276 INFO (coreZkRegister-2109-thread-1-processing-n:127.0.0.1:43446__rsb%2Fde x:collection1 c:collection1) [n:127.0.0.1:43446__rsb%2Fde c:collection1 s:shard3 r:core_node2 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 938276 INFO (coreZkRegister-2109-thread-1-processing-n:127.0.0.1:43446__rsb%2Fde x:collection1 c:collection1) [n:127.0.0.1:43446__rsb%2Fde c:collection1 s:shard3 r:core_node2 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:43446/_rsb/de/collection1/ has no replicas
[junit4] 2> 938280 INFO (coreZkRegister-2109-thread-1-processing-n:127.0.0.1:43446__rsb%2Fde x:collection1 c:collection1) [n:127.0.0.1:43446__rsb%2Fde c:collection1 s:shard3 r:core_node2 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:43446/_rsb/de/collection1/ shard3
[junit4] 2> 938431 INFO (coreZkRegister-2109-thread-1-processing-n:127.0.0.1:43446__rsb%2Fde x:collection1 c:collection1) [n:127.0.0.1:43446__rsb%2Fde c:collection1 s:shard3 r:core_node2 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 938789 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_3BD7CAACFABD75FE-001/shard-3-001/cores/collection1
[junit4] 2> 938790 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_3BD7CAACFABD75FE-001/shard-3-001
[junit4] 2> 938790 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 938792 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@695a419e{/_rsb/de,null,AVAILABLE}
[junit4] 2> 938792 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@5a2f21e4{HTTP/1.1,[http/1.1]}{127.0.0.1:56634}
[junit4] 2> 938792 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.e.j.s.Server Started @942888ms
[junit4] 2> 938793 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:37858/hdfs__localhost_37858__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-6.x_checkout_solr_build_solr-core_test_J2_temp_solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_3BD7CAACFABD75FE-001_tempDir-002_jetty3, solrconfig=solrconfig.xml, hostContext=/_rsb/de, hostPort=56634, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_3BD7CAACFABD75FE-001/shard-3-001/cores}
[junit4] 2> 938793 ERROR (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 938794 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 6.5.0
[junit4] 2> 938794 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 938794 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 938794 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-01-28T16:02:02.282Z
[junit4] 2> 938798 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 938798 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_3BD7CAACFABD75FE-001/shard-3-001/solr.xml
[junit4] 2> 938804 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 938805 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:53542/solr
[junit4] 2> 938817 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [n:127.0.0.1:56634__rsb%2Fde ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 938834 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [n:127.0.0.1:56634__rsb%2Fde ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56634__rsb%2Fde
[junit4] 2> 938837 INFO (zkCallback-1141-thread-1-processing-n:127.0.0.1:43446__rsb%2Fde) [n:127.0.0.1:43446__rsb%2Fde ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 938838 INFO (zkCallback-1126-thread-3-processing-n:127.0.0.1:53126__rsb%2Fde) [n:127.0.0.1:53126__rsb%2Fde ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 938837 INFO (zkCallback-1130-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 938838 INFO (zkCallback-1147-thread-1-processing-n:127.0.0.1:56634__rsb%2Fde) [n:127.0.0.1:56634__rsb%2Fde ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 938839 INFO (zkCallback-1135-thread-1-processing-n:127.0.0.1:50575__rsb%2Fde) [n:127.0.0.1:50575__rsb%2Fde ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 938922 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [n:127.0.0.1:56634__rsb%2Fde ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_3BD7CAACFABD75FE-001/shard-3-001/cores
[junit4] 2> 938922 INFO (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[3BD7CAACFABD75FE]) [n:127.0.0.1:56634__rsb%2Fde ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 938926 INFO (OverseerStateUpdate-97361547493310468-127.0.0.1:53126__rsb%2Fde-n_0000000000) [n:127.0.0.1:53126__rsb%2Fde ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard4
[junit4] 2> 939937 INFO (coreLoadExecutor-2125-thread-1-processing-n:127.0.0.1:56634__rsb%2Fde) [n:127.0.0.1:56634__rsb%2Fde c:collection1 x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
[junit4] 2> 939955 INFO (coreLoadExecutor-2125-thread-1-processing-n:127.0.0.1:56634__rsb%2Fde) [n:127.0.0.1:56634__rsb%2Fde c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 940041 WARN (coreLoadExecutor-2125-thread-1-processing-n:127.0.0.1:56634__rsb%2Fde) [n:127.0.0.1:56634__rsb%2Fde c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 940042 INFO (coreLoadExecutor-2125-thread-1-processing-n:127.0.0.1:56634__rsb%2Fde) [n:127.0.0.1:56634__rsb%2Fde c:collection1 x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 940060 INFO (coreLoadExecutor-2125-thread-1-processing-n:127.0.0.1:56634__rsb%2Fde) [n:127.0.0.1:56634__rsb%2Fde c:collection1 x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 940061 INFO (coreLoadExecutor-2125-thread-1-pr
[...truncated too long message...]
eptor.java:415)
[junit4] 2> at com.sun.jmx.mbeanserver.JmxMBeanServer.unregisterMBean(JmxMBeanServer.java:546)
[junit4] 2> at org.apache.hadoop.metrics2.util.MBeans.unregister(MBeans.java:81)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stopMBeans(MetricsSourceAdapter.java:226)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stop(MetricsSourceAdapter.java:211)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stopSources(MetricsSystemImpl.java:463)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stop(MetricsSystemImpl.java:213)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.shutdown(MetricsSystemImpl.java:594)
[junit4] 2> at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdownInstance(DefaultMetricsSystem.java:72)
[junit4] 2> at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdown(DefaultMetricsSystem.java:68)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.metrics.NameNodeMetrics.shutdown(NameNodeMetrics.java:171)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.NameNode.stop(NameNode.java:872)
[junit4] 2> at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1726)
[junit4] 2> at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1705)
[junit4] 2> at org.apache.solr.cloud.hdfs.HdfsTestUtil.teardownClass(HdfsTestUtil.java:198)
[junit4] 2> at org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest.teardownClass(HdfsWriteToMultipleCollectionsTest.java:73)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:498)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:870)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> Caused by: java.lang.NullPointerException
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlocksMap.size(BlocksMap.java:203)
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.getTotalBlocks(BlockManager.java:3370)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlocksTotal(FSNamesystem.java:5729)
[junit4] 2> ... 53 more
[junit4] 2> 5339258 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[3BD7CAACFABD75FE]-worker) [ ] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_3BD7CAACFABD75FE-001
[junit4] 2> Jan 28, 2017 5:15:22 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 35 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene62): {rnd_b=BlockTreeOrds(blocksize=128), _version_=PostingsFormat(name=MockRandom), a_t=PostingsFormat(name=LuceneVarGapFixedInterval), a_i=BlockTreeOrds(blocksize=128), id=BlockTreeOrds(blocksize=128)}, docValues:{}, maxPointsInLeafNode=1411, maxMBSortInHeap=5.641185289941632, sim=RandomSimilarity(queryNorm=false,coord=no): {}, locale=es-SV, timezone=Europe/Zurich
[junit4] 2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_102 (64-bit)/cpus=4,threads=2,free=74061152,total=531628032
[junit4] 2> NOTE: All tests run in this JVM: [TestStressUserVersions, TestCustomStream, TestDelegationWithHadoopAuth, InfoHandlerTest, TestRandomRequestDistribution, BadComponentTest, DistributedFacetPivotWhiteBoxTest, SolrMetricReporterTest, TestUseDocValuesAsStored, TestComplexPhraseQParserPlugin, JvmMetricsTest, TestPostingsSolrHighlighter, UnloadDistributedZkTest, TestSolrDynamicMBean, TestLeaderElectionZkExpiry, DeleteReplicaTest, PingRequestHandlerTest, PreAnalyzedFieldManagedSchemaCloudTest, DistributedExpandComponentTest, TestManagedResource, ForceLeaderTest, VMParamsZkACLAndCredentialsProvidersTest, FullHLLTest, TestConfigSetsAPIExclusivity, BasicDistributedZk2Test, ZkStateWriterTest, SuggestComponentTest, TestJavabinTupleStreamParser, LeaderFailoverAfterPartitionTest, TestExtendedDismaxParser, ConnectionReuseTest, DebugComponentTest, SmileWriterTest, XmlUpdateRequestHandlerTest, BadIndexSchemaTest, TestIndexSearcher, TestRawTransformer, StressHdfsTest, DistributedQueueTest, FullSolrCloudDistribCmdsTest, OverseerTest, TestDefaultSearchFieldResource, HdfsChaosMonkeyNothingIsSafeTest, SpellPossibilityIteratorTest, BooleanFieldTest, PrimitiveFieldTypeTest, TestNonDefinedSimilarityFactory, SimpleMLTQParserTest, TolerantUpdateProcessorTest, ShowFileRequestHandlerTest, SuggesterTest, TestUtils, TestLMJelinekMercerSimilarityFactory, TestPhraseSuggestions, SSLMigrationTest, PreAnalyzedFieldTest, OverseerCollectionConfigSetProcessorTest, TestScoreJoinQPScore, DocValuesMissingTest, TestDistributedMissingSort, SolrCoreCheckLockOnStartupTest, BlockJoinFacetSimpleTest, TestSolrCoreParser, ShufflingReplicaListTransformerTest, TestSort, DOMUtilTest, TestTolerantUpdateProcessorRandomCloud, SuggesterWFSTTest, OverseerStatusTest, LeaderInitiatedRecoveryOnShardRestartTest, TestRequestForwarding, TermVectorComponentDistributedTest, TestExportWriter, TestInitQParser, TestCloudPivotFacet, CircularListTest, TestHdfsUpdateLog, TestIndexingPerformance, TestFieldTypeResource, TestSimpleQParserPlugin, TestRandomCollapseQParserPlugin, LeaderElectionTest, IgnoreCommitOptimizeUpdateProcessorFactoryTest, ConnectionManagerTest, TestFieldCacheReopen, TestPKIAuthenticationPlugin, CdcrUpdateLogTest, TestSubQueryTransformer, FieldMutatingUpdateProcessorTest, BigEndianAscendingWordSerializerTest, ResponseLogComponentTest, TestLFUCache, HttpSolrCallGetCoreTest, TestFieldCollectionResource, StatelessScriptUpdateProcessorFactoryTest, SolrIndexMetricsTest, TestBulkSchemaAPI, ExitableDirectoryReaderTest, TestUninvertingReader, TestXmlQParserPlugin, CollectionsAPISolrJTest, LukeRequestHandlerTest, SmileWriterTest, TestWriterPerf, AssignTest, DistributedFacetPivotLongTailTest, TestAuthenticationFramework, TestFieldCacheSortRandom, DistributedIntervalFacetingTest, SolrTestCaseJ4Test, TestCursorMarkWithoutUniqueKey, TestHighlightDedupGrouping, TestSimpleTrackingShardHandler, TestTolerantSearch, AsyncCallRequestStatusResponseTest, CdcrRequestHandlerTest, CloudExitableDirectoryReaderTest, CollectionReloadTest, CollectionTooManyReplicasTest, ConcurrentDeleteAndCreateCollectionTest, DistribDocExpirationUpdateProcessorTest, DistributedVersionInfoTest, LeaderFailureAfterFreshStartTest, MigrateRouteKeyTest, MissingSegmentRecoveryTest, MultiThreadedOCPTest, RemoteQueryErrorTest, ReplaceNodeTest, ShardSplitTest, SharedFSAutoReplicaFailoverTest, SharedFSAutoReplicaFailoverUtilsTest, SolrCLIZkUtilsTest, TestCloudInspectUtil, TestCloudRecovery, TestClusterProperties, TestConfigSetsAPI, TestConfigSetsAPIZkFailure, TestDeleteCollectionOnDownNodes, TestDownShardTolerantSearch, TestExclusionRuleCollectionAccess, TestLeaderInitiatedRecoveryThread, TestLocalFSCloudBackupRestore, TestLockTree, TestMiniSolrCloudClusterSSL, TestOnReconnectListenerSupport, TestRandomFlRTGCloud, TestRebalanceLeaders, TestReplicaProperties, TestRequestStatusCollectionAPI, TestSegmentSorting, TestShortCircuitedRequests, TestSizeLimitedDistributedMap, TestSolrCloudWithSecureImpersonation, TestStressLiveNodes, HdfsChaosMonkeySafeLeaderTest, HdfsNNFailoverTest, HdfsSyncSliceTest, HdfsWriteToMultipleCollectionsTest]
[junit4] Completed [547/681 (3!)] on J2 in 59.83s, 1 test, 1 failure <<< FAILURES!
[...truncated 62874 lines...]