You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2018/06/10 16:53:46 UTC
[JENKINS] Lucene-Solr-NightlyTests-7.x - Build # 239 - Still
Unstable
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-7.x/239/
6 tests failed.
FAILED: org.apache.solr.cloud.OverseerTaskQueueTest.testDistributedQueueBlocking
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([2F7EF5D9AC2CE7A7:6AD487A0E87E5BD3]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertFalse(Assert.java:68)
at org.junit.Assert.assertFalse(Assert.java:79)
at org.apache.solr.cloud.DistributedQueueTest.testDistributedQueueBlocking(DistributedQueueTest.java:146)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeaderAfterRestart
Error Message:
Timeout waiting for active collection null Live Nodes: [127.0.0.1:35146_solr, 127.0.0.1:47752_solr, 127.0.0.1:49839_solr, 127.0.0.1:55686_solr] Last available state: DocCollection(outOfSyncReplicasCannotBecomeLeader-true//collections/outOfSyncReplicasCannotBecomeLeader-true/state.json/23)={ "pullReplicas":"0", "replicationFactor":"3", "shards":{"shard1":{ "range":"80000000-7fffffff", "state":"active", "replicas":{ "core_node62":{ "core":"outOfSyncReplicasCannotBecomeLeader-true_shard1_replica_n61", "base_url":"http://127.0.0.1:47752/solr", "node_name":"127.0.0.1:47752_solr", "state":"active", "type":"NRT", "force_set_state":"false", "leader":"true"}, "core_node64":{ "core":"outOfSyncReplicasCannotBecomeLeader-true_shard1_replica_n63", "base_url":"http://127.0.0.1:49839/solr", "node_name":"127.0.0.1:49839_solr", "state":"active", "type":"NRT", "force_set_state":"false"}, "core_node66":{ "core":"outOfSyncReplicasCannotBecomeLeader-true_shard1_replica_n65", "base_url":"http://127.0.0.1:55686/solr", "node_name":"127.0.0.1:55686_solr", "state":"down", "type":"NRT", "force_set_state":"false"}}}}, "router":{"name":"compositeId"}, "maxShardsPerNode":"1", "autoAddReplicas":"false", "nrtReplicas":"3", "tlogReplicas":"0"}
Stack Trace:
java.lang.AssertionError: Timeout waiting for active collection
null
Live Nodes: [127.0.0.1:35146_solr, 127.0.0.1:47752_solr, 127.0.0.1:49839_solr, 127.0.0.1:55686_solr]
Last available state: DocCollection(outOfSyncReplicasCannotBecomeLeader-true//collections/outOfSyncReplicasCannotBecomeLeader-true/state.json/23)={
"pullReplicas":"0",
"replicationFactor":"3",
"shards":{"shard1":{
"range":"80000000-7fffffff",
"state":"active",
"replicas":{
"core_node62":{
"core":"outOfSyncReplicasCannotBecomeLeader-true_shard1_replica_n61",
"base_url":"http://127.0.0.1:47752/solr",
"node_name":"127.0.0.1:47752_solr",
"state":"active",
"type":"NRT",
"force_set_state":"false",
"leader":"true"},
"core_node64":{
"core":"outOfSyncReplicasCannotBecomeLeader-true_shard1_replica_n63",
"base_url":"http://127.0.0.1:49839/solr",
"node_name":"127.0.0.1:49839_solr",
"state":"active",
"type":"NRT",
"force_set_state":"false"},
"core_node66":{
"core":"outOfSyncReplicasCannotBecomeLeader-true_shard1_replica_n65",
"base_url":"http://127.0.0.1:55686/solr",
"node_name":"127.0.0.1:55686_solr",
"state":"down",
"type":"NRT",
"force_set_state":"false"}}}},
"router":{"name":"compositeId"},
"maxShardsPerNode":"1",
"autoAddReplicas":"false",
"nrtReplicas":"3",
"tlogReplicas":"0"}
at __randomizedtesting.SeedInfo.seed([2F7EF5D9AC2CE7A7:7EB678C7FA136FC]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.SolrCloudTestCase.waitForState(SolrCloudTestCase.java:278)
at org.apache.solr.cloud.TestCloudConsistency.addDocToWhenOtherReplicasAreDown(TestCloudConsistency.java:166)
at org.apache.solr.cloud.TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader(TestCloudConsistency.java:124)
at org.apache.solr.cloud.TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeaderAfterRestart(TestCloudConsistency.java:97)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader
Error Message:
IOException occured when talking to server at: http://127.0.0.1:47752/solr
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:47752/solr
at __randomizedtesting.SeedInfo.seed([2F7EF5D9AC2CE7A7:5195D5C96F4BE89D]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:657)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1106)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:886)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:819)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
at org.apache.solr.cloud.TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader(TestCloudConsistency.java:104)
at org.apache.solr.cloud.TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader(TestCloudConsistency.java:92)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.SocketException: Connection reset
at java.net.SocketInputStream.read(SocketInputStream.java:210)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:137)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:153)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:282)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542)
... 50 more
FAILED: org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates.test_stored_idx
Error Message:
Some docs had errors -- check logs expected:<0> but was:<9>
Stack Trace:
java.lang.AssertionError: Some docs had errors -- check logs expected:<0> but was:<9>
at __randomizedtesting.SeedInfo.seed([2F7EF5D9AC2CE7A7:3F1F5820B98EA289]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates.checkField(TestStressCloudBlindAtomicUpdates.java:342)
at org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates.test_stored_idx(TestStressCloudBlindAtomicUpdates.java:241)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates.test_dv_stored_idx
Error Message:
expected:<620> but was:<488>
Stack Trace:
java.lang.AssertionError: expected:<620> but was:<488>
at __randomizedtesting.SeedInfo.seed([2F7EF5D9AC2CE7A7:2559A4F9D35A44F0]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates.checkField(TestStressCloudBlindAtomicUpdates.java:272)
at org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates.test_dv_stored_idx(TestStressCloudBlindAtomicUpdates.java:221)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.cdcr.CdcrRequestHandlerTest.testLifeCycleActions
Error Message:
Captured an uncaught exception in thread: Thread[id=10903, name=cdcr-replicator-1971-thread-4, state=RUNNABLE, group=TGRP-CdcrRequestHandlerTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=10903, name=cdcr-replicator-1971-thread-4, state=RUNNABLE, group=TGRP-CdcrRequestHandlerTest]
at __randomizedtesting.SeedInfo.seed([2F7EF5D9AC2CE7A7:7849F3F1742FBB1C]:0)
Caused by: java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([2F7EF5D9AC2CE7A7]:0)
at org.apache.solr.handler.CdcrReplicatorScheduler.lambda$null$0(CdcrReplicatorScheduler.java:78)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 13171 lines...]
[junit4] Suite: org.apache.solr.cloud.OverseerTaskQueueTest
[junit4] 2> 358264 INFO (SUITE-OverseerTaskQueueTest-seed#[2F7EF5D9AC2CE7A7]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.OverseerTaskQueueTest_2F7EF5D9AC2CE7A7-001/init-core-data-001
[junit4] 2> 358265 WARN (SUITE-OverseerTaskQueueTest-seed#[2F7EF5D9AC2CE7A7]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=72 numCloses=72
[junit4] 2> 358265 INFO (SUITE-OverseerTaskQueueTest-seed#[2F7EF5D9AC2CE7A7]-worker) [ ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 358271 INFO (SUITE-OverseerTaskQueueTest-seed#[2F7EF5D9AC2CE7A7]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 2> 358279 INFO (TEST-OverseerTaskQueueTest.testPeekElements-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testPeekElements
[junit4] 2> 358279 INFO (TEST-OverseerTaskQueueTest.testPeekElements-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 358282 INFO (Thread-322) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 358282 INFO (Thread-322) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 358311 ERROR (Thread-322) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 358382 INFO (TEST-OverseerTaskQueueTest.testPeekElements-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.c.ZkTestServer start zk server on port:35571
[junit4] 2> 358632 INFO (zkConnectionManagerCallback-204-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 360300 INFO (TEST-OverseerTaskQueueTest.testPeekElements-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testPeekElements
[junit4] 2> 360301 ERROR (TEST-OverseerTaskQueueTest.testPeekElements-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 360302 INFO (TEST-OverseerTaskQueueTest.testPeekElements-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:35571 35571
[junit4] 2> 360414 INFO (Thread-322) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:35571 35571
[junit4] 2> 360423 INFO (TEST-OverseerTaskQueueTest.testLeakChildWatcher-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testLeakChildWatcher
[junit4] 2> 360423 INFO (TEST-OverseerTaskQueueTest.testLeakChildWatcher-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 360439 INFO (Thread-323) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 360439 INFO (Thread-323) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 360468 ERROR (Thread-323) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 360539 INFO (TEST-OverseerTaskQueueTest.testLeakChildWatcher-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.c.ZkTestServer start zk server on port:48020
[junit4] 2> 360831 INFO (zkConnectionManagerCallback-207-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 360971 INFO (TEST-OverseerTaskQueueTest.testLeakChildWatcher-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testLeakChildWatcher
[junit4] 2> 360981 ERROR (TEST-OverseerTaskQueueTest.testLeakChildWatcher-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 360988 INFO (TEST-OverseerTaskQueueTest.testLeakChildWatcher-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:48020 48020
[junit4] 2> 361167 INFO (Thread-323) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:48020 48020
[junit4] 2> 361171 INFO (TEST-OverseerTaskQueueTest.testDistributedQueueCache-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testDistributedQueueCache
[junit4] 2> 361171 INFO (TEST-OverseerTaskQueueTest.testDistributedQueueCache-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 361183 INFO (Thread-324) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 361183 INFO (Thread-324) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 361207 ERROR (Thread-324) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 361283 INFO (TEST-OverseerTaskQueueTest.testDistributedQueueCache-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.c.ZkTestServer start zk server on port:55410
[junit4] 2> 361443 INFO (zkConnectionManagerCallback-210-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 361495 INFO (TEST-OverseerTaskQueueTest.testDistributedQueueCache-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testDistributedQueueCache
[junit4] 2> 361499 ERROR (TEST-OverseerTaskQueueTest.testDistributedQueueCache-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 361499 INFO (TEST-OverseerTaskQueueTest.testDistributedQueueCache-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:55410 55410
[junit4] 2> 361604 INFO (Thread-324) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:55410 55410
[junit4] 2> 361615 INFO (TEST-OverseerTaskQueueTest.testContainsTaskWithRequestId-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testContainsTaskWithRequestId
[junit4] 2> 361616 INFO (TEST-OverseerTaskQueueTest.testContainsTaskWithRequestId-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 361619 INFO (Thread-325) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 361619 INFO (Thread-325) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 361655 ERROR (Thread-325) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 361719 INFO (TEST-OverseerTaskQueueTest.testContainsTaskWithRequestId-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.c.ZkTestServer start zk server on port:56227
[junit4] 2> 362003 INFO (zkConnectionManagerCallback-213-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 362037 INFO (TEST-OverseerTaskQueueTest.testContainsTaskWithRequestId-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testContainsTaskWithRequestId
[junit4] 2> 362114 ERROR (TEST-OverseerTaskQueueTest.testContainsTaskWithRequestId-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 362117 INFO (TEST-OverseerTaskQueueTest.testContainsTaskWithRequestId-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:56227 56227
[junit4] 2> 362235 INFO (Thread-325) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:56227 56227
[junit4] 2> 362250 INFO (TEST-OverseerTaskQueueTest.testDistributedQueueBlocking-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testDistributedQueueBlocking
[junit4] 2> 362258 INFO (TEST-OverseerTaskQueueTest.testDistributedQueueBlocking-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 362333 INFO (Thread-326) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 362333 INFO (Thread-326) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 362391 ERROR (Thread-326) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 362433 INFO (TEST-OverseerTaskQueueTest.testDistributedQueueBlocking-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.c.ZkTestServer start zk server on port:49428
[junit4] 2> 362585 INFO (zkConnectionManagerCallback-216-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 363802 INFO (TEST-OverseerTaskQueueTest.testDistributedQueueBlocking-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testDistributedQueueBlocking
[junit4] 2> 363805 ERROR (TEST-OverseerTaskQueueTest.testDistributedQueueBlocking-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 363805 INFO (TEST-OverseerTaskQueueTest.testDistributedQueueBlocking-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:49428 49428
[junit4] 2> 363916 INFO (Thread-326) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:49428 49428
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=OverseerTaskQueueTest -Dtests.method=testDistributedQueueBlocking -Dtests.seed=2F7EF5D9AC2CE7A7 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/test-data/enwiki.random.lines.txt -Dtests.locale=hu-HU -Dtests.timezone=Europe/Brussels -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[junit4] FAILURE 1.68s J0 | OverseerTaskQueueTest.testDistributedQueueBlocking <<<
[junit4] > Throwable #1: java.lang.AssertionError
[junit4] > at __randomizedtesting.SeedInfo.seed([2F7EF5D9AC2CE7A7:6AD487A0E87E5BD3]:0)
[junit4] > at org.apache.solr.cloud.DistributedQueueTest.testDistributedQueueBlocking(DistributedQueueTest.java:146)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 363925 INFO (TEST-OverseerTaskQueueTest.testDistributedQueue-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testDistributedQueue
[junit4] 2> 363926 INFO (TEST-OverseerTaskQueueTest.testDistributedQueue-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 363975 INFO (Thread-327) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 363975 INFO (Thread-327) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 364019 ERROR (Thread-327) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 364075 INFO (TEST-OverseerTaskQueueTest.testDistributedQueue-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.c.ZkTestServer start zk server on port:45201
[junit4] 2> 364123 INFO (zkConnectionManagerCallback-219-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 366330 INFO (TEST-OverseerTaskQueueTest.testDistributedQueue-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testDistributedQueue
[junit4] 2> 366332 ERROR (TEST-OverseerTaskQueueTest.testDistributedQueue-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 366332 INFO (TEST-OverseerTaskQueueTest.testDistributedQueue-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:45201 45201
[junit4] 2> 366512 INFO (Thread-327) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:45201 45201
[junit4] 2> 366515 INFO (TEST-OverseerTaskQueueTest.testLocallyOffer-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testLocallyOffer
[junit4] 2> 366516 INFO (TEST-OverseerTaskQueueTest.testLocallyOffer-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 366651 INFO (Thread-330) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 366651 INFO (Thread-330) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 366653 ERROR (Thread-330) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 366751 INFO (TEST-OverseerTaskQueueTest.testLocallyOffer-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.c.ZkTestServer start zk server on port:48969
[junit4] 2> 366797 INFO (zkConnectionManagerCallback-222-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 368008 INFO (TEST-OverseerTaskQueueTest.testLocallyOffer-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testLocallyOffer
[junit4] 2> 368009 ERROR (TEST-OverseerTaskQueueTest.testLocallyOffer-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 368015 INFO (TEST-OverseerTaskQueueTest.testLocallyOffer-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:48969 48969
[junit4] 2> 368171 INFO (Thread-330) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:48969 48969
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.OverseerTaskQueueTest_2F7EF5D9AC2CE7A7-001
[junit4] 2> Jun 10, 2018 2:47:22 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=HighCompressionCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=HIGH_COMPRESSION, chunkSize=4, maxDocsPerChunk=6, blockSize=3), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=HIGH_COMPRESSION, chunkSize=4, blockSize=3)), sim=RandomSimilarity(queryNorm=true): {}, locale=hu-HU, timezone=Europe/Brussels
[junit4] 2> NOTE: Linux 3.13.0-88-generic amd64/Oracle Corporation 1.8.0_172 (64-bit)/cpus=4,threads=1,free=185990688,total=424148992
[junit4] 2> NOTE: All tests run in this JVM: [TestCSVResponseWriter, TestLRUCache, TestSolrQueryParser, CollectionReloadTest, AtomicUpdatesTest, TestStreamBody, TestRandomRequestDistribution, TestLegacyField, TestRandomFaceting, HdfsThreadLeakTest, AutoAddReplicasIntegrationTest, TestFieldTypeCollectionResource, TlogReplayBufferedWhileIndexingTest, OverseerTaskQueueTest]
[junit4] Completed [63/816 (1!)] on J0 in 10.83s, 7 tests, 1 failure <<< FAILURES!
[...truncated 400 lines...]
[junit4] Suite: org.apache.solr.cloud.cdcr.CdcrRequestHandlerTest
[junit4] 2> 1212359 INFO (SUITE-CdcrRequestHandlerTest-seed#[2F7EF5D9AC2CE7A7]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.cdcr.CdcrRequestHandlerTest_2F7EF5D9AC2CE7A7-001/init-core-data-001
[junit4] 2> 1212359 WARN (SUITE-CdcrRequestHandlerTest-seed#[2F7EF5D9AC2CE7A7]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=7 numCloses=7
[junit4] 2> 1212360 INFO (SUITE-CdcrRequestHandlerTest-seed#[2F7EF5D9AC2CE7A7]-worker) [ ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 1212361 INFO (SUITE-CdcrRequestHandlerTest-seed#[2F7EF5D9AC2CE7A7]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 2> 1212362 INFO (SUITE-CdcrRequestHandlerTest-seed#[2F7EF5D9AC2CE7A7]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
[junit4] 2> 1212364 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1212583 INFO (Thread-6449) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1212583 INFO (Thread-6449) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1212585 ERROR (Thread-6449) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 1212679 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.c.ZkTestServer start zk server on port:46082
[junit4] 2> 1212710 INFO (zkConnectionManagerCallback-1159-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1212735 INFO (zkConnectionManagerCallback-1161-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1212744 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/core/src/test-files/solr/collection1/conf/solrconfig-cdcr.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 1212746 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 1212748 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1212749 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 1212750 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 1212751 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 1212752 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 1212753 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1212755 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1212756 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 1212757 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 1212783 INFO (zkConnectionManagerCallback-1165-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1212788 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testCheckpointActions
[junit4] 2> 1213118 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 1.8.0_172-b11
[junit4] 2> 1213119 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1213119 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1213119 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 1213120 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6ab57855{/,null,AVAILABLE}
[junit4] 2> 1213121 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@55fbef4{SSL,[ssl, http/1.1]}{127.0.0.1:58946}
[junit4] 2> 1213121 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.e.j.s.Server Started @1213198ms
[junit4] 2> 1213121 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {shards=shard1, hostContext=/, hostPort=58946, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.cdcr.CdcrRequestHandlerTest_2F7EF5D9AC2CE7A7-001/jetty-001/cores}
[junit4] 2> 1213121 ERROR (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1213121 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 1213121 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.5.0
[junit4] 2> 1213122 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1213122 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1213122 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-06-10T15:01:27.150Z
[junit4] 2> 1213160 INFO (zkConnectionManagerCallback-1167-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1213171 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1213172 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.cdcr.CdcrRequestHandlerTest_2F7EF5D9AC2CE7A7-001/jetty-001/solr.xml
[junit4] 2> 1213180 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 1213180 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 1213182 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@2c776da4, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1213710 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46082/solr
[junit4] 2> 1213728 INFO (zkConnectionManagerCallback-1171-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1213743 INFO (zkConnectionManagerCallback-1173-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1214435 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [n:127.0.0.1:58946_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1214435 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [n:127.0.0.1:58946_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:58946_
[junit4] 2> 1214437 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [n:127.0.0.1:58946_ ] o.a.s.c.Overseer Overseer (id=73951242579410949-127.0.0.1:58946_-n_0000000000) starting
[junit4] 2> 1214495 INFO (zkConnectionManagerCallback-1180-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1214539 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [n:127.0.0.1:58946_ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:46082/solr ready
[junit4] 2> 1214547 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [n:127.0.0.1:58946_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58946_
[junit4] 2> 1214655 INFO (OverseerStateUpdate-73951242579410949-127.0.0.1:58946_-n_0000000000) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1214691 INFO (zkCallback-1179-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1214751 WARN (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [n:127.0.0.1:58946_ ] o.a.s.h.a.MetricsHistoryHandler Missing .system, keeping metrics history in memory
[junit4] 2> 1214884 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [n:127.0.0.1:58946_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2c776da4
[junit4] 2> 1214902 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [n:127.0.0.1:58946_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2c776da4
[junit4] 2> 1214903 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [n:127.0.0.1:58946_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2c776da4
[junit4] 2> 1214905 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [n:127.0.0.1:58946_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.cdcr.CdcrRequestHandlerTest_2F7EF5D9AC2CE7A7-001/jetty-001/cores
[junit4] 2> 1215154 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 1.8.0_172-b11
[junit4] 2> 1215155 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1215155 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1215155 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 1215156 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6c853a40{/,null,AVAILABLE}
[junit4] 2> 1215156 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@7386341e{SSL,[ssl, http/1.1]}{127.0.0.1:45176}
[junit4] 2> 1215156 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.e.j.s.Server Started @1215233ms
[junit4] 2> 1215156 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {shards=shard2, hostContext=/, hostPort=45176, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.cdcr.CdcrRequestHandlerTest_2F7EF5D9AC2CE7A7-001/jetty-002/cores}
[junit4] 2> 1215157 ERROR (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1215157 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 1215157 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.5.0
[junit4] 2> 1215157 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1215157 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1215157 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-06-10T15:01:29.185Z
[junit4] 2> 1215281 INFO (zkConnectionManagerCallback-1183-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1215282 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1215282 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.cdcr.CdcrRequestHandlerTest_2F7EF5D9AC2CE7A7-001/jetty-002/solr.xml
[junit4] 2> 1215286 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 1215286 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 1215288 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@2c776da4, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1215978 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46082/solr
[junit4] 2> 1215982 INFO (zkConnectionManagerCallback-1187-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1215984 INFO (zkConnectionManagerCallback-1189-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1215991 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [n:127.0.0.1:45176_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1215994 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [n:127.0.0.1:45176_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1215997 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [n:127.0.0.1:45176_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 1215997 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [n:127.0.0.1:45176_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45176_
[junit4] 2> 1215998 INFO (zkCallback-1172-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1216013 INFO (zkCallback-1188-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1216015 INFO (zkCallback-1179-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1216274 INFO (zkConnectionManagerCallback-1196-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1216275 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [n:127.0.0.1:45176_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1216276 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [n:127.0.0.1:45176_ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:46082/solr ready
[junit4] 2> 1216277 WARN (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [n:127.0.0.1:45176_ ] o.a.s.h.a.MetricsHistoryHandler Missing .system, keeping metrics history in memory
[junit4] 2> 1216302 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [n:127.0.0.1:45176_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2c776da4
[junit4] 2> 1216320 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [n:127.0.0.1:45176_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2c776da4
[junit4] 2> 1216320 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [n:127.0.0.1:45176_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2c776da4
[junit4] 2> 1216323 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [n:127.0.0.1:45176_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.cdcr.CdcrRequestHandlerTest_2F7EF5D9AC2CE7A7-001/jetty-002/cores
[junit4] 2> 1216698 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 1.8.0_172-b11
[junit4] 2> 1216700 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1216700 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1216700 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 1216700 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@39725574{/,null,AVAILABLE}
[junit4] 2> 1216701 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@10dfe10{SSL,[ssl, http/1.1]}{127.0.0.1:33233}
[junit4] 2> 1216701 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.e.j.s.Server Started @1216778ms
[junit4] 2> 1216701 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {shards=shard3, hostContext=/, hostPort=33233, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.cdcr.CdcrRequestHandlerTest_2F7EF5D9AC2CE7A7-001/jetty-003/cores}
[junit4] 2> 1216701 ERROR (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1216701 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 1216702 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.5.0
[junit4] 2> 1216702 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1216702 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1216702 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-06-10T15:01:30.730Z
[junit4] 2> 1216711 INFO (zkConnectionManagerCallback-1199-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1216713 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1216713 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.cdcr.CdcrRequestHandlerTest_2F7EF5D9AC2CE7A7-001/jetty-003/solr.xml
[junit4] 2> 1216717 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 1216717 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 1216718 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@2c776da4, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1216810 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46082/solr
[junit4] 2> 1216843 INFO (zkConnectionManagerCallback-1203-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1216867 INFO (zkConnectionManagerCallback-1205-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1216874 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [n:127.0.0.1:33233_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1216876 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [n:127.0.0.1:33233_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1216880 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [n:127.0.0.1:33233_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 1216880 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [n:127.0.0.1:33233_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33233_
[junit4] 2> 1216881 INFO (zkCallback-1188-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1216881 INFO (zkCallback-1179-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1216881 INFO (zkCallback-1172-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1216905 INFO (zkCallback-1195-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1216906 INFO (zkCallback-1204-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1216948 INFO (zkConnectionManagerCallback-1212-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1216967 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [n:127.0.0.1:33233_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 1216979 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [n:127.0.0.1:33233_ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:46082/solr ready
[junit4] 2> 1216979 WARN (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [n:127.0.0.1:33233_ ] o.a.s.h.a.MetricsHistoryHandler Missing .system, keeping metrics history in memory
[junit4] 2> 1217191 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [n:127.0.0.1:33233_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2c776da4
[junit4] 2> 1217207 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [n:127.0.0.1:33233_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2c776da4
[junit4] 2> 1217207 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [n:127.0.0.1:33233_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2c776da4
[junit4] 2> 1217210 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [n:127.0.0.1:33233_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.cdcr.CdcrRequestHandlerTest_2F7EF5D9AC2CE7A7-001/jetty-003/cores
[junit4] 2> 1217440 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 1.8.0_172-b11
[junit4] 2> 1217450 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1217450 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1217451 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 1217451 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1783acf4{/,null,AVAILABLE}
[junit4] 2> 1217452 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@5cc2489b{SSL,[ssl, http/1.1]}{127.0.0.1:44562}
[junit4] 2> 1217452 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.e.j.s.Server Started @1217528ms
[junit4] 2> 1217452 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {shards=shard4, hostContext=/, hostPort=44562, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.cdcr.CdcrRequestHandlerTest_2F7EF5D9AC2CE7A7-001/jetty-004/cores}
[junit4] 2> 1217452 ERROR (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1217452 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 1217452 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.5.0
[junit4] 2> 1217452 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1217452 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1217452 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-06-10T15:01:31.480Z
[junit4] 2> 1217462 INFO (zkConnectionManagerCallback-1215-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1217464 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1217464 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.cdcr.CdcrRequestHandlerTest_2F7EF5D9AC2CE7A7-001/jetty-004/solr.xml
[junit4] 2> 1217468 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 1217468 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 1217469 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@2c776da4, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1217895 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46082/solr
[junit4] 2> 1217897 INFO (zkConnectionManagerCallback-1219-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1217899 INFO (zkConnectionManagerCallback-1221-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1217906 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [n:127.0.0.1:44562_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 1217909 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [n:127.0.0.1:44562_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1217911 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [n:127.0.0.1:44562_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 1217911 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [n:127.0.0.1:44562_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44562_
[junit4] 2> 1217912 INFO (zkCallback-1179-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1217919 INFO (zkCallback-1195-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1217919 INFO (zkCallback-1188-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1217934 INFO (zkCallback-1211-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1217934 INFO (zkCallback-1204-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1217939 INFO (zkCallback-1220-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1217950 INFO (zkCallback-1172-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1217952 INFO (zkConnectionManagerCallback-1228-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1217953 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [n:127.0.0.1:44562_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 1217954 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [n:127.0.0.1:44562_ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:46082/solr ready
[junit4] 2> 1217955 WARN (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [n:127.0.0.1:44562_ ] o.a.s.h.a.MetricsHistoryHandler Missing .system, keeping metrics history in memory
[junit4] 2> 1217982 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [n:127.0.0.1:44562_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2c776da4
[junit4] 2> 1217997 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [n:127.0.0.1:44562_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2c776da4
[junit4] 2> 1217997 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [n:127.0.0.1:44562_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2c776da4
[junit4] 2> 1218007 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [n:127.0.0.1:44562_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.cdcr.CdcrRequestHandlerTest_2F7EF5D9AC2CE7A7-001/jetty-004/cores
[junit4] 2> 1218077 INFO (zkConnectionManagerCallback-1234-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1218078 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 1218079 INFO (TEST-CdcrRequestHandlerTest.testCheckpointActions-seed#[2F7EF5D9AC2CE7A7]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:46082/solr ready
[junit4] 2> 1218301 INFO (qtp1279239970-10320) [n:127.0.0.1:33233_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=tmp_collection&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1218313 INFO (OverseerThreadFactory-1776-thread-1) [ ] o.a.s.c.a.c.CreateCollectionCmd Create collection tmp_collection
[junit4] 2> 1218314 WARN (OverseerThreadFactory-1776-thread-1) [ ] o.a.s.c.a.c.CreateCollectionCmd It is unusual to create a collection (tmp_collection) without cores.
[junit4] 2> 1218432 INFO (qtp1279239970-10320) [n:127.0.0.1:33233_ ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 1218433 INFO (qtp1279239970-10320) [n:127.0.0.1:33233_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=tmp_collection&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&wt=javabin&version=2} status=0 QTime=131
[junit4] 2> 1218434 INFO (OverseerCollectionConfigSetProcessor-73951242579410949-127.0.0.1:58946_-n_0000000000) [ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1218437 INFO (qtp1279239970-10316) [n:127.0.0.1:33233_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:58946_&action=ADDREPLICA&collection=tmp_collection&shard=shard1&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1218438 WARN (OverseerCollectionConfigSetProcessor-73951242579410949-127.0.0.1:58946_-n_0000000000) [ ] o.a.s.c.LockTree lock_is_leaked at[tmp_collection]
[junit4] 2> 1218438 INFO (OverseerThreadFactory-1776-thread-1) [ ] o.a.s.c.LockTree Unlocked multiple times : tmp_collection
[junit4] 2> 1218447 INFO (OverseerThreadFactory-1776-thread-2) [ c:tmp_collection s:shard1 ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:58946_ for creating new replica
[junit4] 2> 1218496 INFO (qtp1244120156-10251) [n:127.0.0.1:58946_ x:tmp_collection_shard1_replica_n41] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=tmp_collection_shard1_replica_n41&action=CREATE&collection=tmp_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1218497 INFO (qtp1244120156-10251) [n:127.0.0.1:58946_ x:tmp_collection_shard1_replica_n41] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 1219522 INFO (qtp1244120156-10251) [n:127.0.0.1:58946_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n41] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.5.0
[junit4] 2> 1219549 INFO (qtp1244120156-10251) [n:127.0.0.1:58946_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n41] o.a.s.s.IndexSchema [tmp_collection_shard1_replica_n41] Schema name=test
[junit4] 2> 1219750 INFO (qtp1244120156-10251) [n:127.0.0.1:58946_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n41] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 1219780 INFO (qtp1244120156-10251) [n:127.0.0.1:58946_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n41] o.a.s.c.CoreContainer Creating SolrCore 'tmp_collection_shard1_replica_n41' using configuration from collection tmp_collection, trusted=true
[junit4] 2> 1219781 INFO (qtp1244120156-10251) [n:127.0.0.1:58946_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n41] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.tmp_collection.shard1.replica_n41' (registry 'solr.core.tmp_collection.shard1.replica_n41') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2c776da4
[junit4] 2> 1219781 INFO (qtp1244120156-10251) [n:127.0.0.1:58946_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n41] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1219781 INFO (qtp1244120156-10251) [n:127.0.0.1:58946_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n41] o.a.s.c.SolrCore [[tmp_collection_shard1_replica_n41] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.cdcr.CdcrRequestHandlerTest_2F7EF5D9AC2CE7A7-001/jetty-001/cores/tmp_collection_shard1_replica_n41], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.cdcr.CdcrRequestHandlerTest_2F7EF5D9AC2CE7A7-001/jetty-001/cores/tmp_collection_shard1_replica_n41/data/]
[junit4] 2> 1219786 INFO (qtp1244120156-10251) [n:127.0.0.1:58946_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@67258b46
[junit4] 2> 1219924 INFO (qtp1244120156-10251) [n:127.0.0.1:58946_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n41] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.CdcrUpdateLog
[junit4] 2> 1219924 INFO (qtp1244120156-10251) [n:127.0.0.1:58946_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n41] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1219925 INFO (qtp1244120156-10251) [n:127.0.0.1:58946_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n41] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1219925 INFO (qtp1244120156-10251) [n:127.0.0.1:58946_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n41] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1219927 INFO (qtp1244120156-10251) [n:127.0.0.1:58946_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=24, maxMergeAtOnceExplicit=26, maxMergedSegmentMB=10.1513671875, floorSegmentMB=2.1630859375, forceMergeDeletesPctAllowed=1.1866491853182581, segmentsPerTier=49.0, maxCFSSegmentSizeMB=8.796093022207999E12,
[...truncated too long message...]
ene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
jar-checksums:
[mkdir] Created dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/null969925617
[copy] Copying 39 files to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/null969925617
[delete] Deleting directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/null969925617
resolve-example:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
resolve-server:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
jar-checksums:
[mkdir] Created dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/null1393046323
[copy] Copying 247 files to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/null1393046323
[delete] Deleting directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/null1393046323
check-working-copy:
[ivy:cachepath] :: resolving dependencies :: org.eclipse.jgit#org.eclipse.jgit-caller;working
[ivy:cachepath] confs: [default]
[ivy:cachepath] found org.eclipse.jgit#org.eclipse.jgit;4.6.0.201612231935-r in public
[ivy:cachepath] found com.jcraft#jsch;0.1.53 in public
[ivy:cachepath] found com.googlecode.javaewah#JavaEWAH;1.1.6 in public
[ivy:cachepath] found org.apache.httpcomponents#httpclient;4.3.6 in public
[ivy:cachepath] found org.apache.httpcomponents#httpcore;4.3.3 in public
[ivy:cachepath] found commons-logging#commons-logging;1.1.3 in public
[ivy:cachepath] found commons-codec#commons-codec;1.6 in public
[ivy:cachepath] found org.slf4j#slf4j-api;1.7.2 in public
[ivy:cachepath] :: resolution report :: resolve 63ms :: artifacts dl 8ms
---------------------------------------------------------------------
| | modules || artifacts |
| conf | number| search|dwnlded|evicted|| number|dwnlded|
---------------------------------------------------------------------
| default | 8 | 0 | 0 | 0 || 8 | 0 |
---------------------------------------------------------------------
[wc-checker] Initializing working copy...
[wc-checker] SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
[wc-checker] SLF4J: Defaulting to no-operation (NOP) logger implementation
[wc-checker] SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
[wc-checker] Checking working copy status...
-jenkins-base:
BUILD SUCCESSFUL
Total time: 379 minutes 59 seconds
Archiving artifacts
WARN: No artifacts found that match the file pattern "**/*.events,heapdumps/**,**/hs_err_pid*". Configuration error?
WARN: java.lang.InterruptedException: no matches found within 10000
Recording test results
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
[JENKINS] Lucene-Solr-NightlyTests-7.x - Build # 244 - Still
Unstable
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-7.x/244/
3 tests failed.
FAILED: org.apache.solr.cloud.DeleteReplicaTest.deleteReplicaFromClusterState
Error Message:
Collection not found: deleteFromClusterState_false
Stack Trace:
org.apache.solr.common.SolrException: Collection not found: deleteFromClusterState_false
at __randomizedtesting.SeedInfo.seed([22A663B41891DC5D:CC3FC8D927AFA7EA]:0)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:853)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:819)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:173)
at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:138)
at org.apache.solr.cloud.DeleteReplicaTest.deleteReplicaFromClusterState(DeleteReplicaTest.java:187)
at org.apache.solr.cloud.DeleteReplicaTest.deleteReplicaFromClusterState(DeleteReplicaTest.java:178)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.RollingRestartTest.test
Error Message:
KeeperErrorCode = Session expired for /overseer_elect/leader
Stack Trace:
org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
at __randomizedtesting.SeedInfo.seed([22A663B41891DC5D:AAF25C6EB66DB1A5]:0)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:130)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:54)
at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1215)
at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$5(SolrZkClient.java:341)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:341)
at org.apache.solr.cloud.OverseerTaskProcessor.getLeaderId(OverseerTaskProcessor.java:379)
at org.apache.solr.cloud.OverseerTaskProcessor.getLeaderNode(OverseerTaskProcessor.java:370)
at org.apache.solr.cloud.RollingRestartTest.waitUntilOverseerDesignateIsLeader(RollingRestartTest.java:137)
at org.apache.solr.cloud.RollingRestartTest.restartWithRolesTest(RollingRestartTest.java:104)
at org.apache.solr.cloud.RollingRestartTest.test(RollingRestartTest.java:52)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.api.collections.TestLocalFSCloudBackupRestore.test
Error Message:
backuprestore_restored expected:<3> but was:<4>
Stack Trace:
java.lang.AssertionError: backuprestore_restored expected:<3> but was:<4>
at __randomizedtesting.SeedInfo.seed([22A663B41891DC5D:AAF25C6EB66DB1A5]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.testBackupAndRestore(AbstractCloudBackupRestoreTestCase.java:353)
at org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.test(AbstractCloudBackupRestoreTestCase.java:143)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 13856 lines...]
[junit4] Suite: org.apache.solr.cloud.RollingRestartTest
[junit4] 2> 1201647 INFO (SUITE-RollingRestartTest-seed#[22A663B41891DC5D]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.RollingRestartTest_22A663B41891DC5D-001/init-core-data-001
[junit4] 2> 1201648 INFO (SUITE-RollingRestartTest-seed#[22A663B41891DC5D]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 1201649 INFO (SUITE-RollingRestartTest-seed#[22A663B41891DC5D]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 2> 1201657 INFO (SUITE-RollingRestartTest-seed#[22A663B41891DC5D]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /fd_/sw
[junit4] 2> 1201666 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1201754 INFO (Thread-2017) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1201754 INFO (Thread-2017) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1201785 ERROR (Thread-2017) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 1201853 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.c.ZkTestServer start zk server on port:44744
[junit4] 2> 1201893 INFO (zkConnectionManagerCallback-2089-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1201915 INFO (zkConnectionManagerCallback-2091-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1201918 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 1201919 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 1201921 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1201921 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 1201922 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 1201923 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 1201924 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 1201925 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1201926 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1201926 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 1201927 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 1201973 INFO (zkConnectionManagerCallback-2095-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1201975 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Will use NRT replicas unless explicitly asked otherwise
[junit4] 2> 1202208 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 1.8.0_172-b11
[junit4] 2> 1202277 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1202277 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1202277 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 1202294 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@28590075{/fd_/sw,null,AVAILABLE}
[junit4] 2> 1202295 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@1476d921{SSL,[ssl, http/1.1]}{127.0.0.1:45766}
[junit4] 2> 1202296 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.e.j.s.Server Started @1202374ms
[junit4] 2> 1202296 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.RollingRestartTest_22A663B41891DC5D-001/tempDir-001/control/data, hostContext=/fd_/sw, hostPort=45766, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.RollingRestartTest_22A663B41891DC5D-001/control-001/cores}
[junit4] 2> 1202296 ERROR (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1202296 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 1202296 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solrâ„¢ version 7.5.0
[junit4] 2> 1202296 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1202296 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1202296 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-06-20T06:00:51.062Z
[junit4] 2> 1202321 INFO (zkConnectionManagerCallback-2097-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1202322 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1202322 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.RollingRestartTest_22A663B41891DC5D-001/control-001/solr.xml
[junit4] 2> 1202325 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 1202325 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 1202360 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@5491aae3, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1202753 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:44744/solr
[junit4] 2> 1202785 INFO (zkConnectionManagerCallback-2101-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1202825 INFO (zkConnectionManagerCallback-2103-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1202909 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [n:127.0.0.1:45766_fd_%2Fsw ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1202909 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [n:127.0.0.1:45766_fd_%2Fsw ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:45766_fd_%2Fsw
[junit4] 2> 1202910 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [n:127.0.0.1:45766_fd_%2Fsw ] o.a.s.c.Overseer Overseer (id=72831695535865861-127.0.0.1:45766_fd_%2Fsw-n_0000000000) starting
[junit4] 2> 1202937 INFO (zkConnectionManagerCallback-2110-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1202940 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [n:127.0.0.1:45766_fd_%2Fsw ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:44744/solr ready
[junit4] 2> 1203015 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [n:127.0.0.1:45766_fd_%2Fsw ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45766_fd_%2Fsw
[junit4] 2> 1203042 INFO (OverseerStateUpdate-72831695535865861-127.0.0.1:45766_fd_%2Fsw-n_0000000000) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1203083 INFO (zkCallback-2109-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1203086 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [n:127.0.0.1:45766_fd_%2Fsw ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 1203116 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [n:127.0.0.1:45766_fd_%2Fsw ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5491aae3
[junit4] 2> 1203132 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [n:127.0.0.1:45766_fd_%2Fsw ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5491aae3
[junit4] 2> 1203132 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [n:127.0.0.1:45766_fd_%2Fsw ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5491aae3
[junit4] 2> 1203134 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [n:127.0.0.1:45766_fd_%2Fsw ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.RollingRestartTest_22A663B41891DC5D-001/control-001/cores
[junit4] 2> 1203229 INFO (zkConnectionManagerCallback-2116-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1203230 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1203231 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:44744/solr ready
[junit4] 2> 1203262 INFO (qtp402036225-8149) [n:127.0.0.1:45766_fd_%2Fsw ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:45766_fd_%252Fsw&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1203273 INFO (OverseerThreadFactory-2635-thread-1) [ ] o.a.s.c.a.c.CreateCollectionCmd Create collection control_collection
[junit4] 2> 1203397 INFO (qtp402036225-8150) [n:127.0.0.1:45766_fd_%2Fsw x:control_collection_shard1_replica_n1] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1203397 INFO (qtp402036225-8150) [n:127.0.0.1:45766_fd_%2Fsw x:control_collection_shard1_replica_n1] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 1204448 INFO (qtp402036225-8150) [n:127.0.0.1:45766_fd_%2Fsw c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.5.0
[junit4] 2> 1204476 INFO (qtp402036225-8150) [n:127.0.0.1:45766_fd_%2Fsw c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
[junit4] 2> 1204692 INFO (qtp402036225-8150) [n:127.0.0.1:45766_fd_%2Fsw c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 1204801 INFO (qtp402036225-8150) [n:127.0.0.1:45766_fd_%2Fsw c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true
[junit4] 2> 1204802 INFO (qtp402036225-8150) [n:127.0.0.1:45766_fd_%2Fsw c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5491aae3
[junit4] 2> 1204802 INFO (qtp402036225-8150) [n:127.0.0.1:45766_fd_%2Fsw c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1204802 INFO (qtp402036225-8150) [n:127.0.0.1:45766_fd_%2Fsw c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.RollingRestartTest_22A663B41891DC5D-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.RollingRestartTest_22A663B41891DC5D-001/control-001/cores/control_collection_shard1_replica_n1/data/]
[junit4] 2> 1204805 INFO (qtp402036225-8150) [n:127.0.0.1:45766_fd_%2Fsw c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=735763809, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 1204855 WARN (qtp402036225-8150) [n:127.0.0.1:45766_fd_%2Fsw c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 1205053 INFO (qtp402036225-8150) [n:127.0.0.1:45766_fd_%2Fsw c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1205053 INFO (qtp402036225-8150) [n:127.0.0.1:45766_fd_%2Fsw c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1205054 INFO (qtp402036225-8150) [n:127.0.0.1:45766_fd_%2Fsw c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1205054 INFO (qtp402036225-8150) [n:127.0.0.1:45766_fd_%2Fsw c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1205056 INFO (qtp402036225-8150) [n:127.0.0.1:45766_fd_%2Fsw c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=47, maxMergeAtOnceExplicit=43, maxMergedSegmentMB=6.923828125, floorSegmentMB=1.3193359375, forceMergeDeletesPctAllowed=17.378066026137517, segmentsPerTier=30.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0, reclaimDeletesWeight=2.979963918490102
[junit4] 2> 1205069 INFO (qtp402036225-8150) [n:127.0.0.1:45766_fd_%2Fsw c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@721ea85d[control_collection_shard1_replica_n1] main]
[junit4] 2> 1205070 INFO (qtp402036225-8150) [n:127.0.0.1:45766_fd_%2Fsw c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1205071 INFO (qtp402036225-8150) [n:127.0.0.1:45766_fd_%2Fsw c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1205071 INFO (qtp402036225-8150) [n:127.0.0.1:45766_fd_%2Fsw c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1205072 INFO (qtp402036225-8150) [n:127.0.0.1:45766_fd_%2Fsw c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1603770204907634688
[junit4] 2> 1205074 INFO (searcherExecutor-2639-thread-1-processing-n:127.0.0.1:45766_fd_%2Fsw x:control_collection_shard1_replica_n1 c:control_collection s:shard1) [n:127.0.0.1:45766_fd_%2Fsw c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@721ea85d[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1205100 INFO (qtp402036225-8150) [n:127.0.0.1:45766_fd_%2Fsw c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ZkShardTerms Successful update of terms at /collections/control_collection/terms/shard1 to Terms{values={core_node2=0}, version=0}
[junit4] 2> 1205104 INFO (qtp402036225-8150) [n:127.0.0.1:45766_fd_%2Fsw c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1205104 INFO (qtp402036225-8150) [n:127.0.0.1:45766_fd_%2Fsw c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1205104 INFO (qtp402036225-8150) [n:127.0.0.1:45766_fd_%2Fsw c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:45766/fd_/sw/control_collection_shard1_replica_n1/
[junit4] 2> 1205104 INFO (qtp402036225-8150) [n:127.0.0.1:45766_fd_%2Fsw c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1205105 INFO (qtp402036225-8150) [n:127.0.0.1:45766_fd_%2Fsw c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy https://127.0.0.1:45766/fd_/sw/control_collection_shard1_replica_n1/ has no replicas
[junit4] 2> 1205105 INFO (qtp402036225-8150) [n:127.0.0.1:45766_fd_%2Fsw c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 1205157 INFO (qtp402036225-8150) [n:127.0.0.1:45766_fd_%2Fsw c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:45766/fd_/sw/control_collection_shard1_replica_n1/ shard1
[junit4] 2> 1205291 INFO (qtp402036225-8150) [n:127.0.0.1:45766_fd_%2Fsw c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1205311 INFO (qtp402036225-8150) [n:127.0.0.1:45766_fd_%2Fsw c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1914
[junit4] 2> 1205324 INFO (qtp402036225-8149) [n:127.0.0.1:45766_fd_%2Fsw ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 1205405 INFO (zkCallback-2102-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1206324 INFO (qtp402036225-8149) [n:127.0.0.1:45766_fd_%2Fsw ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:45766_fd_%252Fsw&wt=javabin&version=2} status=0 QTime=3061
[junit4] 2> 1206417 INFO (zkConnectionManagerCallback-2121-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1206418 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1206419 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:44744/solr ready
[junit4] 2> 1206419 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 1206428 INFO (qtp402036225-8147) [n:127.0.0.1:45766_fd_%2Fsw ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=2&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1206448 INFO (OverseerCollectionConfigSetProcessor-72831695535865861-127.0.0.1:45766_fd_%2Fsw-n_0000000000) [ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1206448 INFO (OverseerThreadFactory-2635-thread-2) [ ] o.a.s.c.a.c.CreateCollectionCmd Create collection collection1
[junit4] 2> 1206461 WARN (OverseerThreadFactory-2635-thread-2) [ ] o.a.s.c.a.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
[junit4] 2> 1206698 INFO (qtp402036225-8147) [n:127.0.0.1:45766_fd_%2Fsw ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 1206708 INFO (qtp402036225-8147) [n:127.0.0.1:45766_fd_%2Fsw ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=2&wt=javabin&version=2} status=0 QTime=279
[junit4] 2> 1207258 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.RollingRestartTest_22A663B41891DC5D-001/shard-1-001 of type NRT
[junit4] 2> 1207259 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 1.8.0_172-b11
[junit4] 2> 1207307 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1207307 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1207307 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 1207308 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4e7ffe99{/fd_/sw,null,AVAILABLE}
[junit4] 2> 1207308 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@cb6bff7{SSL,[ssl, http/1.1]}{127.0.0.1:38579}
[junit4] 2> 1207308 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.e.j.s.Server Started @1207387ms
[junit4] 2> 1207308 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.RollingRestartTest_22A663B41891DC5D-001/tempDir-001/jetty1, replicaType=NRT, solrconfig=solrconfig.xml, hostContext=/fd_/sw, hostPort=38579, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J2/../../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.RollingRestartTest_22A663B41891DC5D-001/shard-1-001/cores}
[junit4] 2> 1207309 ERROR (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1207309 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 1207309 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solrâ„¢ version 7.5.0
[junit4] 2> 1207309 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1207309 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1207309 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-06-20T06:00:56.075Z
[junit4] 2> 1207311 INFO (zkConnectionManagerCallback-2123-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1207318 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1207318 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.RollingRestartTest_22A663B41891DC5D-001/shard-1-001/solr.xml
[junit4] 2> 1207323 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 1207333 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 1207334 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@5491aae3, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1207619 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:44744/solr
[junit4] 2> 1207654 INFO (zkConnectionManagerCallback-2127-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1207705 INFO (zkConnectionManagerCallback-2129-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1207709 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [n:127.0.0.1:38579_fd_%2Fsw ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1207711 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [n:127.0.0.1:38579_fd_%2Fsw ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1207713 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [n:127.0.0.1:38579_fd_%2Fsw ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 1207713 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [n:127.0.0.1:38579_fd_%2Fsw ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38579_fd_%2Fsw
[junit4] 2> 1207714 INFO (zkCallback-2109-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1207846 INFO (zkCallback-2102-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1207847 INFO (zkCallback-2128-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1207857 INFO (zkCallback-2120-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1207897 INFO (zkConnectionManagerCallback-2136-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1207898 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [n:127.0.0.1:38579_fd_%2Fsw ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1207898 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [n:127.0.0.1:38579_fd_%2Fsw ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:44744/solr ready
[junit4] 2> 1207917 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [n:127.0.0.1:38579_fd_%2Fsw ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 1207951 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [n:127.0.0.1:38579_fd_%2Fsw ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5491aae3
[junit4] 2> 1207970 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [n:127.0.0.1:38579_fd_%2Fsw ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5491aae3
[junit4] 2> 1207970 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [n:127.0.0.1:38579_fd_%2Fsw ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5491aae3
[junit4] 2> 1207972 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [n:127.0.0.1:38579_fd_%2Fsw ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J2/../../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.RollingRestartTest_22A663B41891DC5D-001/shard-1-001/cores
[junit4] 2> 1208137 INFO (qtp1428436623-8204) [n:127.0.0.1:38579_fd_%2Fsw ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:38579_fd_%252Fsw&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1208153 INFO (OverseerCollectionConfigSetProcessor-72831695535865861-127.0.0.1:45766_fd_%2Fsw-n_0000000000) [ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1208166 INFO (OverseerThreadFactory-2635-thread-3) [ c:collection1 s:shard2 ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:38579_fd_%2Fsw for creating new replica
[junit4] 2> 1208194 INFO (qtp1428436623-8205) [n:127.0.0.1:38579_fd_%2Fsw x:collection1_shard2_replica_n41] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1209277 INFO (qtp1428436623-8205) [n:127.0.0.1:38579_fd_%2Fsw c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.5.0
[junit4] 2> 1209314 INFO (qtp1428436623-8205) [n:127.0.0.1:38579_fd_%2Fsw c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.s.IndexSchema [collection1_shard2_replica_n41] Schema name=test
[junit4] 2> 1209633 INFO (qtp1428436623-8205) [n:127.0.0.1:38579_fd_%2Fsw c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 1209665 INFO (qtp1428436623-8205) [n:127.0.0.1:38579_fd_%2Fsw c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_n41' using configuration from collection collection1, trusted=true
[junit4] 2> 1209679 INFO (qtp1428436623-8205) [n:127.0.0.1:38579_fd_%2Fsw c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_n41' (registry 'solr.core.collection1.shard2.replica_n41') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5491aae3
[junit4] 2> 1209679 INFO (qtp1428436623-8205) [n:127.0.0.1:38579_fd_%2Fsw c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1209679 INFO (qtp1428436623-8205) [n:127.0.0.1:38579_fd_%2Fsw c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SolrCore [[collection1_shard2_replica_n41] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.RollingRestartTest_22A663B41891DC5D-001/shard-1-001/cores/collection1_shard2_replica_n41], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J2/../../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.RollingRestartTest_22A663B41891DC5D-001/shard-1-001/cores/collection1_shard2_replica_n41/data/]
[junit4] 2> 1209694 INFO (qtp1428436623-8205) [n:127.0.0.1:38579_fd_%2Fsw c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=735763809, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 1209773 WARN (qtp1428436623-8205) [n:127.0.0.1:38579_fd_%2Fsw c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 1209937 INFO (qtp1428436623-8205) [n:127.0.0.1:38579_fd_%2Fsw c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1209937 INFO (qtp1428436623-8205) [n:127.0.0.1:38579_fd_%2Fsw c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1209938 INFO (qtp1428436623-8205) [n:127.0.0.1:38579_fd_%2Fsw c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1209938 INFO (qtp1428436623-8205) [n:127.0.0.1:38579_fd_%2Fsw c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1209939 INFO (qtp1428436623-8205) [n:127.0.0.1:38579_fd_%2Fsw c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=47, maxMergeAtOnceExplicit=43, maxMergedSegmentMB=6.923828125, floorSegmentMB=1.3193359375, forceMergeDeletesPctAllowed=17.378066026137517, segmentsPerTier=30.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0, reclaimDeletesWeight=2.979963918490102
[junit4] 2> 1209940 INFO (qtp1428436623-8205) [n:127.0.0.1:38579_fd_%2Fsw c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.s.SolrIndexSearcher Opening [Searcher@60361bf2[collection1_shard2_replica_n41] main]
[junit4] 2> 1209942 INFO (qtp1428436623-8205) [n:127.0.0.1:38579_fd_%2Fsw c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1209942 INFO (qtp1428436623-8205) [n:127.0.0.1:38579_fd_%2Fsw c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1209943 INFO (qtp1428436623-8205) [n:127.0.0.1:38579_fd_%2Fsw c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1209943 INFO (qtp1428436623-8205) [n:127.0.0.1:38579_fd_%2Fsw c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1603770210015248384
[junit4] 2> 1209953 INFO (qtp1428436623-8205) [n:127.0.0.1:38579_fd_%2Fsw c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.ZkShardTerms Successful update of terms at /collections/collection1/terms/shard2 to Terms{values={core_node42=0}, version=0}
[junit4] 2> 1209955 INFO (qtp1428436623-8205) [n:127.0.0.1:38579_fd_%2Fsw c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1209955 INFO (qtp1428436623-8205) [n:127.0.0.1:38579_fd_%2Fsw c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1209955 INFO (qtp1428436623-8205) [n:127.0.0.1:38579_fd_%2Fsw c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:38579/fd_/sw/collection1_shard2_replica_n41/
[junit4] 2> 1209955 INFO (qtp1428436623-8205) [n:127.0.0.1:38579_fd_%2Fsw c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1209956 INFO (qtp1428436623-8205) [n:127.0.0.1:38579_fd_%2Fsw c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SyncStrategy https://127.0.0.1:38579/fd_/sw/collection1_shard2_replica_n41/ has no replicas
[junit4] 2> 1209956 INFO (qtp1428436623-8205) [n:127.0.0.1:38579_fd_%2Fsw c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 1209956 INFO (searcherExecutor-2653-thread-1-processing-n:127.0.0.1:38579_fd_%2Fsw x:collection1_shard2_replica_n41 c:collection1 s:shard2) [n:127.0.0.1:38579_fd_%2Fsw c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SolrCore [collection1_shard2_replica_n41] Registered new searcher Searcher@60361bf2[collection1_shard2_replica_n41] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1209958 INFO (qtp1428436623-8205) [n:127.0.0.1:38579_fd_%2Fsw c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:38579/fd_/sw/collection1_shard2_replica_n41/ shard2
[junit4] 2> 1210083 INFO (qtp1428436623-8205) [n:127.0.0.1:38579_fd_%2Fsw c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1210088 INFO (qtp1428436623-8205) [n:127.0.0.1:38579_fd_%2Fsw c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1894
[junit4] 2> 1210122 INFO (qtp1428436623-8204) [n:127.0.0.1:38579_fd_%2Fsw c:collection1 ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:38579_fd_%252Fsw&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2} status=0 QTime=1985
[junit4] 2> 1210166 INFO (OverseerCollectionConfigSetProcessor-72831695535865861-127.0.0.1:45766_fd_%2Fsw-n_0000000000) [ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1210185 INFO (zkCallback-2128-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1210472 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.RollingRestartTest_22A663B41891DC5D-001/shard-2-001 of type NRT
[junit4] 2> 1210483 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 1.8.0_172-b11
[junit4] 2> 1210524 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1210524 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1210524 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 1210540 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@74bbdf50{/fd_/sw,null,AVAILABLE}
[junit4] 2> 1210541 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@3d88dce7{SSL,[ssl, http/1.1]}{127.0.0.1:42181}
[junit4] 2> 1210541 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.e.j.s.Server Started @1210619ms
[junit4] 2> 1210541 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.RollingRestartTest_22A663B41891DC5D-001/tempDir-001/jetty2, solrconfig=solrconfig.xml, hostContext=/fd_/sw, hostPort=42181, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.RollingRestartTest_22A663B41891DC5D-001/shard-2-001/cores}
[junit4] 2> 1210541 ERROR (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1210542 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 1210542 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solrâ„¢ version 7.5.0
[junit4] 2> 1210542 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1210542 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1210542 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-06-20T06:00:59.308Z
[junit4] 2> 1210556 INFO (zkConnectionManagerCallback-2139-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1210565 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1210565 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.RollingRestartTest_22A663B41891DC5D-001/shard-2-001/solr.xml
[junit4] 2> 1210577 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 1210577 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 1210579 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@5491aae3, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1211068 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:44744/solr
[junit4] 2> 1211088 INFO (zkConnectionManagerCallback-2143-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1211103 INFO (zkConnectionManagerCallback-2145-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1211107 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [n:127.0.0.1:42181_fd_%2Fsw ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1211109 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [n:127.0.0.1:42181_fd_%2Fsw ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1211120 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [n:127.0.0.1:42181_fd_%2Fsw ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 1211120 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [n:127.0.0.1:42181_fd_%2Fsw ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42181_fd_%2Fsw
[junit4] 2> 1211130 INFO (zkCallback-2109-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1211137 INFO (zkCallback-2128-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1211137 INFO (zkCallback-2120-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1211138 INFO (zkCallback-2102-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1211169 INFO (zkCallback-2135-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1211170 INFO (zkCallback-2144-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1211191 INFO (zkConnectionManagerCallback-2152-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1211192 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [n:127.0.0.1:42181_fd_%2Fsw ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 1211193 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [n:127.0.0.1:42181_fd_%2Fsw ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:44744/solr ready
[junit4] 2> 1211215 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [n:127.0.0.1:42181_fd_%2Fsw ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 1211292 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [n:127.0.0.1:42181_fd_%2Fsw ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5491aae3
[junit4] 2> 1211325 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [n:127.0.0.1:42181_fd_%2Fsw ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5491aae3
[junit4] 2> 1211325 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [n:127.0.0.1:42181_fd_%2Fsw ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5491aae3
[junit4] 2> 1211327 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [n:127.0.0.1:42181_fd_%2Fsw ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.RollingRestartTest_22A663B41891DC5D-001/shard-2-001/cores
[junit4] 2> 1211478 INFO (qtp1428436623-8202) [n:127.0.0.1:38579_fd_%2Fsw ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:42181_fd_%252Fsw&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1211522 INFO (OverseerThreadFactory-2635-thread-4) [ c:collection1 s:shard1 ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:42181_fd_%2Fsw for creating new replica
[junit4] 2> 1211681 INFO (qtp1174425775-8240) [n:127.0.0.1:42181_fd_%2Fsw x:collection1_shard1_replica_n43] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1211836 INFO (zkCallback-2128-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 1212770 INFO (qtp1174425775-8240) [n:127.0.0.1:42181_fd_%2Fsw c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.5.0
[junit4] 2> 1212887 INFO (qtp1174425775-8240) [n:127.0.0.1:42181_fd_%2Fsw c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.s.IndexSchema [collection1_shard1_replica_n43] Schema name=test
[junit4] 2> 1213160 INFO (qtp1174425775-8240) [n:127.0.0.1:42181_fd_%2Fsw c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 1213233 INFO (qtp1174425775-8240) [n:127.0.0.1:42181_fd_%2Fsw c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_n43' using configuration from collection collection1, trusted=true
[junit4] 2> 1213234 INFO (qtp1174425775-8240) [n:127.0.0.1:42181_fd_%2Fsw c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_n43' (registry 'solr.core.collection1.shard1.replica_n43') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5491aae3
[junit4] 2> 1213234 INFO (qtp1174425775-8240) [n:127.0.0.1:42181_fd_%2Fsw c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1213234 INFO (qtp1174425775-8240) [n:127.0.0.1:42181_fd_%2Fsw c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SolrCore [[collection1_shard1_replica_n43] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.RollingRestartTest_22A663B41891DC5D-001/shard-2-001/cores/collection1_shard1_replica_n43], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.RollingRestartTest_22A663B41891DC5D-001/shard-2-001/cores/collection1_shard1_replica_n43/data/]
[junit4] 2> 1213238 INFO (qtp1174425775-8240) [n:127.0.0.1:42181_fd_%2Fsw c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=735763809, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 1213266 WARN (qtp1174425775-8240) [n:127.0.0.1:42181_fd_%2Fsw c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 1213496 INFO (qtp1174425775-8240) [n:127.0.0.1:42181_fd_%2Fsw c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1213496 INFO (qtp1174425775-8240) [n:127.0.0.1:42181_fd_%2Fsw c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1213498 INFO (qtp1174425775-8240) [n:127.0.0.1:42181_fd_%2Fsw c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1213498 INFO (qtp1174425775-8240) [n:127.0.0.1:42181_fd_%2Fsw c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1213499 INFO (qtp1174425775-8240) [n:127.0.0.1:42181_fd_%2Fsw c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=47, maxMergeAtOnceExplicit=43, maxMergedSegmentMB=6.923828125, floorSegmentMB=1.3193359375, forceMergeDeletesPctAllowed=17.378066026137517, segmentsPerTier=30.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0, reclaimDeletesWeight=2.979963918490102
[junit4] 2> 1213500 INFO (qtp1174425775-8240) [n:127.0.0.1:42181_fd_%2Fsw c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.s.SolrIndexSearcher Opening [Searcher@22a1c857[collection1_shard1_replica_n43] main]
[junit4] 2> 1213534 INFO (qtp1174425775-8240) [n:127.0.0.1:42181_fd_%2Fsw c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1213534 INFO (qtp1174425775-8240) [n:127.0.0.1:42181_fd_%2Fsw c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1213535 INFO (qtp1174425775-8240) [n:127.0.0.1:42181_fd_%2Fsw c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1213535 INFO (qtp1174425775-8240) [n:127.0.0.1:42181_fd_%2Fsw c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1603770213781733376
[junit4] 2> 1213550 INFO (searcherExecutor-2667-thread-1-processing-n:127.0.0.1:42181_fd_%2Fsw x:collection1_shard1_replica_n43 c:collection1 s:shard1) [n:127.0.0.1:42181_fd_%2Fsw c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SolrCore [collection1_shard1_replica_n43] Registered new searcher Searcher@22a1c857[collection1_shard1_replica_n43] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1213611 INFO (qtp1174425775-8240) [n:127.0.0.1:42181_fd_%2Fsw c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.ZkShardTerms Successful update of terms at /collections/collection1/terms/shard1 to Terms{values={core_node44=0}, version=0}
[junit4] 2> 1213613 INFO (qtp1174425775-8240) [n:127.0.0.1:42181_fd_%2Fsw c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1213613 INFO (qtp1174425775-8240) [n:127.0.0.1:42181_fd_%2Fsw c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1213613 INFO (qtp1174425775-8240) [n:127.0.0.1:42181_fd_%2Fsw c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:42181/fd_/sw/collection1_shard1_replica_n43/
[junit4] 2> 1213613 INFO (qtp1174425775-8240) [n:127.0.0.1:42181_fd_%2Fsw c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1213613 INFO (qtp1174425775-8240) [n:127.0.0.1:42181_fd_%2Fsw c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SyncStrategy https://127.0.0.1:42181/fd_/sw/collection1_shard1_replica_n43/ has no replicas
[junit4] 2> 1213613 INFO (qtp1174425775-8240) [n:127.0.0.1:42181_fd_%2Fsw c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 1213628 INFO (qtp1174425775-8240) [n:127.0.0.1:42181_fd_%2Fsw c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:42181/fd_/sw/collection1_shard1_replica_n43/ shard1
[junit4] 2> 1213749 INFO (zkCallback-2128-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 1213785 INFO (qtp1174425775-8240) [n:127.0.0.1:42181_fd_%2Fsw c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1213788 INFO (qtp1174425775-8240) [n:127.0.0.1:42181_fd_%2Fsw c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2107
[junit4] 2> 1213838 INFO (qtp1428436623-8202) [n:127.0.0.1:38579_fd_%2Fsw c:collection1 ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:42181_fd_%252Fsw&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2} status=0 QTime=2360
[junit4] 2> 1213924 INFO (zkCallback-2128-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 1213926 INFO (zkCallback-2144-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 1215516 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.RollingRestartTest_22A663B41891DC5D-001/shard-3-001 of type NRT
[junit4] 2> 1215536 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 1.8.0_172-b11
[junit4] 2> 1215552 INFO (OverseerCollectionConfigSetProcessor-72831695535865861-127.0.0.1:45766_fd_%2Fsw-n_0000000000) [ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000006 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1215609 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1215609 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1215609 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 1215609 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@53fe80d1{/fd_/sw,null,AVAILABLE}
[junit4] 2> 1215610 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@397b5db1{SSL,[ssl, http/1.1]}{127.0.0.1:37202}
[junit4] 2> 1215610 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.e.j.s.Server Started @1215688ms
[junit4] 2> 1215611 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.RollingRestartTest_22A663B41891DC5D-001/tempDir-001/jetty3, replicaType=NRT, solrconfig=solrconfig.xml, hostContext=/fd_/sw, hostPort=37202, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.RollingRestartTest_22A663B41891DC5D-001/shard-3-001/cores}
[junit4] 2> 1215611 ERROR (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1215611 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 1215611 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solrâ„¢ version 7.5.0
[junit4] 2> 1215611 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1215611 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1215611 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-06-20T06:01:04.377Z
[junit4] 2> 1215645 INFO (zkConnectionManagerCallback-2155-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1215646 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1215646 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.RollingRestartTest_22A663B41891DC5D-001/shard-3-001/solr.xml
[junit4] 2> 1215662 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 1215662 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 1215663 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@5491aae3, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1216560 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:44744/solr
[junit4] 2> 1216562 INFO (zkConnectionManagerCallback-2159-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1216588 INFO (zkConnectionManagerCallback-2161-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1216625 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [n:127.0.0.1:37202_fd_%2Fsw ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 1216627 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [n:127.0.0.1:37202_fd_%2Fsw ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1216645 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [n:127.0.0.1:37202_fd_%2Fsw ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 1216645 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [n:127.0.0.1:37202_fd_%2Fsw ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37202_fd_%2Fsw
[junit4] 2> 1216650 INFO (zkCallback-2144-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1216650 INFO (zkCallback-2102-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1216661 INFO (zkCallback-2109-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1216683 INFO (zkCallback-2128-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1216683 INFO (zkCallback-2120-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1216722 INFO (zkCallback-2135-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1217027 INFO (zkCallback-2151-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1217027 INFO (zkCallback-2160-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1217028 INFO (zkConnectionManagerCallback-2168-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1217092 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [n:127.0.0.1:37202_fd_%2Fsw ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 1217166 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [n:127.0.0.1:37202_fd_%2Fsw ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:44744/solr ready
[junit4] 2> 1217168 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [n:127.0.0.1:37202_fd_%2Fsw ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 1217350 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [n:127.0.0.1:37202_fd_%2Fsw ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5491aae3
[junit4] 2> 1217425 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [n:127.0.0.1:37202_fd_%2Fsw ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5491aae3
[junit4] 2> 1217425 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [n:127.0.0.1:37202_fd_%2Fsw ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5491aae3
[junit4] 2> 1217440 INFO (TEST-RollingRestartTest.test-seed#[22A663B41891DC5D]) [n:127.0.0.1:37202_fd_%2Fsw ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.RollingRestartTest_22A663B41891DC5D-001/shard-3-001/cores
[junit4] 2> 1218381 INFO (qtp211175091-8278) [n:127.0.0.1:37202_fd_%2Fsw ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:37202_fd_%252Fsw&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1218459 INFO (OverseerThreadFactory-2635-thread-5) [ c:collection1 s:shard2 ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:37202_fd_%2Fsw for creating new replica
[junit4] 2> 1218601 INFO (qtp211175091-8281) [n:127.0.0.1:37202_fd_%2Fsw x:collection1_shard2_replica_n45] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n45&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1218672 INFO (zkCallback-2144-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1218677 INFO (zkCallback-2128-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1219820 INFO (qtp211175091-8281) [n:127.0.0.1:37202_fd_%2Fsw c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.5.0
[junit4] 2> 1219934 INFO (qtp211175091-8281) [n:127.0.0.1:37202_fd_%2Fsw c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.s.IndexSchema [collection1_shard2_replica_n45] Schema name=test
[junit4] 2> 1221009 INFO (qtp211175091-8281) [n:127.0.0.1:37202_fd_%2Fsw c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 1221154 INFO (qtp211175091-8281) [n:127.0.0.1:37202_fd_%2Fsw c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_n45' using co
[...truncated too long message...]
check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
jar-checksums:
[mkdir] Created dir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/null1311916458
[copy] Copying 39 files to /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/null1311916458
[delete] Deleting directory /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/null1311916458
resolve-example:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
resolve-server:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
jar-checksums:
[mkdir] Created dir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/null1543035746
[copy] Copying 247 files to /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/null1543035746
[delete] Deleting directory /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/null1543035746
check-working-copy:
[ivy:cachepath] :: resolving dependencies :: org.eclipse.jgit#org.eclipse.jgit-caller;working
[ivy:cachepath] confs: [default]
[ivy:cachepath] found org.eclipse.jgit#org.eclipse.jgit;4.6.0.201612231935-r in public
[ivy:cachepath] found com.jcraft#jsch;0.1.53 in public
[ivy:cachepath] found com.googlecode.javaewah#JavaEWAH;1.1.6 in public
[ivy:cachepath] found org.apache.httpcomponents#httpclient;4.3.6 in public
[ivy:cachepath] found org.apache.httpcomponents#httpcore;4.3.3 in public
[ivy:cachepath] found commons-logging#commons-logging;1.1.3 in public
[ivy:cachepath] found commons-codec#commons-codec;1.6 in public
[ivy:cachepath] found org.slf4j#slf4j-api;1.7.2 in public
[ivy:cachepath] :: resolution report :: resolve 177ms :: artifacts dl 56ms
---------------------------------------------------------------------
| | modules || artifacts |
| conf | number| search|dwnlded|evicted|| number|dwnlded|
---------------------------------------------------------------------
| default | 8 | 0 | 0 | 0 || 8 | 0 |
---------------------------------------------------------------------
[wc-checker] Initializing working copy...
[wc-checker] SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
[wc-checker] SLF4J: Defaulting to no-operation (NOP) logger implementation
[wc-checker] SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
[wc-checker] Checking working copy status...
-jenkins-base:
BUILD SUCCESSFUL
Total time: 468 minutes 41 seconds
Archiving artifacts
WARN: No artifacts found that match the file pattern "**/*.events,heapdumps/**,**/hs_err_pid*". Configuration error?
WARN: java.lang.InterruptedException: no matches found within 10000
Recording test results
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
[JENKINS] Lucene-Solr-NightlyTests-7.x - Build # 243 - Still
unstable
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-7.x/243/
1 tests failed.
FAILED: org.apache.solr.cloud.MoveReplicaHDFSTest.testFailedMove
Error Message:
No live SolrServers available to handle this request:[https://127.0.0.1:53944/solr/MoveReplicaHDFSTest_failed_coll_true, https://127.0.0.1:32879/solr/MoveReplicaHDFSTest_failed_coll_true]
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[https://127.0.0.1:53944/solr/MoveReplicaHDFSTest_failed_coll_true, https://127.0.0.1:32879/solr/MoveReplicaHDFSTest_failed_coll_true]
at __randomizedtesting.SeedInfo.seed([4A9C7EFA0DCFD13B:E051AD08BA1C04EB]:0)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:462)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1106)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:886)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:993)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:819)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:942)
at org.apache.solr.cloud.MoveReplicaTest.testFailedMove(MoveReplicaTest.java:288)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:53944/solr/MoveReplicaHDFSTest_failed_coll_true: no servers hosting shard: shard1
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:436)
... 46 more
Build Log:
[...truncated 14194 lines...]
[junit4] Suite: org.apache.solr.cloud.MoveReplicaHDFSTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_4A9C7EFA0DCFD13B-001/init-core-data-001
[junit4] 2> 2291736 INFO (SUITE-MoveReplicaHDFSTest-seed#[4A9C7EFA0DCFD13B]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_4A9C7EFA0DCFD13B-001/tempDir-001
[junit4] 2> 2291736 INFO (SUITE-MoveReplicaHDFSTest-seed#[4A9C7EFA0DCFD13B]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 2291751 INFO (Thread-2139) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 2291751 INFO (Thread-2139) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 2291778 ERROR (Thread-2139) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 2291943 INFO (SUITE-MoveReplicaHDFSTest-seed#[4A9C7EFA0DCFD13B]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:34574
[junit4] 2> 2291967 INFO (zkConnectionManagerCallback-53147-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2291980 INFO (jetty-launcher-53144-thread-1) [ ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 1.8.0_172-b11
[junit4] 2> 2291985 INFO (jetty-launcher-53144-thread-4) [ ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 1.8.0_172-b11
[junit4] 2> 2291987 INFO (jetty-launcher-53144-thread-3) [ ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 1.8.0_172-b11
[junit4] 2> 2291988 INFO (jetty-launcher-53144-thread-2) [ ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 1.8.0_172-b11
[junit4] 2> 2292035 INFO (jetty-launcher-53144-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 2292035 INFO (jetty-launcher-53144-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 2292035 INFO (jetty-launcher-53144-thread-1) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 2292043 INFO (jetty-launcher-53144-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3200ab5c{/solr,null,AVAILABLE}
[junit4] 2> 2292099 INFO (jetty-launcher-53144-thread-3) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 2292099 INFO (jetty-launcher-53144-thread-3) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 2292099 INFO (jetty-launcher-53144-thread-3) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 2292107 INFO (jetty-launcher-53144-thread-3) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@16f3575b{/solr,null,AVAILABLE}
[junit4] 2> 2292108 INFO (jetty-launcher-53144-thread-3) [ ] o.e.j.s.AbstractConnector Started ServerConnector@3a0bfeb9{SSL,[ssl, http/1.1]}{127.0.0.1:32879}
[junit4] 2> 2292215 INFO (jetty-launcher-53144-thread-3) [ ] o.e.j.s.Server Started @2292323ms
[junit4] 2> 2292215 INFO (jetty-launcher-53144-thread-3) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=32879}
[junit4] 2> 2292223 ERROR (jetty-launcher-53144-thread-3) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2292223 INFO (jetty-launcher-53144-thread-3) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 2292215 INFO (jetty-launcher-53144-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 2292223 INFO (jetty-launcher-53144-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 2292223 INFO (jetty-launcher-53144-thread-2) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 2292172 INFO (jetty-launcher-53144-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@6ac9ee8{SSL,[ssl, http/1.1]}{127.0.0.1:48336}
[junit4] 2> 2292227 INFO (jetty-launcher-53144-thread-1) [ ] o.e.j.s.Server Started @2292334ms
[junit4] 2> 2292227 INFO (jetty-launcher-53144-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=48336}
[junit4] 2> 2292171 INFO (jetty-launcher-53144-thread-4) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 2292227 INFO (jetty-launcher-53144-thread-4) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 2292227 INFO (jetty-launcher-53144-thread-4) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 2292227 INFO (jetty-launcher-53144-thread-3) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solrâ„¢ version 7.5.0
[junit4] 2> 2292227 INFO (jetty-launcher-53144-thread-3) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2292227 INFO (jetty-launcher-53144-thread-3) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2292227 INFO (jetty-launcher-53144-thread-3) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-06-18T19:03:42.271Z
[junit4] 2> 2292228 ERROR (jetty-launcher-53144-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2292228 INFO (jetty-launcher-53144-thread-1) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 2292228 INFO (jetty-launcher-53144-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solrâ„¢ version 7.5.0
[junit4] 2> 2292228 INFO (jetty-launcher-53144-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2292228 INFO (jetty-launcher-53144-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2292228 INFO (jetty-launcher-53144-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-06-18T19:03:42.272Z
[junit4] 2> 2292233 INFO (jetty-launcher-53144-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@31a00b03{/solr,null,AVAILABLE}
[junit4] 2> 2292234 INFO (jetty-launcher-53144-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@303093db{SSL,[ssl, http/1.1]}{127.0.0.1:40770}
[junit4] 2> 2292234 INFO (jetty-launcher-53144-thread-2) [ ] o.e.j.s.Server Started @2292342ms
[junit4] 2> 2292234 INFO (jetty-launcher-53144-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=40770}
[junit4] 2> 2292234 ERROR (jetty-launcher-53144-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2292234 INFO (jetty-launcher-53144-thread-2) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 2292235 INFO (jetty-launcher-53144-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solrâ„¢ version 7.5.0
[junit4] 2> 2292235 INFO (jetty-launcher-53144-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2292235 INFO (jetty-launcher-53144-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2292235 INFO (jetty-launcher-53144-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-06-18T19:03:42.279Z
[junit4] 2> 2292343 INFO (jetty-launcher-53144-thread-4) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6bbf905d{/solr,null,AVAILABLE}
[junit4] 2> 2292343 INFO (jetty-launcher-53144-thread-4) [ ] o.e.j.s.AbstractConnector Started ServerConnector@40a979df{SSL,[ssl, http/1.1]}{127.0.0.1:45452}
[junit4] 2> 2292344 INFO (jetty-launcher-53144-thread-4) [ ] o.e.j.s.Server Started @2292451ms
[junit4] 2> 2292344 INFO (jetty-launcher-53144-thread-4) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=45452}
[junit4] 2> 2292344 ERROR (jetty-launcher-53144-thread-4) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2292344 INFO (jetty-launcher-53144-thread-4) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 2292344 INFO (jetty-launcher-53144-thread-4) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solrâ„¢ version 7.5.0
[junit4] 2> 2292344 INFO (jetty-launcher-53144-thread-4) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2292344 INFO (jetty-launcher-53144-thread-4) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2292344 INFO (jetty-launcher-53144-thread-4) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-06-18T19:03:42.388Z
[junit4] 2> 2292346 INFO (zkConnectionManagerCallback-53151-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2292346 INFO (jetty-launcher-53144-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2292353 INFO (zkConnectionManagerCallback-53153-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2292354 INFO (jetty-launcher-53144-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2292375 INFO (zkConnectionManagerCallback-53149-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2292375 INFO (jetty-launcher-53144-thread-3) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2292379 INFO (zkConnectionManagerCallback-53155-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2292379 INFO (jetty-launcher-53144-thread-4) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2292830 INFO (jetty-launcher-53144-thread-4) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34574/solr
[junit4] 2> 2292859 INFO (zkConnectionManagerCallback-53159-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2292861 INFO (zkConnectionManagerCallback-53161-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2293117 INFO (jetty-launcher-53144-thread-4) [n:127.0.0.1:45452_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2293118 INFO (jetty-launcher-53144-thread-4) [n:127.0.0.1:45452_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:45452_solr
[junit4] 2> 2293119 INFO (jetty-launcher-53144-thread-4) [n:127.0.0.1:45452_solr ] o.a.s.c.Overseer Overseer (id=73997493641543686-127.0.0.1:45452_solr-n_0000000000) starting
[junit4] 2> 2293188 INFO (zkConnectionManagerCallback-53168-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2293190 INFO (jetty-launcher-53144-thread-4) [n:127.0.0.1:45452_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:34574/solr ready
[junit4] 2> 2293219 INFO (jetty-launcher-53144-thread-4) [n:127.0.0.1:45452_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45452_solr
[junit4] 2> 2293239 INFO (zkCallback-53167-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 2293249 INFO (jetty-launcher-53144-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34574/solr
[junit4] 2> 2293279 INFO (zkCallback-53160-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 2293390 INFO (zkConnectionManagerCallback-53172-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2293450 INFO (jetty-launcher-53144-thread-4) [n:127.0.0.1:45452_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 2293483 INFO (jetty-launcher-53144-thread-3) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34574/solr
[junit4] 2> 2293507 INFO (zkConnectionManagerCallback-53174-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2293517 INFO (jetty-launcher-53144-thread-2) [n:127.0.0.1:40770_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 2293520 INFO (jetty-launcher-53144-thread-2) [n:127.0.0.1:40770_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2293522 INFO (jetty-launcher-53144-thread-2) [n:127.0.0.1:40770_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 2293522 INFO (jetty-launcher-53144-thread-2) [n:127.0.0.1:40770_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40770_solr
[junit4] 2> 2293527 INFO (zkCallback-53167-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 2293535 INFO (zkConnectionManagerCallback-53179-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2293540 INFO (zkCallback-53160-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 2293548 INFO (jetty-launcher-53144-thread-4) [n:127.0.0.1:45452_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45452.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fbf0850
[junit4] 2> 2293559 INFO (zkCallback-53173-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 2293583 INFO (zkConnectionManagerCallback-53183-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2293591 INFO (jetty-launcher-53144-thread-3) [n:127.0.0.1:32879_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 2293591 INFO (jetty-launcher-53144-thread-4) [n:127.0.0.1:45452_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45452.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fbf0850
[junit4] 2> 2293591 INFO (jetty-launcher-53144-thread-4) [n:127.0.0.1:45452_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45452.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fbf0850
[junit4] 2> 2293593 INFO (jetty-launcher-53144-thread-3) [n:127.0.0.1:32879_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2293595 INFO (jetty-launcher-53144-thread-3) [n:127.0.0.1:32879_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 2293595 INFO (jetty-launcher-53144-thread-3) [n:127.0.0.1:32879_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:32879_solr
[junit4] 2> 2293595 INFO (jetty-launcher-53144-thread-4) [n:127.0.0.1:45452_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_4A9C7EFA0DCFD13B-001/tempDir-001/node2/.
[junit4] 2> 2293597 INFO (zkCallback-53160-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 2293597 INFO (zkCallback-53167-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 2293642 INFO (jetty-launcher-53144-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34574/solr
[junit4] 2> 2293655 INFO (zkCallback-53173-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 2293701 INFO (zkCallback-53182-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 2293719 INFO (zkConnectionManagerCallback-53194-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2293727 INFO (zkConnectionManagerCallback-53190-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2293728 INFO (jetty-launcher-53144-thread-2) [n:127.0.0.1:40770_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 2293729 INFO (jetty-launcher-53144-thread-2) [n:127.0.0.1:40770_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:34574/solr ready
[junit4] 2> 2293775 INFO (jetty-launcher-53144-thread-2) [n:127.0.0.1:40770_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 2294284 INFO (zkConnectionManagerCallback-53196-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2294401 INFO (jetty-launcher-53144-thread-2) [n:127.0.0.1:40770_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40770.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fbf0850
[junit4] 2> 2294437 INFO (jetty-launcher-53144-thread-1) [n:127.0.0.1:48336_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 2294439 INFO (jetty-launcher-53144-thread-1) [n:127.0.0.1:48336_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2294441 INFO (jetty-launcher-53144-thread-1) [n:127.0.0.1:48336_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 2294441 INFO (jetty-launcher-53144-thread-1) [n:127.0.0.1:48336_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48336_solr
[junit4] 2> 2294442 INFO (zkCallback-53173-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 2294444 INFO (zkCallback-53167-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 2294445 INFO (zkCallback-53160-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 2294455 INFO (zkCallback-53182-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 2294460 INFO (jetty-launcher-53144-thread-2) [n:127.0.0.1:40770_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40770.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fbf0850
[junit4] 2> 2294461 INFO (jetty-launcher-53144-thread-2) [n:127.0.0.1:40770_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40770.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fbf0850
[junit4] 2> 2294467 INFO (zkConnectionManagerCallback-53202-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2294468 INFO (jetty-launcher-53144-thread-3) [n:127.0.0.1:32879_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 2294469 INFO (jetty-launcher-53144-thread-3) [n:127.0.0.1:32879_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:34574/solr ready
[junit4] 2> 2294475 INFO (jetty-launcher-53144-thread-2) [n:127.0.0.1:40770_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_4A9C7EFA0DCFD13B-001/tempDir-001/node4/.
[junit4] 2> 2294475 INFO (zkCallback-53195-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 2294483 INFO (zkCallback-53189-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 2294489 INFO (jetty-launcher-53144-thread-3) [n:127.0.0.1:32879_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 2294527 INFO (jetty-launcher-53144-thread-3) [n:127.0.0.1:32879_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_32879.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fbf0850
[junit4] 2> 2294562 INFO (jetty-launcher-53144-thread-3) [n:127.0.0.1:32879_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_32879.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fbf0850
[junit4] 2> 2294563 INFO (jetty-launcher-53144-thread-3) [n:127.0.0.1:32879_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_32879.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fbf0850
[junit4] 2> 2294563 INFO (zkConnectionManagerCallback-53210-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2294593 INFO (jetty-launcher-53144-thread-1) [n:127.0.0.1:48336_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 2294594 INFO (jetty-launcher-53144-thread-1) [n:127.0.0.1:48336_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:34574/solr ready
[junit4] 2> 2294600 INFO (jetty-launcher-53144-thread-3) [n:127.0.0.1:32879_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_4A9C7EFA0DCFD13B-001/tempDir-001/node3/.
[junit4] 2> 2294611 INFO (jetty-launcher-53144-thread-1) [n:127.0.0.1:48336_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 2294649 INFO (jetty-launcher-53144-thread-1) [n:127.0.0.1:48336_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_48336.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fbf0850
[junit4] 2> 2294748 INFO (jetty-launcher-53144-thread-1) [n:127.0.0.1:48336_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_48336.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fbf0850
[junit4] 2> 2294749 INFO (jetty-launcher-53144-thread-1) [n:127.0.0.1:48336_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_48336.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fbf0850
[junit4] 2> 2294763 INFO (jetty-launcher-53144-thread-1) [n:127.0.0.1:48336_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_4A9C7EFA0DCFD13B-001/tempDir-001/node1/.
[junit4] 2> 2295279 INFO (zkConnectionManagerCallback-53213-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2295391 INFO (zkConnectionManagerCallback-53218-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2295392 INFO (SUITE-MoveReplicaHDFSTest-seed#[4A9C7EFA0DCFD13B]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 2295393 INFO (SUITE-MoveReplicaHDFSTest-seed#[4A9C7EFA0DCFD13B]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:34574/solr ready
[junit4] 2> 2295440 INFO (qtp1465145489-101923) [n:127.0.0.1:45452_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :overseerstatus with params action=OVERSEERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2295477 INFO (qtp1465145489-101923) [n:127.0.0.1:45452_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=OVERSEERSTATUS&wt=javabin&version=2} status=0 QTime=37
[junit4] 2> 2295484 INFO (OverseerCollectionConfigSetProcessor-73997493641543686-127.0.0.1:45452_solr-n_0000000000) [ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 2297937 WARN (SUITE-MoveReplicaHDFSTest-seed#[4A9C7EFA0DCFD13B]-worker) [ ] o.a.h.u.NativeCodeLoader Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
[junit4] 1> Formatting using clusterid: testClusterID
[junit4] 2> 2300130 WARN (SUITE-MoveReplicaHDFSTest-seed#[4A9C7EFA0DCFD13B]-worker) [ ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
[junit4] 2> 2300744 INFO (SUITE-MoveReplicaHDFSTest-seed#[4A9C7EFA0DCFD13B]-worker) [ ] o.m.log Logging to org.apache.logging.slf4j.Log4jLogger@13c262f6 via org.mortbay.log.Slf4jLog
[junit4] 2> 2300786 WARN (SUITE-MoveReplicaHDFSTest-seed#[4A9C7EFA0DCFD13B]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 2301947 INFO (SUITE-MoveReplicaHDFSTest-seed#[4A9C7EFA0DCFD13B]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 2302037 INFO (SUITE-MoveReplicaHDFSTest-seed#[4A9C7EFA0DCFD13B]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.4-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_43207_hdfs____.4mna7w/webapp
[junit4] 2> 2303350 INFO (SUITE-MoveReplicaHDFSTest-seed#[4A9C7EFA0DCFD13B]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43207
[junit4] 2> 2306804 WARN (SUITE-MoveReplicaHDFSTest-seed#[4A9C7EFA0DCFD13B]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 2306821 INFO (SUITE-MoveReplicaHDFSTest-seed#[4A9C7EFA0DCFD13B]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 2307001 INFO (SUITE-MoveReplicaHDFSTest-seed#[4A9C7EFA0DCFD13B]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.4-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_37921_datanode____.7lapc5/webapp
[junit4] 2> 2308018 INFO (SUITE-MoveReplicaHDFSTest-seed#[4A9C7EFA0DCFD13B]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37921
[junit4] 2> 2309807 WARN (SUITE-MoveReplicaHDFSTest-seed#[4A9C7EFA0DCFD13B]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 2309808 INFO (SUITE-MoveReplicaHDFSTest-seed#[4A9C7EFA0DCFD13B]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 2309881 INFO (SUITE-MoveReplicaHDFSTest-seed#[4A9C7EFA0DCFD13B]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.4-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_52170_datanode____.eyl0uk/webapp
[junit4] 2> 2311515 INFO (SUITE-MoveReplicaHDFSTest-seed#[4A9C7EFA0DCFD13B]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:52170
[junit4] 2> 2313913 ERROR (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_4A9C7EFA0DCFD13B-001/tempDir-002/hdfsBaseDir/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_4A9C7EFA0DCFD13B-001/tempDir-002/hdfsBaseDir/data/data4/]] heartbeating to localhost/127.0.0.1:37469) [ ] o.a.h.h.s.d.DirectoryScanner dfs.datanode.directoryscan.throttle.limit.ms.per.sec set to value below 1 ms/sec. Assuming default value of 1000
[junit4] 2> 2313939 ERROR (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_4A9C7EFA0DCFD13B-001/tempDir-002/hdfsBaseDir/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_4A9C7EFA0DCFD13B-001/tempDir-002/hdfsBaseDir/data/data2/]] heartbeating to localhost/127.0.0.1:37469) [ ] o.a.h.h.s.d.DirectoryScanner dfs.datanode.directoryscan.throttle.limit.ms.per.sec set to value below 1 ms/sec. Assuming default value of 1000
[junit4] 2> 2314682 INFO (Block report processor) [ ] BlockStateChange BLOCK* processReport 0x6929892eb555bf: from storage DS-1055255b-e447-4e3a-9571-69c7cd725924 node DatanodeRegistration(127.0.0.1:33726, datanodeUuid=135c84cb-711d-428e-ac1a-8dc82dd5c26d, infoPort=42625, infoSecurePort=0, ipcPort=35203, storageInfo=lv=-56;cid=testClusterID;nsid=1764599915;c=0), blocks: 0, hasStaleStorage: true, processing time: 3 msecs
[junit4] 2> 2314682 INFO (Block report processor) [ ] BlockStateChange BLOCK* processReport 0x6929892eb555bf: from storage DS-bbae5ead-6484-4fd2-972d-921c16599e2c node DatanodeRegistration(127.0.0.1:33726, datanodeUuid=135c84cb-711d-428e-ac1a-8dc82dd5c26d, infoPort=42625, infoSecurePort=0, ipcPort=35203, storageInfo=lv=-56;cid=testClusterID;nsid=1764599915;c=0), blocks: 0, hasStaleStorage: false, processing time: 0 msecs
[junit4] 2> 2314692 INFO (Block report processor) [ ] BlockStateChange BLOCK* processReport 0x6929892e6a2bcc: from storage DS-779b687d-3472-41ec-925f-04dac41c92a2 node DatanodeRegistration(127.0.0.1:47495, datanodeUuid=15097fcf-4545-4fb8-9850-8acffb536074, infoPort=56719, infoSecurePort=0, ipcPort=33577, storageInfo=lv=-56;cid=testClusterID;nsid=1764599915;c=0), blocks: 0, hasStaleStorage: true, processing time: 0 msecs
[junit4] 2> 2314692 INFO (Block report processor) [ ] BlockStateChange BLOCK* processReport 0x6929892e6a2bcc: from storage DS-804b89b4-a550-477f-99e9-2e5702552522 node DatanodeRegistration(127.0.0.1:47495, datanodeUuid=15097fcf-4545-4fb8-9850-8acffb536074, infoPort=56719, infoSecurePort=0, ipcPort=33577, storageInfo=lv=-56;cid=testClusterID;nsid=1764599915;c=0), blocks: 0, hasStaleStorage: false, processing time: 0 msecs
[junit4] 2> 2316604 INFO (TEST-MoveReplicaHDFSTest.testNormalMove-seed#[4A9C7EFA0DCFD13B]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 2316608 INFO (TEST-MoveReplicaHDFSTest.testNormalMove-seed#[4A9C7EFA0DCFD13B]) [ ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 1.8.0_172-b11
[junit4] 2> 2316719 INFO (TEST-MoveReplicaHDFSTest.testNormalMove-seed#[4A9C7EFA0DCFD13B]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 2316719 INFO (TEST-MoveReplicaHDFSTest.testNormalMove-seed#[4A9C7EFA0DCFD13B]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 2316719 INFO (TEST-MoveReplicaHDFSTest.testNormalMove-seed#[4A9C7EFA0DCFD13B]) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 2316723 INFO (TEST-MoveReplicaHDFSTest.testNormalMove-seed#[4A9C7EFA0DCFD13B]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@377571aa{/solr,null,AVAILABLE}
[junit4] 2> 2316724 INFO (TEST-MoveReplicaHDFSTest.testNormalMove-seed#[4A9C7EFA0DCFD13B]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@3229532a{SSL,[ssl, http/1.1]}{127.0.0.1:53944}
[junit4] 2> 2316724 INFO (TEST-MoveReplicaHDFSTest.testNormalMove-seed#[4A9C7EFA0DCFD13B]) [ ] o.e.j.s.Server Started @2316832ms
[junit4] 2> 2316724 INFO (TEST-MoveReplicaHDFSTest.testNormalMove-seed#[4A9C7EFA0DCFD13B]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=53944}
[junit4] 2> 2316724 ERROR (TEST-MoveReplicaHDFSTest.testNormalMove-seed#[4A9C7EFA0DCFD13B]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2316724 INFO (TEST-MoveReplicaHDFSTest.testNormalMove-seed#[4A9C7EFA0DCFD13B]) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 2316725 INFO (TEST-MoveReplicaHDFSTest.testNormalMove-seed#[4A9C7EFA0DCFD13B]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solrâ„¢ version 7.5.0
[junit4] 2> 2316725 INFO (TEST-MoveReplicaHDFSTest.testNormalMove-seed#[4A9C7EFA0DCFD13B]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2316725 INFO (TEST-MoveReplicaHDFSTest.testNormalMove-seed#[4A9C7EFA0DCFD13B]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2316725 INFO (TEST-MoveReplicaHDFSTest.testNormalMove-seed#[4A9C7EFA0DCFD13B]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-06-18T19:04:06.769Z
[junit4] 2> 2316799 INFO (zkConnectionManagerCallback-53222-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2316800 INFO (TEST-MoveReplicaHDFSTest.testNormalMove-seed#[4A9C7EFA0DCFD13B]) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2317398 INFO (TEST-MoveReplicaHDFSTest.testNormalMove-seed#[4A9C7EFA0DCFD13B]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34574/solr
[junit4] 2> 2317453 INFO (zkConnectionManagerCallback-53226-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2317497 INFO (zkConnectionManagerCallback-53228-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2317511 INFO (TEST-MoveReplicaHDFSTest.testNormalMove-seed#[4A9C7EFA0DCFD13B]) [n:127.0.0.1:53944_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 2317513 INFO (TEST-MoveReplicaHDFSTest.testNormalMove-seed#[4A9C7EFA0DCFD13B]) [n:127.0.0.1:53944_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2317516 INFO (TEST-MoveReplicaHDFSTest.testNormalMove-seed#[4A9C7EFA0DCFD13B]) [n:127.0.0.1:53944_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 2317516 INFO (TEST-MoveReplicaHDFSTest.testNormalMove-seed#[4A9C7EFA0DCFD13B]) [n:127.0.0.1:53944_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53944_solr
[junit4] 2> 2317518 INFO (zkCallback-53173-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 2317518 INFO (zkCallback-53160-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 2317518 INFO (zkCallback-53167-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 2317519 INFO (zkCallback-53182-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 2317535 INFO (zkCallback-53195-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 2317535 INFO (zkCallback-53189-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 2317542 INFO (zkCallback-53209-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 2317545 INFO (zkCallback-53201-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 2317545 INFO (zkCallback-53217-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 2317563 INFO (zkCallback-53217-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 2317583 INFO (zkCallback-53227-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 2317668 INFO (zkConnectionManagerCallback-53235-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2317669 INFO (TEST-MoveReplicaHDFSTest.testNormalMove-seed#[4A9C7EFA0DCFD13B]) [n:127.0.0.1:53944_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (5)
[junit4] 2> 2317670 INFO (TEST-MoveReplicaHDFSTest.testNormalMove-seed#[4A9C7EFA0DCFD13B]) [n:127.0.0.1:53944_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:34574/solr ready
[junit4] 2> 2317686 INFO (TEST-MoveReplicaHDFSTest.testNormalMove-seed#[4A9C7EFA0DCFD13B]) [n:127.0.0.1:53944_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 2317816 INFO (TEST-MoveReplicaHDFSTest.testNormalMove-seed#[4A9C7EFA0DCFD13B]) [n:127.0.0.1:53944_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_53944.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fbf0850
[junit4] 2> 2317866 INFO (TEST-MoveReplicaHDFSTest.testNormalMove-seed#[4A9C7EFA0DCFD13B]) [n:127.0.0.1:53944_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_53944.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fbf0850
[junit4] 2> 2317866 INFO (TEST-MoveReplicaHDFSTest.testNormalMove-seed#[4A9C7EFA0DCFD13B]) [n:127.0.0.1:53944_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_53944.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fbf0850
[junit4] 2> 2317868 INFO (TEST-MoveReplicaHDFSTest.testNormalMove-seed#[4A9C7EFA0DCFD13B]) [n:127.0.0.1:53944_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_4A9C7EFA0DCFD13B-001/tempDir-001/node5/.
[junit4] 2> 2318647 INFO (zkConnectionManagerCallback-53238-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2318649 INFO (TEST-MoveReplicaHDFSTest.testNormalMove-seed#[4A9C7EFA0DCFD13B]) [ ] o.a.s.c.MoveReplicaTest total_jettys: 5
[junit4] 2> 2318700 INFO (qtp1324446918-101914) [n:127.0.0.1:32879_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=2&collection.configName=conf1&maxShardsPerNode=2&autoAddReplicas=false&name=MoveReplicaHDFSTest_coll_false&nrtReplicas=2&action=CREATE&numShards=2&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2318739 INFO (OverseerThreadFactory-8627-thread-2) [ ] o.a.s.c.a.c.CreateCollectionCmd Create collection MoveReplicaHDFSTest_coll_false
[junit4] 2> 2318859 INFO (OverseerStateUpdate-73997493641543686-127.0.0.1:45452_solr-n_0000000000) [ ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"MoveReplicaHDFSTest_coll_false",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"MoveReplicaHDFSTest_coll_false_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:53944/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 2318862 INFO (OverseerStateUpdate-73997493641543686-127.0.0.1:45452_solr-n_0000000000) [ ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"MoveReplicaHDFSTest_coll_false",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"MoveReplicaHDFSTest_coll_false_shard1_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:45452/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 2318864 INFO (OverseerStateUpdate-73997493641543686-127.0.0.1:45452_solr-n_0000000000) [ ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"MoveReplicaHDFSTest_coll_false",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"MoveReplicaHDFSTest_coll_false_shard2_replica_n4",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:32879/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 2318867 INFO (OverseerStateUpdate-73997493641543686-127.0.0.1:45452_solr-n_0000000000) [ ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"MoveReplicaHDFSTest_coll_false",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"MoveReplicaHDFSTest_coll_false_shard2_replica_n6",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:48336/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 2319246 INFO (qtp1465145489-101922) [n:127.0.0.1:45452_solr x:MoveReplicaHDFSTest_coll_false_shard1_replica_n2] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf1&newCollection=true&name=MoveReplicaHDFSTest_coll_false_shard1_replica_n2&action=CREATE&numShards=2&collection=MoveReplicaHDFSTest_coll_false&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 2319247 INFO (qtp1465145489-101922) [n:127.0.0.1:45452_solr x:MoveReplicaHDFSTest_coll_false_shard1_replica_n2] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 2319303 INFO (qtp1324446918-101913) [n:127.0.0.1:32879_solr x:MoveReplicaHDFSTest_coll_false_shard2_replica_n4] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf1&newCollection=true&name=MoveReplicaHDFSTest_coll_false_shard2_replica_n4&action=CREATE&numShards=2&collection=MoveReplicaHDFSTest_coll_false&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 2319354 INFO (qtp1381005493-102211) [n:127.0.0.1:53944_solr x:MoveReplicaHDFSTest_coll_false_shard1_replica_n1] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf1&newCollection=true&name=MoveReplicaHDFSTest_coll_false_shard1_replica_n1&action=CREATE&numShards=2&collection=MoveReplicaHDFSTest_coll_false&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 2319355 INFO (qtp1469358966-101907) [n:127.0.0.1:48336_solr x:MoveReplicaHDFSTest_coll_false_shard2_replica_n6] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf1&newCollection=true&name=MoveReplicaHDFSTest_coll_false_shard2_replica_n6&action=CREATE&numShards=2&collection=MoveReplicaHDFSTest_coll_false&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 2320407 INFO (qtp1465145489-101922) [n:127.0.0.1:45452_solr c:MoveReplicaHDFSTest_coll_false s:shard1 r:core_node5 x:MoveReplicaHDFSTest_coll_false_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.5.0
[junit4] 2> 2320505 INFO (qtp1465145489-101922) [n:127.0.0.1:45452_solr c:MoveReplicaHDFSTest_coll_false s:shard1 r:core_node5 x:MoveReplicaHDFSTest_coll_false_shard1_replica_n2] o.a.s.s.IndexSchema [MoveReplicaHDFSTest_coll_false_shard1_replica_n2] Schema name=minimal
[junit4] 2> 2320509 INFO (qtp1465145489-101922) [n:127.0.0.1:45452_solr c:MoveReplicaHDFSTest_coll_false s:shard1 r:core_node5 x:MoveReplicaHDFSTest_coll_false_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 2320509 INFO (qtp1465145489-101922) [n:127.0.0.1:45452_solr c:MoveReplicaHDFSTest_coll_false s:shard1 r:core_node5 x:MoveReplicaHDFSTest_coll_false_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'MoveReplicaHDFSTest_coll_false_shard1_replica_n2' using configuration from collection MoveReplicaHDFSTest_coll_false, trusted=true
[junit4] 2> 2320509 INFO (qtp1465145489-101922) [n:127.0.0.1:45452_solr c:MoveReplicaHDFSTest_coll_false s:shard1 r:core_node5 x:MoveReplicaHDFSTest_coll_false_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45452.solr.core.MoveReplicaHDFSTest_coll_false.shard1.replica_n2' (registry 'solr.core.MoveReplicaHDFSTest_coll_false.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fbf0850
[junit4] 2> 2320534 INFO (qtp1469358966-101907) [n:127.0.0.1:48336_solr c:MoveReplicaHDFSTest_coll_false s:shard2 r:core_node8 x:MoveReplicaHDFSTest_coll_false_shard2_replica_n6] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.5.0
[junit4] 2> 2320541 INFO (qtp1324446918-101913) [n:127.0.0.1:32879_solr c:MoveReplicaHDFSTest_coll_false s:shard2 r:core_node7 x:MoveReplicaHDFSTest_coll_false_shard2_replica_n4] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.5.0
[junit4] 2> 2320549 INFO (qtp1381005493-102211) [n:127.0.0.1:53944_solr c:MoveReplicaHDFSTest_coll_false s:shard1 r:core_node3 x:MoveReplicaHDFSTest_coll_false_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.5.0
[junit4] 2> 2320563 INFO (qtp1469358966-101907) [n:127.0.0.1:48336_solr c:MoveReplicaHDFSTest_coll_false s:shard2 r:core_node8 x:MoveReplicaHDFSTest_coll_false_shard2_replica_n6] o.a.s.s.IndexSchema [MoveReplicaHDFSTest_coll_false_shard2_replica_n6] Schema name=minimal
[junit4] 2> 2320565 INFO (qtp1469358966-101907) [n:127.0.0.1:48336_solr c:MoveReplicaHDFSTest_coll_false s:shard2 r:core_node8 x:MoveReplicaHDFSTest_coll_false_shard2_replica_n6] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 2320565 INFO (qtp1469358966-101907) [n:127.0.0.1:48336_solr c:MoveReplicaHDFSTest_coll_false s:shard2 r:core_node8 x:MoveReplicaHDFSTest_coll_false_shard2_replica_n6] o.a.s.c.CoreContainer Creating SolrCore 'MoveReplicaHDFSTest_coll_false_shard2_replica_n6' using configuration from collection MoveReplicaHDFSTest_coll_false, trusted=true
[junit4] 2> 2320566 INFO (qtp1469358966-101907) [n:127.0.0.1:48336_solr c:MoveReplicaHDFSTest_coll_false s:shard2 r:core_node8 x:MoveReplicaHDFSTest_coll_false_shard2_replica_n6] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_48336.solr.core.MoveReplicaHDFSTest_coll_false.shard2.replica_n6' (registry 'solr.core.MoveReplicaHDFSTest_coll_false.shard2.replica_n6') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fbf0850
[junit4] 2> 2320569 INFO (qtp1381005493-102211) [n:127.0.0.1:53944_solr c:MoveReplicaHDFSTest_coll_false s:shard1 r:core_node3 x:MoveReplicaHDFSTest_coll_false_shard1_replica_n1] o.a.s.s.IndexSchema [MoveReplicaHDFSTest_coll_false_shard1_replica_n1] Schema name=minimal
[junit4] 2> 2320572 INFO (qtp1381005493-102211) [n:127.0.0.1:53944_solr c:MoveReplicaHDFSTest_coll_false s:shard1 r:core_node3 x:MoveReplicaHDFSTest_coll_false_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 2320572 INFO (qtp1381005493-102211) [n:127.0.0.1:53944_solr c:MoveReplicaHDFSTest_coll_false s:shard1 r:core_node3 x:MoveReplicaHDFSTest_coll_false_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'MoveReplicaHDFSTest_coll_false_shard1_replica_n1' using configuration from collection MoveReplicaHDFSTest_coll_false, trusted=true
[junit4] 2> 2320576 INFO (qtp1324446918-101913) [n:127.0.0.1:32879_solr c:MoveReplicaHDFSTest_coll_false s:shard2 r:core_node7 x:MoveReplicaHDFSTest_coll_false_shard2_replica_n4] o.a.s.s.IndexSchema [MoveReplicaHDFSTest_coll_false_shard2_replica_n4] Schema name=minimal
[junit4] 2> 2320588 INFO (qtp1324446918-101913) [n:127.0.0.1:32879_solr c:MoveReplicaHDFSTest_coll_false s:shard2 r:core_node7 x:MoveReplicaHDFSTest_coll_false_shard2_replica_n4] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 2320598 INFO (qtp1465145489-101922) [n:127.0.0.1:45452_solr c:MoveReplicaHDFSTest_coll_false s:shard1 r:core_node5 x:MoveReplicaHDFSTest_coll_false_shard1_replica_n2] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:37469/data
[junit4] 2> 2320598 INFO (qtp1465145489-101922) [n:127.0.0.1:45452_solr c:MoveReplicaHDFSTest_coll_false s:shard1 r:core_node5 x:MoveReplicaHDFSTest_coll_false_shard1_replica_n2] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 2320598 INFO (qtp1465145489-101922) [n:127.0.0.1:45452_solr c:MoveReplicaHDFSTest_coll_false s:shard1 r:core_node5 x:MoveReplicaHDFSTest_coll_false_shard1_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 2320598 INFO (qtp1465145489-101922) [n:127.0.0.1:45452_solr c:MoveReplicaHDFSTest_coll_false s:shard1 r:core_node5 x:MoveReplicaHDFSTest_coll_false_shard1_replica_n2] o.a.s.c.SolrCore [[MoveReplicaHDFSTest_coll_false_shard1_replica_n2] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_4A9C7EFA0DCFD13B-001/tempDir-001/node2/MoveReplicaHDFSTest_coll_false_shard1_replica_n2], dataDir=[hdfs://localhost:37469/data/MoveReplicaHDFSTest_coll_false/core_node5/data/]
[junit4] 2> 2320599 INFO (qtp1381005493-102211) [n:127.0.0.1:53944_solr c:MoveReplicaHDFSTest_coll_false s:shard1 r:core_node3 x:MoveReplicaHDFSTest_coll_false_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_53944.solr.core.MoveReplicaHDFSTest_coll_false.shard1.replica_n1' (registry 'solr.core.MoveReplicaHDFSTest_coll_false.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fbf0850
[junit4] 2> 2320599 INFO (qtp1381005493-102211) [n:127.0.0.1:53944_solr c:MoveReplicaHDFSTest_coll_false s:shard1 r:core_node3 x:MoveReplicaHDFSTest_coll_false_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:37469/data
[junit4] 2> 2320599 INFO (qtp1381005493-102211) [n:127.0.0.1:53944_solr c:MoveReplicaHDFSTest_coll_false s:shard1 r:core_node3 x:MoveReplicaHDFSTest_coll_false_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 2320599 INFO (qtp1381005493-102211) [n:127.0.0.1:53944_solr c:MoveReplicaHDFSTest_coll_false s:shard1 r:core_node3 x:MoveReplicaHDFSTest_coll_false_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 2320600 INFO (qtp1324446918-101913) [n:127.0.0.1:32879_solr c:MoveReplicaHDFSTest_coll_false s:shard2 r:core_node7 x:MoveReplicaHDFSTest_coll_false_shard2_replica_n4] o.a.s.c.CoreContainer Creating SolrCore 'MoveReplicaHDFSTest_coll_false_shard2_replica_n4' using configuration from collection MoveReplicaHDFSTest_coll_false, trusted=true
[junit4] 2> 2320600 INFO (qtp1324446918-101913) [n:127.0.0.1:32879_solr c:MoveReplicaHDFSTest_coll_false s:shard2 r:core_node7 x:MoveReplicaHDFSTest_coll_false_shard2_replica_n4] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_32879.solr.core.MoveReplicaHDFSTest_coll_false.shard2.replica_n4' (registry 'solr.core.MoveReplicaHDFSTest_coll_false.shard2.replica_n4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fbf0850
[junit4] 2> 2320600 INFO (qtp1324446918-101913) [n:127.0.0.1:32879_solr c:MoveReplicaHDFSTest_coll_false s:shard2 r:core_node7 x:MoveReplicaHDFSTest_coll_false_shard2_replica_n4] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:37469/data
[junit4] 2> 2320600 INFO (qtp1324446918-101913) [n:127.0.0.1:32879_solr c:MoveReplicaHDFSTest_coll_false s:shard2 r:core_node7 x:MoveReplicaHDFSTest_coll_false_shard2_replica_n4] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 2320600 INFO (qtp1324446918-101913) [n:127.0.0.1:32879_solr c:MoveReplicaHDFSTest_coll_false s:shard2 r:core_node7 x:MoveReplicaHDFSTest_coll_false_shard2_replica_n4] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 2320600 INFO (qtp1324446918-101913) [n:127.0.0.1:32879_solr c:MoveReplicaHDFSTest_coll_false s:shard2 r:core_node7 x:MoveReplicaHDFSTest_coll_false_shard2_replica_n4] o.a.s.c.SolrCore [[MoveReplicaHDFSTest_coll_false_shard2_replica_n4] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_4A9C7EFA0DCFD13B-001/tempDir-001/node3/MoveReplicaHDFSTest_coll_false_shard2_replica_n4], dataDir=[hdfs://localhost:37469/data/MoveReplicaHDFSTest_coll_false/core_node7/data/]
[junit4] 2> 2320605 INFO (qtp1324446918-101913) [n:127.0.0.1:32879_solr c:MoveReplicaHDFSTest_coll_false s:shard2 r:core_node7 x:MoveReplicaHDFSTest_coll_false_shard2_replica_n4] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:37469/data/MoveReplicaHDFSTest_coll_false/core_node7/data/snapshot_metadata
[junit4] 2> 2320600 INFO (qtp1381005493-102211) [n:127.0.0.1:53944_solr c:MoveReplicaHDFSTest_coll_false s:shard1 r:core_node3 x:MoveReplicaHDFSTest_coll_false_shard1_replica_n1] o.a.s.c.SolrCore [[MoveReplicaHDFSTest_coll_false_shard1_replica_n1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_4A9C7EFA0DCFD13B-001/tempDir-001/node5/MoveReplicaHDFSTest_coll_false_shard1_replica_n1], dataDir=[hdfs://localhost:37469/data/MoveReplicaHDFSTest_coll_false/core_node3/data/]
[junit4] 2> 2320617 INFO (qtp1381005493-102211) [n:127.0.0.1:53944_solr c:MoveReplicaHDFSTest_coll_false s:shard1 r:core_node3 x:MoveReplicaHDFSTest_coll_false_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:37469/data/MoveReplicaHDFSTest_coll_false/core_node3/data/snapshot_metadata
[junit4] 2> 2320632 INFO (qtp1469358966-101907) [n:127.0.0.1:48336_solr c:MoveReplicaHDFSTest_coll_false s:shard2 r:core_node8 x:MoveReplicaHDFSTest_coll_false_shard2_replica_n6] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:37469/data
[junit4] 2> 2320632 INFO (qtp1469358966-101907) [n:127.0.0.1:48336_solr c:MoveReplicaHDFSTest_coll_false s:shard2 r:core_node8 x:MoveReplicaHDFSTest_coll_false_shard2_replica_n6] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 2320632 INFO (qtp1469358966-101907) [n:127.0.0.1:48336_solr c:MoveReplicaHDFSTest_coll_false s:shard2 r:core_node8 x:MoveReplicaHDFSTest_coll_false_shard2_replica_n6] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 2320633 INFO (qtp1469358966-101907) [n:127.0.0.1:48336_solr c:MoveReplicaHDFSTest_coll_false s:shard2 r:core_node8 x:MoveReplicaHDFSTest_coll_false_shard2_replica_n6] o.a.s.c.SolrCore [[MoveReplicaHDFSTest_coll_false_shard2_replica_n6] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_4A9C7EFA0DCFD13B-001/tempDir-001/node1/MoveReplicaHDFSTest_coll_false_shard2_replica_n6], dataDir=[hdfs://localhost:37469/data/MoveReplicaHDFSTest_coll_false/core_node8/data/]
[junit4] 2> 2320635 INFO (qtp1469358966-101907) [n:127.0.0.1:48336_solr c:MoveReplicaHDFSTest_coll_false s:shard2 r:core_node8 x:MoveReplicaHDFSTest_coll_false_shard2_replica_n6] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:37469/data/MoveReplicaHDFSTest_coll_false/core_node8/data/snapshot_metadata
[junit4] 2> 2320840 INFO (qtp1465145489-101922) [n:127.0.0.1:45452_solr c:MoveReplicaHDFSTest_coll_false s:shard1 r:core_node5 x:MoveReplicaHDFSTest_coll_false_shard1_replica_n2] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:37469/data/MoveReplicaHDFSTest_coll_false/core_node5/data/snapshot_metadata
[junit4] 2> 2321092 INFO (qtp1381005493-102211) [n:127.0.0.1:53944_solr c:MoveReplicaHDFSTest_coll_false s:shard1 r:core_node3 x:MoveReplicaHDFSTest_coll_false_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:37469/data/MoveReplicaHDFSTest_coll_false/core_node3/data
[junit4] 2> 2321093 INFO (qtp1469358966-101907) [n:127.0.0.1:48336_solr c:MoveReplicaHDFSTest_coll_false s:shard2 r:core_node8 x:MoveReplicaHDFSTest_coll_false_shard2_replica_n6] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:37469/data/MoveReplicaHDFSTest_coll_false/core_node8/data
[junit4] 2> 2321095 INFO (qtp1465145489-101922) [n:127.0.0.1:45452_solr c:MoveReplicaHDFSTest_coll_false s:shard1 r:core_node5 x:MoveReplicaHDFSTest_coll_false_shard1_replica_n2] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:37469/data/MoveReplicaHDFSTest_coll_false/core_node5/data
[junit4] 2> 2321101 INFO (qtp1324446918-101913) [n:127.0.0.1:32879_solr c:MoveReplicaHDFSTest_coll_false s:shard2 r:core_node7 x:MoveReplicaHDFSTest_coll_false_shard2_replica_n4] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:37469/data/MoveReplicaHDFSTest_coll_false/core_node7/data
[junit4] 2> 2321394 INFO (qtp1465145489-101922) [n:127.0.0.1:45452_solr c:MoveReplicaHDFSTest_coll_false s:shard1 r:core_node5 x:MoveReplicaHDFSTest_coll_false_shard1_replica_n2] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:37469/data/MoveReplicaHDFSTest_coll_false/core_node5/data/index
[junit4] 2> 2321437 INFO (qtp1469358966-101907) [n:127.0.0.1:48336_solr c:MoveReplicaHDFSTest_coll_false s:shard2 r:core_node8 x:MoveReplicaHDFSTest_coll_false_shard2_replica_n6] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:37469/data/MoveReplicaHDFSTest_coll_false/core_node8/data/index
[junit4] 2> 2321438 INFO (qtp1381005493-102211) [n:127.0.0.1:53944_solr c:MoveReplicaHDFSTest_coll_false s:shard1 r:core_node3 x:MoveReplicaHDFSTest_coll_false_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:37469/data/MoveReplicaHDFSTest_coll_false/core_node3/data/index
[junit4] 2> 2321516 INFO (qtp1324446918-101913) [n:127.0.0.1:32879_solr c:MoveReplicaHDFSTest_coll_false s:shard2 r:core_node7 x:MoveReplicaHDFSTest_coll_false_shard2_replica_n4] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:37469/data/MoveReplicaHDFSTest_coll_false/core_node7/data/index
[junit4] 2> 2322846 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:47495 is added to blk_1073741826_1002{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-1055255b-e447-4e3a-9571-69c7cd725924:NORMAL:127.0.0.1:33726|RBW], ReplicaUC[[DISK]DS-804b89b4-a550-477f-99e9-2e5702552522:NORMAL:127.0.0.1:47495|RBW]]} size 0
[junit4] 2> 2322944 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33726 is added to blk_1073741827_1003{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-1055255b-e447-4e3a-9571-69c7cd725924:NORMAL:127.0.0.1:33726|RBW], ReplicaUC[[DISK]DS-804b89b4-a550-477f-99e9-2e5702552522:NORMAL:127.0.0.1:47495|RBW]]} size 69
[junit4] 2> 2323122 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33726 is added to blk_1073741826_1002 size 69
[junit4] 2> 2323124 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33726 is added to blk_1073741825_1001{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-779b687d-3472-41ec-925f-04dac41c92a2:NORMAL:127.0.0.1:47495|RBW], ReplicaUC[[DISK]DS-bbae5ead-6484-4fd2-972d-921c16599e2c:NORMAL:127.0.0.1:33726|RBW]]} size 69
[junit4] 2> 2323124 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33726 is added to blk_1073741828_1004{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-779b687d-3472-41ec-925f-04dac41c92a2:NORMAL:127.0.0.1:47495|RBW], ReplicaUC[[DISK]DS-bbae5ead-6484-4fd2-972d-921c16599e2c:NORMAL:127.0.0.1:33726|RBW]]} size 69
[junit4] 2> 2323124 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:47495 is added to blk_1073741825_1001 size 69
[junit4] 2> 2323124 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:47495 is added to blk_1073741828_1004 size 69
[junit4] 2> 2323124 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:47495 is added to blk_1073741827_1003 size 69
[junit4] 2> 2323583 INFO (qtp1381005493-102211) [n:127.0.0.1:53944_solr c:MoveReplicaHDFSTest_coll_false s:shard1 r:core_node3 x:MoveReplicaHDFSTest_coll_false_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
[junit4] 2> 2323584 INFO (qtp1381005493-102211) [n:127.0.0.1:53944_solr c:MoveReplicaHDFSTest_coll_false s:shard1 r:core_node3 x:MoveReplicaHDFSTest_coll_false_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 2323584 INFO (qtp1381005493-102211) [n:127.0.0.1:53944_solr c:MoveReplicaHDFSTest_coll_false s:shard1 r:core_node3 x:MoveReplicaHDFSTest_coll_false_shard1_replica_n1] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=3
[junit4] 2> 2323657 INFO (qtp1381005493-102211) [n:127.0.0.1:53944_solr c:MoveReplicaHDFSTest_coll_false s:shard1 r:core_node3 x:MoveReplicaHDFSTest_coll_false_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2323657 INFO (qtp1381005493-102211) [n:127.0.0.1:53944_solr c:MoveReplicaHDFSTest_coll_false s:shard1 r:core_node3 x:MoveReplicaHDFSTest_coll_false_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2323660 INFO (qtp1469358966-101907) [n:127.0.0.1:48336_solr c:MoveReplicaHDFSTest_coll_false s:shard2 r:core_node8 x:MoveReplicaHDFSTest_coll_false_shard2_replica_n6] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
[junit4] 2> 2323660 INFO (qtp1469358966-101907) [n:127.0.0.1:48336_solr c:MoveReplicaHDFSTest_coll_false s:shard2 r:core_node8 x:MoveReplicaHDFSTest_coll_false_shard2_replica_n6] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 2323660 INFO (qtp1469358966-101907) [n:127.0.0.1:48336_solr c:MoveReplicaHDFSTest_coll_false s:shard2 r:core_node8 x:MoveReplicaHDFSTest_coll_false_shard2_replica_n6] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=3
[junit4] 2> 2323717 INFO (qtp1324446918-101913) [n:127.0.0.1:32879_solr c:MoveReplicaHDFSTest_coll_false s:shard2 r:core_node7 x:MoveReplicaHDFSTest_coll_false_shard2_replica_n4] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
[junit4] 2> 2323717 INFO (qtp1324446918-101913) [n:127.0.0.1:32879_solr c:MoveReplicaHDFSTest_coll_false s:shard2 r:core_node7 x:MoveReplicaHDFSTest_coll_false_shard2_replica_n4] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 2323717 INFO (qtp1324446918-101913) [n:127.0.0.1:32879_solr c:MoveReplicaHDFSTest_coll_false s:shard2 r:core_node7 x:MoveReplicaHDFSTest_coll_false_shard2_replica_n4] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=3
[junit4] 2> 2323741 INFO (qtp1465145489-101922) [n:127.0.0.1:45452_solr c:MoveReplicaHDFSTest_coll_false s:shard1 r:core_node5 x:MoveReplicaHDFSTest_coll_false_shard1_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
[junit4] 2> 2323741 INFO (qtp1465145489-101922) [n:127.0.0.1:45452_solr c:MoveReplicaHDFSTest_coll_false s:shard1 r:core_node5 x:MoveReplicaHDFSTest_coll_false_shard1_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 2323741 INFO (qtp1465145489-101922) [n:127.0.0.1:45452_solr c:MoveReplicaHDFSTest_coll_false s:shard1 r:core_node5 x:MoveReplicaHDFSTest_coll_false_shard1_replica_n2] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=3
[junit4] 2> 2323823 INFO (qtp1324446918-101913) [n:127.0.0.1:32879_solr c:MoveReplicaHDFSTest_coll_false s:shard2 r:core_node7 x:MoveReplicaHDFSTest_coll_false_shard2_replica_n4] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2323825 INFO (qtp1324446918-101913) [n:127.0.0.1:32879_solr c:MoveReplicaHDFSTest_coll_false s:shard2 r:core_node7 x:MoveReplicaHDFSTest_coll_false_shard2_replica_n4] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2323829 INFO (qtp1465145489-101922) [n:127.0.0.1:45452_solr c:MoveReplicaHDFSTest_coll_false s:shard1 r:core_node5 x:MoveReplicaHDFSTest_coll_false_shard1_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2323829 INFO (qtp1465145489-101922) [n:127.0.0.1:45452_solr c:MoveReplicaHDFSTest_coll_false s:shard1 r:core_node5 x:MoveReplicaHDFSTest_coll_false_shard1_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2323844 INFO (qtp1469358966-101907) [n:127.0.0.1:48336_solr c:MoveReplicaHDFSTest_coll_false s:shard2 r:core_node8 x:MoveReplicaHDFSTest_coll_false_shard2_replica_n6] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2323844 INFO (qtp1469358966-101907) [n:127.0.0.1:48336_solr c:MoveReplicaHDFSTest_coll_false s:shard2 r:core_node8 x:MoveReplicaHDFSTest_coll_false_shard2_replica_n6] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2324091 INFO (qtp1465145489-101922) [n:127.0.0.1:45452_solr c:MoveReplicaHDFSTest_coll_false s:shard1 r:core_node5 x:MoveReplicaHDFSTest_coll_false_shard1_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@b59ea5a[MoveReplicaHDFSTest_coll_false_shard1_replica_n2] main]
[junit4] 2> 2324095 INFO (qtp1465145489-101922) [n:127.0.0.1:45452_solr c:MoveReplicaHDFSTest_coll_false s:shard1 r:core_node5 x:MoveReplicaHDFSTest_coll_false_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 2324096 INFO (qtp1465145489-101922) [n:127.0.0.1:45452_solr c:MoveReplicaHDFSTest_coll_false s:shard1 r:core_node5 x:MoveReplicaHDFSTest_coll_false_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2324109 INFO (qtp1465145489-101922) [n:127.0.0.1:45452_solr c:MoveReplicaHDFSTest_coll_false s:shard1 r:core_node5 x:MoveReplicaHDFSTest_coll_false_shard1_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 2324121 INFO (qtp1469358966-101907) [n:127.0.0.1:48336_solr c:MoveReplicaHDFSTest_coll_false s:shard2 r:core_node8 x:MoveReplicaHDFSTest_coll_false_shard2_replica_n6] o.a.s.s.SolrIndexSearcher Opening [Searcher@1cc279ce[MoveReplicaHDFSTest_coll_false_shard2_replica_n6] main]
[junit4] 2> 2324121 INFO (searcherExecutor-8659-thread-1-processing-n:127.0.0.1:45452_solr x:MoveReplicaHDFSTest_coll_false_shard1_replica_n2 c:MoveReplicaHDFSTest_coll_false s:shard1 r:core_node5) [n:127.0.0.1:45452_solr c:MoveReplicaHDFSTest_coll_false s:shard1 r:core_node5 x:MoveReplicaHDFSTest_coll_false_shard1_replica_n2] o.a.s.c.SolrCore [MoveReplicaHDFSTest_coll_false_shard1_replica_n2] Registered new searcher Searcher@b59ea5a[MoveReplicaHDFSTest_coll_false_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2324128 INFO (qtp1465145489-101922) [n:127.0.0.1:45452_solr c:MoveReplicaHDFSTest_coll_false s:shard1 r:core_node5 x:MoveReplicaHDFSTest_coll_false_shard1_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1603638294397059072
[junit4] 2> 2324130 INFO (qtp1469358966-101907) [n:127.0.0.1:48336_solr c:MoveReplicaHDFSTest_coll_false s:shard2 r:core_node8 x:MoveReplicaHDFSTest_coll_false_shard2_replica_n6] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 2324131 INFO (qtp1469358966-101907) [n:127.0.0.1:48336_solr c:MoveReplicaHDFSTest_coll_false s:shard2 r:core_node8 x:MoveReplicaHDFSTest_coll_false_shard2_replica_n6] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2324132 INFO (qtp1469358966-101907) [n:127.0.0.1:48336_solr c:MoveReplicaHDFSTest_coll_false s:shard2 r:core_node8 x:MoveReplicaHDFSTest_coll_false_shard2_replica_n6] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 2324132 INFO (qtp1469358966-101907) [n:127.0.0.1:48336_solr c:MoveReplicaHDFSTest_coll_false s:shard2 r:core_node8 x:MoveReplicaHDFSTest_coll_false_shard2_replica_n6] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1603638294401253376
[junit4] 2> 2324134 INFO (qtp1324446918-101913) [n:127.0.0.1:32879_solr c:MoveReplicaHDFSTest_coll_false s:shard2 r:core_node7 x:MoveReplicaHDFSTest_coll_false_shard2_replica_n4] o.a.s.s.SolrIndexSearcher Opening [Searcher@792f69eb[MoveReplicaHDFSTest_coll_false_shard2_replica_n4] main]
[junit4] 2> 2324136 INFO (searcherExecutor-8660-thread-1-processing-n:127.0.0.1:48336_solr x:MoveReplicaHDFSTest_coll_false_shard2_replica_n6 c:MoveReplicaHDFSTest_coll_false s:shard2 r:core_node8) [n:127.0.0.1:48336_solr c:MoveReplicaHDFSTest_coll_false s:shard2 r:core_node8 x:MoveReplicaHDFSTest_coll_false_shard2_replica_n6] o.a.s.c.SolrCore [MoveReplicaHDFSTest_coll_false_shard2_replica_n6] Registered new searcher Searcher@1cc279ce[MoveReplicaHDFSTest_coll_false_shard2_replica_n6] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2324142 INFO (qtp1469358966-101907) [n:127.0.0.1:48336_solr c:MoveReplicaHDFSTest_coll_false s:shard2 r:core_node8 x:MoveReplicaHDFSTest_coll_false_shard2_replica_n6] o.a.s.c.ZkShardTerms Successful update of terms at /collections/MoveReplicaHDFSTest_coll_false/terms/shard2 to Terms{values={core_node8=0}, version=0}
[junit4] 2> 2324143 INFO (qtp1324446918-101913) [n:127.0.0.1:32879_solr c:MoveReplicaHDFSTest_coll_false s:shard2 r:core_node7 x:MoveReplicaHDFSTest_coll_false_shard2_replica_n4] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 2324144 INFO (qtp1324446918-101913) [n:127.0.0.1:32879_solr c:MoveReplicaHDFSTest_coll_false s:shard2 r:core_node7 x:MoveReplicaHDFSTest_coll_false_shard2_replica_n4] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2324145 INFO (qtp1324446918-101913) [n:127.0.0.1:32879_solr c:MoveReplicaHDFSTest_coll_false s:shard2 r:core_node7 x:MoveReplicaHDFSTest_coll_false_shard2_replica_n4] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 2324146 INFO (searcherExecutor-8662-thread-1-processing-n:127.0.0.1:32879_solr x:MoveReplicaHDFSTest_coll_false_shard2_replica_n4 c:MoveReplicaHDFSTest_coll_false s:shard2 r:core_node7) [n:127.0.0.1:32879_solr c:MoveReplicaHDFSTest_coll_false s:shard2 r:core_node7 x:MoveReplicaHDFSTest_coll_false_shard2_replica_n4] o.a.s.c.SolrCore [MoveReplicaHDFSTest_coll_false_shard2_replica_n4] Registered new searcher Searcher@792f69eb[MoveReplicaHDFSTest_coll_false_shard2_replica_n4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2324146 INFO (qtp1324446918-101913) [n:127.0.0.1:32879_solr c:MoveReplicaHDFSTest_coll_false s:shard2 r:core_node7 x:MoveReplicaHDFSTest_coll_false_shard2_replica_n4] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1603638294415933440
[junit4] 2> 2324155 INFO (qtp1324446918-101913) [n:127.0.0.1:32879_solr c:MoveReplicaHDFSTest_coll_false s:shard2 r:core_node7 x:MoveReplicaHDFSTest_coll_false_shard2_replica_n4] o.a.s.c.ZkShardTerms Successful update of terms at /collections/MoveReplicaHDFSTest_coll_false/terms/shard2 to Terms{values={core_node7=0, core_node8=0}, version=1}
[junit4] 2> 2324159 INFO (qtp1469358966-101907) [n:127.0.0.1:48336_solr c:MoveReplicaHDFSTest_coll_false s:shard2 r:core_node8 x:MoveReplicaHDFSTest_coll_false_shard2_replica_n6] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 2324159 INFO (qtp1469358966-101907) [n:127.0.0.1:48336_solr c:MoveReplicaHDFSTest_coll_false s:shard2 r:core_node8 x:MoveReplicaHDFSTest_coll_false_shard2_replica_n6] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 2324159 INFO (qtp1469358966-101907) [n:127.0.0.1:48336_solr c:MoveReplicaHDFSTest_coll_false s:shard2 r:core_node8 x:MoveReplicaHDFSTest_coll_false_shard2_replica_n6] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:48336/solr/MoveReplicaHDFSTest_coll_false_shard2_replica_n6/
[junit4] 2> 2324163 INFO (qtp1381005493-102211) [n:127.0.0.1:53944_solr c:MoveReplicaHDFSTest_coll_false s:shard1 r:core_node3 x:MoveReplicaHDFSTest_coll_false_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@acff73a[MoveReplicaHDFSTest_coll_false_shard1_replica_n1] main]
[junit4] 2> 2324165 INFO (qtp1469358966-101907) [n:127.0.0.1:48336_solr c:MoveReplicaHDFSTest_coll_false s:shard2 r:core_node8 x:MoveReplicaHDFSTest_coll_false_shard2_replica_n6] o.a.s.u.PeerSync PeerSync: core=MoveReplicaHDFSTest_coll_false_shard2_replica_n6 url=https://127.0.0.1:48336/solr START replicas=[https://127.0.0.1:32879/solr/MoveReplicaHDFSTest_coll_false_shard2_replica_n4/] nUpdates=100
[junit4] 2> 2324165 INFO (qtp1381005493-102211) [n:127.0.0.1:53944_solr c:MoveReplicaHDFSTest_coll_false s:shard1 r:core_node3 x:MoveReplicaHDFSTest_coll_false_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 2324165 INFO (qtp1381005493-102211) [n:127.0.0.1:53944_solr c:MoveReplicaHDFSTest_coll_false s:shard1 r:core_node3 x:MoveReplicaHDFSTest_coll_false_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2324166 INFO (qtp1381005493-102211) [n:127.0.0.1:53944_solr c:MoveReplicaHDFSTest_coll_false s:shard1 r:core_node3 x:MoveReplicaHDFSTest_coll_false_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 2324188 INFO (qtp1381005493-102211) [n:127.0.0.1:53944_solr c:MoveReplicaHDFSTest_coll_false s:shard1 r:core_node3 x:MoveReplicaHDFSTest_coll_false_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1603638294459973632
[junit4] 2> 2324191 INFO (searcherExecutor-8661-thread-1-processing-n:127.0.0.1:53944_solr x:MoveReplicaHDFSTest_coll_false_shard1_replica_n1 c:MoveReplicaHDFSTest_coll_false s:shard1 r:core_node3) [n:127.0.0.1:53944_solr c:MoveReplicaHDFSTest_coll_false s:shard1 r:core_node3 x:MoveReplicaHDFSTest_coll_false_shard1_replica_n1] o.a.s.c.SolrCore [MoveReplicaHDFSTest_coll_false_shard1_replica_n1] Registered new searcher Searcher@acff73a[MoveReplicaHDFSTest_coll_false_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2324205 INFO (qtp1465145489-101922) [n:127.0.0.1:45452_solr c:MoveReplicaHDFSTest_coll_false s:shard1 r:core_node5 x:MoveReplicaHDFSTest_coll_false_shard1_replica_n2] o.a.s.c.ZkShardTerms Successful update of terms at /collections/MoveReplicaHDFSTest_coll_false/terms/shard1 to Terms{values={core_node5=0}, version=0}
[junit4] 2> 2324207 INFO (qtp1381005493-102211) [n:127.0.0.1:53944_solr c:MoveReplicaHDFSTest_coll_false s:shard1 r:core_node3 x:MoveReplicaHDFSTest_coll_false_shard1_replica_n1] o.a.s.c.ZkShardTerms Successful update of terms at /collections/MoveReplicaHDFSTest_coll_false/terms/shard1 to Terms{values={core_node3=0, core_node5=0}, version=1}
[junit4] 2> 2324211 INFO (qtp1465145489-101922) [n:127.0.0.1:45452_solr c:MoveReplicaHDFSTest_coll_false s:shard1 r:core_node5 x:MoveReplicaHDFSTest_coll_false_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 2324211 INFO (qtp1465145489-101922) [n:127.0.0.1:45452_solr c:MoveReplicaHDFSTest_coll_false s:shard1 r:core_node5 x:MoveReplicaHDFSTest_coll_false_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 2324211 INFO (qtp1465145489-101922) [n:127.0.0.1:45452_solr c:MoveReplicaHDFSTest_coll_false s:shard1 r:core_node5 x:MoveReplicaHDFSTest_coll_false_shard1_replica_n2] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:45452/solr/MoveReplicaHDFSTest_coll_false_shard1_replica_n2/
[junit4] 2> 2324212 INFO (qtp1465145489-101922) [n:127.0.0.1:45452_solr c:MoveReplicaHDFSTest_coll_false s:shard1 r:core_node5 x:MoveReplicaHDFSTest_coll_false_shard1_replica_n2] o.a.s.u.PeerSync PeerSync: core=MoveReplicaHDFSTest_coll_false_shard1_replica_n2 url=https://127.0.0.1:45452/solr START replicas=[https://127.0.0.1:53944/solr/MoveReplicaHDFSTest_coll_false_shard1_replica_n1/] nUpdates=100
[junit4] 2> 2324252 INFO (qtp1324446918-101916) [n:127.0.0.1:32879_solr c:MoveReplicaHDFSTest_coll_false s:shard2 r:core_node7 x:MoveReplicaHDFSTest_coll_false_shard2_replica_n4] o.a.s.c.S.Request [MoveReplicaHDFSTest_coll_false_shard2_replica_n4] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=10
[junit4] 2> 2324264 INFO (qtp1381005493-102207) [n:127.0.0.1:53944_solr c:MoveReplicaHDFSTest_coll_false s:shard1 r:core_node3 x:MoveReplicaHDFSTest_coll_false_shard1_replica_n1] o.a.s.c.S.Request [MoveReplicaHDFSTest_coll_false_shard1_replica_n1] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=8
[junit4] 2> 2324579 INFO (qtp1469358966-101907) [n:127.0.0.1:48336_solr c:MoveReplicaHDFSTest_coll_false s:shard2 r:core_node8 x:MoveReplicaHDFSTest_coll_false_shard2_replica_n6] o.a.s.u.PeerSync PeerSync: core=MoveReplicaHDFSTest_coll_false_shard2_replica_n6 url=https://127.0.0.1:48336/solr DONE. We have no versions. sync failed.
[junit4] 2> 2324579 INFO (qtp1469358966-101907) [n:127.0.0.1:48336_solr c:MoveReplicaHDFSTest_coll_false s:shard2 r:core_node8 x:MoveReplicaHDFSTest_coll_false_shard2_replica_n6] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 2324579 INFO (qtp1469358966-101907) [n:127.0.0.1:48336_solr c:MoveReplicaHDFSTest_coll_false s:shard2 r:core_node8 x:MoveReplicaHDFSTest_coll_false_shard2_replica_n6] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 2324579 INFO (qtp1469358966-101907) [n:127.0.0.1:48336_solr c:MoveReplicaHDFSTest_coll_false s:shard2 r:core_node8 x:MoveReplicaHDFSTest_coll_false_shard2_replica_n6] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 2324579 INFO (qtp1465145489-101922) [n:127.0.0.1:45452_solr c:MoveReplicaHDFSTest_coll_false s:shard1 r:core_node5 x:MoveReplicaHDFSTest_coll_false_shard1_replica_n2] o.a.s.u.PeerSync PeerSync: core=MoveReplicaHDFSTest_coll_false_shard1_replica_n2 url=https://127.0.0.1:45452/solr DONE. We have no versions. sync failed.
[junit4] 2> 2324579 INFO (qtp1465145489-101922) [n:127.0.0.1:45452_solr c:MoveReplicaHDFSTest_coll_false s:shard1 r:core_node5 x:MoveReplicaHDFSTest_coll_false_shard1_replica_n2] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 2324579 INFO (qtp1465145489-101922) [n:127.0.0.1:45452_solr c:MoveReplicaHDFSTest_coll_false s:shard1 r:core_node5 x:MoveReplicaHDFSTest_coll_false_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 2324579 INFO (qtp1465145489-101922) [n:127.0.0.1:45452_solr c:MoveReplicaHDFSTest_coll_false s:shard1 r:core_node5 x:MoveReplicaHDFSTest_coll_false_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 2324694 INFO (qtp1465145489-101922) [n:127.0.0.1:45452_solr c:MoveReplicaHDFSTest_coll_false s:shard1 r:core_node5 x:MoveReplicaHDFSTest_coll_false_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:45452/solr/MoveReplicaHDFSTest_coll_false_shard1_replica_n2/ shard1
[junit4] 2> 2324694 INFO (qtp1469358966-101907) [n:127.0.0.1:48336_solr c:MoveReplicaHDFSTest_coll_false s:shard2 r:core_node8 x:MoveReplicaHDFSTest_coll_false_shard2_replica_n6] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:48336/solr/MoveReplicaHDFSTest_coll_false_shard2_replica_n6/ shard2
[junit4] 2> 2324800 INFO (qtp1469358966-101907) [n:127.0.0.1:48336_solr c:MoveReplicaHDFSTest_coll_false s:shard2 r:core_node8 x:MoveReplicaHDFSTest_coll_false_shard2_replica_n6] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 2324803 INFO (qtp1469358966-101907) [n:127.0.0.1:48336_solr c:MoveReplicaHDFSTest_coll_false s:shard2 r:core_node8 x:MoveReplicaHDFSTest_coll_false_shard2_replica_n6] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf1&newCollection=true&name=MoveReplicaHDFSTest_coll_false_shard2_replica_n6&action=CREATE&numShards=2&collection=MoveReplicaHDFSTest_coll_false&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=5447
[junit4] 2> 2324804 INFO (qtp1465145489-101922) [n:127.0.0.1:45452_solr c:MoveReplicaHDFSTest_coll_false s:shard1 r:core_node5 x:MoveReplicaHDFSTest_coll_false_shard1_replica_n2] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 2324806 INFO (qtp1465145489-101922) [n:127.0.0.1:45452_solr c:MoveReplicaHDFSTest_coll_false s:s
[...truncated too long message...]
/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
jar-checksums:
[mkdir] Created dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/null1812694335
[copy] Copying 39 files to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/null1812694335
[delete] Deleting directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/null1812694335
resolve-example:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
resolve-server:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
jar-checksums:
[mkdir] Created dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/null1111743533
[copy] Copying 247 files to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/null1111743533
[delete] Deleting directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/null1111743533
check-working-copy:
[ivy:cachepath] :: resolving dependencies :: org.eclipse.jgit#org.eclipse.jgit-caller;working
[ivy:cachepath] confs: [default]
[ivy:cachepath] found org.eclipse.jgit#org.eclipse.jgit;4.6.0.201612231935-r in public
[ivy:cachepath] found com.jcraft#jsch;0.1.53 in public
[ivy:cachepath] found com.googlecode.javaewah#JavaEWAH;1.1.6 in public
[ivy:cachepath] found org.apache.httpcomponents#httpclient;4.3.6 in public
[ivy:cachepath] found org.apache.httpcomponents#httpcore;4.3.3 in public
[ivy:cachepath] found commons-logging#commons-logging;1.1.3 in public
[ivy:cachepath] found commons-codec#commons-codec;1.6 in public
[ivy:cachepath] found org.slf4j#slf4j-api;1.7.2 in public
[ivy:cachepath] :: resolution report :: resolve 72ms :: artifacts dl 7ms
---------------------------------------------------------------------
| | modules || artifacts |
| conf | number| search|dwnlded|evicted|| number|dwnlded|
---------------------------------------------------------------------
| default | 8 | 0 | 0 | 0 || 8 | 0 |
---------------------------------------------------------------------
[wc-checker] Initializing working copy...
[wc-checker] SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
[wc-checker] SLF4J: Defaulting to no-operation (NOP) logger implementation
[wc-checker] SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
[wc-checker] Checking working copy status...
-jenkins-base:
BUILD SUCCESSFUL
Total time: 373 minutes 40 seconds
Archiving artifacts
WARN: No artifacts found that match the file pattern "**/*.events,heapdumps/**,**/hs_err_pid*". Configuration error?
WARN: java.lang.InterruptedException: no matches found within 10000
Recording test results
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
[JENKINS] Lucene-Solr-NightlyTests-7.x - Build # 242 - Failure
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-7.x/242/
2 tests failed.
FAILED: org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest.testSplitIntegration
Error Message:
last state: DocCollection(testSplitIntegration_collection//clusterstate.json/105)={ "replicationFactor":"2", "pullReplicas":"0", "router":{"name":"compositeId"}, "maxShardsPerNode":"2", "autoAddReplicas":"false", "nrtReplicas":"2", "tlogReplicas":"0", "autoCreated":"true", "shards":{ "shard2":{ "replicas":{ "core_node3":{ "core":"testSplitIntegration_collection_shard2_replica_n3", "leader":"true", "SEARCHER.searcher.maxDoc":11, "SEARCHER.searcher.deletedDocs":0, "INDEX.sizeInBytes":15740, "node_name":"127.0.0.1:10000_solr", "state":"active", "type":"NRT", "INDEX.sizeInGB":1.4659017324447632E-5, "SEARCHER.searcher.numDocs":11}, "core_node4":{ "core":"testSplitIntegration_collection_shard2_replica_n4", "SEARCHER.searcher.maxDoc":11, "SEARCHER.searcher.deletedDocs":0, "INDEX.sizeInBytes":15740, "node_name":"127.0.0.1:10001_solr", "state":"active", "type":"NRT", "INDEX.sizeInGB":1.4659017324447632E-5, "SEARCHER.searcher.numDocs":11}}, "range":"0-7fffffff", "state":"active"}, "shard1":{ "stateTimestamp":"1529110277622827600", "replicas":{ "core_node1":{ "core":"testSplitIntegration_collection_shard1_replica_n1", "leader":"true", "SEARCHER.searcher.maxDoc":14, "SEARCHER.searcher.deletedDocs":0, "INDEX.sizeInBytes":17240, "node_name":"127.0.0.1:10000_solr", "state":"active", "type":"NRT", "INDEX.sizeInGB":1.605600118637085E-5, "SEARCHER.searcher.numDocs":14}, "core_node2":{ "core":"testSplitIntegration_collection_shard1_replica_n2", "SEARCHER.searcher.maxDoc":14, "SEARCHER.searcher.deletedDocs":0, "INDEX.sizeInBytes":17240, "node_name":"127.0.0.1:10001_solr", "state":"active", "type":"NRT", "INDEX.sizeInGB":1.605600118637085E-5, "SEARCHER.searcher.numDocs":14}}, "range":"80000000-ffffffff", "state":"inactive"}, "shard1_1":{ "parent":"shard1", "stateTimestamp":"1529110277653672700", "range":"c0000000-ffffffff", "state":"active", "replicas":{ "core_node10":{ "leader":"true", "core":"testSplitIntegration_collection_shard1_1_replica1", "SEARCHER.searcher.maxDoc":6, "SEARCHER.searcher.deletedDocs":0, "INDEX.sizeInBytes":13240, "node_name":"127.0.0.1:10000_solr", "base_url":"http://127.0.0.1:10000/solr", "state":"active", "type":"NRT", "INDEX.sizeInGB":1.2330710887908936E-5, "SEARCHER.searcher.numDocs":6}, "core_node9":{ "core":"testSplitIntegration_collection_shard1_1_replica0", "SEARCHER.searcher.maxDoc":6, "SEARCHER.searcher.deletedDocs":0, "INDEX.sizeInBytes":13240, "node_name":"127.0.0.1:10001_solr", "base_url":"http://127.0.0.1:10001/solr", "state":"active", "type":"NRT", "INDEX.sizeInGB":1.2330710887908936E-5, "SEARCHER.searcher.numDocs":6}}}, "shard1_0":{ "parent":"shard1", "stateTimestamp":"1529110277653354950", "range":"80000000-bfffffff", "state":"active", "replicas":{ "core_node7":{ "leader":"true", "core":"testSplitIntegration_collection_shard1_0_replica0", "SEARCHER.searcher.maxDoc":7, "SEARCHER.searcher.deletedDocs":0, "INDEX.sizeInBytes":23980, "node_name":"127.0.0.1:10001_solr", "base_url":"http://127.0.0.1:10001/solr", "state":"active", "type":"NRT", "INDEX.sizeInGB":2.2333115339279175E-5, "SEARCHER.searcher.numDocs":7}, "core_node8":{ "core":"testSplitIntegration_collection_shard1_0_replica1", "SEARCHER.searcher.maxDoc":7, "SEARCHER.searcher.deletedDocs":0, "INDEX.sizeInBytes":23980, "node_name":"127.0.0.1:10000_solr", "base_url":"http://127.0.0.1:10000/solr", "state":"active", "type":"NRT", "INDEX.sizeInGB":2.2333115339279175E-5, "SEARCHER.searcher.numDocs":7}}}}}
Stack Trace:
java.util.concurrent.TimeoutException: last state: DocCollection(testSplitIntegration_collection//clusterstate.json/105)={
"replicationFactor":"2",
"pullReplicas":"0",
"router":{"name":"compositeId"},
"maxShardsPerNode":"2",
"autoAddReplicas":"false",
"nrtReplicas":"2",
"tlogReplicas":"0",
"autoCreated":"true",
"shards":{
"shard2":{
"replicas":{
"core_node3":{
"core":"testSplitIntegration_collection_shard2_replica_n3",
"leader":"true",
"SEARCHER.searcher.maxDoc":11,
"SEARCHER.searcher.deletedDocs":0,
"INDEX.sizeInBytes":15740,
"node_name":"127.0.0.1:10000_solr",
"state":"active",
"type":"NRT",
"INDEX.sizeInGB":1.4659017324447632E-5,
"SEARCHER.searcher.numDocs":11},
"core_node4":{
"core":"testSplitIntegration_collection_shard2_replica_n4",
"SEARCHER.searcher.maxDoc":11,
"SEARCHER.searcher.deletedDocs":0,
"INDEX.sizeInBytes":15740,
"node_name":"127.0.0.1:10001_solr",
"state":"active",
"type":"NRT",
"INDEX.sizeInGB":1.4659017324447632E-5,
"SEARCHER.searcher.numDocs":11}},
"range":"0-7fffffff",
"state":"active"},
"shard1":{
"stateTimestamp":"1529110277622827600",
"replicas":{
"core_node1":{
"core":"testSplitIntegration_collection_shard1_replica_n1",
"leader":"true",
"SEARCHER.searcher.maxDoc":14,
"SEARCHER.searcher.deletedDocs":0,
"INDEX.sizeInBytes":17240,
"node_name":"127.0.0.1:10000_solr",
"state":"active",
"type":"NRT",
"INDEX.sizeInGB":1.605600118637085E-5,
"SEARCHER.searcher.numDocs":14},
"core_node2":{
"core":"testSplitIntegration_collection_shard1_replica_n2",
"SEARCHER.searcher.maxDoc":14,
"SEARCHER.searcher.deletedDocs":0,
"INDEX.sizeInBytes":17240,
"node_name":"127.0.0.1:10001_solr",
"state":"active",
"type":"NRT",
"INDEX.sizeInGB":1.605600118637085E-5,
"SEARCHER.searcher.numDocs":14}},
"range":"80000000-ffffffff",
"state":"inactive"},
"shard1_1":{
"parent":"shard1",
"stateTimestamp":"1529110277653672700",
"range":"c0000000-ffffffff",
"state":"active",
"replicas":{
"core_node10":{
"leader":"true",
"core":"testSplitIntegration_collection_shard1_1_replica1",
"SEARCHER.searcher.maxDoc":6,
"SEARCHER.searcher.deletedDocs":0,
"INDEX.sizeInBytes":13240,
"node_name":"127.0.0.1:10000_solr",
"base_url":"http://127.0.0.1:10000/solr",
"state":"active",
"type":"NRT",
"INDEX.sizeInGB":1.2330710887908936E-5,
"SEARCHER.searcher.numDocs":6},
"core_node9":{
"core":"testSplitIntegration_collection_shard1_1_replica0",
"SEARCHER.searcher.maxDoc":6,
"SEARCHER.searcher.deletedDocs":0,
"INDEX.sizeInBytes":13240,
"node_name":"127.0.0.1:10001_solr",
"base_url":"http://127.0.0.1:10001/solr",
"state":"active",
"type":"NRT",
"INDEX.sizeInGB":1.2330710887908936E-5,
"SEARCHER.searcher.numDocs":6}}},
"shard1_0":{
"parent":"shard1",
"stateTimestamp":"1529110277653354950",
"range":"80000000-bfffffff",
"state":"active",
"replicas":{
"core_node7":{
"leader":"true",
"core":"testSplitIntegration_collection_shard1_0_replica0",
"SEARCHER.searcher.maxDoc":7,
"SEARCHER.searcher.deletedDocs":0,
"INDEX.sizeInBytes":23980,
"node_name":"127.0.0.1:10001_solr",
"base_url":"http://127.0.0.1:10001/solr",
"state":"active",
"type":"NRT",
"INDEX.sizeInGB":2.2333115339279175E-5,
"SEARCHER.searcher.numDocs":7},
"core_node8":{
"core":"testSplitIntegration_collection_shard1_0_replica1",
"SEARCHER.searcher.maxDoc":7,
"SEARCHER.searcher.deletedDocs":0,
"INDEX.sizeInBytes":23980,
"node_name":"127.0.0.1:10000_solr",
"base_url":"http://127.0.0.1:10000/solr",
"state":"active",
"type":"NRT",
"INDEX.sizeInGB":2.2333115339279175E-5,
"SEARCHER.searcher.numDocs":7}}}}}
at __randomizedtesting.SeedInfo.seed([E9A365B990E8F6E8:D02DDCF9BF173F16]:0)
at org.apache.solr.cloud.CloudTestUtils.waitForState(CloudTestUtils.java:111)
at org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest.testSplitIntegration(IndexSizeTriggerTest.java:299)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest.testMixedBounds
Error Message:
failed to create testMixedBounds_collection Live Nodes: [127.0.0.1:10001_solr, 127.0.0.1:10000_solr] Last available state: DocCollection(testMixedBounds_collection//clusterstate.json/150)={ "replicationFactor":"2", "pullReplicas":"0", "router":{"name":"compositeId"}, "maxShardsPerNode":"2", "autoAddReplicas":"false", "nrtReplicas":"2", "tlogReplicas":"0", "autoCreated":"true", "shards":{ "shard2":{ "replicas":{ "core_node3":{ "core":"testMixedBounds_collection_shard2_replica_n3", "SEARCHER.searcher.maxDoc":0, "SEARCHER.searcher.deletedDocs":0, "INDEX.sizeInBytes":10240, "node_name":"127.0.0.1:10000_solr", "state":"active", "type":"NRT", "INDEX.sizeInGB":9.5367431640625E-6, "SEARCHER.searcher.numDocs":0}, "core_node4":{ "core":"testMixedBounds_collection_shard2_replica_n4", "SEARCHER.searcher.maxDoc":0, "SEARCHER.searcher.deletedDocs":0, "INDEX.sizeInBytes":10240, "node_name":"127.0.0.1:10001_solr", "state":"active", "type":"NRT", "INDEX.sizeInGB":9.5367431640625E-6, "SEARCHER.searcher.numDocs":0}}, "range":"0-7fffffff", "state":"active"}, "shard1":{ "stateTimestamp":"1529110396348173350", "replicas":{ "core_node1":{ "core":"testMixedBounds_collection_shard1_replica_n1", "leader":"true", "SEARCHER.searcher.maxDoc":495, "SEARCHER.searcher.deletedDocs":0, "INDEX.sizeInBytes":257740, "node_name":"127.0.0.1:10000_solr", "state":"active", "type":"NRT", "INDEX.sizeInGB":2.4003908038139343E-4, "SEARCHER.searcher.numDocs":495}, "core_node2":{ "core":"testMixedBounds_collection_shard1_replica_n2", "SEARCHER.searcher.maxDoc":495, "SEARCHER.searcher.deletedDocs":0, "INDEX.sizeInBytes":257740, "node_name":"127.0.0.1:10001_solr", "state":"active", "type":"NRT", "INDEX.sizeInGB":2.4003908038139343E-4, "SEARCHER.searcher.numDocs":495}}, "range":"80000000-ffffffff", "state":"inactive"}, "shard1_1":{ "parent":"shard1", "stateTimestamp":"1529110396349001950", "range":"c0000000-ffffffff", "state":"active", "replicas":{ "core_node10":{ "leader":"true", "core":"testMixedBounds_collection_shard1_1_replica1", "SEARCHER.searcher.maxDoc":247, "SEARCHER.searcher.deletedDocs":0, "INDEX.sizeInBytes":133740, "node_name":"127.0.0.1:10000_solr", "base_url":"http://127.0.0.1:10000/solr", "state":"active", "type":"NRT", "INDEX.sizeInGB":1.245550811290741E-4, "SEARCHER.searcher.numDocs":247}, "core_node9":{ "core":"testMixedBounds_collection_shard1_1_replica0", "SEARCHER.searcher.maxDoc":247, "SEARCHER.searcher.deletedDocs":0, "INDEX.sizeInBytes":133740, "node_name":"127.0.0.1:10001_solr", "base_url":"http://127.0.0.1:10001/solr", "state":"active", "type":"NRT", "INDEX.sizeInGB":1.245550811290741E-4, "SEARCHER.searcher.numDocs":247}}}, "shard1_0":{ "parent":"shard1", "stateTimestamp":"1529110396348823100", "range":"80000000-bfffffff", "state":"active", "replicas":{ "core_node7":{ "leader":"true", "core":"testMixedBounds_collection_shard1_0_replica0", "SEARCHER.searcher.maxDoc":248, "SEARCHER.searcher.deletedDocs":0, "INDEX.sizeInBytes":144480, "node_name":"127.0.0.1:10001_solr", "base_url":"http://127.0.0.1:10001/solr", "state":"active", "type":"NRT", "INDEX.sizeInGB":1.3455748558044434E-4, "SEARCHER.searcher.numDocs":248}, "core_node8":{ "core":"testMixedBounds_collection_shard1_0_replica1", "SEARCHER.searcher.maxDoc":248, "SEARCHER.searcher.deletedDocs":0, "INDEX.sizeInBytes":144480, "node_name":"127.0.0.1:10000_solr", "base_url":"http://127.0.0.1:10000/solr", "state":"active", "type":"NRT", "INDEX.sizeInGB":1.3455748558044434E-4, "SEARCHER.searcher.numDocs":248}}}}}
Stack Trace:
java.lang.AssertionError: failed to create testMixedBounds_collection
Live Nodes: [127.0.0.1:10001_solr, 127.0.0.1:10000_solr]
Last available state: DocCollection(testMixedBounds_collection//clusterstate.json/150)={
"replicationFactor":"2",
"pullReplicas":"0",
"router":{"name":"compositeId"},
"maxShardsPerNode":"2",
"autoAddReplicas":"false",
"nrtReplicas":"2",
"tlogReplicas":"0",
"autoCreated":"true",
"shards":{
"shard2":{
"replicas":{
"core_node3":{
"core":"testMixedBounds_collection_shard2_replica_n3",
"SEARCHER.searcher.maxDoc":0,
"SEARCHER.searcher.deletedDocs":0,
"INDEX.sizeInBytes":10240,
"node_name":"127.0.0.1:10000_solr",
"state":"active",
"type":"NRT",
"INDEX.sizeInGB":9.5367431640625E-6,
"SEARCHER.searcher.numDocs":0},
"core_node4":{
"core":"testMixedBounds_collection_shard2_replica_n4",
"SEARCHER.searcher.maxDoc":0,
"SEARCHER.searcher.deletedDocs":0,
"INDEX.sizeInBytes":10240,
"node_name":"127.0.0.1:10001_solr",
"state":"active",
"type":"NRT",
"INDEX.sizeInGB":9.5367431640625E-6,
"SEARCHER.searcher.numDocs":0}},
"range":"0-7fffffff",
"state":"active"},
"shard1":{
"stateTimestamp":"1529110396348173350",
"replicas":{
"core_node1":{
"core":"testMixedBounds_collection_shard1_replica_n1",
"leader":"true",
"SEARCHER.searcher.maxDoc":495,
"SEARCHER.searcher.deletedDocs":0,
"INDEX.sizeInBytes":257740,
"node_name":"127.0.0.1:10000_solr",
"state":"active",
"type":"NRT",
"INDEX.sizeInGB":2.4003908038139343E-4,
"SEARCHER.searcher.numDocs":495},
"core_node2":{
"core":"testMixedBounds_collection_shard1_replica_n2",
"SEARCHER.searcher.maxDoc":495,
"SEARCHER.searcher.deletedDocs":0,
"INDEX.sizeInBytes":257740,
"node_name":"127.0.0.1:10001_solr",
"state":"active",
"type":"NRT",
"INDEX.sizeInGB":2.4003908038139343E-4,
"SEARCHER.searcher.numDocs":495}},
"range":"80000000-ffffffff",
"state":"inactive"},
"shard1_1":{
"parent":"shard1",
"stateTimestamp":"1529110396349001950",
"range":"c0000000-ffffffff",
"state":"active",
"replicas":{
"core_node10":{
"leader":"true",
"core":"testMixedBounds_collection_shard1_1_replica1",
"SEARCHER.searcher.maxDoc":247,
"SEARCHER.searcher.deletedDocs":0,
"INDEX.sizeInBytes":133740,
"node_name":"127.0.0.1:10000_solr",
"base_url":"http://127.0.0.1:10000/solr",
"state":"active",
"type":"NRT",
"INDEX.sizeInGB":1.245550811290741E-4,
"SEARCHER.searcher.numDocs":247},
"core_node9":{
"core":"testMixedBounds_collection_shard1_1_replica0",
"SEARCHER.searcher.maxDoc":247,
"SEARCHER.searcher.deletedDocs":0,
"INDEX.sizeInBytes":133740,
"node_name":"127.0.0.1:10001_solr",
"base_url":"http://127.0.0.1:10001/solr",
"state":"active",
"type":"NRT",
"INDEX.sizeInGB":1.245550811290741E-4,
"SEARCHER.searcher.numDocs":247}}},
"shard1_0":{
"parent":"shard1",
"stateTimestamp":"1529110396348823100",
"range":"80000000-bfffffff",
"state":"active",
"replicas":{
"core_node7":{
"leader":"true",
"core":"testMixedBounds_collection_shard1_0_replica0",
"SEARCHER.searcher.maxDoc":248,
"SEARCHER.searcher.deletedDocs":0,
"INDEX.sizeInBytes":144480,
"node_name":"127.0.0.1:10001_solr",
"base_url":"http://127.0.0.1:10001/solr",
"state":"active",
"type":"NRT",
"INDEX.sizeInGB":1.3455748558044434E-4,
"SEARCHER.searcher.numDocs":248},
"core_node8":{
"core":"testMixedBounds_collection_shard1_0_replica1",
"SEARCHER.searcher.maxDoc":248,
"SEARCHER.searcher.deletedDocs":0,
"INDEX.sizeInBytes":144480,
"node_name":"127.0.0.1:10000_solr",
"base_url":"http://127.0.0.1:10000/solr",
"state":"active",
"type":"NRT",
"INDEX.sizeInGB":1.3455748558044434E-4,
"SEARCHER.searcher.numDocs":248}}}}}
at __randomizedtesting.SeedInfo.seed([E9A365B990E8F6E8:E320DA14DD53FDB2]:0)
at org.apache.solr.cloud.CloudTestUtils.waitForState(CloudTestUtils.java:69)
at org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest.testMixedBounds(IndexSizeTriggerTest.java:559)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.util.concurrent.TimeoutException: last state: DocCollection(testMixedBounds_collection//clusterstate.json/150)={
"replicationFactor":"2",
"pullReplicas":"0",
"router":{"name":"compositeId"},
"maxShardsPerNode":"2",
"autoAddReplicas":"false",
"nrtReplicas":"2",
"tlogReplicas":"0",
"autoCreated":"true",
"shards":{
"shard2":{
"replicas":{
"core_node3":{
"core":"testMixedBounds_collection_shard2_replica_n3",
"SEARCHER.searcher.maxDoc":0,
"SEARCHER.searcher.deletedDocs":0,
"INDEX.sizeInBytes":10240,
"node_name":"127.0.0.1:10000_solr",
"state":"active",
"type":"NRT",
"INDEX.sizeInGB":9.5367431640625E-6,
"SEARCHER.searcher.numDocs":0},
"core_node4":{
"core":"testMixedBounds_collection_shard2_replica_n4",
"SEARCHER.searcher.maxDoc":0,
"SEARCHER.searcher.deletedDocs":0,
"INDEX.sizeInBytes":10240,
"node_name":"127.0.0.1:10001_solr",
"state":"active",
"type":"NRT",
"INDEX.sizeInGB":9.5367431640625E-6,
"SEARCHER.searcher.numDocs":0}},
"range":"0-7fffffff",
"state":"active"},
"shard1":{
"stateTimestamp":"1529110396348173350",
"replicas":{
"core_node1":{
"core":"testMixedBounds_collection_shard1_replica_n1",
"leader":"true",
"SEARCHER.searcher.maxDoc":495,
"SEARCHER.searcher.deletedDocs":0,
"INDEX.sizeInBytes":257740,
"node_name":"127.0.0.1:10000_solr",
"state":"active",
"type":"NRT",
"INDEX.sizeInGB":2.4003908038139343E-4,
"SEARCHER.searcher.numDocs":495},
"core_node2":{
"core":"testMixedBounds_collection_shard1_replica_n2",
"SEARCHER.searcher.maxDoc":495,
"SEARCHER.searcher.deletedDocs":0,
"INDEX.sizeInBytes":257740,
"node_name":"127.0.0.1:10001_solr",
"state":"active",
"type":"NRT",
"INDEX.sizeInGB":2.4003908038139343E-4,
"SEARCHER.searcher.numDocs":495}},
"range":"80000000-ffffffff",
"state":"inactive"},
"shard1_1":{
"parent":"shard1",
"stateTimestamp":"1529110396349001950",
"range":"c0000000-ffffffff",
"state":"active",
"replicas":{
"core_node10":{
"leader":"true",
"core":"testMixedBounds_collection_shard1_1_replica1",
"SEARCHER.searcher.maxDoc":247,
"SEARCHER.searcher.deletedDocs":0,
"INDEX.sizeInBytes":133740,
"node_name":"127.0.0.1:10000_solr",
"base_url":"http://127.0.0.1:10000/solr",
"state":"active",
"type":"NRT",
"INDEX.sizeInGB":1.245550811290741E-4,
"SEARCHER.searcher.numDocs":247},
"core_node9":{
"core":"testMixedBounds_collection_shard1_1_replica0",
"SEARCHER.searcher.maxDoc":247,
"SEARCHER.searcher.deletedDocs":0,
"INDEX.sizeInBytes":133740,
"node_name":"127.0.0.1:10001_solr",
"base_url":"http://127.0.0.1:10001/solr",
"state":"active",
"type":"NRT",
"INDEX.sizeInGB":1.245550811290741E-4,
"SEARCHER.searcher.numDocs":247}}},
"shard1_0":{
"parent":"shard1",
"stateTimestamp":"1529110396348823100",
"range":"80000000-bfffffff",
"state":"active",
"replicas":{
"core_node7":{
"leader":"true",
"core":"testMixedBounds_collection_shard1_0_replica0",
"SEARCHER.searcher.maxDoc":248,
"SEARCHER.searcher.deletedDocs":0,
"INDEX.sizeInBytes":144480,
"node_name":"127.0.0.1:10001_solr",
"base_url":"http://127.0.0.1:10001/solr",
"state":"active",
"type":"NRT",
"INDEX.sizeInGB":1.3455748558044434E-4,
"SEARCHER.searcher.numDocs":248},
"core_node8":{
"core":"testMixedBounds_collection_shard1_0_replica1",
"SEARCHER.searcher.maxDoc":248,
"SEARCHER.searcher.deletedDocs":0,
"INDEX.sizeInBytes":144480,
"node_name":"127.0.0.1:10000_solr",
"base_url":"http://127.0.0.1:10000/solr",
"state":"active",
"type":"NRT",
"INDEX.sizeInGB":1.3455748558044434E-4,
"SEARCHER.searcher.numDocs":248}}}}}
at org.apache.solr.cloud.CloudTestUtils.waitForState(CloudTestUtils.java:111)
at org.apache.solr.cloud.CloudTestUtils.waitForState(CloudTestUtils.java:63)
... 40 more
Build Log:
[...truncated 13020 lines...]
[junit4] Suite: org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest
[junit4] 2> 194635 INFO (SUITE-IndexSizeTriggerTest-seed#[E9A365B990E8F6E8]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.IndexSizeTriggerTest_E9A365B990E8F6E8-001/init-core-data-001
[junit4] 2> 194636 INFO (SUITE-IndexSizeTriggerTest-seed#[E9A365B990E8F6E8]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 194637 INFO (SUITE-IndexSizeTriggerTest-seed#[E9A365B990E8F6E8]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 2> 194676 INFO (SUITE-IndexSizeTriggerTest-seed#[E9A365B990E8F6E8]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.IndexSizeTriggerTest_E9A365B990E8F6E8-001/tempDir-001
[junit4] 2> 194676 INFO (SUITE-IndexSizeTriggerTest-seed#[E9A365B990E8F6E8]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 194704 INFO (Thread-81) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 194704 INFO (Thread-81) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 194742 ERROR (Thread-81) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 194804 INFO (SUITE-IndexSizeTriggerTest-seed#[E9A365B990E8F6E8]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:52715
[junit4] 2> 194834 INFO (zkConnectionManagerCallback-208-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 194847 INFO (jetty-launcher-205-thread-1) [ ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 1.8.0_172-b11
[junit4] 2> 194859 INFO (jetty-launcher-205-thread-2) [ ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 1.8.0_172-b11
[junit4] 2> 194906 INFO (jetty-launcher-205-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 194906 INFO (jetty-launcher-205-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 194906 INFO (jetty-launcher-205-thread-1) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 194917 INFO (jetty-launcher-205-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@346e9540{/solr,null,AVAILABLE}
[junit4] 2> 195107 INFO (jetty-launcher-205-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 195107 INFO (jetty-launcher-205-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 195107 INFO (jetty-launcher-205-thread-2) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 195174 INFO (jetty-launcher-205-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@61eb9a48{/solr,null,AVAILABLE}
[junit4] 2> 195552 INFO (jetty-launcher-205-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@202dbc8a{SSL,[ssl, http/1.1]}{127.0.0.1:48985}
[junit4] 2> 195552 INFO (jetty-launcher-205-thread-2) [ ] o.e.j.s.Server Started @195609ms
[junit4] 2> 195552 INFO (jetty-launcher-205-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=48985}
[junit4] 2> 195553 ERROR (jetty-launcher-205-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 195553 INFO (jetty-launcher-205-thread-2) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 195553 INFO (jetty-launcher-205-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solrâ„¢ version 7.5.0
[junit4] 2> 195553 INFO (jetty-launcher-205-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 195553 INFO (jetty-launcher-205-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 195553 INFO (jetty-launcher-205-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-06-16T00:46:30.462Z
[junit4] 2> 195645 INFO (jetty-launcher-205-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@cbda943{SSL,[ssl, http/1.1]}{127.0.0.1:40545}
[junit4] 2> 195645 INFO (jetty-launcher-205-thread-1) [ ] o.e.j.s.Server Started @195702ms
[junit4] 2> 195645 INFO (jetty-launcher-205-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=40545}
[junit4] 2> 195646 ERROR (jetty-launcher-205-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 195646 INFO (jetty-launcher-205-thread-1) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 195646 INFO (jetty-launcher-205-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solrâ„¢ version 7.5.0
[junit4] 2> 195646 INFO (jetty-launcher-205-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 195646 INFO (jetty-launcher-205-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 195646 INFO (jetty-launcher-205-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-06-16T00:46:30.555Z
[junit4] 2> 195761 INFO (zkConnectionManagerCallback-210-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 195870 INFO (zkConnectionManagerCallback-212-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 195878 INFO (jetty-launcher-205-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 195890 INFO (jetty-launcher-205-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 197101 INFO (jetty-launcher-205-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:52715/solr
[junit4] 2> 197127 INFO (zkConnectionManagerCallback-216-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 197206 INFO (zkConnectionManagerCallback-218-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 197392 INFO (jetty-launcher-205-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:52715/solr
[junit4] 2> 197422 INFO (zkConnectionManagerCallback-224-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 197510 INFO (zkConnectionManagerCallback-226-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 197552 INFO (jetty-launcher-205-thread-2) [n:127.0.0.1:48985_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 197553 INFO (jetty-launcher-205-thread-2) [n:127.0.0.1:48985_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:48985_solr
[junit4] 2> 197554 INFO (jetty-launcher-205-thread-2) [n:127.0.0.1:48985_solr ] o.a.s.c.Overseer Overseer (id=73981854642864134-127.0.0.1:48985_solr-n_0000000000) starting
[junit4] 2> 197603 INFO (jetty-launcher-205-thread-1) [n:127.0.0.1:40545_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 197605 INFO (jetty-launcher-205-thread-1) [n:127.0.0.1:40545_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40545_solr
[junit4] 2> 197612 INFO (zkConnectionManagerCallback-233-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 197649 INFO (zkCallback-225-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 197650 INFO (jetty-launcher-205-thread-2) [n:127.0.0.1:48985_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 197661 INFO (jetty-launcher-205-thread-2) [n:127.0.0.1:48985_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:52715/solr ready
[junit4] 2> 197699 INFO (zkCallback-217-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 197701 INFO (jetty-launcher-205-thread-2) [n:127.0.0.1:48985_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 197701 INFO (jetty-launcher-205-thread-2) [n:127.0.0.1:48985_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48985_solr
[junit4] 2> 197710 INFO (zkCallback-225-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 197715 DEBUG (OverseerAutoScalingTriggerThread-73981854642864134-127.0.0.1:48985_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and .scheduled_maintenance triggers
[junit4] 2> 197717 DEBUG (OverseerAutoScalingTriggerThread-73981854642864134-127.0.0.1:48985_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
[junit4] 2> 197718 DEBUG (OverseerAutoScalingTriggerThread-73981854642864134-127.0.0.1:48985_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1
[junit4] 2> 197718 DEBUG (OverseerAutoScalingTriggerThread-73981854642864134-127.0.0.1:48985_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
[junit4] 2> 197725 INFO (zkCallback-217-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 197728 INFO (zkCallback-232-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 197972 DEBUG (OverseerAutoScalingTriggerThread-73981854642864134-127.0.0.1:48985_solr-n_0000000000) [ ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial livenodes: [127.0.0.1:48985_solr, 127.0.0.1:40545_solr]
[junit4] 2> 197975 DEBUG (OverseerAutoScalingTriggerThread-73981854642864134-127.0.0.1:48985_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 197975 DEBUG (OverseerAutoScalingTriggerThread-73981854642864134-127.0.0.1:48985_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
[junit4] 2> 197976 DEBUG (ScheduledTrigger-151-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 197982 INFO (jetty-launcher-205-thread-2) [n:127.0.0.1:48985_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 197992 INFO (zkConnectionManagerCallback-239-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 197994 INFO (jetty-launcher-205-thread-1) [n:127.0.0.1:40545_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 197998 INFO (jetty-launcher-205-thread-1) [n:127.0.0.1:40545_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:52715/solr ready
[junit4] 2> 198019 INFO (jetty-launcher-205-thread-1) [n:127.0.0.1:40545_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 198107 INFO (jetty-launcher-205-thread-1) [n:127.0.0.1:40545_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40545.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@23241f34
[junit4] 2> 198119 INFO (jetty-launcher-205-thread-2) [n:127.0.0.1:48985_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_48985.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@23241f34
[junit4] 2> 198230 INFO (jetty-launcher-205-thread-1) [n:127.0.0.1:40545_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40545.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@23241f34
[junit4] 2> 198231 INFO (jetty-launcher-205-thread-1) [n:127.0.0.1:40545_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40545.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@23241f34
[junit4] 2> 198233 INFO (jetty-launcher-205-thread-1) [n:127.0.0.1:40545_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.IndexSizeTriggerTest_E9A365B990E8F6E8-001/tempDir-001/node1/.
[junit4] 2> 198233 INFO (jetty-launcher-205-thread-2) [n:127.0.0.1:48985_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_48985.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@23241f34
[junit4] 2> 198234 INFO (jetty-launcher-205-thread-2) [n:127.0.0.1:48985_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_48985.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@23241f34
[junit4] 2> 198235 INFO (jetty-launcher-205-thread-2) [n:127.0.0.1:48985_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.IndexSizeTriggerTest_E9A365B990E8F6E8-001/tempDir-001/node2/.
[junit4] 2> 198987 DEBUG (ScheduledTrigger-151-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 199086 INFO (zkConnectionManagerCallback-242-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 199106 INFO (zkConnectionManagerCallback-247-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 199107 INFO (SUITE-IndexSizeTriggerTest-seed#[E9A365B990E8F6E8]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 199108 INFO (SUITE-IndexSizeTriggerTest-seed#[E9A365B990E8F6E8]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:52715/solr ready
[junit4] 2> 199372 DEBUG (SUITE-IndexSizeTriggerTest-seed#[E9A365B990E8F6E8]-worker) [ ] o.a.s.c.a.s.SimClusterStateProvider --- new Overseer leader: 127.0.0.1:10000_solr
[junit4] 2> 199379 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and .scheduled_maintenance triggers
[junit4] 2> 199379 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 0
[junit4] 2> 199380 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 0, lastZnodeVersion -1
[junit4] 2> 199380 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 0
[junit4] 2> 199386 INFO (SUITE-IndexSizeTriggerTest-seed#[E9A365B990E8F6E8]-worker) [ ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 199387 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial livenodes: [127.0.0.1:10001_solr, 127.0.0.1:10000_solr]
[junit4] 2> 199395 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 199395 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 0, lastZnodeVersion 0
[junit4] 2> 199395 DEBUG (ScheduledTrigger-164-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 199417 DEBUG (ScheduledTrigger-164-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 199437 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 199458 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 199478 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 199499 DEBUG (ScheduledTrigger-164-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 199520 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 199540 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 199566 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 199587 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 199607 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 199627 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 199628 INFO (TEST-IndexSizeTriggerTest.testTrigger-seed#[E9A365B990E8F6E8]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testTrigger
[junit4] 2> 199647 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 199668 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 199688 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 199708 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 199729 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 199749 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 199850 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 199870 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 199891 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 199916 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 199920 DEBUG (simCloudManagerPool-163-thread-7) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testTrigger_collection / shard1: {"core_node1":{
[junit4] 2> "core":"testTrigger_collection_shard1_replica_n1",
[junit4] 2> "leader":"true",
[junit4] 2> "SEARCHER.searcher.maxDoc":0,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":10240,
[junit4] 2> "node_name":"127.0.0.1:10000_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "INDEX.sizeInGB":9.5367431640625E-6,
[junit4] 2> "SEARCHER.searcher.numDocs":0,
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testTrigger_collection"}}
[junit4] 2> 199926 DEBUG (simCloudManagerPool-163-thread-6) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testTrigger_collection / shard2: {"core_node3":{
[junit4] 2> "core":"testTrigger_collection_shard2_replica_n3",
[junit4] 2> "leader":"true",
[junit4] 2> "SEARCHER.searcher.maxDoc":0,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":10240,
[junit4] 2> "node_name":"127.0.0.1:10000_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "INDEX.sizeInGB":9.5367431640625E-6,
[junit4] 2> "SEARCHER.searcher.numDocs":0,
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"testTrigger_collection"}}
[junit4] 2> 199936 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 199957 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 199977 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 199987 DEBUG (ScheduledTrigger-151-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 199997 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 200017 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 200038 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 200059 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 200079 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 200100 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 200126 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 200146 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 200166 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 200187 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 200207 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 200228 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 200248 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 200269 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 200400 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 200421 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 200442 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 200462 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 200483 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 200503 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 200523 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 200543 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 200564 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 200586 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 200606 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 200626 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 200646 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 200667 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 200687 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 200707 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 200729 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 200749 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 200769 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 200850 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 200870 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 200891 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 200911 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 200932 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 200952 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 200972 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 200987 DEBUG (ScheduledTrigger-151-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 200993 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 201013 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 201033 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 201054 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 201074 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 201095 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 201115 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 201135 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 201155 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 201176 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 201196 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 201216 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 201237 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 201257 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 201350 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 201370 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 201391 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 201412 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 201432 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 201453 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 201474 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 201494 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 201515 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 201535 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 201556 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 201576 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 201596 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 201617 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 201637 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 201657 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 201678 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 201698 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 201718 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 201739 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 201759 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 201779 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 201850 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 201869 INFO (TEST-IndexSizeTriggerTest.testTrigger-seed#[E9A365B990E8F6E8]) [ ] o.a.s.c.a.IndexSizeTriggerTest #######################################
[junit4] 2> ############ CLUSTER STATE ############
[junit4] 2> #######################################
[junit4] 2> ## Live nodes: 2
[junit4] 2> ## Empty nodes: 0
[junit4] 2> ## Dead nodes: 0
[junit4] 2> ## Collections: [testTrigger_collection]
[junit4] 2> DocCollection(testTrigger_collection//clusterstate.json/30)={
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "pullReplicas":"0",
[junit4] 2> "router":{"name":"compositeId"},
[junit4] 2> "maxShardsPerNode":"2",
[junit4] 2> "autoAddReplicas":"false",
[junit4] 2> "nrtReplicas":"2",
[junit4] 2> "tlogReplicas":"0",
[junit4] 2> "autoCreated":"true",
[junit4] 2> "shards":{
[junit4] 2> "shard2":{
[junit4] 2> "replicas":{
[junit4] 2> "core_node3":{
[junit4] 2> "core":"testTrigger_collection_shard2_replica_n3",
[junit4] 2> "leader":"true",
[junit4] 2> "SEARCHER.searcher.maxDoc":11,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":15740,
[junit4] 2> "node_name":"127.0.0.1:10000_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "INDEX.sizeInGB":1.4659017324447632E-5,
[junit4] 2> "SEARCHER.searcher.numDocs":11},
[junit4] 2> "core_node4":{
[junit4] 2> "core":"testTrigger_collection_shard2_replica_n4",
[junit4] 2> "SEARCHER.searcher.maxDoc":11,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":15740,
[junit4] 2> "node_name":"127.0.0.1:10001_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "INDEX.sizeInGB":1.4659017324447632E-5,
[junit4] 2> "SEARCHER.searcher.numDocs":11}},
[junit4] 2> "range":"0-7fffffff",
[junit4] 2> "state":"active"},
[junit4] 2> "shard1":{
[junit4] 2> "replicas":{
[junit4] 2> "core_node1":{
[junit4] 2> "core":"testTrigger_collection_shard1_replica_n1",
[junit4] 2> "leader":"true",
[junit4] 2> "SEARCHER.searcher.maxDoc":14,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":17240,
[junit4] 2> "node_name":"127.0.0.1:10000_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "INDEX.sizeInGB":1.605600118637085E-5,
[junit4] 2> "SEARCHER.searcher.numDocs":14},
[junit4] 2> "core_node2":{
[junit4] 2> "core":"testTrigger_collection_shard1_replica_n2",
[junit4] 2> "SEARCHER.searcher.maxDoc":14,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":17240,
[junit4] 2> "node_name":"127.0.0.1:10001_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "INDEX.sizeInGB":1.605600118637085E-5,
[junit4] 2> "SEARCHER.searcher.numDocs":14}},
[junit4] 2> "range":"80000000-ffffffff",
[junit4] 2> "state":"active"}}}
[junit4] 2> ## Max replicas per node: 2
[junit4] 2> ## Min replicas per node: 2
[junit4] 2> ## Total replicas: 4
[junit4] 2> ## * testTrigger_collection 4
[junit4] 2> ## - active 4
[junit4] 2> ######### Solr op counts ##########
[junit4] 2> ## - CREATE 1
[junit4] 2> ## - update 26
[junit4] 2> ######### Autoscaling event counts ###########
[junit4] 2>
[junit4] 2> 201871 DEBUG (ScheduledTrigger-164-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 201871 DEBUG (TEST-IndexSizeTriggerTest.testTrigger-seed#[E9A365B990E8F6E8]) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
[junit4] 2> 201878 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
[junit4] 2> 201878 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 201879 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 201879 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
[junit4] 2> 201979 INFO (TEST-IndexSizeTriggerTest.testTrigger-seed#[E9A365B990E8F6E8]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testTrigger
[junit4] 2> 201988 DEBUG (ScheduledTrigger-151-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 202087 INFO (TEST-IndexSizeTriggerTest.testMergeIntegration-seed#[E9A365B990E8F6E8]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testMergeIntegration
[junit4] 2> 202229 DEBUG (simCloudManagerPool-163-thread-39) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testMergeIntegration_collection / shard2: {"core_node3":{
[junit4] 2> "core":"testMergeIntegration_collection_shard2_replica_n3",
[junit4] 2> "leader":"true",
[junit4] 2> "SEARCHER.searcher.maxDoc":0,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":10240,
[junit4] 2> "node_name":"127.0.0.1:10000_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "INDEX.sizeInGB":9.5367431640625E-6,
[junit4] 2> "SEARCHER.searcher.numDocs":0,
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"testMergeIntegration_collection"}}
[junit4] 2> 202229 DEBUG (simCloudManagerPool-163-thread-40) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testMergeIntegration_collection / shard1: {"core_node1":{
[junit4] 2> "core":"testMergeIntegration_collection_shard1_replica_n1",
[junit4] 2> "leader":"true",
[junit4] 2> "SEARCHER.searcher.maxDoc":0,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":10240,
[junit4] 2> "node_name":"127.0.0.1:10000_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "INDEX.sizeInGB":9.5367431640625E-6,
[junit4] 2> "SEARCHER.searcher.numDocs":0,
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testMergeIntegration_collection"}}
[junit4] 2> 202899 DEBUG (simCloudManagerPool-163-thread-52) [ ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 202900 DEBUG (simCloudManagerPool-163-thread-52) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 2
[junit4] 2> 202900 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
[junit4] 2> 202901 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 202901 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 202901 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
[junit4] 2> 202915 DEBUG (simCloudManagerPool-163-thread-53) [ ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 202915 DEBUG (simCloudManagerPool-163-thread-53) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 3
[junit4] 2> 202917 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 3
[junit4] 2> 202918 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 202918 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 202918 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion 3
[junit4] 2> 202918 DEBUG (simCloudManagerPool-163-thread-54) [ ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 202919 DEBUG (simCloudManagerPool-163-thread-54) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 4
[junit4] 2> 202921 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 4
[junit4] 2> 202921 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 202921 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 202921 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 4, lastZnodeVersion 4
[junit4] 2> 202988 DEBUG (ScheduledTrigger-151-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 203099 DEBUG (ScheduledTrigger-164-thread-3) [ ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
[junit4] 2> "id":"6850a816a10be5T8kf9por9kjwkkcmrwypl9istz",
[junit4] 2> "source":"index_size_trigger",
[junit4] 2> "eventTime":29362080442289125,
[junit4] 2> "eventType":"INDEXSIZE",
[junit4] 2> "properties":{
[junit4] 2> "aboveSize":{},
[junit4] 2> "belowSize":{"testMergeIntegration_collection":[
[junit4] 2> "{\"core_node1\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":7,\n \"SEARCHER.searcher.deletedDocs\":5,\n \"INDEX.sizeInBytes\":11240,\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":2,\n \"__bytes__\":11240,\n \"core\":\"testMergeIntegration_collection_shard1_replica_n1\",\n \"__docs__\":2,\n \"violationType\":\"belowDocs\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":1.0468065738677979E-5,\n \"shard\":\"shard1\",\n \"collection\":\"testMergeIntegration_collection\"}}",
[junit4] 2> "{\"core_node3\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":3,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":11740,\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":3,\n \"__bytes__\":11740,\n \"core\":\"testMergeIntegration_collection_shard2_replica_n3\",\n \"__docs__\":3,\n \"violationType\":\"belowDocs\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":1.0933727025985718E-5,\n \"shard\":\"shard2\",\n \"collection\":\"testMergeIntegration_collection\"}}"]},
[junit4] 2> "requestedOps":["Op{action=MERGESHARDS, hints={COLL_SHARD=[{\n \"first\":\"testMergeIntegration_collection\",\n \"second\":\"shard2\"}, {\n \"first\":\"testMergeIntegration_collection\",\n \"second\":\"shard1\"}]}}"]}}
[junit4] 2> 203101 DEBUG (ScheduledTrigger-164-thread-3) [ ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: [index_size_trigger]
[junit4] 2> 203104 INFO (ScheduledTrigger-164-thread-3) [ ] o.a.s.c.a.IndexSizeTriggerTest =======> CapturedEvent{timestamp=29362090553186525, stage=STARTED, actionName='null', event={
[junit4] 2> "id":"6850a816a10be5T8kf9por9kjwkkcmrwypl9istz",
[junit4] 2> "source":"index_size_trigger",
[junit4] 2> "eventTime":29362080442289125,
[junit4] 2> "eventType":"INDEXSIZE",
[junit4] 2> "properties":{
[junit4] 2> "aboveSize":{},
[junit4] 2> "belowSize":{"testMergeIntegration_collection":[
[junit4] 2> "{\"core_node1\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":7,\n \"SEARCHER.searcher.deletedDocs\":5,\n \"INDEX.sizeInBytes\":11240,\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":2,\n \"__bytes__\":11240,\n \"core\":\"testMergeIntegration_collection_shard1_replica_n1\",\n \"__docs__\":2,\n \"violationType\":\"belowDocs\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":1.0468065738677979E-5,\n \"shard\":\"shard1\",\n \"collection\":\"testMergeIntegration_collection\"}}",
[junit4] 2> "{\"core_node3\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":3,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":11740,\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":3,\n \"__bytes__\":11740,\n \"core\":\"testMergeIntegration_collection_shard2_replica_n3\",\n \"__docs__\":3,\n \"violationType\":\"belowDocs\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":1.0933727025985718E-5,\n \"shard\":\"shard2\",\n \"collection\":\"testMergeIntegration_collection\"}}"]},
[junit4] 2> "_enqueue_time_":29362090480739075,
[junit4] 2> "requestedOps":["Op{action=MERGESHARDS, hints={COLL_SHARD=[{\n \"first\":\"testMergeIntegration_collection\",\n \"second\":\"shard2\"}, {\n \"first\":\"testMergeIntegration_collection\",\n \"second\":\"shard1\"}]}}"]}}, context={}, config={
[junit4] 2> "trigger":"index_size_trigger",
[junit4] 2> "stage":[
[junit4] 2> "STARTED",
[junit4] 2> "ABORTED",
[junit4] 2> "SUCCEEDED",
[junit4] 2> "FAILED"],
[junit4] 2> "afterAction":[
[junit4] 2> "compute_plan",
[junit4] 2> "execute_plan"],
[junit4] 2> "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener",
[junit4] 2> "beforeAction":[
[junit4] 2> "compute_plan",
[junit4] 2> "execute_plan"]}, message='null'}
[junit4] 2> 203335 DEBUG (simCloudManagerPool-163-thread-61) [ ] o.a.s.c.a.s.SimClusterStateProvider -- no leader in shard1:{
[junit4] 2> "replicas":{"core_node1":{
[junit4] 2> "core":".system_shard1_replica_n1",
[junit4] 2> "SEARCHER.searcher.maxDoc":0,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":10240,
[junit4] 2> "node_name":"127.0.0.1:10000_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "INDEX.sizeInGB":9.5367431640625E-6,
[junit4] 2> "SEARCHER.searcher.numDocs":0}},
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active"}
[junit4] 2> 203359 DEBUG (AutoscalingActionExecutor-165-thread-1) [ ] o.a.s.c.a.ScheduledTriggers -- processing actions for {
[junit4] 2> "id":"6850a816a10be5T8kf9por9kjwkkcmrwypl9istz",
[junit4] 2> "source":"index_size_trigger",
[junit4] 2> "eventTime":29362080442289125,
[junit4] 2> "eventType":"INDEXSIZE",
[junit4] 2> "properties":{
[junit4] 2> "aboveSize":{},
[junit4] 2> "belowSize":{"testMergeIntegration_collection":[
[junit4] 2> "{\"core_node1\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":7,\n \"SEARCHER.searcher.deletedDocs\":5,\n \"INDEX.sizeInBytes\":11240,\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":2,\n \"__bytes__\":11240,\n \"core\":\"testMergeIntegration_collection_shard1_replica_n1\",\n \"__docs__\":2,\n \"violationType\":\"belowDocs\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":1.0468065738677979E-5,\n \"shard\":\"shard1\",\n \"collection\":\"testMergeIntegration_collection\"}}",
[junit4] 2> "{\"core_node3\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":3,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":11740,\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":3,\n \"__bytes__\":11740,\n \"core\":\"testMergeIntegration_collection_shard2_replica_n3\",\n \"__docs__\":3,\n \"violationType\":\"belowDocs\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":1.0933727025985718E-5,\n \"shard\":\"shard2\",\n \"collection\":\"testMergeIntegration_collection\"}}"]},
[junit4] 2> "_enqueue_time_":29362090480739075,
[junit4] 2> "requestedOps":["Op{action=MERGESHARDS, hints={COLL_SHARD=[{\n \"first\":\"testMergeIntegration_collection\",\n \"second\":\"shard2\"}, {\n \"first\":\"testMergeIntegration_collection\",\n \"second\":\"shard1\"}]}}"]}}
[junit4] 2> 203370 INFO (AutoscalingActionExecutor-165-thread-1) [ ] o.a.s.c.a.IndexSizeTriggerTest =======> CapturedEvent{timestamp=29362103858939475, stage=BEFORE_ACTION, actionName='compute_plan', event={
[junit4] 2> "id":"6850a816a10be5T8kf9por9kjwkkcmrwypl9istz",
[junit4] 2> "source":"index_size_trigger",
[junit4] 2> "eventTime":29362080442289125,
[junit4] 2> "eventType":"INDEXSIZE",
[junit4] 2> "properties":{
[junit4] 2> "aboveSize":{},
[junit4] 2> "belowSize":{"testMergeIntegration_collection":[
[junit4] 2> "{\"core_node1\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":7,\n \"SEARCHER.searcher.deletedDocs\":5,\n \"INDEX.sizeInBytes\":11240,\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":2,\n \"__bytes__\":11240,\n \"core\":\"testMergeIntegration_collection_shard1_replica_n1\",\n \"__docs__\":2,\n \"violationType\":\"belowDocs\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":1.0468065738677979E-5,\n \"shard\":\"shard1\",\n \"collection\":\"testMergeIntegration_collection\"}}",
[junit4] 2> "{\"core_node3\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":3,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":11740,\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":3,\n \"__bytes__\":11740,\n \"core\":\"testMergeIntegration_collection_shard2_replica_n3\",\n \"__docs__\":3,\n \"violationType\":\"belowDocs\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":1.0933727025985718E-5,\n \"shard\":\"shard2\",\n \"collection\":\"testMergeIntegration_collection\"}}"]},
[junit4] 2> "_enqueue_time_":29362090480739075,
[junit4] 2> "requestedOps":["Op{action=MERGESHARDS, hints={COLL_SHARD=[{\n \"first\":\"testMergeIntegration_collection\",\n \"second\":\"shard2\"}, {\n \"first\":\"testMergeIntegration_collection\",\n \"second\":\"shard1\"}]}}"]}}, context={properties.BEFORE_ACTION=[compute_plan], source=index_size_trigger}, config={
[junit4] 2> "trigger":"index_size_trigger",
[junit4] 2> "stage":[
[junit4] 2> "STARTED",
[junit4] 2> "ABORTED",
[junit4] 2> "SUCCEEDED",
[junit4] 2> "FAILED"],
[junit4] 2> "afterAction":[
[junit4] 2> "compute_plan",
[junit4] 2> "execute_plan"],
[junit4] 2> "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener",
[junit4] 2> "beforeAction":[
[junit4] 2> "compute_plan",
[junit4] 2> "execute_plan"]}, message='null'}
[junit4] 2> 203370 DEBUG (AutoscalingActionExecutor-165-thread-1) [ ] o.a.s.c.a.ComputePlanAction -- processing event: {
[junit4] 2> "id":"6850a816a10be5T8kf9por9kjwkkcmrwypl9istz",
[junit4] 2> "source":"index_size_trigger",
[junit4] 2> "eventTime":29362080442289125,
[junit4] 2> "eventType":"INDEXSIZE",
[junit4] 2> "properties":{
[junit4] 2> "aboveSize":{},
[junit4] 2> "belowSize":{"testMergeIntegration_collection":[
[junit4] 2> "{\"core_node1\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":7,\n \"SEARCHER.searcher.deletedDocs\":5,\n \"INDEX.sizeInBytes\":11240,\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":2,\n \"__bytes__\":11240,\n \"core\":\"testMergeIntegration_collection_shard1_replica_n1\",\n \"__docs__\":2,\n \"violationType\":\"belowDocs\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":1.0468065738677979E-5,\n \"shard\":\"shard1\",\n \"collection\":\"testMergeIntegration_collection\"}}",
[junit4] 2> "{\"core_node3\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":3,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":11740,\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":3,\n \"__bytes__\":11740,\n \"core\":\"testMergeIntegration_collection_shard2_replica_n3\",\n \"__docs__\":3,\n \"violationType\":\"belowDocs\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":1.0933727025985718E-5,\n \"shard\":\"shard2\",\n \"collection\":\"testMergeIntegration_collection\"}}"]},
[junit4] 2> "_enqueue_time_":29362090480739075,
[junit4] 2> "requestedOps":["Op{action=MERGESHARDS, hints={COLL_SHARD=[{\n \"first\":\"testMergeIntegration_collection\",\n \"second\":\"shard2\"}, {\n \"first\":\"testMergeIntegration_collection\",\n \"second\":\"shard1\"}]}}"]}} with context properties: {BEFORE_ACTION=[compute_plan]}
[junit4] 2> 203380 INFO (AutoscalingActionExecutor-165-thread-1) [ ] o.a.s.c.a.ComputePlanAction Computed plan empty, remained 0 requested ops to try.
[junit4] 2> 203380 INFO (AutoscalingActionExecutor-165-thread-1) [ ] o.a.s.c.s.c.a.PolicyHelper returnSession, curr-time 29362104357 sessionWrapper.createTime 29362104152892475, this.sessionWrapper.createTime 29362104152892475
[junit4] 2> 203380 INFO (AutoscalingActionExecutor-165-thread-1) [ ] o.a.s.c.a.IndexSizeTriggerTest =======> CapturedEvent{timestamp=29362104378185225, stage=AFTER_ACTION, actionName='compute_plan', event={
[junit4] 2> "id":"6850a816a10be5T8kf9por9kjwkkcmrwypl9istz",
[junit4] 2> "source":"index_size_trigger",
[junit4] 2> "eventTime":29362080442289125,
[junit4] 2> "eventType":"INDEXSIZE",
[junit4] 2> "properties":{
[junit4] 2> "__start__":1,
[junit4] 2> "aboveSize":{},
[junit4] 2>
[...truncated too long message...]
instance=1120413098
[junit4] 2> 209523 INFO (jetty-closer-206-thread-2) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1093793150
[junit4] 2> 209523 INFO (jetty-closer-206-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 209524 INFO (jetty-closer-206-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 209524 INFO (jetty-closer-206-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4ae4eea9: rootName = solr_40545, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@140c1778
[junit4] 2> 209530 INFO (jetty-closer-206-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@34c89667: rootName = solr_48985, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@3ad6d07b
[junit4] 2> 209537 INFO (jetty-closer-206-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 209537 INFO (jetty-closer-206-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3e9c619d: rootName = solr_48985, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@488f102a
[junit4] 2> 209540 INFO (jetty-closer-206-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 209540 INFO (jetty-closer-206-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@e1f272d: rootName = solr_40545, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@488f102a
[junit4] 2> 209568 INFO (jetty-closer-206-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 209568 INFO (jetty-closer-206-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1ce4d2bd: rootName = solr_40545, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@420dcdd2
[junit4] 2> 209569 INFO (jetty-closer-206-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 209569 INFO (jetty-closer-206-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@79fd50f5: rootName = solr_48985, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@420dcdd2
[junit4] 2> 209576 INFO (jetty-closer-206-thread-2) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:48985_solr
[junit4] 2> 209578 INFO (zkCallback-217-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 209579 INFO (zkCallback-225-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 209581 INFO (jetty-closer-206-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 209588 INFO (jetty-closer-206-thread-1) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:40545_solr
[junit4] 2> 209589 INFO (zkCallback-217-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 209591 INFO (zkCallback-225-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 209592 INFO (jetty-closer-206-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 209592 INFO (jetty-closer-206-thread-1) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 209599 INFO (zkCallback-232-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (0)
[junit4] 2> 209600 INFO (jetty-closer-206-thread-2) [ ] o.a.s.c.Overseer Overseer (id=73981854642864134-127.0.0.1:48985_solr-n_0000000000) closing
[junit4] 2> 209600 WARN (OverseerAutoScalingTriggerThread-73981854642864134-127.0.0.1:48985_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 209600 INFO (OverseerStateUpdate-73981854642864134-127.0.0.1:48985_solr-n_0000000000) [ ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:48985_solr
[junit4] 2> 209613 DEBUG (jetty-closer-206-thread-2) [ ] o.a.s.c.a.ScheduledTriggers Shutting down scheduled thread pool executor now
[junit4] 2> 209613 DEBUG (jetty-closer-206-thread-2) [ ] o.a.s.c.a.ScheduledTriggers Shutting down action executor now
[junit4] 2> 209613 DEBUG (jetty-closer-206-thread-2) [ ] o.a.s.c.a.ScheduledTriggers Awaiting termination for action executor
[junit4] 2> 209613 DEBUG (jetty-closer-206-thread-2) [ ] o.a.s.c.a.ScheduledTriggers Awaiting termination for scheduled thread pool executor
[junit4] 2> 209613 DEBUG (jetty-closer-206-thread-2) [ ] o.a.s.c.a.ScheduledTriggers ScheduledTriggers closed completely
[junit4] 2> 209614 DEBUG (jetty-closer-206-thread-2) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
[junit4] 2> 209614 INFO (zkCallback-238-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (0)
[junit4] 2> 209628 INFO (jetty-closer-206-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@346e9540{/solr,null,UNAVAILABLE}
[junit4] 2> 209628 INFO (jetty-closer-206-thread-1) [ ] o.e.j.s.session node0 Stopped scavenging
[junit4] 2> 209633 INFO (jetty-closer-206-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@61eb9a48{/solr,null,UNAVAILABLE}
[junit4] 2> 209633 INFO (jetty-closer-206-thread-2) [ ] o.e.j.s.session node0 Stopped scavenging
[junit4] 2> 209634 ERROR (SUITE-IndexSizeTriggerTest-seed#[E9A365B990E8F6E8]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 209634 INFO (SUITE-IndexSizeTriggerTest-seed#[E9A365B990E8F6E8]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:52715 52715
[junit4] 2> 209719 INFO (Thread-81) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:52715 52715
[junit4] 2> 209719 WARN (Thread-81) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 5 /solr/aliases.json
[junit4] 2> 2 /solr/security.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 5 /solr/clusterstate.json
[junit4] 2> 5 /solr/clusterprops.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 5 /solr/live_nodes
[junit4] 2> 5 /solr/collections
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.IndexSizeTriggerTest_E9A365B990E8F6E8-001
[junit4] 2> Jun 16, 2018 12:46:44 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 3 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=1157, maxMBSortInHeap=7.179750562465741, sim=RandomSimilarity(queryNorm=false): {}, locale=es-PY, timezone=Etc/GMT0
[junit4] 2> NOTE: Linux 3.13.0-88-generic amd64/Oracle Corporation 1.8.0_172 (64-bit)/cpus=4,threads=1,free=153191384,total=315097088
[junit4] 2> NOTE: All tests run in this JVM: [TestSchemaSimilarityResource, ConnectionReuseTest, TestConfigSetsAPIZkFailure, TestCoreAdminApis, StressHdfsTest, TestLegacyFieldReuse, TokenizerChainTest, TestOnReconnectListenerSupport, OverriddenZkACLAndCredentialsProvidersTest, IndexSizeTriggerTest]
[junit4] Completed [21/816 (1!)] on J1 in 16.02s, 4 tests, 1 failure, 1 error <<< FAILURES!
[...truncated 2941 lines...]
[junit4] JVM J1: stdout was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/temp/junit4-J1-20180616_004314_7877801973574991942100.sysout
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] java.lang.OutOfMemoryError: GC overhead limit exceeded
[junit4] Dumping heap to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/heapdumps/java_pid22213.hprof ...
[junit4] Heap dump file created [586987694 bytes in 14.193 secs]
[junit4] <<< JVM J1: EOF ----
[...truncated 9428 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/build.xml:651: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/build.xml:585: Some of the tests produced a heap dump, but did not fail. Maybe a suppressed OutOfMemoryError? Dumps created:
* java_pid22213.hprof
Total time: 393 minutes 6 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-NightlyTests-7.x - Build # 241 - Still
Unstable
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-7.x/241/
3 tests failed.
FAILED: org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest.testSplitIntegration
Error Message:
last state: DocCollection(testSplitIntegration_collection//clusterstate.json/50)={ "replicationFactor":"2", "pullReplicas":"0", "router":{"name":"compositeId"}, "maxShardsPerNode":"2", "autoAddReplicas":"false", "nrtReplicas":"2", "tlogReplicas":"0", "autoCreated":"true", "shards":{ "shard2":{ "replicas":{ "core_node3":{ "core":"testSplitIntegration_collection_shard2_replica_n3", "leader":"true", "SEARCHER.searcher.maxDoc":11, "SEARCHER.searcher.deletedDocs":0, "INDEX.sizeInBytes":15740, "node_name":"127.0.0.1:10001_solr", "state":"active", "type":"NRT", "INDEX.sizeInGB":1.4659017324447632E-5, "SEARCHER.searcher.numDocs":11}, "core_node4":{ "core":"testSplitIntegration_collection_shard2_replica_n4", "SEARCHER.searcher.maxDoc":11, "SEARCHER.searcher.deletedDocs":0, "INDEX.sizeInBytes":15740, "node_name":"127.0.0.1:10000_solr", "state":"active", "type":"NRT", "INDEX.sizeInGB":1.4659017324447632E-5, "SEARCHER.searcher.numDocs":11}}, "range":"0-7fffffff", "state":"active"}, "shard1":{ "stateTimestamp":"1528975827417324650", "replicas":{ "core_node1":{ "core":"testSplitIntegration_collection_shard1_replica_n1", "leader":"true", "SEARCHER.searcher.maxDoc":14, "SEARCHER.searcher.deletedDocs":0, "INDEX.sizeInBytes":17240, "node_name":"127.0.0.1:10001_solr", "state":"active", "type":"NRT", "INDEX.sizeInGB":1.605600118637085E-5, "SEARCHER.searcher.numDocs":14}, "core_node2":{ "core":"testSplitIntegration_collection_shard1_replica_n2", "SEARCHER.searcher.maxDoc":14, "SEARCHER.searcher.deletedDocs":0, "INDEX.sizeInBytes":17240, "node_name":"127.0.0.1:10000_solr", "state":"active", "type":"NRT", "INDEX.sizeInGB":1.605600118637085E-5, "SEARCHER.searcher.numDocs":14}}, "range":"80000000-ffffffff", "state":"inactive"}, "shard1_1":{ "parent":"shard1", "stateTimestamp":"1528975827451705050", "range":"c0000000-ffffffff", "state":"active", "replicas":{ "core_node10":{ "leader":"true", "core":"testSplitIntegration_collection_shard1_1_replica1", "SEARCHER.searcher.maxDoc":7, "SEARCHER.searcher.deletedDocs":0, "INDEX.sizeInBytes":13740, "node_name":"127.0.0.1:10000_solr", "base_url":"http://127.0.0.1:10000/solr", "state":"active", "type":"NRT", "INDEX.sizeInGB":1.2796372175216675E-5, "SEARCHER.searcher.numDocs":7}, "core_node9":{ "core":"testSplitIntegration_collection_shard1_1_replica0", "SEARCHER.searcher.maxDoc":7, "SEARCHER.searcher.deletedDocs":0, "INDEX.sizeInBytes":13740, "node_name":"127.0.0.1:10001_solr", "base_url":"http://127.0.0.1:10001/solr", "state":"active", "type":"NRT", "INDEX.sizeInGB":1.2796372175216675E-5, "SEARCHER.searcher.numDocs":7}}}, "shard1_0":{ "parent":"shard1", "stateTimestamp":"1528975827451393300", "range":"80000000-bfffffff", "state":"active", "replicas":{ "core_node7":{ "leader":"true", "core":"testSplitIntegration_collection_shard1_0_replica0", "SEARCHER.searcher.maxDoc":7, "SEARCHER.searcher.deletedDocs":0, "INDEX.sizeInBytes":23980, "node_name":"127.0.0.1:10001_solr", "base_url":"http://127.0.0.1:10001/solr", "state":"active", "type":"NRT", "INDEX.sizeInGB":2.2333115339279175E-5, "SEARCHER.searcher.numDocs":7}, "core_node8":{ "core":"testSplitIntegration_collection_shard1_0_replica1", "SEARCHER.searcher.maxDoc":7, "SEARCHER.searcher.deletedDocs":0, "INDEX.sizeInBytes":23980, "node_name":"127.0.0.1:10000_solr", "base_url":"http://127.0.0.1:10000/solr", "state":"active", "type":"NRT", "INDEX.sizeInGB":2.2333115339279175E-5, "SEARCHER.searcher.numDocs":7}}}}}
Stack Trace:
java.util.concurrent.TimeoutException: last state: DocCollection(testSplitIntegration_collection//clusterstate.json/50)={
"replicationFactor":"2",
"pullReplicas":"0",
"router":{"name":"compositeId"},
"maxShardsPerNode":"2",
"autoAddReplicas":"false",
"nrtReplicas":"2",
"tlogReplicas":"0",
"autoCreated":"true",
"shards":{
"shard2":{
"replicas":{
"core_node3":{
"core":"testSplitIntegration_collection_shard2_replica_n3",
"leader":"true",
"SEARCHER.searcher.maxDoc":11,
"SEARCHER.searcher.deletedDocs":0,
"INDEX.sizeInBytes":15740,
"node_name":"127.0.0.1:10001_solr",
"state":"active",
"type":"NRT",
"INDEX.sizeInGB":1.4659017324447632E-5,
"SEARCHER.searcher.numDocs":11},
"core_node4":{
"core":"testSplitIntegration_collection_shard2_replica_n4",
"SEARCHER.searcher.maxDoc":11,
"SEARCHER.searcher.deletedDocs":0,
"INDEX.sizeInBytes":15740,
"node_name":"127.0.0.1:10000_solr",
"state":"active",
"type":"NRT",
"INDEX.sizeInGB":1.4659017324447632E-5,
"SEARCHER.searcher.numDocs":11}},
"range":"0-7fffffff",
"state":"active"},
"shard1":{
"stateTimestamp":"1528975827417324650",
"replicas":{
"core_node1":{
"core":"testSplitIntegration_collection_shard1_replica_n1",
"leader":"true",
"SEARCHER.searcher.maxDoc":14,
"SEARCHER.searcher.deletedDocs":0,
"INDEX.sizeInBytes":17240,
"node_name":"127.0.0.1:10001_solr",
"state":"active",
"type":"NRT",
"INDEX.sizeInGB":1.605600118637085E-5,
"SEARCHER.searcher.numDocs":14},
"core_node2":{
"core":"testSplitIntegration_collection_shard1_replica_n2",
"SEARCHER.searcher.maxDoc":14,
"SEARCHER.searcher.deletedDocs":0,
"INDEX.sizeInBytes":17240,
"node_name":"127.0.0.1:10000_solr",
"state":"active",
"type":"NRT",
"INDEX.sizeInGB":1.605600118637085E-5,
"SEARCHER.searcher.numDocs":14}},
"range":"80000000-ffffffff",
"state":"inactive"},
"shard1_1":{
"parent":"shard1",
"stateTimestamp":"1528975827451705050",
"range":"c0000000-ffffffff",
"state":"active",
"replicas":{
"core_node10":{
"leader":"true",
"core":"testSplitIntegration_collection_shard1_1_replica1",
"SEARCHER.searcher.maxDoc":7,
"SEARCHER.searcher.deletedDocs":0,
"INDEX.sizeInBytes":13740,
"node_name":"127.0.0.1:10000_solr",
"base_url":"http://127.0.0.1:10000/solr",
"state":"active",
"type":"NRT",
"INDEX.sizeInGB":1.2796372175216675E-5,
"SEARCHER.searcher.numDocs":7},
"core_node9":{
"core":"testSplitIntegration_collection_shard1_1_replica0",
"SEARCHER.searcher.maxDoc":7,
"SEARCHER.searcher.deletedDocs":0,
"INDEX.sizeInBytes":13740,
"node_name":"127.0.0.1:10001_solr",
"base_url":"http://127.0.0.1:10001/solr",
"state":"active",
"type":"NRT",
"INDEX.sizeInGB":1.2796372175216675E-5,
"SEARCHER.searcher.numDocs":7}}},
"shard1_0":{
"parent":"shard1",
"stateTimestamp":"1528975827451393300",
"range":"80000000-bfffffff",
"state":"active",
"replicas":{
"core_node7":{
"leader":"true",
"core":"testSplitIntegration_collection_shard1_0_replica0",
"SEARCHER.searcher.maxDoc":7,
"SEARCHER.searcher.deletedDocs":0,
"INDEX.sizeInBytes":23980,
"node_name":"127.0.0.1:10001_solr",
"base_url":"http://127.0.0.1:10001/solr",
"state":"active",
"type":"NRT",
"INDEX.sizeInGB":2.2333115339279175E-5,
"SEARCHER.searcher.numDocs":7},
"core_node8":{
"core":"testSplitIntegration_collection_shard1_0_replica1",
"SEARCHER.searcher.maxDoc":7,
"SEARCHER.searcher.deletedDocs":0,
"INDEX.sizeInBytes":23980,
"node_name":"127.0.0.1:10000_solr",
"base_url":"http://127.0.0.1:10000/solr",
"state":"active",
"type":"NRT",
"INDEX.sizeInGB":2.2333115339279175E-5,
"SEARCHER.searcher.numDocs":7}}}}}
at __randomizedtesting.SeedInfo.seed([D0587EE810FE7C38:E9D6C7A83F01B5C6]:0)
at org.apache.solr.cloud.CloudTestUtils.waitForState(CloudTestUtils.java:111)
at org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest.testSplitIntegration(IndexSizeTriggerTest.java:299)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest.testMixedBounds
Error Message:
events: [CapturedEvent{timestamp=29227747052642425, stage=AFTER_ACTION, actionName='execute_plan', event={ "id":"67d67155b07949T2mi19qz6dl7ovezin3l1g4rhj", "source":"index_size_trigger", "eventTime":29227704858474825, "eventType":"INDEXSIZE", "properties":{ "__start__":1, "aboveSize":{"testSplitIntegration_collection":["{\"core_node3\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":11,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":15740,\n \"node_name\":\"127.0.0.1:10001_solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":11,\n \"__bytes__\":15740,\n \"core\":\"testSplitIntegration_collection_shard2_replica_n3\",\n \"__docs__\":11,\n \"violationType\":\"aboveDocs\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":1.4659017324447632E-5,\n \"shard\":\"shard2\",\n \"collection\":\"testSplitIntegration_collection\"}}"]}, "belowSize":{}, "_enqueue_time_":29227735439844375, "requestedOps":["Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2\"}]}}"]}}, context={properties.operations=[{class=org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard, method=GET, params.action=SPLITSHARD, params.async=index_size_trigger/67d67155b07949T2mi19qz6dl7ovezin3l1g4rhj/0, params.waitForFinalState=true, params.collection=testSplitIntegration_collection, params.shard=shard2}], properties.BEFORE_ACTION=[compute_plan, execute_plan], properties.responses=[{status={state=completed,msg=found [index_size_trigger/67d67155b07949T2mi19qz6dl7ovezin3l1g4rhj/0] in completed tasks},success=}], source=index_size_trigger, properties.AFTER_ACTION=[compute_plan, execute_plan]}, config={ "trigger":"index_size_trigger", "stage":[ "STARTED", "ABORTED", "SUCCEEDED", "FAILED"], "afterAction":[ "compute_plan", "execute_plan"], "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener", "beforeAction":[ "compute_plan", "execute_plan"]}, message='null'}, CapturedEvent{timestamp=29227765761574725, stage=STARTED, actionName='null', event={ "id":"67d67dd99e6741T2mi19qz6dl7ovezin3l1g4rhl", "source":"index_size_trigger", "eventTime":29227758611490625, "eventType":"INDEXSIZE", "properties":{ "__start__":3, "aboveSize":{"testMixedBounds_collection":[ "{\"core_node3\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":505,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":262740,\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":505,\n \"__bytes__\":262740,\n \"core\":\"testMixedBounds_collection_shard2_replica_n3\",\n \"__docs__\":505,\n \"violationType\":\"aboveBytes\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":2.446956932544708E-4,\n \"shard\":\"shard2\",\n \"collection\":\"testMixedBounds_collection\"}}", "{\"core_node1\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":495,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":257740,\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":495,\n \"__bytes__\":257740,\n \"core\":\"testMixedBounds_collection_shard1_replica_n1\",\n \"__docs__\":495,\n \"violationType\":\"aboveBytes\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":2.4003908038139343E-4,\n \"shard\":\"shard1\",\n \"collection\":\"testMixedBounds_collection\"}}"]}, "belowSize":{"testSplitIntegration_collection":[ "{\"core_node16\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":5,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":12740,\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"base_url\":\"http://127.0.0.1:10000/solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":5,\n \"__bytes__\":12740,\n \"__docs__\":5,\n \"violationType\":\"belowDocs\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":1.1865049600601196E-5,\n \"core\":\"testSplitIntegration_collection_shard2_1_replica1\",\n \"shard\":\"shard2_1\",\n \"collection\":\"testSplitIntegration_collection\"}}", "{\"core_node14\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":6,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":23480,\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"base_url\":\"http://127.0.0.1:10000/solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":6,\n \"__bytes__\":23480,\n \"__docs__\":6,\n \"violationType\":\"belowDocs\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":2.1867454051971436E-5,\n \"core\":\"testSplitIntegration_collection_shard2_0_replica1\",\n \"shard\":\"shard2_0\",\n \"collection\":\"testSplitIntegration_collection\"}}"]}, "_enqueue_time_":29227765744872575, "requestedOps":[ "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testMixedBounds_collection\",\n \"second\":\"shard2\"}]}}", "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testMixedBounds_collection\",\n \"second\":\"shard1\"}]}}", "Op{action=MERGESHARDS, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2_1\"}, {\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2_0\"}]}}"]}}, context={}, config={ "trigger":"index_size_trigger", "stage":[ "STARTED", "ABORTED", "SUCCEEDED", "FAILED"], "afterAction":[ "compute_plan", "execute_plan"], "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener", "beforeAction":[ "compute_plan", "execute_plan"]}, message='null'}, CapturedEvent{timestamp=29227768546258625, stage=BEFORE_ACTION, actionName='compute_plan', event={ "id":"67d67dd99e6741T2mi19qz6dl7ovezin3l1g4rhl", "source":"index_size_trigger", "eventTime":29227758611490625, "eventType":"INDEXSIZE", "properties":{ "__start__":3, "aboveSize":{"testMixedBounds_collection":[ "{\"core_node3\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":505,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":262740,\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":505,\n \"__bytes__\":262740,\n \"core\":\"testMixedBounds_collection_shard2_replica_n3\",\n \"__docs__\":505,\n \"violationType\":\"aboveBytes\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":2.446956932544708E-4,\n \"shard\":\"shard2\",\n \"collection\":\"testMixedBounds_collection\"}}", "{\"core_node1\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":495,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":257740,\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":495,\n \"__bytes__\":257740,\n \"core\":\"testMixedBounds_collection_shard1_replica_n1\",\n \"__docs__\":495,\n \"violationType\":\"aboveBytes\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":2.4003908038139343E-4,\n \"shard\":\"shard1\",\n \"collection\":\"testMixedBounds_collection\"}}"]}, "belowSize":{"testSplitIntegration_collection":[ "{\"core_node16\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":5,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":12740,\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"base_url\":\"http://127.0.0.1:10000/solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":5,\n \"__bytes__\":12740,\n \"__docs__\":5,\n \"violationType\":\"belowDocs\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":1.1865049600601196E-5,\n \"core\":\"testSplitIntegration_collection_shard2_1_replica1\",\n \"shard\":\"shard2_1\",\n \"collection\":\"testSplitIntegration_collection\"}}", "{\"core_node14\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":6,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":23480,\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"base_url\":\"http://127.0.0.1:10000/solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":6,\n \"__bytes__\":23480,\n \"__docs__\":6,\n \"violationType\":\"belowDocs\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":2.1867454051971436E-5,\n \"core\":\"testSplitIntegration_collection_shard2_0_replica1\",\n \"shard\":\"shard2_0\",\n \"collection\":\"testSplitIntegration_collection\"}}"]}, "_enqueue_time_":29227765744872575, "requestedOps":[ "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testMixedBounds_collection\",\n \"second\":\"shard2\"}]}}", "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testMixedBounds_collection\",\n \"second\":\"shard1\"}]}}", "Op{action=MERGESHARDS, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2_1\"}, {\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2_0\"}]}}"]}}, context={properties.BEFORE_ACTION=[compute_plan], source=index_size_trigger}, config={ "trigger":"index_size_trigger", "stage":[ "STARTED", "ABORTED", "SUCCEEDED", "FAILED"], "afterAction":[ "compute_plan", "execute_plan"], "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener", "beforeAction":[ "compute_plan", "execute_plan"]}, message='null'}, CapturedEvent{timestamp=29227768742019275, stage=AFTER_ACTION, actionName='compute_plan', event={ "id":"67d67dd99e6741T2mi19qz6dl7ovezin3l1g4rhl", "source":"index_size_trigger", "eventTime":29227758611490625, "eventType":"INDEXSIZE", "properties":{ "__start__":3, "aboveSize":{"testMixedBounds_collection":[ "{\"core_node3\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":505,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":262740,\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":505,\n \"__bytes__\":262740,\n \"core\":\"testMixedBounds_collection_shard2_replica_n3\",\n \"__docs__\":505,\n \"violationType\":\"aboveBytes\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":2.446956932544708E-4,\n \"shard\":\"shard2\",\n \"collection\":\"testMixedBounds_collection\"}}", "{\"core_node1\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":495,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":257740,\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":495,\n \"__bytes__\":257740,\n \"core\":\"testMixedBounds_collection_shard1_replica_n1\",\n \"__docs__\":495,\n \"violationType\":\"aboveBytes\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":2.4003908038139343E-4,\n \"shard\":\"shard1\",\n \"collection\":\"testMixedBounds_collection\"}}"]}, "belowSize":{"testSplitIntegration_collection":[ "{\"core_node16\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":5,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":12740,\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"base_url\":\"http://127.0.0.1:10000/solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":5,\n \"__bytes__\":12740,\n \"__docs__\":5,\n \"violationType\":\"belowDocs\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":1.1865049600601196E-5,\n \"core\":\"testSplitIntegration_collection_shard2_1_replica1\",\n \"shard\":\"shard2_1\",\n \"collection\":\"testSplitIntegration_collection\"}}", "{\"core_node14\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":6,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":23480,\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"base_url\":\"http://127.0.0.1:10000/solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":6,\n \"__bytes__\":23480,\n \"__docs__\":6,\n \"violationType\":\"belowDocs\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":2.1867454051971436E-5,\n \"core\":\"testSplitIntegration_collection_shard2_0_replica1\",\n \"shard\":\"shard2_0\",\n \"collection\":\"testSplitIntegration_collection\"}}"]}, "_enqueue_time_":29227765744872575, "requestedOps":[ "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testMixedBounds_collection\",\n \"second\":\"shard2\"}]}}", "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testMixedBounds_collection\",\n \"second\":\"shard1\"}]}}", "Op{action=MERGESHARDS, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2_1\"}, {\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2_0\"}]}}"]}}, context={properties.operations=[{class=org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard, method=GET, params.action=SPLITSHARD, params.collection=testMixedBounds_collection, params.shard=shard2}, {class=org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard, method=GET, params.action=SPLITSHARD, params.collection=testMixedBounds_collection, params.shard=shard1}], properties.unsupportedOps=[Op{action=MERGESHARDS, hints={COLL_SHARD=[{ "first":"testSplitIntegration_collection", "second":"shard2_1"}, { "first":"testSplitIntegration_collection", "second":"shard2_0"}]}}], properties.BEFORE_ACTION=[compute_plan], source=index_size_trigger, properties.AFTER_ACTION=[compute_plan]}, config={ "trigger":"index_size_trigger", "stage":[ "STARTED", "ABORTED", "SUCCEEDED", "FAILED"], "afterAction":[ "compute_plan", "execute_plan"], "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener", "beforeAction":[ "compute_plan", "execute_plan"]}, message='null'}, CapturedEvent{timestamp=29227768778124725, stage=BEFORE_ACTION, actionName='execute_plan', event={ "id":"67d67dd99e6741T2mi19qz6dl7ovezin3l1g4rhl", "source":"index_size_trigger", "eventTime":29227758611490625, "eventType":"INDEXSIZE", "properties":{ "__start__":3, "aboveSize":{"testMixedBounds_collection":[ "{\"core_node3\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":505,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":262740,\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":505,\n \"__bytes__\":262740,\n \"core\":\"testMixedBounds_collection_shard2_replica_n3\",\n \"__docs__\":505,\n \"violationType\":\"aboveBytes\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":2.446956932544708E-4,\n \"shard\":\"shard2\",\n \"collection\":\"testMixedBounds_collection\"}}", "{\"core_node1\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":495,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":257740,\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":495,\n \"__bytes__\":257740,\n \"core\":\"testMixedBounds_collection_shard1_replica_n1\",\n \"__docs__\":495,\n \"violationType\":\"aboveBytes\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":2.4003908038139343E-4,\n \"shard\":\"shard1\",\n \"collection\":\"testMixedBounds_collection\"}}"]}, "belowSize":{"testSplitIntegration_collection":[ "{\"core_node16\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":5,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":12740,\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"base_url\":\"http://127.0.0.1:10000/solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":5,\n \"__bytes__\":12740,\n \"__docs__\":5,\n \"violationType\":\"belowDocs\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":1.1865049600601196E-5,\n \"core\":\"testSplitIntegration_collection_shard2_1_replica1\",\n \"shard\":\"shard2_1\",\n \"collection\":\"testSplitIntegration_collection\"}}", "{\"core_node14\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":6,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":23480,\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"base_url\":\"http://127.0.0.1:10000/solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":6,\n \"__bytes__\":23480,\n \"__docs__\":6,\n \"violationType\":\"belowDocs\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":2.1867454051971436E-5,\n \"core\":\"testSplitIntegration_collection_shard2_0_replica1\",\n \"shard\":\"shard2_0\",\n \"collection\":\"testSplitIntegration_collection\"}}"]}, "_enqueue_time_":29227765744872575, "requestedOps":[ "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testMixedBounds_collection\",\n \"second\":\"shard2\"}]}}", "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testMixedBounds_collection\",\n \"second\":\"shard1\"}]}}", "Op{action=MERGESHARDS, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2_1\"}, {\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2_0\"}]}}"]}}, context={properties.operations=[{class=org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard, method=GET, params.action=SPLITSHARD, params.collection=testMixedBounds_collection, params.shard=shard2}, {class=org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard, method=GET, params.action=SPLITSHARD, params.collection=testMixedBounds_collection, params.shard=shard1}], properties.unsupportedOps=[Op{action=MERGESHARDS, hints={COLL_SHARD=[{ "first":"testSplitIntegration_collection", "second":"shard2_1"}, { "first":"testSplitIntegration_collection", "second":"shard2_0"}]}}], properties.BEFORE_ACTION=[compute_plan, execute_plan], source=index_size_trigger, properties.AFTER_ACTION=[compute_plan]}, config={ "trigger":"index_size_trigger", "stage":[ "STARTED", "ABORTED", "SUCCEEDED", "FAILED"], "afterAction":[ "compute_plan", "execute_plan"], "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener", "beforeAction":[ "compute_plan", "execute_plan"]}, message='null'}, CapturedEvent{timestamp=29227795143892675, stage=AFTER_ACTION, actionName='execute_plan', event={ "id":"67d67dd99e6741T2mi19qz6dl7ovezin3l1g4rhl", "source":"index_size_trigger", "eventTime":29227758611490625, "eventType":"INDEXSIZE", "properties":{ "__start__":3, "aboveSize":{"testMixedBounds_collection":[ "{\"core_node3\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":505,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":262740,\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":505,\n \"__bytes__\":262740,\n \"core\":\"testMixedBounds_collection_shard2_replica_n3\",\n \"__docs__\":505,\n \"violationType\":\"aboveBytes\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":2.446956932544708E-4,\n \"shard\":\"shard2\",\n \"collection\":\"testMixedBounds_collection\"}}", "{\"core_node1\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":495,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":257740,\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":495,\n \"__bytes__\":257740,\n \"core\":\"testMixedBounds_collection_shard1_replica_n1\",\n \"__docs__\":495,\n \"violationType\":\"aboveBytes\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":2.4003908038139343E-4,\n \"shard\":\"shard1\",\n \"collection\":\"testMixedBounds_collection\"}}"]}, "belowSize":{"testSplitIntegration_collection":[ "{\"core_node16\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":5,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":12740,\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"base_url\":\"http://127.0.0.1:10000/solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":5,\n \"__bytes__\":12740,\n \"__docs__\":5,\n \"violationType\":\"belowDocs\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":1.1865049600601196E-5,\n \"core\":\"testSplitIntegration_collection_shard2_1_replica1\",\n \"shard\":\"shard2_1\",\n \"collection\":\"testSplitIntegration_collection\"}}", "{\"core_node14\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":6,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":23480,\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"base_url\":\"http://127.0.0.1:10000/solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":6,\n \"__bytes__\":23480,\n \"__docs__\":6,\n \"violationType\":\"belowDocs\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":2.1867454051971436E-5,\n \"core\":\"testSplitIntegration_collection_shard2_0_replica1\",\n \"shard\":\"shard2_0\",\n \"collection\":\"testSplitIntegration_collection\"}}"]}, "_enqueue_time_":29227765744872575, "requestedOps":[ "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testMixedBounds_collection\",\n \"second\":\"shard2\"}]}}", "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testMixedBounds_collection\",\n \"second\":\"shard1\"}]}}", "Op{action=MERGESHARDS, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2_1\"}, {\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2_0\"}]}}"]}}, context={properties.operations=[{class=org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard, method=GET, params.action=SPLITSHARD, params.async=index_size_trigger/67d67dd99e6741T2mi19qz6dl7ovezin3l1g4rhl/0, params.waitForFinalState=true, params.collection=testMixedBounds_collection, params.shard=shard2}, {class=org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard, method=GET, params.action=SPLITSHARD, params.async=index_size_trigger/67d67dd99e6741T2mi19qz6dl7ovezin3l1g4rhl/0, params.waitForFinalState=true, params.collection=testMixedBounds_collection, params.shard=shard1}], properties.unsupportedOps=[Op{action=MERGESHARDS, hints={COLL_SHARD=[{ "first":"testSplitIntegration_collection", "second":"shard2_1"}, { "first":"testSplitIntegration_collection", "second":"shard2_0"}]}}], properties.BEFORE_ACTION=[compute_plan, execute_plan], properties.responses=[{status={state=completed,msg=found [index_size_trigger/67d67dd99e6741T2mi19qz6dl7ovezin3l1g4rhl/0] in completed tasks},success=}, {status={state=completed,msg=found [index_size_trigger/67d67dd99e6741T2mi19qz6dl7ovezin3l1g4rhl/0] in completed tasks},success=}], source=index_size_trigger, properties.AFTER_ACTION=[compute_plan, execute_plan]}, config={ "trigger":"index_size_trigger", "stage":[ "STARTED", "ABORTED", "SUCCEEDED", "FAILED"], "afterAction":[ "compute_plan", "execute_plan"], "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener", "beforeAction":[ "compute_plan", "execute_plan"]}, message='null'}, CapturedEvent{timestamp=29227795198535075, stage=SUCCEEDED, actionName='null', event={ "id":"67d67dd99e6741T2mi19qz6dl7ovezin3l1g4rhl", "source":"index_size_trigger", "eventTime":29227758611490625, "eventType":"INDEXSIZE", "properties":{ "__start__":3, "aboveSize":{"testMixedBounds_collection":[ "{\"core_node3\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":505,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":262740,\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":505,\n \"__bytes__\":262740,\n \"core\":\"testMixedBounds_collection_shard2_replica_n3\",\n \"__docs__\":505,\n \"violationType\":\"aboveBytes\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":2.446956932544708E-4,\n \"shard\":\"shard2\",\n \"collection\":\"testMixedBounds_collection\"}}", "{\"core_node1\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":495,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":257740,\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":495,\n \"__bytes__\":257740,\n \"core\":\"testMixedBounds_collection_shard1_replica_n1\",\n \"__docs__\":495,\n \"violationType\":\"aboveBytes\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":2.4003908038139343E-4,\n \"shard\":\"shard1\",\n \"collection\":\"testMixedBounds_collection\"}}"]}, "belowSize":{"testSplitIntegration_collection":[ "{\"core_node16\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":5,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":12740,\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"base_url\":\"http://127.0.0.1:10000/solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":5,\n \"__bytes__\":12740,\n \"__docs__\":5,\n \"violationType\":\"belowDocs\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":1.1865049600601196E-5,\n \"core\":\"testSplitIntegration_collection_shard2_1_replica1\",\n \"shard\":\"shard2_1\",\n \"collection\":\"testSplitIntegration_collection\"}}", "{\"core_node14\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":6,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":23480,\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"base_url\":\"http://127.0.0.1:10000/solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":6,\n \"__bytes__\":23480,\n \"__docs__\":6,\n \"violationType\":\"belowDocs\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":2.1867454051971436E-5,\n \"core\":\"testSplitIntegration_collection_shard2_0_replica1\",\n \"shard\":\"shard2_0\",\n \"collection\":\"testSplitIntegration_collection\"}}"]}, "_enqueue_time_":29227765744872575, "requestedOps":[ "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testMixedBounds_collection\",\n \"second\":\"shard2\"}]}}", "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testMixedBounds_collection\",\n \"second\":\"shard1\"}]}}", "Op{action=MERGESHARDS, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2_1\"}, {\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2_0\"}]}}"]}}, context={}, config={ "trigger":"index_size_trigger", "stage":[ "STARTED", "ABORTED", "SUCCEEDED", "FAILED"], "afterAction":[ "compute_plan", "execute_plan"], "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener", "beforeAction":[ "compute_plan", "execute_plan"]}, message='null'}] expected:<6> but was:<7>
Stack Trace:
java.lang.AssertionError: events: [CapturedEvent{timestamp=29227747052642425, stage=AFTER_ACTION, actionName='execute_plan', event={
"id":"67d67155b07949T2mi19qz6dl7ovezin3l1g4rhj",
"source":"index_size_trigger",
"eventTime":29227704858474825,
"eventType":"INDEXSIZE",
"properties":{
"__start__":1,
"aboveSize":{"testSplitIntegration_collection":["{\"core_node3\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":11,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":15740,\n \"node_name\":\"127.0.0.1:10001_solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":11,\n \"__bytes__\":15740,\n \"core\":\"testSplitIntegration_collection_shard2_replica_n3\",\n \"__docs__\":11,\n \"violationType\":\"aboveDocs\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":1.4659017324447632E-5,\n \"shard\":\"shard2\",\n \"collection\":\"testSplitIntegration_collection\"}}"]},
"belowSize":{},
"_enqueue_time_":29227735439844375,
"requestedOps":["Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2\"}]}}"]}}, context={properties.operations=[{class=org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard, method=GET, params.action=SPLITSHARD, params.async=index_size_trigger/67d67155b07949T2mi19qz6dl7ovezin3l1g4rhj/0, params.waitForFinalState=true, params.collection=testSplitIntegration_collection, params.shard=shard2}], properties.BEFORE_ACTION=[compute_plan, execute_plan], properties.responses=[{status={state=completed,msg=found [index_size_trigger/67d67155b07949T2mi19qz6dl7ovezin3l1g4rhj/0] in completed tasks},success=}], source=index_size_trigger, properties.AFTER_ACTION=[compute_plan, execute_plan]}, config={
"trigger":"index_size_trigger",
"stage":[
"STARTED",
"ABORTED",
"SUCCEEDED",
"FAILED"],
"afterAction":[
"compute_plan",
"execute_plan"],
"class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener",
"beforeAction":[
"compute_plan",
"execute_plan"]}, message='null'}, CapturedEvent{timestamp=29227765761574725, stage=STARTED, actionName='null', event={
"id":"67d67dd99e6741T2mi19qz6dl7ovezin3l1g4rhl",
"source":"index_size_trigger",
"eventTime":29227758611490625,
"eventType":"INDEXSIZE",
"properties":{
"__start__":3,
"aboveSize":{"testMixedBounds_collection":[
"{\"core_node3\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":505,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":262740,\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":505,\n \"__bytes__\":262740,\n \"core\":\"testMixedBounds_collection_shard2_replica_n3\",\n \"__docs__\":505,\n \"violationType\":\"aboveBytes\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":2.446956932544708E-4,\n \"shard\":\"shard2\",\n \"collection\":\"testMixedBounds_collection\"}}",
"{\"core_node1\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":495,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":257740,\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":495,\n \"__bytes__\":257740,\n \"core\":\"testMixedBounds_collection_shard1_replica_n1\",\n \"__docs__\":495,\n \"violationType\":\"aboveBytes\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":2.4003908038139343E-4,\n \"shard\":\"shard1\",\n \"collection\":\"testMixedBounds_collection\"}}"]},
"belowSize":{"testSplitIntegration_collection":[
"{\"core_node16\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":5,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":12740,\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"base_url\":\"http://127.0.0.1:10000/solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":5,\n \"__bytes__\":12740,\n \"__docs__\":5,\n \"violationType\":\"belowDocs\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":1.1865049600601196E-5,\n \"core\":\"testSplitIntegration_collection_shard2_1_replica1\",\n \"shard\":\"shard2_1\",\n \"collection\":\"testSplitIntegration_collection\"}}",
"{\"core_node14\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":6,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":23480,\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"base_url\":\"http://127.0.0.1:10000/solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":6,\n \"__bytes__\":23480,\n \"__docs__\":6,\n \"violationType\":\"belowDocs\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":2.1867454051971436E-5,\n \"core\":\"testSplitIntegration_collection_shard2_0_replica1\",\n \"shard\":\"shard2_0\",\n \"collection\":\"testSplitIntegration_collection\"}}"]},
"_enqueue_time_":29227765744872575,
"requestedOps":[
"Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testMixedBounds_collection\",\n \"second\":\"shard2\"}]}}",
"Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testMixedBounds_collection\",\n \"second\":\"shard1\"}]}}",
"Op{action=MERGESHARDS, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2_1\"}, {\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2_0\"}]}}"]}}, context={}, config={
"trigger":"index_size_trigger",
"stage":[
"STARTED",
"ABORTED",
"SUCCEEDED",
"FAILED"],
"afterAction":[
"compute_plan",
"execute_plan"],
"class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener",
"beforeAction":[
"compute_plan",
"execute_plan"]}, message='null'}, CapturedEvent{timestamp=29227768546258625, stage=BEFORE_ACTION, actionName='compute_plan', event={
"id":"67d67dd99e6741T2mi19qz6dl7ovezin3l1g4rhl",
"source":"index_size_trigger",
"eventTime":29227758611490625,
"eventType":"INDEXSIZE",
"properties":{
"__start__":3,
"aboveSize":{"testMixedBounds_collection":[
"{\"core_node3\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":505,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":262740,\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":505,\n \"__bytes__\":262740,\n \"core\":\"testMixedBounds_collection_shard2_replica_n3\",\n \"__docs__\":505,\n \"violationType\":\"aboveBytes\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":2.446956932544708E-4,\n \"shard\":\"shard2\",\n \"collection\":\"testMixedBounds_collection\"}}",
"{\"core_node1\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":495,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":257740,\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":495,\n \"__bytes__\":257740,\n \"core\":\"testMixedBounds_collection_shard1_replica_n1\",\n \"__docs__\":495,\n \"violationType\":\"aboveBytes\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":2.4003908038139343E-4,\n \"shard\":\"shard1\",\n \"collection\":\"testMixedBounds_collection\"}}"]},
"belowSize":{"testSplitIntegration_collection":[
"{\"core_node16\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":5,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":12740,\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"base_url\":\"http://127.0.0.1:10000/solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":5,\n \"__bytes__\":12740,\n \"__docs__\":5,\n \"violationType\":\"belowDocs\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":1.1865049600601196E-5,\n \"core\":\"testSplitIntegration_collection_shard2_1_replica1\",\n \"shard\":\"shard2_1\",\n \"collection\":\"testSplitIntegration_collection\"}}",
"{\"core_node14\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":6,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":23480,\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"base_url\":\"http://127.0.0.1:10000/solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":6,\n \"__bytes__\":23480,\n \"__docs__\":6,\n \"violationType\":\"belowDocs\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":2.1867454051971436E-5,\n \"core\":\"testSplitIntegration_collection_shard2_0_replica1\",\n \"shard\":\"shard2_0\",\n \"collection\":\"testSplitIntegration_collection\"}}"]},
"_enqueue_time_":29227765744872575,
"requestedOps":[
"Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testMixedBounds_collection\",\n \"second\":\"shard2\"}]}}",
"Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testMixedBounds_collection\",\n \"second\":\"shard1\"}]}}",
"Op{action=MERGESHARDS, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2_1\"}, {\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2_0\"}]}}"]}}, context={properties.BEFORE_ACTION=[compute_plan], source=index_size_trigger}, config={
"trigger":"index_size_trigger",
"stage":[
"STARTED",
"ABORTED",
"SUCCEEDED",
"FAILED"],
"afterAction":[
"compute_plan",
"execute_plan"],
"class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener",
"beforeAction":[
"compute_plan",
"execute_plan"]}, message='null'}, CapturedEvent{timestamp=29227768742019275, stage=AFTER_ACTION, actionName='compute_plan', event={
"id":"67d67dd99e6741T2mi19qz6dl7ovezin3l1g4rhl",
"source":"index_size_trigger",
"eventTime":29227758611490625,
"eventType":"INDEXSIZE",
"properties":{
"__start__":3,
"aboveSize":{"testMixedBounds_collection":[
"{\"core_node3\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":505,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":262740,\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":505,\n \"__bytes__\":262740,\n \"core\":\"testMixedBounds_collection_shard2_replica_n3\",\n \"__docs__\":505,\n \"violationType\":\"aboveBytes\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":2.446956932544708E-4,\n \"shard\":\"shard2\",\n \"collection\":\"testMixedBounds_collection\"}}",
"{\"core_node1\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":495,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":257740,\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":495,\n \"__bytes__\":257740,\n \"core\":\"testMixedBounds_collection_shard1_replica_n1\",\n \"__docs__\":495,\n \"violationType\":\"aboveBytes\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":2.4003908038139343E-4,\n \"shard\":\"shard1\",\n \"collection\":\"testMixedBounds_collection\"}}"]},
"belowSize":{"testSplitIntegration_collection":[
"{\"core_node16\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":5,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":12740,\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"base_url\":\"http://127.0.0.1:10000/solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":5,\n \"__bytes__\":12740,\n \"__docs__\":5,\n \"violationType\":\"belowDocs\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":1.1865049600601196E-5,\n \"core\":\"testSplitIntegration_collection_shard2_1_replica1\",\n \"shard\":\"shard2_1\",\n \"collection\":\"testSplitIntegration_collection\"}}",
"{\"core_node14\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":6,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":23480,\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"base_url\":\"http://127.0.0.1:10000/solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":6,\n \"__bytes__\":23480,\n \"__docs__\":6,\n \"violationType\":\"belowDocs\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":2.1867454051971436E-5,\n \"core\":\"testSplitIntegration_collection_shard2_0_replica1\",\n \"shard\":\"shard2_0\",\n \"collection\":\"testSplitIntegration_collection\"}}"]},
"_enqueue_time_":29227765744872575,
"requestedOps":[
"Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testMixedBounds_collection\",\n \"second\":\"shard2\"}]}}",
"Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testMixedBounds_collection\",\n \"second\":\"shard1\"}]}}",
"Op{action=MERGESHARDS, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2_1\"}, {\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2_0\"}]}}"]}}, context={properties.operations=[{class=org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard, method=GET, params.action=SPLITSHARD, params.collection=testMixedBounds_collection, params.shard=shard2}, {class=org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard, method=GET, params.action=SPLITSHARD, params.collection=testMixedBounds_collection, params.shard=shard1}], properties.unsupportedOps=[Op{action=MERGESHARDS, hints={COLL_SHARD=[{
"first":"testSplitIntegration_collection",
"second":"shard2_1"}, {
"first":"testSplitIntegration_collection",
"second":"shard2_0"}]}}], properties.BEFORE_ACTION=[compute_plan], source=index_size_trigger, properties.AFTER_ACTION=[compute_plan]}, config={
"trigger":"index_size_trigger",
"stage":[
"STARTED",
"ABORTED",
"SUCCEEDED",
"FAILED"],
"afterAction":[
"compute_plan",
"execute_plan"],
"class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener",
"beforeAction":[
"compute_plan",
"execute_plan"]}, message='null'}, CapturedEvent{timestamp=29227768778124725, stage=BEFORE_ACTION, actionName='execute_plan', event={
"id":"67d67dd99e6741T2mi19qz6dl7ovezin3l1g4rhl",
"source":"index_size_trigger",
"eventTime":29227758611490625,
"eventType":"INDEXSIZE",
"properties":{
"__start__":3,
"aboveSize":{"testMixedBounds_collection":[
"{\"core_node3\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":505,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":262740,\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":505,\n \"__bytes__\":262740,\n \"core\":\"testMixedBounds_collection_shard2_replica_n3\",\n \"__docs__\":505,\n \"violationType\":\"aboveBytes\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":2.446956932544708E-4,\n \"shard\":\"shard2\",\n \"collection\":\"testMixedBounds_collection\"}}",
"{\"core_node1\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":495,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":257740,\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":495,\n \"__bytes__\":257740,\n \"core\":\"testMixedBounds_collection_shard1_replica_n1\",\n \"__docs__\":495,\n \"violationType\":\"aboveBytes\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":2.4003908038139343E-4,\n \"shard\":\"shard1\",\n \"collection\":\"testMixedBounds_collection\"}}"]},
"belowSize":{"testSplitIntegration_collection":[
"{\"core_node16\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":5,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":12740,\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"base_url\":\"http://127.0.0.1:10000/solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":5,\n \"__bytes__\":12740,\n \"__docs__\":5,\n \"violationType\":\"belowDocs\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":1.1865049600601196E-5,\n \"core\":\"testSplitIntegration_collection_shard2_1_replica1\",\n \"shard\":\"shard2_1\",\n \"collection\":\"testSplitIntegration_collection\"}}",
"{\"core_node14\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":6,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":23480,\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"base_url\":\"http://127.0.0.1:10000/solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":6,\n \"__bytes__\":23480,\n \"__docs__\":6,\n \"violationType\":\"belowDocs\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":2.1867454051971436E-5,\n \"core\":\"testSplitIntegration_collection_shard2_0_replica1\",\n \"shard\":\"shard2_0\",\n \"collection\":\"testSplitIntegration_collection\"}}"]},
"_enqueue_time_":29227765744872575,
"requestedOps":[
"Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testMixedBounds_collection\",\n \"second\":\"shard2\"}]}}",
"Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testMixedBounds_collection\",\n \"second\":\"shard1\"}]}}",
"Op{action=MERGESHARDS, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2_1\"}, {\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2_0\"}]}}"]}}, context={properties.operations=[{class=org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard, method=GET, params.action=SPLITSHARD, params.collection=testMixedBounds_collection, params.shard=shard2}, {class=org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard, method=GET, params.action=SPLITSHARD, params.collection=testMixedBounds_collection, params.shard=shard1}], properties.unsupportedOps=[Op{action=MERGESHARDS, hints={COLL_SHARD=[{
"first":"testSplitIntegration_collection",
"second":"shard2_1"}, {
"first":"testSplitIntegration_collection",
"second":"shard2_0"}]}}], properties.BEFORE_ACTION=[compute_plan, execute_plan], source=index_size_trigger, properties.AFTER_ACTION=[compute_plan]}, config={
"trigger":"index_size_trigger",
"stage":[
"STARTED",
"ABORTED",
"SUCCEEDED",
"FAILED"],
"afterAction":[
"compute_plan",
"execute_plan"],
"class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener",
"beforeAction":[
"compute_plan",
"execute_plan"]}, message='null'}, CapturedEvent{timestamp=29227795143892675, stage=AFTER_ACTION, actionName='execute_plan', event={
"id":"67d67dd99e6741T2mi19qz6dl7ovezin3l1g4rhl",
"source":"index_size_trigger",
"eventTime":29227758611490625,
"eventType":"INDEXSIZE",
"properties":{
"__start__":3,
"aboveSize":{"testMixedBounds_collection":[
"{\"core_node3\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":505,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":262740,\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":505,\n \"__bytes__\":262740,\n \"core\":\"testMixedBounds_collection_shard2_replica_n3\",\n \"__docs__\":505,\n \"violationType\":\"aboveBytes\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":2.446956932544708E-4,\n \"shard\":\"shard2\",\n \"collection\":\"testMixedBounds_collection\"}}",
"{\"core_node1\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":495,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":257740,\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":495,\n \"__bytes__\":257740,\n \"core\":\"testMixedBounds_collection_shard1_replica_n1\",\n \"__docs__\":495,\n \"violationType\":\"aboveBytes\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":2.4003908038139343E-4,\n \"shard\":\"shard1\",\n \"collection\":\"testMixedBounds_collection\"}}"]},
"belowSize":{"testSplitIntegration_collection":[
"{\"core_node16\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":5,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":12740,\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"base_url\":\"http://127.0.0.1:10000/solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":5,\n \"__bytes__\":12740,\n \"__docs__\":5,\n \"violationType\":\"belowDocs\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":1.1865049600601196E-5,\n \"core\":\"testSplitIntegration_collection_shard2_1_replica1\",\n \"shard\":\"shard2_1\",\n \"collection\":\"testSplitIntegration_collection\"}}",
"{\"core_node14\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":6,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":23480,\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"base_url\":\"http://127.0.0.1:10000/solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":6,\n \"__bytes__\":23480,\n \"__docs__\":6,\n \"violationType\":\"belowDocs\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":2.1867454051971436E-5,\n \"core\":\"testSplitIntegration_collection_shard2_0_replica1\",\n \"shard\":\"shard2_0\",\n \"collection\":\"testSplitIntegration_collection\"}}"]},
"_enqueue_time_":29227765744872575,
"requestedOps":[
"Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testMixedBounds_collection\",\n \"second\":\"shard2\"}]}}",
"Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testMixedBounds_collection\",\n \"second\":\"shard1\"}]}}",
"Op{action=MERGESHARDS, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2_1\"}, {\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2_0\"}]}}"]}}, context={properties.operations=[{class=org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard, method=GET, params.action=SPLITSHARD, params.async=index_size_trigger/67d67dd99e6741T2mi19qz6dl7ovezin3l1g4rhl/0, params.waitForFinalState=true, params.collection=testMixedBounds_collection, params.shard=shard2}, {class=org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard, method=GET, params.action=SPLITSHARD, params.async=index_size_trigger/67d67dd99e6741T2mi19qz6dl7ovezin3l1g4rhl/0, params.waitForFinalState=true, params.collection=testMixedBounds_collection, params.shard=shard1}], properties.unsupportedOps=[Op{action=MERGESHARDS, hints={COLL_SHARD=[{
"first":"testSplitIntegration_collection",
"second":"shard2_1"}, {
"first":"testSplitIntegration_collection",
"second":"shard2_0"}]}}], properties.BEFORE_ACTION=[compute_plan, execute_plan], properties.responses=[{status={state=completed,msg=found [index_size_trigger/67d67dd99e6741T2mi19qz6dl7ovezin3l1g4rhl/0] in completed tasks},success=}, {status={state=completed,msg=found [index_size_trigger/67d67dd99e6741T2mi19qz6dl7ovezin3l1g4rhl/0] in completed tasks},success=}], source=index_size_trigger, properties.AFTER_ACTION=[compute_plan, execute_plan]}, config={
"trigger":"index_size_trigger",
"stage":[
"STARTED",
"ABORTED",
"SUCCEEDED",
"FAILED"],
"afterAction":[
"compute_plan",
"execute_plan"],
"class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener",
"beforeAction":[
"compute_plan",
"execute_plan"]}, message='null'}, CapturedEvent{timestamp=29227795198535075, stage=SUCCEEDED, actionName='null', event={
"id":"67d67dd99e6741T2mi19qz6dl7ovezin3l1g4rhl",
"source":"index_size_trigger",
"eventTime":29227758611490625,
"eventType":"INDEXSIZE",
"properties":{
"__start__":3,
"aboveSize":{"testMixedBounds_collection":[
"{\"core_node3\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":505,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":262740,\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":505,\n \"__bytes__\":262740,\n \"core\":\"testMixedBounds_collection_shard2_replica_n3\",\n \"__docs__\":505,\n \"violationType\":\"aboveBytes\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":2.446956932544708E-4,\n \"shard\":\"shard2\",\n \"collection\":\"testMixedBounds_collection\"}}",
"{\"core_node1\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":495,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":257740,\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":495,\n \"__bytes__\":257740,\n \"core\":\"testMixedBounds_collection_shard1_replica_n1\",\n \"__docs__\":495,\n \"violationType\":\"aboveBytes\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":2.4003908038139343E-4,\n \"shard\":\"shard1\",\n \"collection\":\"testMixedBounds_collection\"}}"]},
"belowSize":{"testSplitIntegration_collection":[
"{\"core_node16\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":5,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":12740,\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"base_url\":\"http://127.0.0.1:10000/solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":5,\n \"__bytes__\":12740,\n \"__docs__\":5,\n \"violationType\":\"belowDocs\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":1.1865049600601196E-5,\n \"core\":\"testSplitIntegration_collection_shard2_1_replica1\",\n \"shard\":\"shard2_1\",\n \"collection\":\"testSplitIntegration_collection\"}}",
"{\"core_node14\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":6,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":23480,\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"base_url\":\"http://127.0.0.1:10000/solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":6,\n \"__bytes__\":23480,\n \"__docs__\":6,\n \"violationType\":\"belowDocs\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":2.1867454051971436E-5,\n \"core\":\"testSplitIntegration_collection_shard2_0_replica1\",\n \"shard\":\"shard2_0\",\n \"collection\":\"testSplitIntegration_collection\"}}"]},
"_enqueue_time_":29227765744872575,
"requestedOps":[
"Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testMixedBounds_collection\",\n \"second\":\"shard2\"}]}}",
"Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testMixedBounds_collection\",\n \"second\":\"shard1\"}]}}",
"Op{action=MERGESHARDS, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2_1\"}, {\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2_0\"}]}}"]}}, context={}, config={
"trigger":"index_size_trigger",
"stage":[
"STARTED",
"ABORTED",
"SUCCEEDED",
"FAILED"],
"afterAction":[
"compute_plan",
"execute_plan"],
"class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener",
"beforeAction":[
"compute_plan",
"execute_plan"]}, message='null'}] expected:<6> but was:<7>
at __randomizedtesting.SeedInfo.seed([D0587EE810FE7C38:DADBC1455D457762]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest.testMixedBounds(IndexSizeTriggerTest.java:550)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest.testMergeIntegration
Error Message:
did not finish processing in time
Stack Trace:
java.lang.AssertionError: did not finish processing in time
at __randomizedtesting.SeedInfo.seed([D0587EE810FE7C38:83E13C58F2EFE9C2]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest.testMergeIntegration(IndexSizeTriggerTest.java:404)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 13953 lines...]
[junit4] Suite: org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.IndexSizeTriggerTest_D0587EE810FE7C38-001/init-core-data-001
[junit4] 2> 1912906 WARN (SUITE-IndexSizeTriggerTest-seed#[D0587EE810FE7C38]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=5 numCloses=5
[junit4] 2> 1912906 INFO (SUITE-IndexSizeTriggerTest-seed#[D0587EE810FE7C38]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 1912908 INFO (SUITE-IndexSizeTriggerTest-seed#[D0587EE810FE7C38]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 2> 1912909 INFO (SUITE-IndexSizeTriggerTest-seed#[D0587EE810FE7C38]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 1912909 INFO (SUITE-IndexSizeTriggerTest-seed#[D0587EE810FE7C38]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.IndexSizeTriggerTest_D0587EE810FE7C38-001/tempDir-001
[junit4] 2> 1912909 INFO (SUITE-IndexSizeTriggerTest-seed#[D0587EE810FE7C38]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1912916 INFO (Thread-7089) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1912916 INFO (Thread-7089) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1912972 ERROR (Thread-7089) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 1913016 INFO (SUITE-IndexSizeTriggerTest-seed#[D0587EE810FE7C38]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:33863
[junit4] 2> 1913077 INFO (zkConnectionManagerCallback-2887-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1913107 INFO (jetty-launcher-2884-thread-1) [ ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 1.8.0_172-b11
[junit4] 2> 1913113 INFO (jetty-launcher-2884-thread-2) [ ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 1.8.0_172-b11
[junit4] 2> 1913220 INFO (jetty-launcher-2884-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1913220 INFO (jetty-launcher-2884-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1913220 INFO (jetty-launcher-2884-thread-1) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 1913224 INFO (jetty-launcher-2884-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@614cef2b{/solr,null,AVAILABLE}
[junit4] 2> 1913226 INFO (jetty-launcher-2884-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@3996133f{SSL,[ssl, http/1.1]}{127.0.0.1:34467}
[junit4] 2> 1913226 INFO (jetty-launcher-2884-thread-1) [ ] o.e.j.s.Server Started @1913566ms
[junit4] 2> 1913226 INFO (jetty-launcher-2884-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=34467}
[junit4] 2> 1913226 ERROR (jetty-launcher-2884-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1913226 INFO (jetty-launcher-2884-thread-1) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 1913226 INFO (jetty-launcher-2884-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.5.0
[junit4] 2> 1913226 INFO (jetty-launcher-2884-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1913226 INFO (jetty-launcher-2884-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1913226 INFO (jetty-launcher-2884-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-06-14T11:29:10.305Z
[junit4] 2> 1913252 INFO (jetty-launcher-2884-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1913252 INFO (jetty-launcher-2884-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1913252 INFO (jetty-launcher-2884-thread-2) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 1913277 INFO (jetty-launcher-2884-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@13e1847d{/solr,null,AVAILABLE}
[junit4] 2> 1913278 INFO (jetty-launcher-2884-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@42d6d60f{SSL,[ssl, http/1.1]}{127.0.0.1:38287}
[junit4] 2> 1913278 INFO (jetty-launcher-2884-thread-2) [ ] o.e.j.s.Server Started @1913618ms
[junit4] 2> 1913278 INFO (jetty-launcher-2884-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=38287}
[junit4] 2> 1913279 ERROR (jetty-launcher-2884-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1913279 INFO (jetty-launcher-2884-thread-2) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 1913279 INFO (jetty-launcher-2884-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.5.0
[junit4] 2> 1913279 INFO (jetty-launcher-2884-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1913279 INFO (jetty-launcher-2884-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1913279 INFO (jetty-launcher-2884-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-06-14T11:29:10.358Z
[junit4] 2> 1913280 INFO (zkConnectionManagerCallback-2889-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1913280 INFO (jetty-launcher-2884-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1913322 INFO (zkConnectionManagerCallback-2891-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1913322 INFO (jetty-launcher-2884-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1913781 INFO (jetty-launcher-2884-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:33863/solr
[junit4] 2> 1913804 INFO (zkConnectionManagerCallback-2895-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1913824 INFO (zkConnectionManagerCallback-2897-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1913981 INFO (jetty-launcher-2884-thread-2) [n:127.0.0.1:38287_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1913982 INFO (jetty-launcher-2884-thread-2) [n:127.0.0.1:38287_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:38287_solr
[junit4] 2> 1913983 INFO (jetty-launcher-2884-thread-2) [n:127.0.0.1:38287_solr ] o.a.s.c.Overseer Overseer (id=73973057115717636-127.0.0.1:38287_solr-n_0000000000) starting
[junit4] 2> 1913988 INFO (jetty-launcher-2884-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:33863/solr
[junit4] 2> 1914029 INFO (zkConnectionManagerCallback-2903-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1914080 INFO (zkConnectionManagerCallback-2910-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1914084 INFO (zkConnectionManagerCallback-2908-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1914086 INFO (jetty-launcher-2884-thread-2) [n:127.0.0.1:38287_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:33863/solr ready
[junit4] 2> 1914108 INFO (jetty-launcher-2884-thread-1) [n:127.0.0.1:34467_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1914109 INFO (jetty-launcher-2884-thread-1) [n:127.0.0.1:34467_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34467_solr
[junit4] 2> 1914121 INFO (OverseerStateUpdate-73973057115717636-127.0.0.1:38287_solr-n_0000000000) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1914162 INFO (jetty-launcher-2884-thread-2) [n:127.0.0.1:38287_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 1914162 INFO (jetty-launcher-2884-thread-2) [n:127.0.0.1:38287_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38287_solr
[junit4] 2> 1914180 INFO (zkCallback-2896-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1914184 DEBUG (OverseerAutoScalingTriggerThread-73973057115717636-127.0.0.1:38287_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and .scheduled_maintenance triggers
[junit4] 2> 1914185 DEBUG (OverseerAutoScalingTriggerThread-73973057115717636-127.0.0.1:38287_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
[junit4] 2> 1914185 DEBUG (OverseerAutoScalingTriggerThread-73973057115717636-127.0.0.1:38287_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1
[junit4] 2> 1914185 DEBUG (OverseerAutoScalingTriggerThread-73973057115717636-127.0.0.1:38287_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
[junit4] 2> 1914213 INFO (zkCallback-2909-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1914232 DEBUG (OverseerAutoScalingTriggerThread-73973057115717636-127.0.0.1:38287_solr-n_0000000000) [ ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial livenodes: []
[junit4] 2> 1914252 INFO (zkCallback-2907-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1914256 INFO (jetty-launcher-2884-thread-2) [n:127.0.0.1:38287_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 1914280 DEBUG (ScheduledTrigger-4525-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1914309 INFO (jetty-launcher-2884-thread-2) [n:127.0.0.1:38287_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38287.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@738fdd79
[junit4] 2> 1914324 DEBUG (OverseerAutoScalingTriggerThread-73973057115717636-127.0.0.1:38287_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 1914324 DEBUG (OverseerAutoScalingTriggerThread-73973057115717636-127.0.0.1:38287_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
[junit4] 2> 1914333 INFO (jetty-launcher-2884-thread-2) [n:127.0.0.1:38287_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38287.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@738fdd79
[junit4] 2> 1914334 INFO (jetty-launcher-2884-thread-2) [n:127.0.0.1:38287_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38287.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@738fdd79
[junit4] 2> 1914345 INFO (jetty-launcher-2884-thread-2) [n:127.0.0.1:38287_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.IndexSizeTriggerTest_D0587EE810FE7C38-001/tempDir-001/node2/.
[junit4] 2> 1914736 INFO (zkConnectionManagerCallback-2918-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1914737 INFO (jetty-launcher-2884-thread-1) [n:127.0.0.1:34467_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1914738 INFO (jetty-launcher-2884-thread-1) [n:127.0.0.1:34467_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:33863/solr ready
[junit4] 2> 1914760 INFO (jetty-launcher-2884-thread-1) [n:127.0.0.1:34467_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 1914784 INFO (jetty-launcher-2884-thread-1) [n:127.0.0.1:34467_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34467.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@738fdd79
[junit4] 2> 1914798 INFO (jetty-launcher-2884-thread-1) [n:127.0.0.1:34467_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34467.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@738fdd79
[jun
[...truncated too long message...]
ne/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
jar-checksums:
[mkdir] Created dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/null757245464
[copy] Copying 39 files to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/null757245464
[delete] Deleting directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/null757245464
resolve-example:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
resolve-server:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
jar-checksums:
[mkdir] Created dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/null2079115991
[copy] Copying 247 files to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/null2079115991
[delete] Deleting directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/null2079115991
check-working-copy:
[ivy:cachepath] :: resolving dependencies :: org.eclipse.jgit#org.eclipse.jgit-caller;working
[ivy:cachepath] confs: [default]
[ivy:cachepath] found org.eclipse.jgit#org.eclipse.jgit;4.6.0.201612231935-r in public
[ivy:cachepath] found com.jcraft#jsch;0.1.53 in public
[ivy:cachepath] found com.googlecode.javaewah#JavaEWAH;1.1.6 in public
[ivy:cachepath] found org.apache.httpcomponents#httpclient;4.3.6 in public
[ivy:cachepath] found org.apache.httpcomponents#httpcore;4.3.3 in public
[ivy:cachepath] found commons-logging#commons-logging;1.1.3 in public
[ivy:cachepath] found commons-codec#commons-codec;1.6 in public
[ivy:cachepath] found org.slf4j#slf4j-api;1.7.2 in public
[ivy:cachepath] :: resolution report :: resolve 115ms :: artifacts dl 9ms
---------------------------------------------------------------------
| | modules || artifacts |
| conf | number| search|dwnlded|evicted|| number|dwnlded|
---------------------------------------------------------------------
| default | 8 | 0 | 0 | 0 || 8 | 0 |
---------------------------------------------------------------------
[wc-checker] Initializing working copy...
[wc-checker] SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
[wc-checker] SLF4J: Defaulting to no-operation (NOP) logger implementation
[wc-checker] SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
[wc-checker] Checking working copy status...
-jenkins-base:
BUILD SUCCESSFUL
Total time: 395 minutes 30 seconds
Archiving artifacts
WARN: No artifacts found that match the file pattern "**/*.events,heapdumps/**,**/hs_err_pid*". Configuration error?
WARN: java.lang.InterruptedException: no matches found within 10000
Recording test results
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
[JENKINS] Lucene-Solr-NightlyTests-7.x - Build # 240 - Still
Unstable
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-7.x/240/
2 tests failed.
FAILED: org.apache.solr.cloud.DocValuesNotIndexedTest.testDistribFaceting
Error Message:
Field intField should have a count of 1 expected:<1> but was:<0>
Stack Trace:
java.lang.AssertionError: Field intField should have a count of 1 expected:<1> but was:<0>
at __randomizedtesting.SeedInfo.seed([EA6BC1AB257C709:6C174227D64CECDB]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.apache.solr.cloud.DocValuesNotIndexedTest.testFacet(DocValuesNotIndexedTest.java:445)
at org.apache.solr.cloud.DocValuesNotIndexedTest.testDistribFaceting(DocValuesNotIndexedTest.java:216)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest.testMergeIntegration
Error Message:
did not finish processing in time
Stack Trace:
java.lang.AssertionError: did not finish processing in time
at __randomizedtesting.SeedInfo.seed([EA6BC1AB257C709:5D1FFEAA504652F3]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest.testMergeIntegration(IndexSizeTriggerTest.java:406)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 13423 lines...]
[junit4] Suite: org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest
[junit4] 2> 1310774 INFO (SUITE-IndexSizeTriggerTest-seed#[EA6BC1AB257C709]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.IndexSizeTriggerTest_EA6BC1AB257C709-001/init-core-data-001
[junit4] 2> 1310775 WARN (SUITE-IndexSizeTriggerTest-seed#[EA6BC1AB257C709]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=14 numCloses=14
[junit4] 2> 1310776 INFO (SUITE-IndexSizeTriggerTest-seed#[EA6BC1AB257C709]-worker) [ ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 1310777 INFO (SUITE-IndexSizeTriggerTest-seed#[EA6BC1AB257C709]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 2> 1310807 INFO (SUITE-IndexSizeTriggerTest-seed#[EA6BC1AB257C709]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.IndexSizeTriggerTest_EA6BC1AB257C709-001/tempDir-001
[junit4] 2> 1310807 INFO (SUITE-IndexSizeTriggerTest-seed#[EA6BC1AB257C709]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1310814 INFO (Thread-26703) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1310814 INFO (Thread-26703) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1310846 ERROR (Thread-26703) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 1310914 INFO (SUITE-IndexSizeTriggerTest-seed#[EA6BC1AB257C709]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:36486
[junit4] 2> 1311022 INFO (zkConnectionManagerCallback-853-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1311040 INFO (jetty-launcher-850-thread-1) [ ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 1.8.0_172-b11
[junit4] 2> 1311050 INFO (jetty-launcher-850-thread-2) [ ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 1.8.0_172-b11
[junit4] 2> 1311086 INFO (jetty-launcher-850-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1311086 INFO (jetty-launcher-850-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1311086 INFO (jetty-launcher-850-thread-1) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 1311090 INFO (jetty-launcher-850-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@237a1a22{/solr,null,AVAILABLE}
[junit4] 2> 1311093 INFO (jetty-launcher-850-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1311093 INFO (jetty-launcher-850-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1311093 INFO (jetty-launcher-850-thread-2) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 1311094 INFO (jetty-launcher-850-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@992dba0{/solr,null,AVAILABLE}
[junit4] 2> 1311096 INFO (jetty-launcher-850-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@6ae63d45{SSL,[ssl, http/1.1]}{127.0.0.1:41132}
[junit4] 2> 1311096 INFO (jetty-launcher-850-thread-2) [ ] o.e.j.s.Server Started @1311153ms
[junit4] 2> 1311097 INFO (jetty-launcher-850-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=41132}
[junit4] 2> 1311097 ERROR (jetty-launcher-850-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1311097 INFO (jetty-launcher-850-thread-2) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 1311097 INFO (jetty-launcher-850-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.5.0
[junit4] 2> 1311097 INFO (jetty-launcher-850-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1311097 INFO (jetty-launcher-850-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1311097 INFO (jetty-launcher-850-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-06-12T02:12:55.542Z
[junit4] 2> 1311098 INFO (jetty-launcher-850-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@7c93ba0{SSL,[ssl, http/1.1]}{127.0.0.1:52822}
[junit4] 2> 1311098 INFO (jetty-launcher-850-thread-1) [ ] o.e.j.s.Server Started @1311154ms
[junit4] 2> 1311098 INFO (jetty-launcher-850-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=52822}
[junit4] 2> 1311098 ERROR (jetty-launcher-850-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1311098 INFO (jetty-launcher-850-thread-1) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 1311098 INFO (jetty-launcher-850-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.5.0
[junit4] 2> 1311098 INFO (jetty-launcher-850-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1311098 INFO (jetty-launcher-850-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1311098 INFO (jetty-launcher-850-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-06-12T02:12:55.543Z
[junit4] 2> 1311326 INFO (zkConnectionManagerCallback-855-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1311326 INFO (jetty-launcher-850-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1311338 INFO (zkConnectionManagerCallback-857-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1311342 INFO (jetty-launcher-850-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1311707 INFO (jetty-launcher-850-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36486/solr
[junit4] 2> 1311726 INFO (zkConnectionManagerCallback-861-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1311742 INFO (zkConnectionManagerCallback-863-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1311976 INFO (jetty-launcher-850-thread-2) [n:127.0.0.1:41132_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1311976 INFO (jetty-launcher-850-thread-2) [n:127.0.0.1:41132_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:41132_solr
[junit4] 2> 1311977 INFO (jetty-launcher-850-thread-2) [n:127.0.0.1:41132_solr ] o.a.s.c.Overseer Overseer (id=73959545247105028-127.0.0.1:41132_solr-n_0000000000) starting
[junit4] 2> 1311986 INFO (zkConnectionManagerCallback-870-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1311988 INFO (jetty-launcher-850-thread-2) [n:127.0.0.1:41132_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:36486/solr ready
[junit4] 2> 1312022 DEBUG (OverseerAutoScalingTriggerThread-73959545247105028-127.0.0.1:41132_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and .scheduled_maintenance triggers
[junit4] 2> 1312023 INFO (jetty-launcher-850-thread-2) [n:127.0.0.1:41132_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41132_solr
[junit4] 2> 1312024 DEBUG (OverseerAutoScalingTriggerThread-73959545247105028-127.0.0.1:41132_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
[junit4] 2> 1312025 DEBUG (OverseerAutoScalingTriggerThread-73959545247105028-127.0.0.1:41132_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1
[junit4] 2> 1312025 DEBUG (OverseerAutoScalingTriggerThread-73959545247105028-127.0.0.1:41132_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
[junit4] 2> 1312027 INFO (OverseerStateUpdate-73959545247105028-127.0.0.1:41132_solr-n_0000000000) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1312052 INFO (zkCallback-869-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1312091 DEBUG (OverseerAutoScalingTriggerThread-73959545247105028-127.0.0.1:41132_solr-n_0000000000) [ ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial livenodes: [127.0.0.1:41132_solr]
[junit4] 2> 1312125 DEBUG (OverseerAutoScalingTriggerThread-73959545247105028-127.0.0.1:41132_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 1312127 DEBUG (OverseerAutoScalingTriggerThread-73959545247105028-127.0.0.1:41132_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
[junit4] 2> 1312129 DEBUG (ScheduledTrigger-1078-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 1312130 WARN (jetty-launcher-850-thread-2) [n:127.0.0.1:41132_solr ] o.a.s.h.a.MetricsHistoryHandler Missing .system, keeping metrics history in memory
[junit4] 2> 1312163 INFO (jetty-launcher-850-thread-2) [n:127.0.0.1:41132_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41132.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@240fda1e
[junit4] 2> 1312169 INFO (jetty-launcher-850-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36486/solr
[junit4] 2> 1312176 INFO (jetty-launcher-850-thread-2) [n:127.0.0.1:41132_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41132.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@240fda1e
[junit4] 2> 1312176 INFO (jetty-launcher-850-thread-2) [n:127.0.0.1:41132_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41132.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@240fda1e
[junit4] 2> 1312177 INFO (jetty-launcher-850-thread-2) [n:127.0.0.1:41132_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.IndexSizeTriggerTest_EA6BC1AB257C709-001/tempDir-001/node2/.
[junit4] 2> 1312238 INFO (zkConnectionManagerCallback-875-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1312264 INFO (zkConnectionManagerCallback-877-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1312485 INFO (jetty-launcher-850-thread-1) [n:127.0.0.1:52822_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1312487 INFO (jetty-launcher-850-thread-1) [n:127.0.0.1:52822_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1312506 INFO (jetty-launcher-850-thread-1) [n:127.0.0.1:52822_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 1312506 INFO (jetty-launcher-850-thread-1) [n:127.0.0.1:52822_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52822_solr
[junit4] 2> 1312522 INFO (zkCallback-862-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1312535 INFO (zkCallback-869-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1312536 INFO (zkCallback-876-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1312610 INFO (zkConnectionManagerCallback-884-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1312611 INFO (jetty-launcher-850-thread-1) [n:127.0.0.1:52822_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1312612 INFO (jetty-launcher-850-thread-1) [n:127.0.0.1:52822_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:36486/solr ready
[junit4] 2> 1312625 WARN (jetty-launcher-850-thread-1) [n:127.0.0.1:52822_solr ] o.a.s.h.a.MetricsHistoryHandler Missing .system, keeping metrics history in memory
[junit4] 2> 1312705 INFO (jetty-launcher-850-thread-1) [n:127.0.0.1:52822_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_52822.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@240fda1e
[junit4] 2> 1313086 INFO (jetty-launcher-850-thread-1) [n:127.0.0.1:52822_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_52822.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@240fda1e
[junit4] 2> 1313086 INFO (jetty-launcher-850-thread-1) [n:127.0.0.1:52822_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_52822.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@240fda1e
[junit4] 2> 1313088 INFO (jetty-launcher-850-thread-1) [n:127.0.0.1:52822_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.IndexSizeTriggerTest_EA6BC1AB257C709-001/tempDir-001/node1/.
[junit4] 2> 1313133 DEBUG (ScheduledTrigger-1078-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1313176 INFO (zkConnectionManagerCallback-887-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1313183 INFO (zkConnectionManagerCallback-892-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1313184 INFO (SUITE-IndexSizeTriggerTest-seed#[EA6BC1AB257C709]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1313185 INFO (SUITE-IndexSizeTriggerTest-seed#[EA6BC1AB257C709]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:36486/solr ready
[junit4] 2> 1313255 DEBUG (SUITE-IndexSizeTriggerTest-seed#[EA6BC1AB257C709]-worker) [ ] o.a.s.c.a.s.SimClusterStateProvider --- new Overseer leader: 127.0.0.1:10000_solr
[junit4] 2> 1313262 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and .scheduled_maintenance triggers
[junit4] 2> 1313262 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 0
[junit4] 2> 1313263 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 0, lastZnodeVersion -1
[junit4] 2> 1313271 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 0
[junit4] 2> 1313278 WARN (SUITE-IndexSizeTriggerTest-seed#[EA6BC1AB257C709]-worker) [ ] o.a.s.h.a.MetricsHistoryHandler Missing .system, keeping metrics history in memory
[junit4] 2> 1313313 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial livenodes: [127.0.0.1:10001_solr, 127.0.0.1:10000_solr]
[junit4] 2> 1313316 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 1313316 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 0, lastZnodeVersion 0
[junit4] 2> 1313316 DEBUG (ScheduledTrigger-1094-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1313338 DEBUG (ScheduledTrigger-1094-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1313358 DEBUG (ScheduledTrigger-1094-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1313379 DEBUG (ScheduledTrigger-1094-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1313399 DEBUG (ScheduledTrigger-1094-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1313419 DEBUG (ScheduledTrigger-1094-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1313439 DEBUG (ScheduledTrigger-1094-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1313460 DEBUG (ScheduledTrigger-1094-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1313480 DEBUG (ScheduledTrigger-1094-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1313564 DEBUG (ScheduledTrigger-1094-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1313584 DEBUG (ScheduledTrigger-1094-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1313614 DEBUG (ScheduledTrigger-1094-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1313629 INFO (TEST-IndexSizeTriggerTest.testTrigger-seed#[EA6BC1AB257C709]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testTrigger
[junit4] 2> 1313634 DEBUG (ScheduledTrigger-1094-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1313655 DEBUG (ScheduledTrigger-1094-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1313675 DEBUG (ScheduledTrigger-1094-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1313695 DEBUG (ScheduledTrigger-1094-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1313715 DEBUG (ScheduledTrigger-1094-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1313735 DEBUG (ScheduledTrigger-1094-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1313757 DEBUG (ScheduledTrigger-1094-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1313766 DEBUG (simCloudManagerPool-1093-thread-6) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testTrigger_collection / shard2: {"core_node3":{
[junit4] 2> "core":"testTrigger_collection_shard2_replica_n3",
[junit4] 2> "leader":"true",
[junit4] 2> "SEARCHER.searcher.maxDoc":0,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10000_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":0,
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"testTrigger_collection"}}
[junit4] 2> 1313786 DEBUG (simCloudManagerPool-1093-thread-7) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testTrigger_collection / shard1: {"core_node1":{
[junit4] 2> "core":"testTrigger_collection_shard1_replica_n1",
[junit4] 2> "leader":"true",
[junit4] 2> "SEARCHER.searcher.maxDoc":0,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10000_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":0,
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testTrigger_collection"}}
[junit4] 2> 1313787 DEBUG (ScheduledTrigger-1094-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1313807 DEBUG (ScheduledTrigger-1094-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1313827 DEBUG (ScheduledTrigger-1094-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1313847 DEBUG (ScheduledTrigger-1094-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1313868 DEBUG (ScheduledTrigger-1094-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1313894 DEBUG (ScheduledTrigger-1094-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1313920 DEBUG (ScheduledTrigger-1094-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1313940 DEBUG (ScheduledTrigger-1094-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1313961 DEBUG (ScheduledTrigger-1094-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1313981 DEBUG (ScheduledTrigger-1094-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1314001 DEBUG (ScheduledTrigger-1094-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1314021 DEBUG (ScheduledTrigger-1094-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1314042 DEBUG (ScheduledTrigger-1094-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1314062 DEBUG (ScheduledTrigger-1094-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1314082 DEBUG (ScheduledTrigger-1094-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1314090 INFO (TEST-IndexSizeTriggerTest.testTrigger-seed#[EA6BC1AB257C709]) [ ] o.a.s.c.a.IndexSizeTriggerTest #######################################
[junit4] 2> ############ CLUSTER STATE ############
[junit4] 2> #######################################
[junit4] 2> ## Live nodes: 2
[junit4] 2> ## Empty nodes: 0
[junit4] 2> ## Dead nodes: 0
[junit4] 2> ## Collections: [testTrigger_collection]
[junit4] 2> DocCollection(testTrigger_collection//clusterstate.json/29)={
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "pullReplicas":"0",
[junit4] 2> "router":{"name":"compositeId"},
[junit4] 2> "maxShardsPerNode":"2",
[junit4] 2> "autoAddReplicas":"false",
[junit4] 2> "nrtReplicas":"2",
[junit4] 2> "tlogReplicas":"0",
[junit4] 2> "autoCreated":"true",
[junit4] 2> "shards":{
[junit4] 2> "shard2":{
[junit4] 2> "replicas":{
[junit4] 2> "core_node3":{
[junit4] 2> "core":"testTrigger_collection_shard2_replica_n3",
[junit4] 2> "leader":"true",
[junit4] 2> "SEARCHER.searcher.maxDoc":11,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10000_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":11},
[junit4] 2> "core_node4":{
[junit4] 2> "core":"testTrigger_collection_shard2_replica_n4",
[junit4] 2> "SEARCHER.searcher.maxDoc":11,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10001_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":11}},
[junit4] 2> "range":"0-7fffffff",
[junit4] 2> "state":"active"},
[junit4] 2> "shard1":{
[junit4] 2> "replicas":{
[junit4] 2> "core_node1":{
[junit4] 2> "core":"testTrigger_collection_shard1_replica_n1",
[junit4] 2> "leader":"true",
[junit4] 2> "SEARCHER.searcher.maxDoc":14,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10000_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":14},
[junit4] 2> "core_node2":{
[junit4] 2> "core":"testTrigger_collection_shard1_replica_n2",
[junit4] 2> "SEARCHER.searcher.maxDoc":14,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10001_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":14}},
[junit4] 2> "range":"80000000-ffffffff",
[junit4] 2> "state":"active"}}}
[junit4] 2> ## Max replicas per node: 2
[junit4] 2> ## Min replicas per node: 2
[junit4] 2> ## Total replicas: 4
[junit4] 2> ## * testTrigger_collection 4
[junit4] 2> ## - active 4
[junit4] 2> ######### Solr op counts ##########
[junit4] 2> ## - CREATE 1
[junit4] 2> ## - update 26
[junit4] 2> ######### Autoscaling event counts ###########
[junit4] 2>
[junit4] 2> 1314102 DEBUG (ScheduledTrigger-1094-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1314107 DEBUG (TEST-IndexSizeTriggerTest.testTrigger-seed#[EA6BC1AB257C709]) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
[junit4] 2> 1314107 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
[junit4] 2> 1314107 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 1314108 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 1314108 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
[junit4] 2> 1314134 DEBUG (ScheduledTrigger-1078-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1314207 INFO (TEST-IndexSizeTriggerTest.testTrigger-seed#[EA6BC1AB257C709]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testTrigger
[junit4] 2> 1314287 INFO (TEST-IndexSizeTriggerTest.testMergeIntegration-seed#[EA6BC1AB257C709]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testMergeIntegration
[junit4] 2> 1314364 DEBUG (simCloudManagerPool-1093-thread-40) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testMergeIntegration_collection / shard1: {"core_node1":{
[junit4] 2> "core":"testMergeIntegration_collection_shard1_replica_n1",
[junit4] 2> "leader":"true",
[junit4] 2> "SEARCHER.searcher.maxDoc":0,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10000_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":0,
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testMergeIntegration_collection"}}
[junit4] 2> 1314585 DEBUG (simCloudManagerPool-1093-thread-52) [ ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 1314585 DEBUG (simCloudManagerPool-1093-thread-52) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 2
[junit4] 2> 1314594 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
[junit4] 2> 1314594 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 1314594 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 1314594 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
[junit4] 2> 1314610 DEBUG (simCloudManagerPool-1093-thread-53) [ ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 1314610 DEBUG (simCloudManagerPool-1093-thread-53) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 3
[junit4] 2> 1314611 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 3
[junit4] 2> 1314611 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 1314611 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 1314611 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion 3
[junit4] 2> 1314626 DEBUG (simCloudManagerPool-1093-thread-54) [ ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 1314626 DEBUG (simCloudManagerPool-1093-thread-54) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 4
[junit4] 2> 1314626 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 4
[junit4] 2> 1314627 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 1314627 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 1314627 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 4, lastZnodeVersion 4
[junit4] 2> 1315135 DEBUG (ScheduledTrigger-1078-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1316004 INFO (TEST-IndexSizeTriggerTest.testMergeIntegration-seed#[EA6BC1AB257C709]) [ ] o.a.s.c.a.IndexSizeTriggerTest #######################################
[junit4] 2> ############ CLUSTER STATE ############
[junit4] 2> #######################################
[junit4] 2> ## Live nodes: 2
[junit4] 2> ## Empty nodes: 0
[junit4] 2> ## Dead nodes: 0
[junit4] 2> ## Collections: [testMergeIntegration_collection]
[junit4] 2> DocCollection(testMergeIntegration_collection//clusterstate.json/52)={
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "pullReplicas":"0",
[junit4] 2> "router":{"name":"compositeId"},
[junit4] 2> "maxShardsPerNode":"2",
[junit4] 2> "autoAddReplicas":"false",
[junit4] 2> "nrtReplicas":"2",
[junit4] 2> "tlogReplicas":"0",
[junit4] 2> "autoCreated":"true",
[junit4] 2> "shards":{
[junit4] 2> "shard2":{
[junit4] 2> "replicas":{
[junit4] 2> "core_node3":{
[junit4] 2> "core":"testMergeIntegration_collection_shard2_replica_n3",
[junit4] 2> "SEARCHER.searcher.maxDoc":3,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10000_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":3},
[junit4] 2> "core_node4":{
[junit4] 2> "core":"testMergeIntegration_collection_shard2_replica_n4",
[junit4] 2> "SEARCHER.searcher.maxDoc":3,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10001_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":3}},
[junit4] 2> "range":"0-7fffffff",
[junit4] 2> "state":"active"},
[junit4] 2> "shard1":{
[junit4] 2> "replicas":{
[junit4] 2> "core_node1":{
[junit4] 2> "core":"testMergeIntegration_collection_shard1_replica_n1",
[junit4] 2> "leader":"true",
[junit4] 2> "SEARCHER.searcher.maxDoc":7,
[junit4] 2> "SEARCHER.searcher.deletedDocs":5,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10000_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":2},
[junit4] 2> "core_node2":{
[junit4] 2> "core":"testMergeIntegration_collection_shard1_replica_n2",
[junit4] 2> "SEARCHER.searcher.maxDoc":7,
[junit4] 2> "SEARCHER.searcher.deletedDocs":5,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10001_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":2}},
[junit4] 2> "range":"80000000-ffffffff",
[junit4] 2> "state":"active"}}}
[junit4] 2> ## Max replicas per node: 2
[junit4] 2> ## Min replicas per node: 2
[junit4] 2> ## Total replicas: 4
[junit4] 2> ## * testMergeIntegration_collection 4
[junit4] 2> ## - active 4
[junit4] 2> ######### Solr op counts ##########
[junit4] 2> ## - CREATE 1
[junit4] 2> ## - autoscaling 3
[junit4] 2> ## - update 17
[junit4] 2> ######### Autoscaling event counts ###########
[junit4] 2>
[junit4] 2> 1316004 DEBUG (TEST-IndexSizeTriggerTest.testMergeIntegration-seed#[EA6BC1AB257C709]) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 5
[junit4] 2> 1316004 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 5
[junit4] 2> 1316005 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 1316005 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 1316005 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 5, lastZnodeVersion 5
[junit4] 2> 1316244 INFO (TEST-IndexSizeTriggerTest.testMergeIntegration-seed#[EA6BC1AB257C709]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testMergeIntegration
[junit4] 2> 1316264 DEBUG (ScheduledTrigger-1078-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=IndexSizeTriggerTest -Dtests.method=testMergeIntegration -Dtests.seed=EA6BC1AB257C709 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/test-data/enwiki.random.lines.txt -Dtests.locale=ga-IE -Dtests.timezone=America/Louisville -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[junit4] FAILURE 2.09s J1 | IndexSizeTriggerTest.testMergeIntegration <<<
[junit4] > Throwable #1: java.lang.AssertionError: did not finish processing in time
[junit4] > at __randomizedtesting.SeedInfo.seed([EA6BC1AB257C709:5D1FFEAA504652F3]:0)
[junit4] > at org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest.testMergeIntegration(IndexSizeTriggerTest.java:406)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 1316466 INFO (TEST-IndexSizeTriggerTest.testSplitIntegration-seed#[EA6BC1AB257C709]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testSplitIntegration
[junit4] 2> 1316665 DEBUG (simCloudManagerPool-1093-thread-66) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testSplitIntegration_collection / shard2: {"core_node3":{
[junit4] 2> "core":"testSplitIntegration_collection_shard2_replica_n3",
[junit4] 2> "leader":"true",
[junit4] 2> "SEARCHER.searcher.maxDoc":0,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10001_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":0,
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"testSplitIntegration_collection"}}
[junit4] 2> 1316678 DEBUG (simCloudManagerPool-1093-thread-67) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testSplitIntegration_collection / shard1: {"core_node1":{
[junit4] 2> "core":"testSplitIntegration_collection_shard1_replica_n1",
[junit4] 2> "leader":"true",
[junit4] 2> "SEARCHER.searcher.maxDoc":0,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10001_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":0,
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testSplitIntegration_collection"}}
[junit4] 2> 1316694 DEBUG (simCloudManagerPool-1093-thread-68) [ ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 1316694 DEBUG (simCloudManagerPool-1093-thread-68) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 6
[junit4] 2> 1316696 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 6
[junit4] 2> 1316697 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 1316697 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 1316697 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 6, lastZnodeVersion 6
[junit4] 2> 1316713 DEBUG (simCloudManagerPool-1093-thread-69) [ ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 1316713 DEBUG (simCloudManagerPool-1093-thread-69) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 7
[junit4] 2> 1316714 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 7
[junit4] 2> 1316714 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 1316714 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 1316714 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 7, lastZnodeVersion 7
[junit4] 2> 1316738 DEBUG (simCloudManagerPool-1093-thread-70) [ ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 1316738 DEBUG (simCloudManagerPool-1093-thread-70) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 8
[junit4] 2> 1316739 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 8
[junit4] 2> 1316739 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 1316739 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 1316739 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 8, lastZnodeVersion 8
[junit4] 2> 1316947 DEBUG (ScheduledTrigger-1094-thread-1) [ ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
[junit4] 2> "id":"671b0aedc7d75cT4gefepv4ymdsxun8xew87kx0k",
[junit4] 2> "source":"index_size_trigger",
[junit4] 2> "eventTime":29021656354117468,
[junit4] 2> "eventType":"INDEXSIZE",
[junit4] 2> "properties":{
[junit4] 2> "aboveSize":{"testSplitIntegration_collection":[
[junit4] 2> "{\"core_node1\":{\n \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":14,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":14,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10001_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":14,\n \"__bytes__\":1,\n \"shard\":\"shard1\",\n \"collection\":\"testSplitIntegration_collection\"}}",
[junit4] 2> "{\"core_node3\":{\n \"core\":\"testSplitIntegration_collection_shard2_replica_n3\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":11,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":11,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10001_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":11,\n \"__bytes__\":1,\n \"shard\":\"shard2\",\n \"collection\":\"testSplitIntegration_collection\"}}"]},
[junit4] 2> "belowSize":{},
[junit4] 2> "requestedOps":[
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard1\"}]}}",
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2\"}]}}"]}}
[junit4] 2> 1316949 DEBUG (ScheduledTrigger-1094-thread-1) [ ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: [index_size_trigger]
[junit4] 2> 1316951 INFO (ScheduledTrigger-1094-thread-1) [ ] o.a.s.c.a.IndexSizeTriggerTest =======> CapturedEvent{timestamp=29021662692058918, stage=STARTED, actionName='null', event={
[junit4] 2> "id":"671b0aedc7d75cT4gefepv4ymdsxun8xew87kx0k",
[junit4] 2> "source":"index_size_trigger",
[junit4] 2> "eventTime":29021656354117468,
[junit4] 2> "eventType":"INDEXSIZE",
[junit4] 2> "properties":{
[junit4] 2> "aboveSize":{"testSplitIntegration_collection":[
[junit4] 2> "{\"core_node1\":{\n \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":14,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":14,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10001_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":14,\n \"__bytes__\":1,\n \"shard\":\"shard1\",\n \"collection\":\"testSplitIntegration_collection\"}}",
[junit4] 2> "{\"core_node3\":{\n \"core\":\"testSplitIntegration_collection_shard2_replica_n3\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":11,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":11,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10001_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":11,\n \"__bytes__\":1,\n \"shard\":\"shard2\",\n \"collection\":\"testSplitIntegration_collection\"}}"]},
[junit4] 2> "belowSize":{},
[junit4] 2> "_enqueue_time_":29021662626759868,
[junit4] 2> "requestedOps":[
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard1\"}]}}",
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2\"}]}}"]}}, context={}, config={
[junit4] 2> "trigger":"index_size_trigger",
[junit4] 2> "stage":[
[junit4] 2> "STARTED",
[junit4] 2> "ABORTED",
[junit4] 2> "SUCCEEDED",
[junit4] 2> "FAILED"],
[junit4] 2> "afterAction":[
[junit4] 2> "compute_plan",
[junit4] 2> "execute_plan"],
[junit4] 2> "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener",
[junit4] 2> "beforeAction":[
[junit4] 2> "compute_plan",
[junit4] 2> "execute_plan"]}, message='null'}
[junit4] 2> 1317034 DEBUG (AutoscalingActionExecutor-1095-thread-1) [ ] o.a.s.c.a.ScheduledTriggers -- processing actions for {
[junit4] 2> "id":"671b0aedc7d75cT4gefepv4ymdsxun8xew87kx0k",
[junit4] 2> "source":"index_size_trigger",
[junit4] 2> "eventTime":29021656354117468,
[junit4] 2> "eventType":"INDEXSIZE",
[junit4] 2> "properties":{
[junit4] 2> "aboveSize":{"testSplitIntegration_collection":[
[junit4] 2> "{\"core_node1\":{\n \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":14,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":14,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10001_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":14,\n \"__bytes__\":1,\n \"shard\":\"shard1\",\n \"collection\":\"testSplitIntegration_collection\"}}",
[junit4] 2> "{\"core_node3\":{\n \"core\":\"testSplitIntegration_collection_shard2_replica_n3\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":11,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":11,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10001_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":11,\n \"__bytes__\":1,\n \"shard\":\"shard2\",\n \"collection\":\"testSplitIntegration_collection\"}}"]},
[junit4] 2> "belowSize":{},
[junit4] 2> "_enqueue_time_":29021662626759868,
[junit4] 2> "requestedOps":[
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard1\"}]}}",
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2\"}]}}"]}}
[junit4] 2> 1317035 INFO (AutoscalingActionExecutor-1095-thread-1) [ ] o.a.s.c.a.IndexSizeTriggerTest =======> CapturedEvent{timestamp=29021666925474318, stage=BEFORE_ACTION, actionName='compute_plan', event={
[junit4] 2> "id":"671b0aedc7d75cT4gefepv4ymdsxun8xew87kx0k",
[junit4] 2> "source":"index_size_trigger",
[junit4] 2> "eventTime":29021656354117468,
[junit4] 2> "eventType":"INDEXSIZE",
[junit4] 2> "properties":{
[junit4] 2> "aboveSize":{"testSplitIntegration_collection":[
[junit4] 2> "{\"core_node1\":{\n \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":14,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":14,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10001_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":14,\n \"__bytes__\":1,\n \"shard\":\"shard1\",\n \"collection\":\"testSplitIntegration_collection\"}}",
[junit4] 2> "{\"core_node3\":{\n \"core\":\"testSplitIntegration_collection_shard2_replica_n3\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":11,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":11,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10001_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":11,\n \"__bytes__\":1,\n \"shard\":\"shard2\",\n \"collection\":\"testSplitIntegration_collection\"}}"]},
[junit4] 2> "belowSize":{},
[junit4] 2> "_enqueue_time_":29021662626759868,
[junit4] 2> "requestedOps":[
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard1\"}]}}",
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2\"}]}}"]}}, context={properties.BEFORE_ACTION=[compute_plan], source=index_size_trigger}, config={
[junit4] 2> "trigger":"index_size_trigger",
[junit4] 2> "stage":[
[junit4] 2> "STARTED",
[junit4] 2> "ABORTED",
[junit4] 2> "SUCCEEDED",
[junit4] 2> "FAILED"],
[junit4] 2> "afterAction":[
[junit4] 2> "compute_plan",
[junit4] 2> "execute_plan"],
[junit4] 2> "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener",
[junit4] 2> "beforeAction":[
[junit4] 2> "compute_plan",
[junit4] 2> "execute_plan"]}, message='null'}
[junit4] 2> 1317035 DEBUG (AutoscalingActionExecutor-1095-thread-1) [ ] o.a.s.c.a.ComputePlanAction -- processing event: {
[junit4] 2> "id":"671b0aedc7d75cT4gefepv4ymdsxun8xew87kx0k",
[junit4] 2> "source":"index_size_trigger",
[junit4] 2> "eventTime":29021656354117468,
[junit4] 2> "eventType":"INDEXSIZE",
[junit4] 2> "properties":{
[junit4] 2> "aboveSize":{"testSplitIntegration_collection":[
[junit4] 2> "{\"core_node1\":{\n \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":14,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":14,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10001_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":14,\n \"__bytes__\":1,\n \"shard\":\"shard1\",\n \"collection\":\"testSplitIntegration_collection\"}}",
[junit4] 2> "{\"core_node3\":{\n \"core\":\"testSplitIntegration_collection_shard2_replica_n3\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":11,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":11,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10001_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":11,\n \"__bytes__\":1,\n \"shard\":\"shard2\",\n \"collection\":\"testSplitIntegration_collection\"}}"]},
[junit4] 2> "belowSize":{},
[junit4] 2> "_enqueue_time_":29021662626759868,
[junit4] 2> "requestedOps":[
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard1\"}]}}",
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2\"}]}}"]}} with context properties: {BEFORE_ACTION=[compute_plan]}
[junit4] 2> 1317040 INFO (AutoscalingActionExecutor-1095-thread-1) [ ] o.a.s.c.a.ComputePlanAction Computed Plan: action=SPLITSHARD&collection=testSplitIntegration_collection&shard=shard1
[junit4] 2> 1317040 INFO (AutoscalingActionExecutor-1095-thread-1) [ ] o.a.s.c.a.ComputePlanAction Computed Plan: action=SPLITSHARD&collection=testSplitIntegration_collection&shard=shard2
[junit4] 2> 1317040 INFO (AutoscalingActionExecutor-1095-thread-1) [ ] o.a.s.c.s.c.a.PolicyHelper returnSession, curr-time 29021667173 sessionWrapper.createTime 29021667017620218, this.sessionWrapper.createTime 29021667017620218
[junit4] 2> 1317040 INFO (AutoscalingActionExecutor-1095-thread-1) [ ] o.a.s.c.a.IndexSizeTriggerTest =======> CapturedEvent{timestamp=29021667176630168, stage=AFTER_ACTION, actionName='compute_plan', event={
[junit4] 2> "id":"671b0aedc7d75cT4gefepv4ymdsxun8xew87kx0k",
[junit4] 2> "source":"index_size_trigger",
[junit4] 2> "eventTime":29021656354117468,
[junit4] 2> "eventType":"INDEXSIZE",
[junit4] 2> "properties":{
[junit4] 2> "__start__":2,
[junit4] 2> "aboveSize":{"testSplitIntegration_collection":[
[junit4] 2> "{\"core_node1\":{\n \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":14,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":14,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10001_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":14,\n \"__bytes__\":1,\n \"shard\":\"shard1\",\n \"collection\":\"testSplitIntegration_collection\"}}",
[junit4] 2> "{\"core_node3\":{\n \"core\":\"testSplitIntegration_collection_shard2_replica_n3\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":11,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":11,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10001_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":11,\n \"__bytes__\":1,\n \"shard\":\"shard2\",\n \"collection\":\"testSplitIntegration_collection\"}}"]},
[junit4] 2> "belowSize":{},
[junit4] 2> "_enqueue_time_":29021662626759868,
[junit4] 2> "requestedOps":[
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard1\"}]}}",
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2\"}]}}"]}}, context={properties.operations=[{class=org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard, method=GET, params.action=SPLITSHARD, params.collection=testSplitIntegration_collection, params.shard=shard1}, {class=org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard, method=GET, params.action=SPLITSHARD, params.collection=testSplitIntegration_collection, params.shard=shard2}], properties.BEFORE_ACTION=[compute_plan], source=index_size_trigger, properties.AFTER_ACTION=[compute_plan]}, config={
[junit4] 2> "trigger":"index_size_trigger",
[junit4] 2> "stage":[
[junit4] 2> "STARTED",
[junit4] 2> "ABORTED",
[junit4] 2> "SUCCEEDED",
[junit4] 2> "FAILED"],
[junit4] 2> "afterAction":[
[junit4] 2> "compute_plan",
[junit4] 2> "execute_plan"],
[junit4] 2> "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener",
[junit4] 2> "beforeAction":[
[junit4] 2> "compute_plan",
[junit4] 2> "execute_plan"]}, message='null'}
[junit4] 2> 1317041 INFO (AutoscalingActionExecutor-1095-thread-1) [ ] o.a.s.c.a.IndexSizeTriggerTest =======> CapturedEvent{timestamp=29021667202484118, stage=BEFORE_ACTION, actionName='execute_plan', event={
[junit4] 2> "id":"671b0aedc7d75cT4gefepv4ymdsxun8xew87kx0k",
[junit4] 2> "source":"index_size_trigger",
[junit4] 2> "eventTime":29021656354117468,
[junit4] 2> "eventType":"INDEXSIZE",
[junit4] 2> "properties":{
[junit4] 2> "__start__":2,
[junit4] 2> "aboveSize":{"testSplitIntegration_collection":[
[junit4] 2> "{\"core_node1\":{\n \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":14,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":14,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10001_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":14,\n \"__bytes__\":1,\n \"shard\":\"shard1\",\n \"collection\":\"testSplitIntegration_collection\"}}",
[junit4] 2> "{\"core_node3\":{\n \"core\":\"testSplitIntegration_collection_shard2_replica_n3\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":11,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":11,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10001_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":11,\n \"__bytes__\":1,\n \"shard\":\"shard2\",\n \"collection\":\"testSplitIntegration_collection\"}}"]},
[junit4] 2> "belowSize":{},
[junit4] 2> "_enqueue_time_":29021662626759868,
[junit4] 2> "requestedOps":[
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard1\"}]}}",
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2\"}]}}"]}}, context={properties.operations=[{class=org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard, method=GET, params.action=SPLITSHARD, params.collection=testSplitIntegration_collection, params.shard=shard1}, {class=org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard, method=GET, params.action=SPLITSHARD, params.collection=testSplitIntegration_collection, params.shard=shard2}], properties.BEFORE_ACTION=[compute_plan, execute_plan], source=index_size_trigger, properties.AFTER_ACTION=[compute_plan]}, config={
[junit4] 2> "trigger":"index_size_trigger",
[junit4] 2> "stage":[
[junit4] 2> "STARTED",
[junit4] 2> "ABORTED",
[junit4] 2> "SUCCEEDED",
[junit4] 2> "FAILED"],
[junit4] 2> "afterAction":[
[junit4] 2> "compute_plan",
[junit4] 2> "execute_plan"],
[junit4] 2> "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener",
[junit4] 2> "beforeAction":[
[junit4] 2> "compute_plan",
[junit4] 2> "execute_plan"]}, message='null'}
[junit4] 2> 1317041 DEBUG (AutoscalingActionExecutor-1095-thread-1) [ ] o.a.s.c.a.ExecutePlanAction -- processing event: {
[junit4] 2> "id":"671b0aedc7d75cT4gefepv4ymdsxun8xew87kx0k",
[junit4] 2> "source":"index_size_trigger",
[junit4] 2> "eventTime":29021656354117468,
[junit4] 2> "eventType":"INDEXSIZE",
[junit4] 2> "properties":{
[junit4] 2> "__start__":2,
[junit4] 2> "aboveSize":{"testSplitIntegration_collection":[
[junit4] 2> "{\"core_node1\":{\n \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":14,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":14,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10001_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":14,\n \"__bytes__\":1,\n \"shard\":\"shard1\",\n \"collection\":\"testSplitIntegration_collection\"}}",
[junit4] 2> "{\"core_node3\":{\n \"core\":\"testSplitIntegration_collection_shard2_replica_n3\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":11,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":11,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10001_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":11,\n \"__bytes__\":1,\n \"shard\":\"shard2\",\n \"collection\":\"testSplitIntegration_collection\"}}"]},
[junit4] 2> "belowSize":{},
[junit4] 2> "_enqueue_time_":29021662626759868,
[junit4] 2> "requestedOps":[
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard1\"}]}}",
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2\"}]}}"]}} with context properties: {operations=[org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard@3ef33543, org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard@d7d2fad], AFTER_ACTION=[compute_plan], BEFORE_ACTION=[compute_plan, execute_plan]}
[junit4] 2> 1317041 DEBUG (AutoscalingActionExecutor-1095-thread-1) [ ] o.a.s.c.a.ExecutePlanAction Executing operation: action=SPLITSHARD&collection=testSplitIntegration_collection&shard=shard1
[junit4] 2> 1317264 DEBUG (ScheduledTrigger-1078-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1317323 DEBUG (simCloudManagerPool-1093-thread-103) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testSplitIntegration_collection / shard1_1: {"core_node10":{
[junit4] 2> "leader":"true",
[junit4] 2> "SEARCHER.searcher.maxDoc":7,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10000_solr",
[junit4] 2> "base_url":"http://127.0.0.1:10000/solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":7,
[junit4] 2> "core":"testSplitIntegration_collection_shard1_1_replica1",
[junit4] 2> "shard":"shard1_1",
[junit4] 2> "collection":"testSplitIntegration_collection"}}
[junit4] 2> 1317330 DEBUG (AutoscalingActionExecutor-1095-thread-1) [ ] o.a.s.c.a.ExecutePlanAction Executing operation: action=SPLITSHARD&collection=testSplitIntegration_collection&shard=shard2
[junit4] 2> 1317330 DEBUG (simCloudManagerPool-1093-thread-104) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testSplitIntegration_collection / shard1_0: {"core_node7":{
[junit4] 2> "leader":"true",
[junit4] 2> "SEARCHER.searcher.maxDoc":7,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10001_solr",
[junit4] 2> "base_url":"http://127.0.0.1:10001/solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":7,
[junit4] 2> "core":"testSplitIntegration_collection_shard1_0_replica0",
[junit4] 2> "shard":"shard1_0",
[junit4] 2> "collection":"testSplitIntegration_collection"}}
[junit4] 2> 1317810 DEBUG (simCloudManagerPool-1093-thread-110) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testSplitIntegration_collection / shard2_1: {"core_node16":{
[junit4] 2> "leader":"true",
[junit4] 2> "SEARCHER.searcher.maxDoc":5,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10000_solr",
[junit4] 2> "base_url":"http://127.0.0.1:10000/solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":5,
[junit4] 2> "core":"testSplitIntegration_collection_shard2_1_replica1",
[junit4] 2> "shard":"shard2_1",
[junit4] 2> "collection":"testSplitIntegration_collection"}}
[junit4] 2> 1317810 DEBUG (simCloudManagerPool-1093-thread-113) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testSplitIntegration_collection / shard2_0: {"core_node14":{
[junit4] 2> "leader":"true",
[junit4] 2> "SEARCHER.searcher.maxDoc":6,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10000_solr",
[junit4] 2> "base_url":"http://127.0.0.1:10000/solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":6,
[junit4] 2> "core":"testSplitIntegration_collection_shard2_0_replica1",
[junit4] 2> "shard":"shard2_0",
[junit4] 2> "collection":"testSplitIntegration_collection"}}
[junit4] 2> 1317857 INFO (AutoscalingActionExecutor-1095-thread-1) [ ] o.a.s.c.a.IndexSizeTriggerTest =======> CapturedEvent{timestamp=29021708013827818, stage=AFTER_ACTION, actionName='execute_plan', event={
[junit4] 2> "id":"671b0aedc7d75cT4gefepv4ymdsxun8xew87kx0k",
[junit4] 2> "source":"index_size_trigger",
[junit4] 2> "eventTime":29021656354117468,
[junit4] 2> "eventType":"INDEXSIZE",
[junit4] 2> "properties":{
[junit4] 2> "__start__":2,
[junit4] 2> "aboveSize":{"testSplitIntegration_collection":[
[junit4] 2> "{\"core_node1\":{\n \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":14,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":14,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10001_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":14,\n \"__bytes__\":1,\n \"shard\":\"shard1\",\n \"collection\":\"testSplitIntegration_collection\"}}",
[junit4] 2> "{\"core_node3\":{\n \"core\":\"testSplitIntegration_collection_shard2_replica_n3\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":11,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":11,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10001_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":11,\n \"__bytes__\":1,\n \"shard\":\"shard2\",\n \"collection\":\"testSplitIntegration_collection\"}}"]},
[junit4] 2> "belowSize":{},
[junit4] 2> "_enqueue_time_":29021662626759868,
[junit4] 2> "requestedOps":[
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard1\"}]}}",
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2\"}]}}"]}}, context={properties.operations=[{class=org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard, method=GET, params.action=SPLITSHARD, params.async=index_size_trigger/671b0aedc7d75cT4gefepv4ymdsxun8xew87kx0k/0, params.waitForFinalState=true, params.collection=testSplitIntegration_collection, params.shard=shard1}, {class=org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard, method=GET, params.action=SPLITSHARD, params.async=index_size_trigger/671b0aedc7d75cT4gefepv4ymdsxun8xew87kx0k/0, params.waitForFinalState=true, params.collection=testSplitIntegration_collection, params.shard=shard2}], properties.BEFORE_ACTION=[compute_plan, execute_plan], properties.responses=[{status={state=completed,msg=found [index_size_trigger/671b0aedc7d75cT4gefepv4ymdsxun8xew87kx0k/0] in completed tasks},success=}, {status={state=completed,msg=found [index_size_trigger/671b0aedc7d75cT4gefepv4ymdsxun8xew87kx0k/0] in completed tasks},success=}], source=index_size_trigger, properties.AFTER_ACTION=[compute_plan, execute_plan]}, config={
[junit4] 2> "trigger":"index_size_trigger",
[junit4] 2> "stage":[
[junit4] 2> "STARTED",
[junit4] 2> "ABORTED",
[junit4] 2> "SUCCEEDED",
[junit4] 2> "FAILED"],
[junit4] 2> "afterAction":[
[junit4] 2> "compute_plan",
[junit4] 2> "execute_plan"],
[junit4] 2> "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener",
[junit4] 2> "beforeAction":[
[junit4] 2> "compute_plan",
[junit4] 2> "execute_plan"]}, message='null'}
[junit4] 2> 1317858 INFO (AutoscalingActionExecutor-1095-thread-1) [ ] o.a.s.c.a.IndexSizeTriggerTest =======> CapturedEvent{timestamp=29021708067143018, stage=SUCCEEDED, actionName='null', event={
[junit4] 2> "id":"671b0aedc7d75cT4gefepv4ymdsxun8xew87kx0k",
[junit4] 2> "source":"index_size_trigger",
[junit4] 2> "eventTime":29021656354117468,
[junit4] 2> "eventType":"INDEXSIZE",
[junit4] 2> "properties":{
[junit4] 2> "__start__":2,
[junit4] 2> "aboveSize":{"testSplitIntegration_collection":[
[junit4] 2> "{\"core_node1\":{\n \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":14,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":14,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10001_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":14,\n \"__bytes__\":1,\n \"shard\":\"shard1\",\n \"collection\":\"testSplitIntegration_collection\"}}",
[junit4] 2> "{\"core_node3\":{\n \"core\":\"testSplitIntegration_collection_shard2_replica_n3\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":11,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":11,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10001_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":11,\n \"__bytes__\":1,\n \"shard\":\"shard2\",\n \"collection\":\"testSplitIntegration_collection\"}}"]},
[junit4] 2> "belowSize":{},
[junit4] 2> "_enqueue_time_":29021662626759868,
[junit4] 2> "requestedOps":[
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard1\"}]}}",
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2\"}]}}"]}}, context={}, config={
[junit4] 2> "trigger":"index_size_trigger",
[junit4] 2> "stage":[
[junit4] 2> "STARTED",
[junit4] 2> "ABORTED",
[junit4] 2> "SUCCEEDED",
[junit4] 2> "FAILED"],
[junit4] 2> "afterAction":[
[junit4] 2> "compute_plan",
[junit4] 2> "execute_plan"],
[junit4] 2> "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener",
[junit4] 2> "beforeAction":[
[junit4] 2> "compute_plan",
[junit4] 2> "execute_plan"]}, message='null'}
[junit4] 2> 1317903 INFO (TEST-IndexSizeTriggerTest.testSplitIntegration-seed#[EA6BC1AB257C709]) [ ] o.a.s.c.a.IndexSizeTriggerTest #######################################
[junit4] 2> ############ CLUSTER STATE ############
[junit4] 2> #######################################
[junit4] 2> ## Live nodes: 2
[junit4] 2> ## Empty nodes: 0
[junit4] 2> ## Dead nodes: 0
[junit4] 2> ## Collections: [testSplitIntegration_collection, .system]
[junit4] 2> DocCollection(testSplitIntegration_collection//clusterstate.json/94)={
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "pullReplicas":"0",
[junit4] 2> "router":{"name":"compositeId"},
[junit4] 2> "maxShardsPerNode":"2",
[junit4] 2> "autoAddReplicas":"false",
[junit4] 2> "nrtReplicas":"2",
[junit4] 2> "tlogReplicas":"0",
[junit4] 2> "autoCreated":"true",
[junit4] 2> "shards":{
[junit4] 2> "shard2":{
[junit4] 2> "stateTimestamp":"1528769792320169250",
[junit4] 2> "replicas":{
[junit4] 2> "core_node3":{
[junit4] 2> "core":"testSplitIntegration_collection_shard2_replica_n3",
[junit4] 2> "leader":"true",
[junit4] 2> "SEARCHER.searcher.maxDoc":11,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10001_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":11},
[junit4] 2> "core_node4":{
[junit4] 2> "core":"testSplitIntegration_collection_shard2_replica_n4",
[junit4] 2> "SEARCHER.searcher.maxDoc":11,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10000_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":11}},
[junit4] 2> "range":"0-7fffffff",
[junit4] 2> "state":"inactive"},
[junit4] 2> "shard1":{
[junit4] 2> "stateTimestamp":"1528769779409291200",
[junit4] 2> "replicas":{
[junit4] 2> "core_node1":{
[junit4] 2> "core":"testSplitIntegration_collection_shard1_replica_n1",
[junit4] 2> "leader":"true",
[junit4] 2> "SEARCHER.searcher.maxDoc":14,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10001_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":14},
[junit4] 2> "core_node2":{
[junit4] 2> "core":"testSplitIntegration_collection_shard1_replica_n2",
[junit4] 2> "SEARCHER.searcher.maxDoc":14,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10000_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":14}},
[junit4] 2> "range":"80000000-ffffffff",
[junit4] 2> "state":"inactive"},
[junit4] 2> "shard2_1":{
[junit4] 2> "parent":"shard2",
[junit4] 2> "stateTimestamp":"1528769792320869650",
[junit4] 2> "range":"40000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{
[junit4] 2> "core_node16":{
[junit4] 2> "leader":"true",
[junit4] 2> "core":"testSplitIntegration_collection_shard2_1_replica1",
[junit4] 2> "SEARCHER.searcher.maxDoc":5,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10000_solr",
[junit4] 2> "base_url":"http://127.0.0.1:10000/solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":5},
[junit4] 2> "core_node15":{
[junit4] 2> "core":"testSplitIntegration_collection_shard2_1_replica0",
[junit4] 2> "SEARCHER.searcher.maxDoc":5,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10001_solr",
[junit4] 2> "base_url":"http://127.0.0.1:10001/solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":5}}},
[junit4] 2> "shard1_1":{
[junit4] 2> "parent":"shard1",
[junit4] 2> "stateTimestamp":"1528769779445789350",
[junit4] 2> "range":"c0000000-ffffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{
[junit4] 2> "core_node10":{
[junit4] 2> "leader":"true",
[junit4] 2> "core":"testSplitIntegration_collection_shard1_1_replica1",
[junit4] 2> "SEARCHER.searcher.maxDoc":7,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10000_solr",
[junit4] 2> "base_url":"http://127.0.0.1:10000/solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":7},
[junit4] 2> "core_node9":{
[junit4] 2> "core":"testSplitIntegration_collection_shard1_1_replica0",
[junit4] 2> "SEARCHER.searcher.maxDoc":7,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10001_solr",
[junit4] 2> "base_url":"http://127.0.0.1:10001/solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":7}}},
[junit4] 2> "shard1_0":{
[junit4] 2> "parent":"shard1",
[...truncated too long message...]
/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
jar-checksums:
[mkdir] Created dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/null1584703618
[copy] Copying 39 files to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/null1584703618
[delete] Deleting directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/null1584703618
resolve-example:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
resolve-server:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/top-level-ivy-settings.xml
resolve:
jar-checksums:
[mkdir] Created dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/null2121870937
[copy] Copying 247 files to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/null2121870937
[delete] Deleting directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/null2121870937
check-working-copy:
[ivy:cachepath] :: resolving dependencies :: org.eclipse.jgit#org.eclipse.jgit-caller;working
[ivy:cachepath] confs: [default]
[ivy:cachepath] found org.eclipse.jgit#org.eclipse.jgit;4.6.0.201612231935-r in public
[ivy:cachepath] found com.jcraft#jsch;0.1.53 in public
[ivy:cachepath] found com.googlecode.javaewah#JavaEWAH;1.1.6 in public
[ivy:cachepath] found org.apache.httpcomponents#httpclient;4.3.6 in public
[ivy:cachepath] found org.apache.httpcomponents#httpcore;4.3.3 in public
[ivy:cachepath] found commons-logging#commons-logging;1.1.3 in public
[ivy:cachepath] found commons-codec#commons-codec;1.6 in public
[ivy:cachepath] found org.slf4j#slf4j-api;1.7.2 in public
[ivy:cachepath] :: resolution report :: resolve 71ms :: artifacts dl 9ms
---------------------------------------------------------------------
| | modules || artifacts |
| conf | number| search|dwnlded|evicted|| number|dwnlded|
---------------------------------------------------------------------
| default | 8 | 0 | 0 | 0 || 8 | 0 |
---------------------------------------------------------------------
[wc-checker] Initializing working copy...
[wc-checker] SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
[wc-checker] SLF4J: Defaulting to no-operation (NOP) logger implementation
[wc-checker] SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
[wc-checker] Checking working copy status...
-jenkins-base:
BUILD SUCCESSFUL
Total time: 372 minutes 54 seconds
Archiving artifacts
WARN: No artifacts found that match the file pattern "**/*.events,heapdumps/**,**/hs_err_pid*". Configuration error?
WARN: java.lang.InterruptedException: no matches found within 10000
Recording test results
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)