You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2018/06/17 09:22:36 UTC
[JENKINS] Lucene-Solr-master-MacOSX (64bit/jdk-9) - Build # 4682 -
Still Unstable!
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-MacOSX/4682/
Java: 64bit/jdk-9 -XX:-UseCompressedOops -XX:+UseG1GC
3 tests failed.
FAILED: org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest.testTrigger
Error Message:
number of ops expected:<2> but was:<1>
Stack Trace:
java.lang.AssertionError: number of ops expected:<2> but was:<1>
at __randomizedtesting.SeedInfo.seed([7D095C19376C9A18:1EC26A9BAEA3E935]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest.testTrigger(IndexSizeTriggerTest.java:187)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
FAILED: org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest.testMergeIntegration
Error Message:
did not finish processing in time
Stack Trace:
java.lang.AssertionError: did not finish processing in time
at __randomizedtesting.SeedInfo.seed([7D095C19376C9A18:2EB01EA9D57D0FE2]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest.testMergeIntegration(IndexSizeTriggerTest.java:425)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
FAILED: org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest.testMixedBounds
Error Message:
failed to create testMixedBounds_collection Live Nodes: [127.0.0.1:10006_solr, 127.0.0.1:10005_solr] Last available state: DocCollection(testMixedBounds_collection//clusterstate.json/134)={ "replicationFactor":"2", "pullReplicas":"0", "router":{"name":"compositeId"}, "maxShardsPerNode":"2", "autoAddReplicas":"false", "nrtReplicas":"2", "tlogReplicas":"0", "autoCreated":"true", "shards":{ "shard2":{ "replicas":{ "core_node3":{ "core":"testMixedBounds_collection_shard2_replica_n3", "leader":"true", "SEARCHER.searcher.maxDoc":0, "SEARCHER.searcher.deletedDocs":0, "INDEX.sizeInBytes":10240, "node_name":"127.0.0.1:10005_solr", "state":"active", "type":"NRT", "INDEX.sizeInGB":9.5367431640625E-6, "SEARCHER.searcher.numDocs":0}, "core_node4":{ "core":"testMixedBounds_collection_shard2_replica_n4", "SEARCHER.searcher.maxDoc":0, "SEARCHER.searcher.deletedDocs":0, "INDEX.sizeInBytes":10240, "node_name":"127.0.0.1:10006_solr", "state":"active", "type":"NRT", "INDEX.sizeInGB":9.5367431640625E-6, "SEARCHER.searcher.numDocs":0}}, "range":"0-7fffffff", "state":"active"}, "shard1":{ "stateTimestamp":"1529352401980317900", "replicas":{ "core_node1":{ "core":"testMixedBounds_collection_shard1_replica_n1", "leader":"true", "SEARCHER.searcher.maxDoc":495, "SEARCHER.searcher.deletedDocs":0, "INDEX.sizeInBytes":257740, "node_name":"127.0.0.1:10005_solr", "state":"active", "type":"NRT", "INDEX.sizeInGB":2.4003908038139343E-4, "SEARCHER.searcher.numDocs":495}, "core_node2":{ "core":"testMixedBounds_collection_shard1_replica_n2", "SEARCHER.searcher.maxDoc":495, "SEARCHER.searcher.deletedDocs":0, "INDEX.sizeInBytes":257740, "node_name":"127.0.0.1:10006_solr", "state":"active", "type":"NRT", "INDEX.sizeInGB":2.4003908038139343E-4, "SEARCHER.searcher.numDocs":495}}, "range":"80000000-ffffffff", "state":"inactive"}, "shard1_1":{ "parent":"shard1", "stateTimestamp":"1529352401980821700", "range":"c0000000-ffffffff", "state":"active", "replicas":{ "core_node10":{ "leader":"true", "core":"testMixedBounds_collection_shard1_1_replica1", "SEARCHER.searcher.maxDoc":247, "SEARCHER.searcher.deletedDocs":0, "INDEX.sizeInBytes":133740, "node_name":"127.0.0.1:10005_solr", "base_url":"http://127.0.0.1:10005/solr", "state":"active", "type":"NRT", "INDEX.sizeInGB":1.245550811290741E-4, "SEARCHER.searcher.numDocs":247}, "core_node9":{ "core":"testMixedBounds_collection_shard1_1_replica0", "SEARCHER.searcher.maxDoc":247, "SEARCHER.searcher.deletedDocs":0, "INDEX.sizeInBytes":133740, "node_name":"127.0.0.1:10006_solr", "base_url":"http://127.0.0.1:10006/solr", "state":"active", "type":"NRT", "INDEX.sizeInGB":1.245550811290741E-4, "SEARCHER.searcher.numDocs":247}}}, "shard1_0":{ "parent":"shard1", "stateTimestamp":"1529352401980707100", "range":"80000000-bfffffff", "state":"active", "replicas":{ "core_node7":{ "leader":"true", "core":"testMixedBounds_collection_shard1_0_replica0", "SEARCHER.searcher.maxDoc":248, "SEARCHER.searcher.deletedDocs":0, "INDEX.sizeInBytes":144480, "node_name":"127.0.0.1:10006_solr", "base_url":"http://127.0.0.1:10006/solr", "state":"active", "type":"NRT", "INDEX.sizeInGB":1.3455748558044434E-4, "SEARCHER.searcher.numDocs":248}, "core_node8":{ "core":"testMixedBounds_collection_shard1_0_replica1", "SEARCHER.searcher.maxDoc":248, "SEARCHER.searcher.deletedDocs":0, "INDEX.sizeInBytes":144480, "node_name":"127.0.0.1:10005_solr", "base_url":"http://127.0.0.1:10005/solr", "state":"active", "type":"NRT", "INDEX.sizeInGB":1.3455748558044434E-4, "SEARCHER.searcher.numDocs":248}}}}}
Stack Trace:
java.lang.AssertionError: failed to create testMixedBounds_collection
Live Nodes: [127.0.0.1:10006_solr, 127.0.0.1:10005_solr]
Last available state: DocCollection(testMixedBounds_collection//clusterstate.json/134)={
"replicationFactor":"2",
"pullReplicas":"0",
"router":{"name":"compositeId"},
"maxShardsPerNode":"2",
"autoAddReplicas":"false",
"nrtReplicas":"2",
"tlogReplicas":"0",
"autoCreated":"true",
"shards":{
"shard2":{
"replicas":{
"core_node3":{
"core":"testMixedBounds_collection_shard2_replica_n3",
"leader":"true",
"SEARCHER.searcher.maxDoc":0,
"SEARCHER.searcher.deletedDocs":0,
"INDEX.sizeInBytes":10240,
"node_name":"127.0.0.1:10005_solr",
"state":"active",
"type":"NRT",
"INDEX.sizeInGB":9.5367431640625E-6,
"SEARCHER.searcher.numDocs":0},
"core_node4":{
"core":"testMixedBounds_collection_shard2_replica_n4",
"SEARCHER.searcher.maxDoc":0,
"SEARCHER.searcher.deletedDocs":0,
"INDEX.sizeInBytes":10240,
"node_name":"127.0.0.1:10006_solr",
"state":"active",
"type":"NRT",
"INDEX.sizeInGB":9.5367431640625E-6,
"SEARCHER.searcher.numDocs":0}},
"range":"0-7fffffff",
"state":"active"},
"shard1":{
"stateTimestamp":"1529352401980317900",
"replicas":{
"core_node1":{
"core":"testMixedBounds_collection_shard1_replica_n1",
"leader":"true",
"SEARCHER.searcher.maxDoc":495,
"SEARCHER.searcher.deletedDocs":0,
"INDEX.sizeInBytes":257740,
"node_name":"127.0.0.1:10005_solr",
"state":"active",
"type":"NRT",
"INDEX.sizeInGB":2.4003908038139343E-4,
"SEARCHER.searcher.numDocs":495},
"core_node2":{
"core":"testMixedBounds_collection_shard1_replica_n2",
"SEARCHER.searcher.maxDoc":495,
"SEARCHER.searcher.deletedDocs":0,
"INDEX.sizeInBytes":257740,
"node_name":"127.0.0.1:10006_solr",
"state":"active",
"type":"NRT",
"INDEX.sizeInGB":2.4003908038139343E-4,
"SEARCHER.searcher.numDocs":495}},
"range":"80000000-ffffffff",
"state":"inactive"},
"shard1_1":{
"parent":"shard1",
"stateTimestamp":"1529352401980821700",
"range":"c0000000-ffffffff",
"state":"active",
"replicas":{
"core_node10":{
"leader":"true",
"core":"testMixedBounds_collection_shard1_1_replica1",
"SEARCHER.searcher.maxDoc":247,
"SEARCHER.searcher.deletedDocs":0,
"INDEX.sizeInBytes":133740,
"node_name":"127.0.0.1:10005_solr",
"base_url":"http://127.0.0.1:10005/solr",
"state":"active",
"type":"NRT",
"INDEX.sizeInGB":1.245550811290741E-4,
"SEARCHER.searcher.numDocs":247},
"core_node9":{
"core":"testMixedBounds_collection_shard1_1_replica0",
"SEARCHER.searcher.maxDoc":247,
"SEARCHER.searcher.deletedDocs":0,
"INDEX.sizeInBytes":133740,
"node_name":"127.0.0.1:10006_solr",
"base_url":"http://127.0.0.1:10006/solr",
"state":"active",
"type":"NRT",
"INDEX.sizeInGB":1.245550811290741E-4,
"SEARCHER.searcher.numDocs":247}}},
"shard1_0":{
"parent":"shard1",
"stateTimestamp":"1529352401980707100",
"range":"80000000-bfffffff",
"state":"active",
"replicas":{
"core_node7":{
"leader":"true",
"core":"testMixedBounds_collection_shard1_0_replica0",
"SEARCHER.searcher.maxDoc":248,
"SEARCHER.searcher.deletedDocs":0,
"INDEX.sizeInBytes":144480,
"node_name":"127.0.0.1:10006_solr",
"base_url":"http://127.0.0.1:10006/solr",
"state":"active",
"type":"NRT",
"INDEX.sizeInGB":1.3455748558044434E-4,
"SEARCHER.searcher.numDocs":248},
"core_node8":{
"core":"testMixedBounds_collection_shard1_0_replica1",
"SEARCHER.searcher.maxDoc":248,
"SEARCHER.searcher.deletedDocs":0,
"INDEX.sizeInBytes":144480,
"node_name":"127.0.0.1:10005_solr",
"base_url":"http://127.0.0.1:10005/solr",
"state":"active",
"type":"NRT",
"INDEX.sizeInGB":1.3455748558044434E-4,
"SEARCHER.searcher.numDocs":248}}}}}
at __randomizedtesting.SeedInfo.seed([7D095C19376C9A18:778AE3B47AD79142]:0)
at org.apache.solr.cloud.CloudTestUtils.waitForState(CloudTestUtils.java:69)
at org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest.testMixedBounds(IndexSizeTriggerTest.java:580)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
Caused by: java.util.concurrent.TimeoutException: last state: DocCollection(testMixedBounds_collection//clusterstate.json/134)={
"replicationFactor":"2",
"pullReplicas":"0",
"router":{"name":"compositeId"},
"maxShardsPerNode":"2",
"autoAddReplicas":"false",
"nrtReplicas":"2",
"tlogReplicas":"0",
"autoCreated":"true",
"shards":{
"shard2":{
"replicas":{
"core_node3":{
"core":"testMixedBounds_collection_shard2_replica_n3",
"leader":"true",
"SEARCHER.searcher.maxDoc":0,
"SEARCHER.searcher.deletedDocs":0,
"INDEX.sizeInBytes":10240,
"node_name":"127.0.0.1:10005_solr",
"state":"active",
"type":"NRT",
"INDEX.sizeInGB":9.5367431640625E-6,
"SEARCHER.searcher.numDocs":0},
"core_node4":{
"core":"testMixedBounds_collection_shard2_replica_n4",
"SEARCHER.searcher.maxDoc":0,
"SEARCHER.searcher.deletedDocs":0,
"INDEX.sizeInBytes":10240,
"node_name":"127.0.0.1:10006_solr",
"state":"active",
"type":"NRT",
"INDEX.sizeInGB":9.5367431640625E-6,
"SEARCHER.searcher.numDocs":0}},
"range":"0-7fffffff",
"state":"active"},
"shard1":{
"stateTimestamp":"1529352401980317900",
"replicas":{
"core_node1":{
"core":"testMixedBounds_collection_shard1_replica_n1",
"leader":"true",
"SEARCHER.searcher.maxDoc":495,
"SEARCHER.searcher.deletedDocs":0,
"INDEX.sizeInBytes":257740,
"node_name":"127.0.0.1:10005_solr",
"state":"active",
"type":"NRT",
"INDEX.sizeInGB":2.4003908038139343E-4,
"SEARCHER.searcher.numDocs":495},
"core_node2":{
"core":"testMixedBounds_collection_shard1_replica_n2",
"SEARCHER.searcher.maxDoc":495,
"SEARCHER.searcher.deletedDocs":0,
"INDEX.sizeInBytes":257740,
"node_name":"127.0.0.1:10006_solr",
"state":"active",
"type":"NRT",
"INDEX.sizeInGB":2.4003908038139343E-4,
"SEARCHER.searcher.numDocs":495}},
"range":"80000000-ffffffff",
"state":"inactive"},
"shard1_1":{
"parent":"shard1",
"stateTimestamp":"1529352401980821700",
"range":"c0000000-ffffffff",
"state":"active",
"replicas":{
"core_node10":{
"leader":"true",
"core":"testMixedBounds_collection_shard1_1_replica1",
"SEARCHER.searcher.maxDoc":247,
"SEARCHER.searcher.deletedDocs":0,
"INDEX.sizeInBytes":133740,
"node_name":"127.0.0.1:10005_solr",
"base_url":"http://127.0.0.1:10005/solr",
"state":"active",
"type":"NRT",
"INDEX.sizeInGB":1.245550811290741E-4,
"SEARCHER.searcher.numDocs":247},
"core_node9":{
"core":"testMixedBounds_collection_shard1_1_replica0",
"SEARCHER.searcher.maxDoc":247,
"SEARCHER.searcher.deletedDocs":0,
"INDEX.sizeInBytes":133740,
"node_name":"127.0.0.1:10006_solr",
"base_url":"http://127.0.0.1:10006/solr",
"state":"active",
"type":"NRT",
"INDEX.sizeInGB":1.245550811290741E-4,
"SEARCHER.searcher.numDocs":247}}},
"shard1_0":{
"parent":"shard1",
"stateTimestamp":"1529352401980707100",
"range":"80000000-bfffffff",
"state":"active",
"replicas":{
"core_node7":{
"leader":"true",
"core":"testMixedBounds_collection_shard1_0_replica0",
"SEARCHER.searcher.maxDoc":248,
"SEARCHER.searcher.deletedDocs":0,
"INDEX.sizeInBytes":144480,
"node_name":"127.0.0.1:10006_solr",
"base_url":"http://127.0.0.1:10006/solr",
"state":"active",
"type":"NRT",
"INDEX.sizeInGB":1.3455748558044434E-4,
"SEARCHER.searcher.numDocs":248},
"core_node8":{
"core":"testMixedBounds_collection_shard1_0_replica1",
"SEARCHER.searcher.maxDoc":248,
"SEARCHER.searcher.deletedDocs":0,
"INDEX.sizeInBytes":144480,
"node_name":"127.0.0.1:10005_solr",
"base_url":"http://127.0.0.1:10005/solr",
"state":"active",
"type":"NRT",
"INDEX.sizeInGB":1.3455748558044434E-4,
"SEARCHER.searcher.numDocs":248}}}}}
at org.apache.solr.cloud.CloudTestUtils.waitForState(CloudTestUtils.java:111)
at org.apache.solr.cloud.CloudTestUtils.waitForState(CloudTestUtils.java:63)
... 39 more
Build Log:
[...truncated 14422 lines...]
[junit4] Suite: org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest
[junit4] 2> 2769172 INFO (SUITE-IndexSizeTriggerTest-seed#[7D095C19376C9A18]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.IndexSizeTriggerTest_7D095C19376C9A18-001/init-core-data-001
[junit4] 2> 2769173 INFO (SUITE-IndexSizeTriggerTest-seed#[7D095C19376C9A18]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 2769173 INFO (SUITE-IndexSizeTriggerTest-seed#[7D095C19376C9A18]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", value=0.0/0.0, ssl=0.0/0.0, clientAuth=0.0/0.0) w/ MAC_OS_X supressed clientAuth
[junit4] 2> 2769174 INFO (SUITE-IndexSizeTriggerTest-seed#[7D095C19376C9A18]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.IndexSizeTriggerTest_7D095C19376C9A18-001/tempDir-001
[junit4] 2> 2769174 INFO (SUITE-IndexSizeTriggerTest-seed#[7D095C19376C9A18]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 2769175 INFO (Thread-4752) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 2769175 INFO (Thread-4752) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 2769178 ERROR (Thread-4752) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 2769278 INFO (SUITE-IndexSizeTriggerTest-seed#[7D095C19376C9A18]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:53113
[junit4] 2> 2769291 INFO (zkConnectionManagerCallback-8561-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2769300 INFO (jetty-launcher-8558-thread-1) [ ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 9+181
[junit4] 2> 2769300 INFO (jetty-launcher-8558-thread-2) [ ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 9+181
[junit4] 2> 2769301 INFO (jetty-launcher-8558-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 2769301 INFO (jetty-launcher-8558-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 2769301 INFO (jetty-launcher-8558-thread-1) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 2769302 INFO (jetty-launcher-8558-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2854e809{/solr,null,AVAILABLE}
[junit4] 2> 2769303 INFO (jetty-launcher-8558-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@38624652{SSL,[ssl, http/1.1]}{127.0.0.1:53115}
[junit4] 2> 2769303 INFO (jetty-launcher-8558-thread-1) [ ] o.e.j.s.Server Started @2769402ms
[junit4] 2> 2769303 INFO (jetty-launcher-8558-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=53115}
[junit4] 2> 2769303 ERROR (jetty-launcher-8558-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2769303 INFO (jetty-launcher-8558-thread-1) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 2769303 INFO (jetty-launcher-8558-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 2769303 INFO (jetty-launcher-8558-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2769303 INFO (jetty-launcher-8558-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2769303 INFO (jetty-launcher-8558-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-06-17T08:56:19.938952Z
[junit4] 2> 2769305 INFO (jetty-launcher-8558-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 2769305 INFO (jetty-launcher-8558-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 2769305 INFO (jetty-launcher-8558-thread-2) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 2769306 INFO (jetty-launcher-8558-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@19589c68{/solr,null,AVAILABLE}
[junit4] 2> 2769306 INFO (jetty-launcher-8558-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@8e22e5d{SSL,[ssl, http/1.1]}{127.0.0.1:53116}
[junit4] 2> 2769306 INFO (jetty-launcher-8558-thread-2) [ ] o.e.j.s.Server Started @2769405ms
[junit4] 2> 2769306 INFO (jetty-launcher-8558-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=53116}
[junit4] 2> 2769307 ERROR (jetty-launcher-8558-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2769307 INFO (jetty-launcher-8558-thread-2) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 2769307 INFO (jetty-launcher-8558-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 2769307 INFO (jetty-launcher-8558-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2769307 INFO (jetty-launcher-8558-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2769307 INFO (jetty-launcher-8558-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-06-17T08:56:19.942533Z
[junit4] 2> 2769311 INFO (zkConnectionManagerCallback-8563-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2769311 INFO (zkConnectionManagerCallback-8565-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2769312 INFO (jetty-launcher-8558-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2769312 INFO (jetty-launcher-8558-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2769317 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x1008f36c23b0001, likely client has closed socket
[junit4] 2> 2769374 INFO (jetty-launcher-8558-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:53113/solr
[junit4] 2> 2769376 INFO (zkConnectionManagerCallback-8569-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2769380 INFO (zkConnectionManagerCallback-8571-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2769409 INFO (jetty-launcher-8558-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:53113/solr
[junit4] 2> 2769411 INFO (zkConnectionManagerCallback-8577-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2769415 INFO (zkConnectionManagerCallback-8579-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2769588 INFO (jetty-launcher-8558-thread-1) [n:127.0.0.1:53115_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2769588 INFO (jetty-launcher-8558-thread-2) [n:127.0.0.1:53116_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2769589 INFO (jetty-launcher-8558-thread-1) [n:127.0.0.1:53115_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:53115_solr
[junit4] 2> 2769590 INFO (jetty-launcher-8558-thread-2) [n:127.0.0.1:53116_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53116_solr
[junit4] 2> 2769591 INFO (jetty-launcher-8558-thread-1) [n:127.0.0.1:53115_solr ] o.a.s.c.Overseer Overseer (id=72215059387580422-127.0.0.1:53115_solr-n_0000000000) starting
[junit4] 2> 2769592 INFO (zkCallback-8570-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 2769593 INFO (zkCallback-8578-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 2769604 INFO (zkConnectionManagerCallback-8586-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2769606 INFO (jetty-launcher-8558-thread-1) [n:127.0.0.1:53115_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 2769608 INFO (jetty-launcher-8558-thread-1) [n:127.0.0.1:53115_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:53113/solr ready
[junit4] 2> 2769609 DEBUG (OverseerAutoScalingTriggerThread-72215059387580422-127.0.0.1:53115_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and .scheduled_maintenance triggers
[junit4] 2> 2769611 DEBUG (OverseerAutoScalingTriggerThread-72215059387580422-127.0.0.1:53115_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
[junit4] 2> 2769611 DEBUG (OverseerAutoScalingTriggerThread-72215059387580422-127.0.0.1:53115_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1
[junit4] 2> 2769611 DEBUG (OverseerAutoScalingTriggerThread-72215059387580422-127.0.0.1:53115_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
[junit4] 2> 2769612 INFO (jetty-launcher-8558-thread-1) [n:127.0.0.1:53115_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 2769612 INFO (jetty-launcher-8558-thread-1) [n:127.0.0.1:53115_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53115_solr
[junit4] 2> 2769613 INFO (zkConnectionManagerCallback-8591-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2769614 INFO (zkCallback-8570-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 2769614 INFO (zkCallback-8578-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 2769614 INFO (zkCallback-8585-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 2769615 INFO (jetty-launcher-8558-thread-2) [n:127.0.0.1:53116_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 2769617 INFO (jetty-launcher-8558-thread-2) [n:127.0.0.1:53116_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:53113/solr ready
[junit4] 2> 2769617 INFO (jetty-launcher-8558-thread-2) [n:127.0.0.1:53116_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 2769620 DEBUG (OverseerAutoScalingTriggerThread-72215059387580422-127.0.0.1:53115_solr-n_0000000000) [ ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial livenodes: [127.0.0.1:53116_solr, 127.0.0.1:53115_solr]
[junit4] 2> 2769620 DEBUG (OverseerAutoScalingTriggerThread-72215059387580422-127.0.0.1:53115_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 2769621 DEBUG (OverseerAutoScalingTriggerThread-72215059387580422-127.0.0.1:53115_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
[junit4] 2> 2769621 DEBUG (ScheduledTrigger-13604-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 2769628 INFO (jetty-launcher-8558-thread-1) [n:127.0.0.1:53115_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 2769636 INFO (jetty-launcher-8558-thread-2) [n:127.0.0.1:53116_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_53116.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@15f7af96
[junit4] 2> 2769651 INFO (jetty-launcher-8558-thread-1) [n:127.0.0.1:53115_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_53115.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@15f7af96
[junit4] 2> 2769652 INFO (jetty-launcher-8558-thread-2) [n:127.0.0.1:53116_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_53116.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@15f7af96
[junit4] 2> 2769653 INFO (jetty-launcher-8558-thread-2) [n:127.0.0.1:53116_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_53116.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@15f7af96
[junit4] 2> 2769654 INFO (jetty-launcher-8558-thread-2) [n:127.0.0.1:53116_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.IndexSizeTriggerTest_7D095C19376C9A18-001/tempDir-001/node2/.
[junit4] 2> 2769658 INFO (jetty-launcher-8558-thread-1) [n:127.0.0.1:53115_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_53115.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@15f7af96
[junit4] 2> 2769659 INFO (jetty-launcher-8558-thread-1) [n:127.0.0.1:53115_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_53115.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@15f7af96
[junit4] 2> 2769659 INFO (jetty-launcher-8558-thread-1) [n:127.0.0.1:53115_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.IndexSizeTriggerTest_7D095C19376C9A18-001/tempDir-001/node1/.
[junit4] 2> 2769689 INFO (zkConnectionManagerCallback-8595-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2769693 INFO (zkConnectionManagerCallback-8600-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2769695 INFO (SUITE-IndexSizeTriggerTest-seed#[7D095C19376C9A18]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 2769697 INFO (SUITE-IndexSizeTriggerTest-seed#[7D095C19376C9A18]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:53113/solr ready
[junit4] 2> 2769720 DEBUG (SUITE-IndexSizeTriggerTest-seed#[7D095C19376C9A18]-worker) [ ] o.a.s.c.a.s.SimClusterStateProvider --- new Overseer leader: 127.0.0.1:10005_solr
[junit4] 2> 2769721 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and .scheduled_maintenance triggers
[junit4] 2> 2769721 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 0
[junit4] 2> 2769721 INFO (SUITE-IndexSizeTriggerTest-seed#[7D095C19376C9A18]-worker) [ ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 2769721 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 0, lastZnodeVersion -1
[junit4] 2> 2769721 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 0
[junit4] 2> 2769721 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial livenodes: [127.0.0.1:10006_solr, 127.0.0.1:10005_solr]
[junit4] 2> 2769721 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 2769721 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 0, lastZnodeVersion 0
[junit4] 2> 2769722 DEBUG (ScheduledTrigger-13616-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 2769752 DEBUG (ScheduledTrigger-13616-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 2769776 DEBUG (ScheduledTrigger-13616-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 2769801 DEBUG (ScheduledTrigger-13616-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 2769831 DEBUG (ScheduledTrigger-13616-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 2769861 DEBUG (ScheduledTrigger-13616-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 2769887 DEBUG (ScheduledTrigger-13616-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 2769910 DEBUG (ScheduledTrigger-13616-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 2769931 DEBUG (ScheduledTrigger-13616-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 2769950 INFO (TEST-IndexSizeTriggerTest.testTrigger-seed#[7D095C19376C9A18]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testTrigger
[junit4] 2> 2769960 DEBUG (ScheduledTrigger-13616-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 2769985 DEBUG (ScheduledTrigger-13616-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 2770010 DEBUG (ScheduledTrigger-13616-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 2770012 DEBUG (simCloudManagerPool-13615-thread-6) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testTrigger_collection / shard2: {"core_node3":{
[junit4] 2> "core":"testTrigger_collection_shard2_replica_n3",
[junit4] 2> "leader":"true",
[junit4] 2> "SEARCHER.searcher.maxDoc":0,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":10240,
[junit4] 2> "node_name":"127.0.0.1:10006_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "INDEX.sizeInGB":9.5367431640625E-6,
[junit4] 2> "SEARCHER.searcher.numDocs":0,
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"testTrigger_collection"}}
[junit4] 2> 2770013 DEBUG (simCloudManagerPool-13615-thread-7) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testTrigger_collection / shard1: {"core_node1":{
[junit4] 2> "core":"testTrigger_collection_shard1_replica_n1",
[junit4] 2> "leader":"true",
[junit4] 2> "SEARCHER.searcher.maxDoc":0,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":10240,
[junit4] 2> "node_name":"127.0.0.1:10006_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "INDEX.sizeInGB":9.5367431640625E-6,
[junit4] 2> "SEARCHER.searcher.numDocs":0,
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testTrigger_collection"}}
[junit4] 2> 2770034 DEBUG (ScheduledTrigger-13616-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 2770060 DEBUG (ScheduledTrigger-13616-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 2770090 DEBUG (ScheduledTrigger-13616-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 2770120 DEBUG (ScheduledTrigger-13616-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 2770150 DEBUG (ScheduledTrigger-13616-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 2770175 DEBUG (ScheduledTrigger-13616-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 2770179 INFO (TEST-IndexSizeTriggerTest.testTrigger-seed#[7D095C19376C9A18]) [ ] o.a.s.c.a.IndexSizeTriggerTest #######################################
[junit4] 2> ############ CLUSTER STATE ############
[junit4] 2> #######################################
[junit4] 2> ## Live nodes: 2
[junit4] 2> ## Empty nodes: 0
[junit4] 2> ## Dead nodes: 0
[junit4] 2> ## Collections: [testTrigger_collection]
[junit4] 2> DocCollection(testTrigger_collection//clusterstate.json/29)={
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "pullReplicas":"0",
[junit4] 2> "router":{"name":"compositeId"},
[junit4] 2> "maxShardsPerNode":"2",
[junit4] 2> "autoAddReplicas":"false",
[junit4] 2> "nrtReplicas":"2",
[junit4] 2> "tlogReplicas":"0",
[junit4] 2> "autoCreated":"true",
[junit4] 2> "shards":{
[junit4] 2> "shard2":{
[junit4] 2> "replicas":{
[junit4] 2> "core_node3":{
[junit4] 2> "core":"testTrigger_collection_shard2_replica_n3",
[junit4] 2> "leader":"true",
[junit4] 2> "SEARCHER.searcher.maxDoc":11,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":15740,
[junit4] 2> "node_name":"127.0.0.1:10006_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "INDEX.sizeInGB":1.4659017324447632E-5,
[junit4] 2> "SEARCHER.searcher.numDocs":11},
[junit4] 2> "core_node4":{
[junit4] 2> "core":"testTrigger_collection_shard2_replica_n4",
[junit4] 2> "SEARCHER.searcher.maxDoc":11,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":15740,
[junit4] 2> "node_name":"127.0.0.1:10005_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "INDEX.sizeInGB":1.4659017324447632E-5,
[junit4] 2> "SEARCHER.searcher.numDocs":11}},
[junit4] 2> "range":"0-7fffffff",
[junit4] 2> "state":"active"},
[junit4] 2> "shard1":{
[junit4] 2> "replicas":{
[junit4] 2> "core_node1":{
[junit4] 2> "core":"testTrigger_collection_shard1_replica_n1",
[junit4] 2> "leader":"true",
[junit4] 2> "SEARCHER.searcher.maxDoc":14,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":17240,
[junit4] 2> "node_name":"127.0.0.1:10006_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "INDEX.sizeInGB":1.605600118637085E-5,
[junit4] 2> "SEARCHER.searcher.numDocs":14},
[junit4] 2> "core_node2":{
[junit4] 2> "core":"testTrigger_collection_shard1_replica_n2",
[junit4] 2> "SEARCHER.searcher.maxDoc":14,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":17240,
[junit4] 2> "node_name":"127.0.0.1:10005_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "INDEX.sizeInGB":1.605600118637085E-5,
[junit4] 2> "SEARCHER.searcher.numDocs":14}},
[junit4] 2> "range":"80000000-ffffffff",
[junit4] 2> "state":"active"}}}
[junit4] 2> ## Max replicas per node: 2
[junit4] 2> ## Min replicas per node: 2
[junit4] 2> ## Total replicas: 4
[junit4] 2> ## * testTrigger_collection 4
[junit4] 2> ## - active 4
[junit4] 2> ######### Solr op counts ##########
[junit4] 2> ## - CREATE 1
[junit4] 2> ## - update 26
[junit4] 2> ######### Autoscaling event counts ###########
[junit4] 2>
[junit4] 2> 2770179 DEBUG (TEST-IndexSizeTriggerTest.testTrigger-seed#[7D095C19376C9A18]) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
[junit4] 2> 2770179 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
[junit4] 2> 2770179 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 2770179 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 2770179 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
[junit4] 2> 2770288 INFO (TEST-IndexSizeTriggerTest.testTrigger-seed#[7D095C19376C9A18]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testTrigger
[junit4] 2> 2770314 INFO (TEST-IndexSizeTriggerTest.testSplitIntegration-seed#[7D095C19376C9A18]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testSplitIntegration
[junit4] 2> 2770366 DEBUG (simCloudManagerPool-13615-thread-39) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testSplitIntegration_collection / shard2: {"core_node3":{
[junit4] 2> "core":"testSplitIntegration_collection_shard2_replica_n3",
[junit4] 2> "leader":"true",
[junit4] 2> "SEARCHER.searcher.maxDoc":0,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":10240,
[junit4] 2> "node_name":"127.0.0.1:10006_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "INDEX.sizeInGB":9.5367431640625E-6,
[junit4] 2> "SEARCHER.searcher.numDocs":0,
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"testSplitIntegration_collection"}}
[junit4] 2> 2770367 DEBUG (simCloudManagerPool-13615-thread-40) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testSplitIntegration_collection / shard1: {"core_node1":{
[junit4] 2> "core":"testSplitIntegration_collection_shard1_replica_n1",
[junit4] 2> "leader":"true",
[junit4] 2> "SEARCHER.searcher.maxDoc":0,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":10240,
[junit4] 2> "node_name":"127.0.0.1:10006_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "INDEX.sizeInGB":9.5367431640625E-6,
[junit4] 2> "SEARCHER.searcher.numDocs":0,
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testSplitIntegration_collection"}}
[junit4] 2> 2770381 DEBUG (simCloudManagerPool-13615-thread-41) [ ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 2770381 DEBUG (simCloudManagerPool-13615-thread-41) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 2
[junit4] 2> 2770382 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
[junit4] 2> 2770382 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 2770382 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 2770382 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
[junit4] 2> 2770393 DEBUG (simCloudManagerPool-13615-thread-42) [ ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 2770393 DEBUG (simCloudManagerPool-13615-thread-42) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 3
[junit4] 2> 2770393 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 3
[junit4] 2> 2770393 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 2770393 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 2770393 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion 3
[junit4] 2> 2770400 DEBUG (simCloudManagerPool-13615-thread-43) [ ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 2770400 DEBUG (simCloudManagerPool-13615-thread-43) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 4
[junit4] 2> 2770400 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 4
[junit4] 2> 2770401 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 2770401 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 2770401 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 4, lastZnodeVersion 4
[junit4] 2> 2770428 DEBUG (simCloudManagerPool-13615-thread-95) [ ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 2770428 DEBUG (simCloudManagerPool-13615-thread-95) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 5
[junit4] 2> 2770428 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 5
[junit4] 2> 2770428 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 2770428 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 2770429 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 5, lastZnodeVersion 5
[junit4] 2> 2770526 DEBUG (ScheduledTrigger-13616-thread-2) [ ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
[junit4] 2> "id":"8fc47c4b68425T5fnptuyzydihb7s226yrki4tq",
[junit4] 2> "source":"index_size_trigger2",
[junit4] 2> "eventTime":2529184986858533,
[junit4] 2> "eventType":"INDEXSIZE",
[junit4] 2> "properties":{
[junit4] 2> "aboveSize":{"testSplitIntegration_collection":[
[junit4] 2> "{\"core_node1\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":25,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":22740,\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":25,\n \"__bytes__\":22740,\n \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n \"__docs__\":25,\n \"violationType\":\"aboveDocs\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":2.117827534675598E-5,\n \"shard\":\"shard1\",\n \"collection\":\"testSplitIntegration_collection\"}}",
[junit4] 2> "{\"core_node3\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":25,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":22740,\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":25,\n \"__bytes__\":22740,\n \"core\":\"testSplitIntegration_collection_shard2_replica_n3\",\n \"__docs__\":25,\n \"violationType\":\"aboveDocs\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":2.117827534675598E-5,\n \"shard\":\"shard2\",\n \"collection\":\"testSplitIntegration_collection\"}}"]},
[junit4] 2> "belowSize":{},
[junit4] 2> "requestedOps":[
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard1\"}]}}",
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2\"}]}}"]}}
[junit4] 2> 2770527 DEBUG (ScheduledTrigger-13616-thread-2) [ ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: [index_size_trigger2]
[junit4] 2> 2770528 INFO (ScheduledTrigger-13616-thread-2) [ ] o.a.s.c.a.IndexSizeTriggerTest =======> CapturedEvent{timestamp=2529189940567583, stage=STARTED, actionName='null', event={
[junit4] 2> "id":"8fc47c4b68425T5fnptuyzydihb7s226yrki4tq",
[junit4] 2> "source":"index_size_trigger2",
[junit4] 2> "eventTime":2529184986858533,
[junit4] 2> "eventType":"INDEXSIZE",
[junit4] 2> "properties":{
[junit4] 2> "aboveSize":{"testSplitIntegration_collection":[
[junit4] 2> "{\"core_node1\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":25,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":22740,\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":25,\n \"__bytes__\":22740,\n \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n \"__docs__\":25,\n \"violationType\":\"aboveDocs\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":2.117827534675598E-5,\n \"shard\":\"shard1\",\n \"collection\":\"testSplitIntegration_collection\"}}",
[junit4] 2> "{\"core_node3\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":25,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":22740,\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":25,\n \"__bytes__\":22740,\n \"core\":\"testSplitIntegration_collection_shard2_replica_n3\",\n \"__docs__\":25,\n \"violationType\":\"aboveDocs\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":2.117827534675598E-5,\n \"shard\":\"shard2\",\n \"collection\":\"testSplitIntegration_collection\"}}"]},
[junit4] 2> "belowSize":{},
[junit4] 2> "_enqueue_time_":2529189906600483,
[junit4] 2> "requestedOps":[
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard1\"}]}}",
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2\"}]}}"]}}, context={}, config={
[junit4] 2> "trigger":"index_size_trigger2",
[junit4] 2> "stage":[
[junit4] 2> "STARTED",
[junit4] 2> "ABORTED",
[junit4] 2> "SUCCEEDED",
[junit4] 2> "FAILED"],
[junit4] 2> "afterAction":[
[junit4] 2> "compute_plan",
[junit4] 2> "execute_plan"],
[junit4] 2> "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener",
[junit4] 2> "beforeAction":[
[junit4] 2> "compute_plan",
[junit4] 2> "execute_plan"]}, message='null'}
[junit4] 2> 2770561 DEBUG (simCloudManagerPool-13615-thread-96) [ ] o.a.s.c.a.s.SimClusterStateProvider -- no leader in shard1:{
[junit4] 2> "replicas":{"core_node1":{
[junit4] 2> "core":".system_shard1_replica_n1",
[junit4] 2> "SEARCHER.searcher.maxDoc":0,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":10240,
[junit4] 2> "node_name":"127.0.0.1:10005_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "INDEX.sizeInGB":9.5367431640625E-6,
[junit4] 2> "SEARCHER.searcher.numDocs":0}},
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active"}
[junit4] 2> 2770561 DEBUG (AutoscalingActionExecutor-13617-thread-1) [ ] o.a.s.c.a.ScheduledTriggers -- processing actions for {
[junit4] 2> "id":"8fc47c4b68425T5fnptuyzydihb7s226yrki4tq",
[junit4] 2> "source":"index_size_trigger2",
[junit4] 2> "eventTime":2529184986858533,
[junit4] 2> "eventType":"INDEXSIZE",
[junit4] 2> "properties":{
[junit4] 2> "aboveSize":{"testSplitIntegration_collection":[
[junit4] 2> "{\"core_node1\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":25,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":22740,\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":25,\n \"__bytes__\":22740,\n \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n \"__docs__\":25,\n \"violationType\":\"aboveDocs\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":2.117827534675598E-5,\n \"shard\":\"shard1\",\n \"collection\":\"testSplitIntegration_collection\"}}",
[junit4] 2> "{\"core_node3\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":25,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":22740,\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":25,\n \"__bytes__\":22740,\n \"core\":\"testSplitIntegration_collection_shard2_replica_n3\",\n \"__docs__\":25,\n \"violationType\":\"aboveDocs\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":2.117827534675598E-5,\n \"shard\":\"shard2\",\n \"collection\":\"testSplitIntegration_collection\"}}"]},
[junit4] 2> "belowSize":{},
[junit4] 2> "_enqueue_time_":2529189906600483,
[junit4] 2> "requestedOps":[
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard1\"}]}}",
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2\"}]}}"]}}
[junit4] 2> 2770562 INFO (AutoscalingActionExecutor-13617-thread-1) [ ] o.a.s.c.a.IndexSizeTriggerTest =======> CapturedEvent{timestamp=2529191667139283, stage=BEFORE_ACTION, actionName='compute_plan', event={
[junit4] 2> "id":"8fc47c4b68425T5fnptuyzydihb7s226yrki4tq",
[junit4] 2> "source":"index_size_trigger2",
[junit4] 2> "eventTime":2529184986858533,
[junit4] 2> "eventType":"INDEXSIZE",
[junit4] 2> "properties":{
[junit4] 2> "aboveSize":{"testSplitIntegration_collection":[
[junit4] 2> "{\"core_node1\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":25,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":22740,\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":25,\n \"__bytes__\":22740,\n \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n \"__docs__\":25,\n \"violationType\":\"aboveDocs\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":2.117827534675598E-5,\n \"shard\":\"shard1\",\n \"collection\":\"testSplitIntegration_collection\"}}",
[junit4] 2> "{\"core_node3\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":25,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":22740,\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":25,\n \"__bytes__\":22740,\n \"core\":\"testSplitIntegration_collection_shard2_replica_n3\",\n \"__docs__\":25,\n \"violationType\":\"aboveDocs\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":2.117827534675598E-5,\n \"shard\":\"shard2\",\n \"collection\":\"testSplitIntegration_collection\"}}"]},
[junit4] 2> "belowSize":{},
[junit4] 2> "_enqueue_time_":2529189906600483,
[junit4] 2> "requestedOps":[
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard1\"}]}}",
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2\"}]}}"]}}, context={properties.BEFORE_ACTION=[compute_plan], source=index_size_trigger2}, config={
[junit4] 2> "trigger":"index_size_trigger2",
[junit4] 2> "stage":[
[junit4] 2> "STARTED",
[junit4] 2> "ABORTED",
[junit4] 2> "SUCCEEDED",
[junit4] 2> "FAILED"],
[junit4] 2> "afterAction":[
[junit4] 2> "compute_plan",
[junit4] 2> "execute_plan"],
[junit4] 2> "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener",
[junit4] 2> "beforeAction":[
[junit4] 2> "compute_plan",
[junit4] 2> "execute_plan"]}, message='null'}
[junit4] 2> 2770563 DEBUG (AutoscalingActionExecutor-13617-thread-1) [ ] o.a.s.c.a.ComputePlanAction -- processing event: {
[junit4] 2> "id":"8fc47c4b68425T5fnptuyzydihb7s226yrki4tq",
[junit4] 2> "source":"index_size_trigger2",
[junit4] 2> "eventTime":2529184986858533,
[junit4] 2> "eventType":"INDEXSIZE",
[junit4] 2> "properties":{
[junit4] 2> "aboveSize":{"testSplitIntegration_collection":[
[junit4] 2> "{\"core_node1\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":25,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":22740,\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":25,\n \"__bytes__\":22740,\n \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n \"__docs__\":25,\n \"violationType\":\"aboveDocs\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":2.117827534675598E-5,\n \"shard\":\"shard1\",\n \"collection\":\"testSplitIntegration_collection\"}}",
[junit4] 2> "{\"core_node3\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":25,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":22740,\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":25,\n \"__bytes__\":22740,\n \"core\":\"testSplitIntegration_collection_shard2_replica_n3\",\n \"__docs__\":25,\n \"violationType\":\"aboveDocs\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":2.117827534675598E-5,\n \"shard\":\"shard2\",\n \"collection\":\"testSplitIntegration_collection\"}}"]},
[junit4] 2> "belowSize":{},
[junit4] 2> "_enqueue_time_":2529189906600483,
[junit4] 2> "requestedOps":[
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard1\"}]}}",
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2\"}]}}"]}} with context properties: {BEFORE_ACTION=[compute_plan]}
[junit4] 2> 2770563 INFO (AutoscalingActionExecutor-13617-thread-1) [ ] o.a.s.c.a.ComputePlanAction Computed Plan: action=SPLITSHARD&collection=testSplitIntegration_collection&shard=shard1
[junit4] 2> 2770564 INFO (AutoscalingActionExecutor-13617-thread-1) [ ] o.a.s.c.a.ComputePlanAction Computed Plan: action=SPLITSHARD&collection=testSplitIntegration_collection&shard=shard2
[junit4] 2> 2770564 INFO (AutoscalingActionExecutor-13617-thread-1) [ ] o.a.s.c.s.c.a.PolicyHelper returnSession, curr-time 2529191736 sessionWrapper.createTime 2529191711526633, this.sessionWrapper.createTime 2529191711526633
[junit4] 2> 2770564 INFO (AutoscalingActionExecutor-13617-thread-1) [ ] o.a.s.c.a.IndexSizeTriggerTest =======> CapturedEvent{timestamp=2529191738173583, stage=AFTER_ACTION, actionName='compute_plan', event={
[junit4] 2> "id":"8fc47c4b68425T5fnptuyzydihb7s226yrki4tq",
[junit4] 2> "source":"index_size_trigger2",
[junit4] 2> "eventTime":2529184986858533,
[junit4] 2> "eventType":"INDEXSIZE",
[junit4] 2> "properties":{
[junit4] 2> "__start__":2,
[junit4] 2> "aboveSize":{"testSplitIntegration_collection":[
[junit4] 2> "{\"core_node1\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":25,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":22740,\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":25,\n \"__bytes__\":22740,\n \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n \"__docs__\":25,\n \"violationType\":\"aboveDocs\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":2.117827534675598E-5,\n \"shard\":\"shard1\",\n \"collection\":\"testSplitIntegration_collection\"}}",
[junit4] 2> "{\"core_node3\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":25,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":22740,\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":25,\n \"__bytes__\":22740,\n \"core\":\"testSplitIntegration_collection_shard2_replica_n3\",\n \"__docs__\":25,\n \"violationType\":\"aboveDocs\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":2.117827534675598E-5,\n \"shard\":\"shard2\",\n \"collection\":\"testSplitIntegration_collection\"}}"]},
[junit4] 2> "belowSize":{},
[junit4] 2> "_enqueue_time_":2529189906600483,
[junit4] 2> "requestedOps":[
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard1\"}]}}",
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2\"}]}}"]}}, context={properties.operations=[{class=org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard, method=GET, params.action=SPLITSHARD, params.collection=testSplitIntegration_collection, params.shard=shard1}, {class=org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard, method=GET, params.action=SPLITSHARD, params.collection=testSplitIntegration_collection, params.shard=shard2}], properties.BEFORE_ACTION=[compute_plan], source=index_size_trigger2, properties.AFTER_ACTION=[compute_plan]}, config={
[junit4] 2> "trigger":"index_size_trigger2",
[junit4] 2> "stage":[
[junit4] 2> "STARTED",
[junit4] 2> "ABORTED",
[junit4] 2> "SUCCEEDED",
[junit4] 2> "FAILED"],
[junit4] 2> "afterAction":[
[junit4] 2> "compute_plan",
[junit4] 2> "execute_plan"],
[junit4] 2> "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener",
[junit4] 2> "beforeAction":[
[junit4] 2> "compute_plan",
[junit4] 2> "execute_plan"]}, message='null'}
[junit4] 2> 2770564 INFO (AutoscalingActionExecutor-13617-thread-1) [ ] o.a.s.c.a.IndexSizeTriggerTest =======> CapturedEvent{timestamp=2529191757236283, stage=BEFORE_ACTION, actionName='execute_plan', event={
[junit4] 2> "id":"8fc47c4b68425T5fnptuyzydihb7s226yrki4tq",
[junit4] 2> "source":"index_size_trigger2",
[junit4] 2> "eventTime":2529184986858533,
[junit4] 2> "eventType":"INDEXSIZE",
[junit4] 2> "properties":{
[junit4] 2> "__start__":2,
[junit4] 2> "aboveSize":{"testSplitIntegration_collection":[
[junit4] 2> "{\"core_node1\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":25,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":22740,\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":25,\n \"__bytes__\":22740,\n \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n \"__docs__\":25,\n \"violationType\":\"aboveDocs\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":2.117827534675598E-5,\n \"shard\":\"shard1\",\n \"collection\":\"testSplitIntegration_collection\"}}",
[junit4] 2> "{\"core_node3\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":25,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":22740,\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":25,\n \"__bytes__\":22740,\n \"core\":\"testSplitIntegration_collection_shard2_replica_n3\",\n \"__docs__\":25,\n \"violationType\":\"aboveDocs\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":2.117827534675598E-5,\n \"shard\":\"shard2\",\n \"collection\":\"testSplitIntegration_collection\"}}"]},
[junit4] 2> "belowSize":{},
[junit4] 2> "_enqueue_time_":2529189906600483,
[junit4] 2> "requestedOps":[
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard1\"}]}}",
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2\"}]}}"]}}, context={properties.operations=[{class=org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard, method=GET, params.action=SPLITSHARD, params.collection=testSplitIntegration_collection, params.shard=shard1}, {class=org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard, method=GET, params.action=SPLITSHARD, params.collection=testSplitIntegration_collection, params.shard=shard2}], properties.BEFORE_ACTION=[compute_plan, execute_plan], source=index_size_trigger2, properties.AFTER_ACTION=[compute_plan]}, config={
[junit4] 2> "trigger":"index_size_trigger2",
[junit4] 2> "stage":[
[junit4] 2> "STARTED",
[junit4] 2> "ABORTED",
[junit4] 2> "SUCCEEDED",
[junit4] 2> "FAILED"],
[junit4] 2> "afterAction":[
[junit4] 2> "compute_plan",
[junit4] 2> "execute_plan"],
[junit4] 2> "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener",
[junit4] 2> "beforeAction":[
[junit4] 2> "compute_plan",
[junit4] 2> "execute_plan"]}, message='null'}
[junit4] 2> 2770565 DEBUG (AutoscalingActionExecutor-13617-thread-1) [ ] o.a.s.c.a.ExecutePlanAction -- processing event: {
[junit4] 2> "id":"8fc47c4b68425T5fnptuyzydihb7s226yrki4tq",
[junit4] 2> "source":"index_size_trigger2",
[junit4] 2> "eventTime":2529184986858533,
[junit4] 2> "eventType":"INDEXSIZE",
[junit4] 2> "properties":{
[junit4] 2> "__start__":2,
[junit4] 2> "aboveSize":{"testSplitIntegration_collection":[
[junit4] 2> "{\"core_node1\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":25,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":22740,\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":25,\n \"__bytes__\":22740,\n \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n \"__docs__\":25,\n \"violationType\":\"aboveDocs\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":2.117827534675598E-5,\n \"shard\":\"shard1\",\n \"collection\":\"testSplitIntegration_collection\"}}",
[junit4] 2> "{\"core_node3\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":25,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":22740,\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":25,\n \"__bytes__\":22740,\n \"core\":\"testSplitIntegration_collection_shard2_replica_n3\",\n \"__docs__\":25,\n \"violationType\":\"aboveDocs\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":2.117827534675598E-5,\n \"shard\":\"shard2\",\n \"collection\":\"testSplitIntegration_collection\"}}"]},
[junit4] 2> "belowSize":{},
[junit4] 2> "_enqueue_time_":2529189906600483,
[junit4] 2> "requestedOps":[
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard1\"}]}}",
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2\"}]}}"]}} with context properties: {operations=[org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard@9b3f07f, org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard@7932b50], AFTER_ACTION=[compute_plan], BEFORE_ACTION=[compute_plan, execute_plan]}
[junit4] 2> 2770565 DEBUG (AutoscalingActionExecutor-13617-thread-1) [ ] o.a.s.c.a.ExecutePlanAction Executing operation: action=SPLITSHARD&collection=testSplitIntegration_collection&shard=shard1
[junit4] 2> 2770624 DEBUG (ScheduledTrigger-13604-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 2770735 DEBUG (simCloudManagerPool-13615-thread-102) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testSplitIntegration_collection / shard1_1: {"core_node10":{
[junit4] 2> "leader":"true",
[junit4] 2> "SEARCHER.searcher.maxDoc":12,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":16240,
[junit4] 2> "node_name":"127.0.0.1:10005_solr",
[junit4] 2> "base_url":"http://127.0.0.1:10005/solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "INDEX.sizeInGB":1.5124678611755371E-5,
[junit4] 2> "SEARCHER.searcher.numDocs":12,
[junit4] 2> "core":"testSplitIntegration_collection_shard1_1_replica1",
[junit4] 2> "shard":"shard1_1",
[junit4] 2> "collection":"testSplitIntegration_collection"}}
[junit4] 2> 2770735 DEBUG (simCloudManagerPool-13615-thread-103) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testSplitIntegration_collection / shard1_0: {"core_node7":{
[junit4] 2> "leader":"true",
[junit4] 2> "SEARCHER.searcher.maxDoc":13,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":26980,
[junit4] 2> "node_name":"127.0.0.1:10006_solr",
[junit4] 2> "base_url":"http://127.0.0.1:10006/solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "INDEX.sizeInGB":2.512708306312561E-5,
[junit4] 2> "SEARCHER.searcher.numDocs":13,
[junit4] 2> "core":"testSplitIntegration_collection_shard1_0_replica0",
[junit4] 2> "shard":"shard1_0",
[junit4] 2> "collection":"testSplitIntegration_collection"}}
[junit4] 2> 2770736 DEBUG (AutoscalingActionExecutor-13617-thread-1) [ ] o.a.s.c.a.ExecutePlanAction Executing operation: action=SPLITSHARD&collection=testSplitIntegration_collection&shard=shard2
[junit4] 2> 2770909 DEBUG (simCloudManagerPool-13615-thread-109) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testSplitIntegration_collection / shard2_1: {"core_node16":{
[junit4] 2> "leader":"true",
[junit4] 2> "SEARCHER.searcher.maxDoc":12,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":16240,
[junit4] 2> "node_name":"127.0.0.1:10005_solr",
[junit4] 2> "base_url":"http://127.0.0.1:10005/solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "INDEX.sizeInGB":1.5124678611755371E-5,
[junit4] 2> "SEARCHER.searcher.numDocs":12,
[junit4] 2> "core":"testSplitIntegration_collection_shard2_1_replica1",
[junit4] 2> "shard":"shard2_1",
[junit4] 2> "collection":"testSplitIntegration_collection"}}
[junit4] 2> 2770913 DEBUG (simCloudManagerPool-13615-thread-112) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testSplitIntegration_collection / shard2_0: {"core_node14":{
[junit4] 2> "leader":"true",
[junit4] 2> "SEARCHER.searcher.maxDoc":13,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":26980,
[junit4] 2> "node_name":"127.0.0.1:10005_solr",
[junit4] 2> "base_url":"http://127.0.0.1:10005/solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "INDEX.sizeInGB":2.512708306312561E-5,
[junit4] 2> "SEARCHER.searcher.numDocs":13,
[junit4] 2> "core":"testSplitIntegration_collection_shard2_0_replica1",
[junit4] 2> "shard":"shard2_0",
[junit4] 2> "collection":"testSplitIntegration_collection"}}
[junit4] 2> 2770914 INFO (AutoscalingActionExecutor-13617-thread-1) [ ] o.a.s.c.a.IndexSizeTriggerTest =======> CapturedEvent{timestamp=2529209229627733, stage=AFTER_ACTION, actionName='execute_plan', event={
[junit4] 2> "id":"8fc47c4b68425T5fnptuyzydihb7s226yrki4tq",
[junit4] 2> "source":"index_size_trigger2",
[junit4] 2> "eventTime":2529184986858533,
[junit4] 2> "eventType":"INDEXSIZE",
[junit4] 2> "properties":{
[junit4] 2> "__start__":2,
[junit4] 2> "aboveSize":{"testSplitIntegration_collection":[
[junit4] 2> "{\"core_node1\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":25,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":22740,\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":25,\n \"__bytes__\":22740,\n \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n \"__docs__\":25,\n \"violationType\":\"aboveDocs\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":2.117827534675598E-5,\n \"shard\":\"shard1\",\n \"collection\":\"testSplitIntegration_collection\"}}",
[junit4] 2> "{\"core_node3\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":25,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":22740,\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":25,\n \"__bytes__\":22740,\n \"core\":\"testSplitIntegration_collection_shard2_replica_n3\",\n \"__docs__\":25,\n \"violationType\":\"aboveDocs\",\n \"state\":\"active\",\n \"INDEX.sizeInGB\":2.117827534675598E-5,\n \"shard\":\"shard2\",\n \"collection\":\"testSplitIntegration_collection\"}}"]},
[junit4] 2> "belowSize":{},
[junit4] 2> "_enqueue_time_":2529189906600483,
[junit4] 2> "requestedOps":[
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard1\"}]}}",
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2\"}]}}"]}}, context={properties.operations=[{class=org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard, method=GET, params.action=SPLITSHARD, params.async=index_size_trigger2/8fc47c4b68425T5fnptuyzydihb7s226yrki4tq/0, params.waitForFinalState=true, params.collection=testSplitIntegration_collection, params.shard=shard1}, {class=org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard, method=GET, params.action=SPLITSHARD, params.async=index_size_trigger2/8fc47c4b68425T5fnptuyzydihb7s226yrki4tq/0, params.waitForFinalState=true, params.collection=testSplitIntegration_collection, params.shard=shard2}], properties.BEFORE_ACTION=[compute_plan, execute_plan], properties.responses=[{status={state=completed,msg=found [index_size_trigger2/8fc47c4b68425T5fnptuyzydihb7s226yrki4tq/0] in completed tasks},success=}, {status={state=completed,msg=found [index_size_trigger2/8fc47c4b68425T5fnptuyzydihb7s226yrki4tq/0] in completed tasks},success=}], source=index_size_trigger2, properties.AFTER_ACTION=[compute_plan, execute_plan]}, config={
[junit4] 2> "trigger":"index_size_trigger2",
[junit4] 2> "stage":[
[junit4] 2> "STARTED",
[junit4] 2> "ABORTED",
[junit4] 2> "SUCCEEDED",
[junit4] 2> "FAILED"],
[junit4] 2> "afterAction":[
[junit4] 2> "compute_plan",
[junit4] 2> "execute_plan"],
[junit4] 2> "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener",
[junit4] 2> "beforeAction":[
[junit4] 2> "compute_plan",
[junit4] 2> "execute_plan"]}, message='null'}
[junit4] 2> 2770914 INFO (AutoscalingActionExecutor-13617-thread-1) [ ] o.a.s.c.a.IndexSizeTriggerTest =======> CapturedEvent{timestamp=2529209263699583, stage=SUCCEEDED, actionName='null', event={
[junit4] 2> "id":"8fc47c4b68425T5fnptuyzydihb7s226yrki4tq",
[junit4] 2> "source":"index_size_trigger2",
[junit4] 2> "eventTime":2529184986858533,
[junit4] 2> "eventType":"INDEXSIZE",
[junit4] 2> "properties":{
[junit4] 2> "__start__":2,
[junit4] 2> "aboveSize":{"testSplitIntegration_collection":[
[junit4] 2> "{\"core_node1\":{\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":25,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":22740,\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":25,\n \"__bytes__\":22740,\n \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n \"__docs__\":25,\n
[...truncated too long message...]
ainer instance=1249049780
[junit4] 2> 19879 INFO (jetty-closer-88-thread-1) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=16270976
[junit4] 2> 19879 INFO (jetty-closer-88-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 19880 INFO (jetty-closer-88-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 19880 INFO (jetty-closer-88-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4b024631: rootName = solr_60267, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@18e0f85f
[junit4] 2> 19880 INFO (jetty-closer-88-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@262ec4d3: rootName = solr_60266, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@434a8c4b
[junit4] 2> 19902 INFO (jetty-closer-88-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 19902 INFO (jetty-closer-88-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@51fc22d0: rootName = solr_60266, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@36c639ee
[junit4] 2> 19904 INFO (jetty-closer-88-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 19904 INFO (jetty-closer-88-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@998743c: rootName = solr_60267, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@36c639ee
[junit4] 2> 19907 INFO (jetty-closer-88-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 19907 INFO (jetty-closer-88-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@73a429bb: rootName = solr_60266, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@5d027e87
[junit4] 2> 19908 INFO (jetty-closer-88-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 19908 INFO (jetty-closer-88-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1e5d3423: rootName = solr_60267, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@5d027e87
[junit4] 2> 19910 INFO (jetty-closer-88-thread-2) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:60266_solr
[junit4] 2> 19910 INFO (jetty-closer-88-thread-1) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:60267_solr
[junit4] 2> 19911 INFO (jetty-closer-88-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 19911 INFO (jetty-closer-88-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 19912 INFO (jetty-closer-88-thread-1) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 19912 INFO (zkCallback-107-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (0)
[junit4] 2> 19912 INFO (zkCallback-99-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (0)
[junit4] 2> 19912 INFO (zkCallback-114-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (0)
[junit4] 2> 19914 INFO (zkCallback-119-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (0)
[junit4] 2> 19916 INFO (jetty-closer-88-thread-2) [ ] o.a.s.c.Overseer Overseer (id=72215155381436422-127.0.0.1:60266_solr-n_0000000000) closing
[junit4] 2> 19916 INFO (OverseerStateUpdate-72215155381436422-127.0.0.1:60266_solr-n_0000000000) [ ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:60266_solr
[junit4] 2> 19916 WARN (OverseerAutoScalingTriggerThread-72215155381436422-127.0.0.1:60266_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 19917 DEBUG (jetty-closer-88-thread-2) [ ] o.a.s.c.a.ScheduledTriggers Shutting down scheduled thread pool executor now
[junit4] 2> 19918 DEBUG (jetty-closer-88-thread-2) [ ] o.a.s.c.a.ScheduledTriggers Shutting down action executor now
[junit4] 2> 19918 DEBUG (jetty-closer-88-thread-2) [ ] o.a.s.c.a.ScheduledTriggers Awaiting termination for action executor
[junit4] 2> 19918 DEBUG (jetty-closer-88-thread-2) [ ] o.a.s.c.a.ScheduledTriggers Awaiting termination for scheduled thread pool executor
[junit4] 2> 19918 DEBUG (jetty-closer-88-thread-2) [ ] o.a.s.c.a.ScheduledTriggers ScheduledTriggers closed completely
[junit4] 2> 19918 DEBUG (jetty-closer-88-thread-2) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
[junit4] 2> 19920 INFO (jetty-closer-88-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@3de8548a{/solr,null,UNAVAILABLE}
[junit4] 2> 19920 INFO (jetty-closer-88-thread-1) [ ] o.e.j.s.session node0 Stopped scavenging
[junit4] 2> 19922 INFO (jetty-closer-88-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@7f940787{/solr,null,UNAVAILABLE}
[junit4] 2> 19922 INFO (jetty-closer-88-thread-2) [ ] o.e.j.s.session node0 Stopped scavenging
[junit4] 2> 19924 ERROR (SUITE-IndexSizeTriggerTest-seed#[7D095C19376C9A18]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 19924 INFO (SUITE-IndexSizeTriggerTest-seed#[7D095C19376C9A18]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:60264 60264
[junit4] 2> 19951 INFO (Thread-39) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:60264 60264
[junit4] 2> 22048 WARN (Thread-39) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 5 /solr/aliases.json
[junit4] 2> 2 /solr/security.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 5 /solr/clusterstate.json
[junit4] 2> 5 /solr/clusterprops.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 5 /solr/live_nodes
[junit4] 2> 5 /solr/collections
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.IndexSizeTriggerTest_7D095C19376C9A18-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=540, maxMBSortInHeap=5.786178187451346, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@4d3a5276), locale=rm, timezone=Europe/Ulyanovsk
[junit4] 2> NOTE: Mac OS X 10.11.6 x86_64/Oracle Corporation 9 (64-bit)/cpus=3,threads=1,free=30962760,total=85983232
[junit4] 2> NOTE: All tests run in this JVM: [IndexSizeTriggerTest, IndexSizeTriggerTest, IndexSizeTriggerTest]
[junit4] Completed [5/5 (1!)] on J1 in 5.37s, 4 tests, 1 failure <<< FAILURES!
[...truncated 10 lines...]
BUILD FAILED
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/lucene/common-build.xml:1568: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/lucene/common-build.xml:1092: There were test failures: 5 suites, 20 tests, 1 failure [seed: 7D095C19376C9A18]
Total time: 24 seconds
[repro] Setting last failure code to 256
[repro] Failures:
[repro] 1/5 failed: org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=228a84fd6db3ef5fc1624d69e1c82a1f02c51352, workspace=/Users/jenkins/workspace/Lucene-Solr-master-MacOSX
[WARNINGS] Computing warning deltas based on reference build #4681
Recording test results
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2