You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2018/03/23 04:18:41 UTC
[JENKINS] Lucene-Solr-master-MacOSX (64bit/jdk1.8.0) - Build # 4518
- Still Unstable!
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-MacOSX/4518/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseParallelGC
1 tests failed.
FAILED: org.apache.solr.cloud.autoscaling.sim.TestComputePlanAction.testNodeWithMultipleReplicasLost
Error Message:
The operations computed by ComputePlanAction should not be null {AFTER_ACTION=[compute_plan, null], BEFORE_ACTION=[compute_plan, null]} event: { "id":"31a456ee86794T5qdm1omq06vll1xv5jm0n5x4i", "source":"node_lost_trigger", "eventTime":873310445922196, "eventType":"NODELOST", "properties":{ "eventTimes":[873310445922196], "_enqueue_time_":873322324433846, "nodeNames":["127.0.0.1:10008_solr"]}}
Stack Trace:
java.lang.AssertionError: The operations computed by ComputePlanAction should not be null {AFTER_ACTION=[compute_plan, null], BEFORE_ACTION=[compute_plan, null]}
event: {
"id":"31a456ee86794T5qdm1omq06vll1xv5jm0n5x4i",
"source":"node_lost_trigger",
"eventTime":873310445922196,
"eventType":"NODELOST",
"properties":{
"eventTimes":[873310445922196],
"_enqueue_time_":873322324433846,
"nodeNames":["127.0.0.1:10008_solr"]}}
at __randomizedtesting.SeedInfo.seed([4BE996DD454D339A:7B29775FCD3FD2C6]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNotNull(Assert.java:526)
at org.apache.solr.cloud.autoscaling.sim.TestComputePlanAction.testNodeWithMultipleReplicasLost(TestComputePlanAction.java:240)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 1841 lines...]
[junit4] JVM J0: stdout was not empty, see: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/lucene/build/core/test/temp/junit4-J0-20180323_022835_263993294050207131487.sysout
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] codec: FastDecompressionCompressingStoredFields, pf: Memory, dvf: Asserting
[junit4] <<< JVM J0: EOF ----
[...truncated 12287 lines...]
[junit4] Suite: org.apache.solr.cloud.autoscaling.sim.TestComputePlanAction
[junit4] 2> Creating dataDir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.sim.TestComputePlanAction_4BE996DD454D339A-001/init-core-data-001
[junit4] 2> 3251233 WARN (SUITE-TestComputePlanAction-seed#[4BE996DD454D339A]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=4 numCloses=4
[junit4] 2> 3251233 INFO (SUITE-TestComputePlanAction-seed#[4BE996DD454D339A]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 3251245 INFO (SUITE-TestComputePlanAction-seed#[4BE996DD454D339A]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN) w/ MAC_OS_X supressed clientAuth
[junit4] 2> 3251245 INFO (SUITE-TestComputePlanAction-seed#[4BE996DD454D339A]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 3251276 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and .scheduled_maintenance triggers
[junit4] 2> 3251276 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 0
[junit4] 2> 3251277 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:10005_solr]
[junit4] 2> 3251277 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 0, lastZnodeVersion -1
[junit4] 2> 3251277 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 0
[junit4] 2> 3251278 INFO (TEST-TestComputePlanAction.testNodeAdded-seed#[4BE996DD454D339A]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testNodeAdded
[junit4] 2> 3251278 DEBUG (TEST-TestComputePlanAction.testNodeAdded-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
[junit4] 2> 3251278 INFO (TEST-TestComputePlanAction.testNodeAdded-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimCloudManager === Restarting OverseerTriggerThread and clearing object cache...
[junit4] 2> 3251278 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 3251278 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 0
[junit4] 2> 3251278 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
[junit4] 2> 3251279 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 3251279 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 3251279 WARN (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Interrupted
[junit4] 2> java.lang.InterruptedException
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireInterruptibly(AbstractQueuedSynchronizer.java:1220)
[junit4] 2> at java.util.concurrent.locks.ReentrantLock.lockInterruptibly(ReentrantLock.java:335)
[junit4] 2> at org.apache.solr.cloud.autoscaling.OverseerTriggerThread.run(OverseerTriggerThread.java:165)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 3251280 DEBUG (TEST-TestComputePlanAction.testNodeAdded-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
[junit4] 2> 3251281 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and .scheduled_maintenance triggers
[junit4] 2> 3251281 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 2
[junit4] 2> 3251281 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:10005_solr]
[junit4] 2> 3251281 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion -1
[junit4] 2> 3251281 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
[junit4] 2> 3251282 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 3251282 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
[junit4] 2> 3251282 DEBUG (ScheduledTrigger-10446-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 3251304 DEBUG (ScheduledTrigger-10446-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 3251329 DEBUG (ScheduledTrigger-10446-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 3251354 DEBUG (ScheduledTrigger-10446-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 3251375 DEBUG (ScheduledTrigger-10446-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 3251385 DEBUG (simCloudManagerPool-10445-thread-1) [ ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 3251385 DEBUG (simCloudManagerPool-10445-thread-1) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 3
[junit4] 2> 3251386 DEBUG (simCloudManagerPool-10445-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:10005_solr]
[junit4] 2> 3251386 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 3
[junit4] 2> 3251386 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 3251386 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion 3
[junit4] 2> 3251387 DEBUG (simCloudManagerPool-10445-thread-2) [ ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 3251387 DEBUG (simCloudManagerPool-10445-thread-2) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 4
[junit4] 2> 3251387 DEBUG (simCloudManagerPool-10445-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:10005_solr]
[junit4] 2> 3251387 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 4
[junit4] 2> 3251387 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 3251387 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 4, lastZnodeVersion 4
[junit4] 2> 3251396 DEBUG (ScheduledTrigger-10446-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 3251416 DEBUG (ScheduledTrigger-10446-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 3251438 DEBUG (ScheduledTrigger-10446-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 3251461 DEBUG (ScheduledTrigger-10446-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 3251486 DEBUG (ScheduledTrigger-10446-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 3251511 DEBUG (simCloudManagerPool-10445-thread-3) [ ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 3251511 DEBUG (simCloudManagerPool-10445-thread-3) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 5
[junit4] 2> 3251511 DEBUG (simCloudManagerPool-10445-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:10005_solr]
[junit4] 2> 3251511 DEBUG (ScheduledTrigger-10446-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 3251512 DEBUG (simCloudManagerPool-10445-thread-3) [ ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:10005_solr]
[junit4] 2> 3251512 DEBUG (simCloudManagerPool-10445-thread-3) [ ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger instantiated with properties: {event=nodeAdded, waitFor=1, actions=[{name=compute_plan, class=solr.ComputePlanAction}, {name=test, class=org.apache.solr.cloud.autoscaling.sim.TestComputePlanAction$AssertingTriggerAction}], enabled=true}
[junit4] 2> 3251513 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 5
[junit4] 2> 3251513 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 5, lastZnodeVersion 5
[junit4] 2> 3251513 DEBUG (ScheduledTrigger-10446-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
[junit4] 2> 3251513 DEBUG (ScheduledTrigger-10446-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 1
[junit4] 2> 3251520 DEBUG (simCloudManagerPool-10445-thread-4) [ ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 3251520 DEBUG (simCloudManagerPool-10445-thread-4) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 6
[junit4] 2> 3251520 DEBUG (simCloudManagerPool-10445-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:10005_solr]
[junit4] 2> 3251521 DEBUG (simCloudManagerPool-10445-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:10005_solr]
[junit4] 2> 3251521 DEBUG (simCloudManagerPool-10445-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger instantiated with properties: {event=nodeAdded, waitFor=1, actions=[{name=compute_plan, class=solr.ComputePlanAction}, {name=test, class=org.apache.solr.cloud.autoscaling.sim.TestComputePlanAction$AssertingTriggerAction}], enabled=true}
[junit4] 2> 3251521 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 6
[junit4] 2> 3251521 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 6, lastZnodeVersion 6
[junit4] 2> 3251522 DEBUG (simCloudManagerPool-10445-thread-5) [ ] o.a.s.c.o.ClusterStateMutator building a new cName: testNodeAdded
[junit4] 2> 3251533 DEBUG (ScheduledTrigger-10446-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 3251533 DEBUG (ScheduledTrigger-10446-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
[junit4] 2> 3251533 DEBUG (ScheduledTrigger-10446-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 1
[junit4] 2> 3251543 WARN (simCloudManagerPool-10445-thread-5) [ ] o.a.s.c.a.c.CreateCollectionCmd Specified number of replicas of 2 on collection testNodeAdded is higher than the number of Solr instances currently live or live and part of your createNodeSet(1). It's unusual to run two replica of the same slice on the same Solr-instance.
[junit4] 2> 3251543 DEBUG (simCloudManagerPool-10445-thread-5) [ ] o.a.s.c.s.c.a.PolicyHelper Creating a new session
[junit4] 2> 3251543 DEBUG (simCloudManagerPool-10445-thread-5) [ ] o.a.s.c.s.c.a.PolicyHelper New session created
[junit4] 2> 3251543 INFO (simCloudManagerPool-10445-thread-5) [ ] o.a.s.c.s.c.a.PolicyHelper returnSession, curr-time 873276851 sessionWrapper.createTime 873276840432446, this.sessionWrapper.createTime 873276840432446
[junit4] 2> 3251543 DEBUG (simCloudManagerPool-10445-thread-5) [ ] o.a.s.c.s.c.a.PolicyHelper session set to NULL
[junit4] 2> 3251559 DEBUG (ScheduledTrigger-10446-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 3251559 DEBUG (ScheduledTrigger-10446-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
[junit4] 2> 3251560 DEBUG (ScheduledTrigger-10446-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 1
[junit4] 2> 3251576 DEBUG (simCloudManagerPool-10445-thread-8) [ ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 3251576 DEBUG (simCloudManagerPool-10445-thread-8) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 7
[junit4] 2> 3251576 DEBUG (simCloudManagerPool-10445-thread-8) [ ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:10005_solr]
[junit4] 2> 3251578 DEBUG (simCloudManagerPool-10445-thread-8) [ ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:10005_solr]
[junit4] 2> 3251578 DEBUG (simCloudManagerPool-10445-thread-8) [ ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger instantiated with properties: {event=nodeAdded, waitFor=1, actions=[{name=compute_plan, class=solr.ComputePlanAction}, {name=test, class=org.apache.solr.cloud.autoscaling.sim.TestComputePlanAction$AssertingTriggerAction}], enabled=true}
[junit4] 2> 3251578 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 7
[junit4] 2> 3251578 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 7, lastZnodeVersion 7
[junit4] 2> 3251582 DEBUG (ScheduledTrigger-10446-thread-1) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
[junit4] 2> 3251583 DEBUG (ScheduledTrigger-10446-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 3251583 DEBUG (ScheduledTrigger-10446-thread-1) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 2
[junit4] 2> 3251583 DEBUG (ScheduledTrigger-10446-thread-1) [ ] o.a.s.c.a.NodeAddedTrigger Tracking new node: 127.0.0.1:10006_solr at time 873278838408246
[junit4] 2> 3251603 DEBUG (ScheduledTrigger-10446-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 3251603 DEBUG (ScheduledTrigger-10446-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
[junit4] 2> 3251603 DEBUG (ScheduledTrigger-10446-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 2
[junit4] 2> 3251603 DEBUG (ScheduledTrigger-10446-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger firing registered processor for nodes: [127.0.0.1:10006_solr] added at times [873278838408246], now=873279850827296
[junit4] 2> 3251603 DEBUG (ScheduledTrigger-10446-thread-2) [ ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
[junit4] 2> "id":"31a3e12f40436T5qdm1omq06vll1xv5jm0n5x48",
[junit4] 2> "source":"node_added_trigger",
[junit4] 2> "eventTime":873278838408246,
[junit4] 2> "eventType":"NODEADDED",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[873278838408246],
[junit4] 2> "nodeNames":["127.0.0.1:10006_solr"]}}
[junit4] 2> 3251604 DEBUG (ScheduledTrigger-10446-thread-2) [ ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: [.auto_add_replicas, .scheduled_maintenance, node_added_trigger]
[junit4] 2> 3251605 DEBUG (AutoscalingActionExecutor-10447-thread-1) [ ] o.a.s.c.a.ScheduledTriggers -- processing actions for {
[junit4] 2> "id":"31a3e12f40436T5qdm1omq06vll1xv5jm0n5x48",
[junit4] 2> "source":"node_added_trigger",
[junit4] 2> "eventTime":873278838408246,
[junit4] 2> "eventType":"NODEADDED",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[873278838408246],
[junit4] 2> "_enqueue_time_":873279884390146,
[junit4] 2> "nodeNames":["127.0.0.1:10006_solr"]}}
[junit4] 2> 3251606 DEBUG (AutoscalingActionExecutor-10447-thread-1) [ ] o.a.s.c.a.ComputePlanAction -- processing event: {
[junit4] 2> "id":"31a3e12f40436T5qdm1omq06vll1xv5jm0n5x48",
[junit4] 2> "source":"node_added_trigger",
[junit4] 2> "eventTime":873278838408246,
[junit4] 2> "eventType":"NODEADDED",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[873278838408246],
[junit4] 2> "_enqueue_time_":873279884390146,
[junit4] 2> "nodeNames":["127.0.0.1:10006_solr"]}} with context properties: {BEFORE_ACTION=[compute_plan]}
[junit4] 2> 3251606 DEBUG (AutoscalingActionExecutor-10447-thread-1) [ ] o.a.s.c.s.c.a.PolicyHelper Creating a new session
[junit4] 2> 3251606 DEBUG (AutoscalingActionExecutor-10447-thread-1) [ ] o.a.s.c.s.c.a.PolicyHelper New session created
[junit4] 2> 3251607 INFO (AutoscalingActionExecutor-10447-thread-1) [ ] o.a.s.c.a.ComputePlanAction Computed Plan: action=MOVEREPLICA&collection=testNodeAdded&targetNode=127.0.0.1:10006_solr&inPlaceMove=true&replica=core_node1
[junit4] 2> 3251607 INFO (AutoscalingActionExecutor-10447-thread-1) [ ] o.a.s.c.s.c.a.PolicyHelper returnSession, curr-time 873280023 sessionWrapper.createTime 873280008824696, this.sessionWrapper.createTime 873280008824696
[junit4] 2> 3251607 DEBUG (AutoscalingActionExecutor-10447-thread-1) [ ] o.a.s.c.s.c.a.PolicyHelper session set to NULL
[junit4] 2> 3251619 INFO (TEST-TestComputePlanAction.testNodeAdded-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.TestComputePlanAction Node values: {
[junit4] 2> "127.0.0.1:10006_solr":{
[junit4] 2> "sysprop.java.vendor":"Oracle Corporation",
[junit4] 2> "cores":0,
[junit4] 2> "host":"127.0.0.1",
[junit4] 2> "freedisk":1000,
[junit4] 2> "sysprop.java.version":"1.8.0_144",
[junit4] 2> "ip_1":"127",
[junit4] 2> "ip_3":"0",
[junit4] 2> "ip_2":"0",
[junit4] 2> "ip_4":"1",
[junit4] 2> "node":"127.0.0.1:10006_solr",
[junit4] 2> "metrics:solr.jvm:buffers.direct.Count":0,
[junit4] 2> "port":10006,
[junit4] 2> "heapUsage":123450000,
[junit4] 2> "sysLoadAvg":1.0,
[junit4] 2> "metrics:solr.node:ADMIN./admin/authorization.clientErrors:count":0},
[junit4] 2> "127.0.0.1:10005_solr":{
[junit4] 2> "sysprop.java.vendor":"Oracle Corporation",
[junit4] 2> "cores":2,
[junit4] 2> "host":"127.0.0.1",
[junit4] 2> "freedisk":998,
[junit4] 2> "sysprop.java.version":"1.8.0_144",
[junit4] 2> "ip_1":"127",
[junit4] 2> "ip_3":"0",
[junit4] 2> "ip_2":"0",
[junit4] 2> "ip_4":"1",
[junit4] 2> "node":"127.0.0.1:10005_solr",
[junit4] 2> "metrics:solr.jvm:buffers.direct.Count":0,
[junit4] 2> "port":10005,
[junit4] 2> "heapUsage":123450000,
[junit4] 2> "sysLoadAvg":1.0,
[junit4] 2> "metrics:solr.node:ADMIN./admin/authorization.clientErrors:count":0}}
[junit4] 2> 3251619 INFO (TEST-TestComputePlanAction.testNodeAdded-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.TestComputePlanAction Live nodes: [127.0.0.1:10006_solr, 127.0.0.1:10005_solr], collection state: DocCollection(testNodeAdded//clusterstate.json/1)={
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "pullReplicas":"0",
[junit4] 2> "router":{"name":"compositeId"},
[junit4] 2> "maxShardsPerNode":"1",
[junit4] 2> "autoAddReplicas":"false",
[junit4] 2> "nrtReplicas":"2",
[junit4] 2> "tlogReplicas":"0",
[junit4] 2> "autoCreated":"true",
[junit4] 2> "shards":{"shard1":{
[junit4] 2> "replicas":{
[junit4] 2> "core_node1":{
[junit4] 2> "node_name":"127.0.0.1:10005_solr",
[junit4] 2> "core":"testNodeAdded_shard1_replica_n1",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "INDEX.sizeInBytes":1},
[junit4] 2> "core_node2":{
[junit4] 2> "node_name":"127.0.0.1:10005_solr",
[junit4] 2> "core":"testNodeAdded_shard1_replica_n2",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "INDEX.sizeInBytes":1}},
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active"}}}
[junit4] 2> 3251620 INFO (TEST-TestComputePlanAction.testNodeAdded-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.TestComputePlanAction -------------_ FINAL STATE --------------
[junit4] 2> 3251620 INFO (TEST-TestComputePlanAction.testNodeAdded-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.TestComputePlanAction * Node values: {
[junit4] 2> "127.0.0.1:10006_solr":{
[junit4] 2> "sysprop.java.vendor":"Oracle Corporation",
[junit4] 2> "cores":0,
[junit4] 2> "host":"127.0.0.1",
[junit4] 2> "freedisk":1000,
[junit4] 2> "sysprop.java.version":"1.8.0_144",
[junit4] 2> "ip_1":"127",
[junit4] 2> "ip_3":"0",
[junit4] 2> "ip_2":"0",
[junit4] 2> "ip_4":"1",
[junit4] 2> "node":"127.0.0.1:10006_solr",
[junit4] 2> "metrics:solr.jvm:buffers.direct.Count":0,
[junit4] 2> "port":10006,
[junit4] 2> "heapUsage":123450000,
[junit4] 2> "sysLoadAvg":1.0,
[junit4] 2> "metrics:solr.node:ADMIN./admin/authorization.clientErrors:count":0},
[junit4] 2> "127.0.0.1:10005_solr":{
[junit4] 2> "sysprop.java.vendor":"Oracle Corporation",
[junit4] 2> "cores":2,
[junit4] 2> "host":"127.0.0.1",
[junit4] 2> "freedisk":998,
[junit4] 2> "sysprop.java.version":"1.8.0_144",
[junit4] 2> "ip_1":"127",
[junit4] 2> "ip_3":"0",
[junit4] 2> "ip_2":"0",
[junit4] 2> "ip_4":"1",
[junit4] 2> "node":"127.0.0.1:10005_solr",
[junit4] 2> "metrics:solr.jvm:buffers.direct.Count":0,
[junit4] 2> "port":10005,
[junit4] 2> "heapUsage":123450000,
[junit4] 2> "sysLoadAvg":1.0,
[junit4] 2> "metrics:solr.node:ADMIN./admin/authorization.clientErrors:count":0}}
[junit4] 2> 3251620 INFO (TEST-TestComputePlanAction.testNodeAdded-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.TestComputePlanAction * Live nodes: [127.0.0.1:10006_solr, 127.0.0.1:10005_solr]
[junit4] 2> 3251620 INFO (TEST-TestComputePlanAction.testNodeAdded-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.TestComputePlanAction * Collection testNodeAdded state: DocCollection(testNodeAdded//clusterstate.json/1)={
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "pullReplicas":"0",
[junit4] 2> "router":{"name":"compositeId"},
[junit4] 2> "maxShardsPerNode":"1",
[junit4] 2> "autoAddReplicas":"false",
[junit4] 2> "nrtReplicas":"2",
[junit4] 2> "tlogReplicas":"0",
[junit4] 2> "autoCreated":"true",
[junit4] 2> "shards":{"shard1":{
[junit4] 2> "replicas":{
[junit4] 2> "core_node1":{
[junit4] 2> "node_name":"127.0.0.1:10005_solr",
[junit4] 2> "core":"testNodeAdded_shard1_replica_n1",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "INDEX.sizeInBytes":1},
[junit4] 2> "core_node2":{
[junit4] 2> "node_name":"127.0.0.1:10005_solr",
[junit4] 2> "core":"testNodeAdded_shard1_replica_n2",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "INDEX.sizeInBytes":1}},
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active"}}}
[junit4] 2> 3251620 INFO (TEST-TestComputePlanAction.testNodeAdded-seed#[4BE996DD454D339A]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testNodeAdded
[junit4] 2> 3251620 INFO (TEST-TestComputePlanAction.testNodeAdded-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase
[junit4] 2>
[junit4] 2> 3251620 INFO (TEST-TestComputePlanAction.testNodeAdded-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase #############################################
[junit4] 2> 3251620 INFO (TEST-TestComputePlanAction.testNodeAdded-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ############ FINAL CLUSTER STATS ############
[junit4] 2> 3251620 INFO (TEST-TestComputePlanAction.testNodeAdded-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase #############################################
[junit4] 2>
[junit4] 2> 3251620 INFO (TEST-TestComputePlanAction.testNodeAdded-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Live nodes: 2
[junit4] 2> 3251620 INFO (TEST-TestComputePlanAction.testNodeAdded-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Empty nodes: 1
[junit4] 2> 3251620 INFO (TEST-TestComputePlanAction.testNodeAdded-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Dead nodes: 0
[junit4] 2> 3251620 INFO (TEST-TestComputePlanAction.testNodeAdded-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Collections: [testNodeAdded]
[junit4] 2> 3251620 INFO (TEST-TestComputePlanAction.testNodeAdded-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Max replicas per node: 2
[junit4] 2> 3251620 INFO (TEST-TestComputePlanAction.testNodeAdded-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Min replicas per node: 0
[junit4] 2> 3251620 INFO (TEST-TestComputePlanAction.testNodeAdded-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Total replicas: 2
[junit4] 2> 3251620 INFO (TEST-TestComputePlanAction.testNodeAdded-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## * testNodeAdded 2
[junit4] 2> 3251620 INFO (TEST-TestComputePlanAction.testNodeAdded-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - active 2
[junit4] 2> 3251620 INFO (TEST-TestComputePlanAction.testNodeAdded-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ######### Final Solr op counts ##########
[junit4] 2> 3251620 INFO (TEST-TestComputePlanAction.testNodeAdded-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - CREATE 1
[junit4] 2> 3251621 INFO (TEST-TestComputePlanAction.testNodeAdded-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - autoscaling 5
[junit4] 2> 3251621 INFO (TEST-TestComputePlanAction.testNodeAdded-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - update 2
[junit4] 2> 3251621 INFO (TEST-TestComputePlanAction.testNodeAdded-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ######### Autoscaling event counts ###########
[junit4] 2> 3251622 INFO (TEST-TestComputePlanAction.testNodeAdded-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## * Trigger: node_added_trigger
[junit4] 2> 3251623 INFO (TEST-TestComputePlanAction.testNodeAdded-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - BEFORE_ACTION 1
[junit4] 2> 3251623 INFO (TEST-TestComputePlanAction.testNodeAdded-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - STARTED 1
[junit4] 2> 3251628 DEBUG (AutoscalingActionExecutor-10447-thread-1) [ ] o.a.s.c.a.ScheduledTriggers Resuming trigger: .auto_add_replicas after 100ms
[junit4] 2> 3251628 DEBUG (AutoscalingActionExecutor-10447-thread-1) [ ] o.a.s.c.a.ScheduledTriggers Resuming trigger: .scheduled_maintenance after 100ms
[junit4] 2> 3251628 DEBUG (AutoscalingActionExecutor-10447-thread-1) [ ] o.a.s.c.a.ScheduledTriggers Resuming trigger: node_added_trigger after 100ms
[junit4] 2> 3251628 DEBUG (AutoscalingActionExecutor-10447-thread-1) [ ] o.a.s.c.a.ScheduledTriggers -- processing took 1132 ms for event id=31a3e12f40436T5qdm1omq06vll1xv5jm0n5x48
[junit4] 2> 3251636 INFO (TEST-TestComputePlanAction.testNodeLost-seed#[4BE996DD454D339A]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testNodeLost
[junit4] 2> 3251636 DEBUG (TEST-TestComputePlanAction.testNodeLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 8
[junit4] 2> 3251636 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 8
[junit4] 2> 3251637 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 3251637 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 3251637 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 8, lastZnodeVersion 8
[junit4] 2> 3251642 INFO (TEST-TestComputePlanAction.testNodeLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimCloudManager === Restarting OverseerTriggerThread and clearing object cache...
[junit4] 2> 3251642 DEBUG (TEST-TestComputePlanAction.testNodeLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
[junit4] 2> 3251642 WARN (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 3251648 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and .scheduled_maintenance triggers
[junit4] 2> 3251648 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 9
[junit4] 2> 3251649 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:10006_solr]
[junit4] 2> 3251649 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 9, lastZnodeVersion -1
[junit4] 2> 3251649 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 9
[junit4] 2> 3251650 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 3251650 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 9, lastZnodeVersion 9
[junit4] 2> 3251650 DEBUG (ScheduledTrigger-10449-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 3251673 DEBUG (ScheduledTrigger-10449-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 3251695 DEBUG (ScheduledTrigger-10449-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 3251716 DEBUG (ScheduledTrigger-10449-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 3251738 DEBUG (ScheduledTrigger-10449-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 3251759 DEBUG (simCloudManagerPool-10448-thread-1) [ ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 3251759 DEBUG (simCloudManagerPool-10448-thread-1) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 10
[junit4] 2> 3251759 DEBUG (ScheduledTrigger-10449-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 3251760 DEBUG (simCloudManagerPool-10448-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:10006_solr]
[junit4] 2> 3251760 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 10
[junit4] 2> 3251760 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 3251760 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 10, lastZnodeVersion 10
[junit4] 2> 3251761 DEBUG (simCloudManagerPool-10448-thread-2) [ ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 3251761 DEBUG (simCloudManagerPool-10448-thread-2) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 11
[junit4] 2> 3251761 DEBUG (simCloudManagerPool-10448-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:10006_solr]
[junit4] 2> 3251762 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 11
[junit4] 2> 3251762 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 3251762 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 11, lastZnodeVersion 11
[junit4] 2> 3251784 DEBUG (ScheduledTrigger-10449-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 3251805 DEBUG (ScheduledTrigger-10449-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 3251827 DEBUG (ScheduledTrigger-10449-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 3251851 DEBUG (ScheduledTrigger-10449-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 3251871 DEBUG (ScheduledTrigger-10449-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 3251872 DEBUG (simCloudManagerPool-10448-thread-3) [ ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 3251872 DEBUG (simCloudManagerPool-10448-thread-3) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 12
[junit4] 2> 3251872 DEBUG (simCloudManagerPool-10448-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:10006_solr, 127.0.0.1:10007_solr]
[junit4] 2> 3251872 DEBUG (simCloudManagerPool-10448-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:10006_solr, 127.0.0.1:10007_solr]
[junit4] 2> 3251873 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 12
[junit4] 2> 3251873 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 3251873 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 12, lastZnodeVersion 12
[junit4] 2> 3251873 DEBUG (ScheduledTrigger-10449-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 2
[junit4] 2> 3251875 DEBUG (simCloudManagerPool-10448-thread-4) [ ] o.a.s.c.o.ClusterStateMutator building a new cName: testNodeLost
[junit4] 2> 3251895 DEBUG (ScheduledTrigger-10449-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 3251895 DEBUG (simCloudManagerPool-10448-thread-4) [ ] o.a.s.c.s.c.a.PolicyHelper Creating a new session
[junit4] 2> 3251895 DEBUG (simCloudManagerPool-10448-thread-4) [ ] o.a.s.c.s.c.a.PolicyHelper New session created
[junit4] 2> 3251901 DEBUG (ScheduledTrigger-10449-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 2
[junit4] 2> 3251901 INFO (simCloudManagerPool-10448-thread-4) [ ] o.a.s.c.s.c.a.PolicyHelper returnSession, curr-time 873294749 sessionWrapper.createTime 873294463483346, this.sessionWrapper.createTime 873294463483346
[junit4] 2> 3251901 DEBUG (simCloudManagerPool-10448-thread-4) [ ] o.a.s.c.s.c.a.PolicyHelper session set to NULL
[junit4] 2> 3251926 DEBUG (ScheduledTrigger-10449-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 3251926 DEBUG (ScheduledTrigger-10449-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 2
[junit4] 2> 3251927 DEBUG (TEST-TestComputePlanAction.testNodeLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.TestComputePlanAction -- cluster state: znodeVersion: 5
[junit4] 2> live nodes:[127.0.0.1:10006_solr, 127.0.0.1:10007_solr]
[junit4] 2> collections:{testNodeLost=DocCollection(testNodeLost//clusterstate.json/4)={
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "pullReplicas":"0",
[junit4] 2> "router":{"name":"compositeId"},
[junit4] 2> "maxShardsPerNode":"1",
[junit4] 2> "autoAddReplicas":"false",
[junit4] 2> "nrtReplicas":"2",
[junit4] 2> "tlogReplicas":"0",
[junit4] 2> "autoCreated":"true",
[junit4] 2> "shards":{"shard1":{
[junit4] 2> "replicas":{
[junit4] 2> "core_node1":{
[junit4] 2> "node_name":"127.0.0.1:10007_solr",
[junit4] 2> "core":"testNodeLost_shard1_replica_n1",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "INDEX.sizeInBytes":1},
[junit4] 2> "core_node2":{
[junit4] 2> "node_name":"127.0.0.1:10006_solr",
[junit4] 2> "core":"testNodeLost_shard1_replica_n2",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "INDEX.sizeInBytes":1}},
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active"}}}}
[junit4] 2> 3251929 INFO (TEST-TestComputePlanAction.testNodeLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.TestComputePlanAction Stopped_node : 127.0.0.1:10007_solr
[junit4] 2> 3251934 DEBUG (simCloudManagerPool-10448-thread-7) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testNodeLost / shard1: {"core_node2":{
[junit4] 2> "node_name":"127.0.0.1:10006_solr",
[junit4] 2> "core":"testNodeLost_shard1_replica_n2",
[junit4] 2> "leader":"true",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testNodeLost"}}
[junit4] 2> 3251947 DEBUG (ScheduledTrigger-10449-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 3251947 DEBUG (ScheduledTrigger-10449-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Tracking lost node: 127.0.0.1:10007_solr
[junit4] 2> 3251947 DEBUG (ScheduledTrigger-10449-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 2
[junit4] 2> 3251947 DEBUG (ScheduledTrigger-10449-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Tracking lost node: 127.0.0.1:10007_solr
[junit4] 2> 3251983 DEBUG (ScheduledTrigger-10449-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 3251983 DEBUG (ScheduledTrigger-10449-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 2
[junit4] 2> 3252003 DEBUG (ScheduledTrigger-10449-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 3252003 DEBUG (ScheduledTrigger-10449-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 2
[junit4] 2> 3252025 DEBUG (ScheduledTrigger-10449-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 3252025 DEBUG (ScheduledTrigger-10449-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 2
[junit4] 2> 3252048 DEBUG (ScheduledTrigger-10449-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 3252048 DEBUG (ScheduledTrigger-10449-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 2
[junit4] 2> 3252069 DEBUG (ScheduledTrigger-10449-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 3252069 DEBUG (ScheduledTrigger-10449-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 2
[junit4] 2> 3252091 DEBUG (ScheduledTrigger-10449-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 3252091 DEBUG (ScheduledTrigger-10449-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 2
[junit4] 2> 3252092 DEBUG (ScheduledTrigger-10449-thread-2) [ ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger firing registered processor for lost nodes: [127.0.0.1:10007_solr]
[junit4] 2> 3252092 DEBUG (ScheduledTrigger-10449-thread-2) [ ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
[junit4] 2> "id":"31a424fd5f6d0T5qdm1omq06vll1xv5jm0n5x4d",
[junit4] 2> "source":"node_lost_trigger",
[junit4] 2> "eventTime":873297039718096,
[junit4] 2> "eventType":"NODELOST",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[873297039718096],
[junit4] 2> "nodeNames":["127.0.0.1:10007_solr"]}}
[junit4] 2> 3252093 DEBUG (ScheduledTrigger-10449-thread-2) [ ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: [.auto_add_replicas, .scheduled_maintenance, node_lost_trigger]
[junit4] 2> 3252096 DEBUG (AutoscalingActionExecutor-10450-thread-1) [ ] o.a.s.c.a.ScheduledTriggers -- processing actions for {
[junit4] 2> "id":"31a424fd5f6d0T5qdm1omq06vll1xv5jm0n5x4d",
[junit4] 2> "source":"node_lost_trigger",
[junit4] 2> "eventTime":873297039718096,
[junit4] 2> "eventType":"NODELOST",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[873297039718096],
[junit4] 2> "_enqueue_time_":873304339638196,
[junit4] 2> "nodeNames":["127.0.0.1:10007_solr"]}}
[junit4] 2> 3252096 DEBUG (AutoscalingActionExecutor-10450-thread-1) [ ] o.a.s.c.a.ComputePlanAction -- processing event: {
[junit4] 2> "id":"31a424fd5f6d0T5qdm1omq06vll1xv5jm0n5x4d",
[junit4] 2> "source":"node_lost_trigger",
[junit4] 2> "eventTime":873297039718096,
[junit4] 2> "eventType":"NODELOST",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[873297039718096],
[junit4] 2> "_enqueue_time_":873304339638196,
[junit4] 2> "nodeNames":["127.0.0.1:10007_solr"]}} with context properties: {BEFORE_ACTION=[compute_plan]}
[junit4] 2> 3252096 DEBUG (AutoscalingActionExecutor-10450-thread-1) [ ] o.a.s.c.s.c.a.PolicyHelper Creating a new session
[junit4] 2> 3252097 DEBUG (AutoscalingActionExecutor-10450-thread-1) [ ] o.a.s.c.s.c.a.PolicyHelper New session created
[junit4] 2> 3252100 INFO (AutoscalingActionExecutor-10450-thread-1) [ ] o.a.s.c.a.ComputePlanAction Computed Plan: action=MOVEREPLICA&collection=testNodeLost&targetNode=127.0.0.1:10008_solr&inPlaceMove=true&replica=core_node1
[junit4] 2> 3252100 INFO (AutoscalingActionExecutor-10450-thread-1) [ ] o.a.s.c.s.c.a.PolicyHelper returnSession, curr-time 873304685 sessionWrapper.createTime 873304561370896, this.sessionWrapper.createTime 873304561370896
[junit4] 2> 3252100 DEBUG (AutoscalingActionExecutor-10450-thread-1) [ ] o.a.s.c.s.c.a.PolicyHelper session set to NULL
[junit4] 2> 3252103 INFO (TEST-TestComputePlanAction.testNodeLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.TestComputePlanAction -------------_ FINAL STATE --------------
[junit4] 2> 3252105 INFO (TEST-TestComputePlanAction.testNodeLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.TestComputePlanAction * Node values: {
[junit4] 2> "127.0.0.1:10006_solr":{
[junit4] 2> "sysprop.java.vendor":"Oracle Corporation",
[junit4] 2> "cores":1,
[junit4] 2> "host":"127.0.0.1",
[junit4] 2> "freedisk":999,
[junit4] 2> "sysprop.java.version":"1.8.0_144",
[junit4] 2> "ip_1":"127",
[junit4] 2> "ip_3":"0",
[junit4] 2> "ip_2":"0",
[junit4] 2> "ip_4":"1",
[junit4] 2> "node":"127.0.0.1:10006_solr",
[junit4] 2> "metrics:solr.jvm:buffers.direct.Count":0,
[junit4] 2> "port":10006,
[junit4] 2> "heapUsage":123450000,
[junit4] 2> "sysLoadAvg":1.0,
[junit4] 2> "metrics:solr.node:ADMIN./admin/authorization.clientErrors:count":0},
[junit4] 2> "127.0.0.1:10008_solr":{
[junit4] 2> "sysprop.java.vendor":"Oracle Corporation",
[junit4] 2> "cores":0,
[junit4] 2> "host":"127.0.0.1",
[junit4] 2> "freedisk":1000,
[junit4] 2> "sysprop.java.version":"1.8.0_144",
[junit4] 2> "ip_1":"127",
[junit4] 2> "ip_3":"0",
[junit4] 2> "ip_2":"0",
[junit4] 2> "ip_4":"1",
[junit4] 2> "node":"127.0.0.1:10008_solr",
[junit4] 2> "metrics:solr.jvm:buffers.direct.Count":0,
[junit4] 2> "port":10008,
[junit4] 2> "heapUsage":123450000,
[junit4] 2> "sysLoadAvg":1.0,
[junit4] 2> "metrics:solr.node:ADMIN./admin/authorization.clientErrors:count":0},
[junit4] 2> "127.0.0.1:10007_solr":{
[junit4] 2> "sysprop.java.vendor":"Oracle Corporation",
[junit4] 2> "cores":1,
[junit4] 2> "host":"127.0.0.1",
[junit4] 2> "freedisk":999,
[junit4] 2> "sysprop.java.version":"1.8.0_144",
[junit4] 2> "ip_1":"127",
[junit4] 2> "ip_3":"0",
[junit4] 2> "ip_2":"0",
[junit4] 2> "ip_4":"1",
[junit4] 2> "node":"127.0.0.1:10007_solr",
[junit4] 2> "metrics:solr.jvm:buffers.direct.Count":0,
[junit4] 2> "port":10007,
[junit4] 2> "heapUsage":123450000,
[junit4] 2> "sysLoadAvg":1.0,
[junit4] 2> "metrics:solr.node:ADMIN./admin/authorization.clientErrors:count":0}}
[junit4] 2> 3252106 INFO (TEST-TestComputePlanAction.testNodeLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.TestComputePlanAction * Live nodes: [127.0.0.1:10006_solr]
[junit4] 2> 3252106 INFO (TEST-TestComputePlanAction.testNodeLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.TestComputePlanAction * Collection testNodeLost state: DocCollection(testNodeLost//clusterstate.json/6)={
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "pullReplicas":"0",
[junit4] 2> "router":{"name":"compositeId"},
[junit4] 2> "maxShardsPerNode":"1",
[junit4] 2> "autoAddReplicas":"false",
[junit4] 2> "nrtReplicas":"2",
[junit4] 2> "tlogReplicas":"0",
[junit4] 2> "autoCreated":"true",
[junit4] 2> "shards":{"shard1":{
[junit4] 2> "replicas":{
[junit4] 2> "core_node1":{
[junit4] 2> "node_name":"127.0.0.1:10007_solr",
[junit4] 2> "core":"testNodeLost_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "type":"NRT",
[junit4] 2> "INDEX.sizeInBytes":1},
[junit4] 2> "core_node2":{
[junit4] 2> "core":"testNodeLost_shard1_replica_n2",
[junit4] 2> "leader":"true",
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10006_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT"}},
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active"}}}
[junit4] 2> 3252107 INFO (TEST-TestComputePlanAction.testNodeLost-seed#[4BE996DD454D339A]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testNodeLost
[junit4] 2> 3252107 INFO (TEST-TestComputePlanAction.testNodeLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase
[junit4] 2>
[junit4] 2> 3252107 INFO (TEST-TestComputePlanAction.testNodeLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase #############################################
[junit4] 2> 3252107 INFO (TEST-TestComputePlanAction.testNodeLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ############ FINAL CLUSTER STATS ############
[junit4] 2> 3252107 INFO (TEST-TestComputePlanAction.testNodeLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase #############################################
[junit4] 2>
[junit4] 2> 3252107 INFO (TEST-TestComputePlanAction.testNodeLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Live nodes: 1
[junit4] 2> 3252107 INFO (TEST-TestComputePlanAction.testNodeLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Empty nodes: 0
[junit4] 2> 3252108 INFO (TEST-TestComputePlanAction.testNodeLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Dead nodes: 2
[junit4] 2> 3252108 INFO (TEST-TestComputePlanAction.testNodeLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## 127.0.0.1:10007_solr
[junit4] 2> 3252108 INFO (TEST-TestComputePlanAction.testNodeLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## 127.0.0.1:10008_solr
[junit4] 2> 3252108 INFO (TEST-TestComputePlanAction.testNodeLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Collections: [testNodeLost]
[junit4] 2> 3252108 INFO (TEST-TestComputePlanAction.testNodeLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Max replicas per node: 1
[junit4] 2> 3252108 INFO (TEST-TestComputePlanAction.testNodeLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Min replicas per node: 1
[junit4] 2> 3252108 INFO (TEST-TestComputePlanAction.testNodeLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Total replicas: 1
[junit4] 2> 3252108 INFO (TEST-TestComputePlanAction.testNodeLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## * testNodeLost 1
[junit4] 2> 3252110 DEBUG (AutoscalingActionExecutor-10450-thread-1) [ ] o.a.s.c.a.ScheduledTriggers Resuming trigger: .auto_add_replicas after 100ms
[junit4] 2> 3252110 INFO (TEST-TestComputePlanAction.testNodeLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - active 1
[junit4] 2> 3252110 INFO (TEST-TestComputePlanAction.testNodeLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ######### Final Solr op counts ##########
[junit4] 2> 3252110 DEBUG (AutoscalingActionExecutor-10450-thread-1) [ ] o.a.s.c.a.ScheduledTriggers Resuming trigger: .scheduled_maintenance after 100ms
[junit4] 2> 3252110 INFO (TEST-TestComputePlanAction.testNodeLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - CREATE 1
[junit4] 2> 3252110 DEBUG (AutoscalingActionExecutor-10450-thread-1) [ ] o.a.s.c.a.ScheduledTriggers Resuming trigger: node_lost_trigger after 100ms
[junit4] 2> 3252110 INFO (TEST-TestComputePlanAction.testNodeLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - autoscaling 3
[junit4] 2> 3252110 DEBUG (AutoscalingActionExecutor-10450-thread-1) [ ] o.a.s.c.a.ScheduledTriggers -- processing took 726 ms for event id=31a424fd5f6d0T5qdm1omq06vll1xv5jm0n5x4d
[junit4] 2> 3252110 INFO (TEST-TestComputePlanAction.testNodeLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - update 4
[junit4] 2> 3252110 INFO (TEST-TestComputePlanAction.testNodeLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ######### Autoscaling event counts ###########
[junit4] 2> 3252110 INFO (TEST-TestComputePlanAction.testNodeLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## * Trigger: node_lost_trigger
[junit4] 2> 3252110 INFO (TEST-TestComputePlanAction.testNodeLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - AFTER_ACTION 1
[junit4] 2> 3252110 INFO (TEST-TestComputePlanAction.testNodeLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - BEFORE_ACTION 1
[junit4] 2> 3252111 INFO (TEST-TestComputePlanAction.testNodeLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - STARTED 1
[junit4] 2> 3252111 INFO (TEST-TestComputePlanAction.testNodeLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - SUCCEEDED 1
[junit4] 2> 3252211 INFO (TEST-TestComputePlanAction.testNodeWithMultipleReplicasLost-seed#[4BE996DD454D339A]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testNodeWithMultipleReplicasLost
[junit4] 2> 3252211 DEBUG (TEST-TestComputePlanAction.testNodeWithMultipleReplicasLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 13
[junit4] 2> 3252211 DEBUG (ScheduledTrigger-10449-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 3252211 DEBUG (ScheduledTrigger-10449-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Tracking lost node: 127.0.0.1:10008_solr
[junit4] 2> 3252212 DEBUG (ScheduledTrigger-10449-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 1
[junit4] 2> 3252212 DEBUG (TEST-TestComputePlanAction.testNodeWithMultipleReplicasLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimNodeStateProvider - removing dead node values: 127.0.0.1:10008_solr
[junit4] 2> 3252212 DEBUG (TEST-TestComputePlanAction.testNodeWithMultipleReplicasLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimNodeStateProvider - removing dead node values: 127.0.0.1:10007_solr
[junit4] 2> 3252212 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 13
[junit4] 2> 3252212 INFO (TEST-TestComputePlanAction.testNodeWithMultipleReplicasLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimCloudManager === Restarting OverseerTriggerThread and clearing object cache...
[junit4] 2> 3252212 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 3252212 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 3252212 DEBUG (TEST-TestComputePlanAction.testNodeWithMultipleReplicasLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
[junit4] 2> 3252213 WARN (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Interrupted
[junit4] 2> java.lang.InterruptedException
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireInterruptibly(AbstractQueuedSynchronizer.java:1220)
[junit4] 2> at java.util.concurrent.locks.ReentrantLock.lockInterruptibly(ReentrantLock.java:335)
[junit4] 2> at org.apache.solr.cloud.autoscaling.OverseerTriggerThread.run(OverseerTriggerThread.java:165)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 3252215 DEBUG (ScheduledTrigger-10449-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Tracking lost node: 127.0.0.1:10008_solr
[junit4] 2> 3252221 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and .scheduled_maintenance triggers
[junit4] 2> 3252222 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 14
[junit4] 2> 3252223 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:10006_solr]
[junit4] 2> 3252223 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 14, lastZnodeVersion -1
[junit4] 2> 3252223 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 14
[junit4] 2> 3252223 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 3252224 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 14, lastZnodeVersion 14
[junit4] 2> 3252230 DEBUG (ScheduledTrigger-10452-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 3252256 DEBUG (ScheduledTrigger-10452-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 3252277 DEBUG (ScheduledTrigger-10452-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 3252298 DEBUG (ScheduledTrigger-10452-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 3252319 DEBUG (ScheduledTrigger-10452-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 3252328 DEBUG (simCloudManagerPool-10451-thread-1) [ ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 3252328 DEBUG (simCloudManagerPool-10451-thread-1) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 15
[junit4] 2> 3252329 DEBUG (simCloudManagerPool-10451-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:10006_solr]
[junit4] 2> 3252329 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 15
[junit4] 2> 3252330 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 3252330 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 15, lastZnodeVersion 15
[junit4] 2> 3252333 DEBUG (simCloudManagerPool-10451-thread-2) [ ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 3252333 DEBUG (simCloudManagerPool-10451-thread-2) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 16
[junit4] 2> 3252334 DEBUG (simCloudManagerPool-10451-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:10006_solr]
[junit4] 2> 3252334 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 16
[junit4] 2> 3252334 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 3252334 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 16, lastZnodeVersion 16
[junit4] 2> 3252342 DEBUG (ScheduledTrigger-10452-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 3252363 DEBUG (ScheduledTrigger-10452-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 3252387 DEBUG (ScheduledTrigger-10452-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 3252415 DEBUG (ScheduledTrigger-10452-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 3252435 DEBUG (ScheduledTrigger-10452-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 3252449 DEBUG (simCloudManagerPool-10451-thread-3) [ ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 3252449 DEBUG (simCloudManagerPool-10451-thread-3) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 17
[junit4] 2> 3252449 DEBUG (simCloudManagerPool-10451-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:10006_solr, 127.0.0.1:10010_solr, 127.0.0.1:10009_solr, 127.0.0.1:10011_solr]
[junit4] 2> 3252450 DEBUG (simCloudManagerPool-10451-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:10006_solr, 127.0.0.1:10010_solr, 127.0.0.1:10009_solr, 127.0.0.1:10011_solr]
[junit4] 2> 3252450 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 17
[junit4] 2> 3252450 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 3252450 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 17, lastZnodeVersion 17
[junit4] 2> 3252451 DEBUG (ScheduledTrigger-10452-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 4
[junit4] 2> 3252451 DEBUG (ScheduledTrigger-10452-thread-1) [ ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger firing registered processor for lost nodes: [127.0.0.1:10008_solr]
[junit4] 2> 3252452 DEBUG (ScheduledTrigger-10452-thread-1) [ ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
[junit4] 2> "id":"31a456ee86794T5qdm1omq06vll1xv5jm0n5x4i",
[junit4] 2> "source":"node_lost_trigger",
[junit4] 2> "eventTime":873310445922196,
[junit4] 2> "eventType":"NODELOST",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[873310445922196],
[junit4] 2> "nodeNames":["127.0.0.1:10008_solr"]}}
[junit4] 2> 3252452 DEBUG (simCloudManagerPool-10451-thread-4) [ ] o.a.s.c.o.ClusterStateMutator building a new cName: testNodeWithMultipleReplicasLost
[junit4] 2> 3252453 DEBUG (ScheduledTrigger-10452-thread-1) [ ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: [.auto_add_replicas, .scheduled_maintenance, node_lost_trigger]
[junit4] 2> 3252456 DEBUG (AutoscalingActionExecutor-10453-thread-1) [ ] o.a.s.c.a.ScheduledTriggers -- processing actions for {
[junit4] 2> "id":"31a456ee86794T5qdm1omq06vll1xv5jm0n5x4i",
[junit4] 2> "source":"node_lost_trigger",
[junit4] 2> "eventTime":873310445922196,
[junit4] 2> "eventType":"NODELOST",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[873310445922196],
[junit4] 2> "_enqueue_time_":873322324433846,
[junit4] 2> "nodeNames":["127.0.0.1:10008_solr"]}}
[junit4] 2> 3252456 DEBUG (AutoscalingActionExecutor-10453-thread-1) [ ] o.a.s.c.a.ComputePlanAction -- processing event: {
[junit4] 2> "id":"31a456ee86794T5qdm1omq06vll1xv5jm0n5x4i",
[junit4] 2> "source":"node_lost_trigger",
[junit4] 2> "eventTime":873310445922196,
[junit4] 2> "eventType":"NODELOST",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[873310445922196],
[junit4] 2> "_enqueue_time_":873322324433846,
[junit4] 2> "nodeNames":["127.0.0.1:10008_solr"]}} with context properties: {BEFORE_ACTION=[compute_plan]}
[junit4] 2> 3252456 DEBUG (AutoscalingActionExecutor-10453-thread-1) [ ] o.a.s.c.s.c.a.PolicyHelper Creating a new session
[junit4] 2> 3252456 DEBUG (AutoscalingActionExecutor-10453-thread-1) [ ] o.a.s.c.s.c.a.PolicyHelper New session created
[junit4] 2> 3252456 INFO (AutoscalingActionExecutor-10453-thread-1) [ ] o.a.s.c.s.c.a.PolicyHelper returnSession, curr-time 873322507 sessionWrapper.createTime 873322496133496, this.sessionWrapper.createTime 873322496133496
[junit4] 2> 3252456 DEBUG (AutoscalingActionExecutor-10453-thread-1) [ ] o.a.s.c.s.c.a.PolicyHelper session set to NULL
[junit4] 2> 3252462 DEBUG (AutoscalingActionExecutor-10453-thread-1) [ ] o.a.s.c.a.ScheduledTriggers Resuming trigger: .auto_add_replicas after 100ms
[junit4] 2> 3252462 DEBUG (AutoscalingActionExecutor-10453-thread-1) [ ] o.a.s.c.a.ScheduledTriggers Resuming trigger: .scheduled_maintenance after 100ms
[junit4] 2> 3252462 DEBUG (AutoscalingActionExecutor-10453-thread-1) [ ] o.a.s.c.a.ScheduledTriggers Resuming trigger: node_lost_trigger after 100ms
[junit4] 2> 3252462 DEBUG (AutoscalingActionExecutor-10453-thread-1) [ ] o.a.s.c.a.ScheduledTriggers -- processing took 337 ms for event id=31a456ee86794T5qdm1omq06vll1xv5jm0n5x4i
[junit4] 2> 3252466 DEBUG (simCloudManagerPool-10451-thread-4) [ ] o.a.s.c.s.c.a.PolicyHelper Creating a new session
[junit4] 2> 3252466 DEBUG (simCloudManagerPool-10451-thread-4) [ ] o.a.s.c.s.c.a.PolicyHelper New session created
[junit4] 2> 3252468 INFO (simCloudManagerPool-10451-thread-4) [ ] o.a.s.c.s.c.a.PolicyHelper returnSession, curr-time 873323064 sessionWrapper.createTime 873322980514846, this.sessionWrapper.createTime 873322980514846
[junit4] 2> 3252468 DEBUG (simCloudManagerPool-10451-thread-4) [ ] o.a.s.c.s.c.a.PolicyHelper session set to NULL
[junit4] 2> 3252537 DEBUG (TEST-TestComputePlanAction.testNodeWithMultipleReplicasLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.TestComputePlanAction -- cluster state: znodeVersion: 11
[junit4] 2> live nodes:[127.0.0.1:10006_solr, 127.0.0.1:10010_solr, 127.0.0.1:10009_solr, 127.0.0.1:10011_solr]
[junit4] 2> collections:{testNodeWithMultipleReplicasLost=DocCollection(testNodeWithMultipleReplicasLost//clusterstate.json/10)={
[junit4] 2> "replicationFactor":"3",
[junit4] 2> "pullReplicas":"0",
[junit4] 2> "router":{"name":"compositeId"},
[junit4] 2> "maxShardsPerNode":"1",
[junit4] 2> "autoAddReplicas":"false",
[junit4] 2> "nrtReplicas":"3",
[junit4] 2> "tlogReplicas":"0",
[junit4] 2> "autoCreated":"true",
[junit4] 2> "shards":{
[junit4] 2> "shard2":{
[junit4] 2> "replicas":{
[junit4] 2> "core_node6":{
[junit4] 2> "node_name":"127.0.0.1:10009_solr",
[junit4] 2> "core":"testNodeWithMultipleReplicasLost_shard2_replica_n6",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "INDEX.sizeInBytes":1},
[junit4] 2> "core_node4":{
[junit4] 2> "node_name":"127.0.0.1:10006_solr",
[junit4] 2> "core":"testNodeWithMultipleReplicasLost_shard2_replica_n4",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "INDEX.sizeInBytes":1},
[junit4] 2> "core_node5":{
[junit4] 2> "node_name":"127.0.0.1:10010_solr",
[junit4] 2> "core":"testNodeWithMultipleReplicasLost_shard2_replica_n5",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "INDEX.sizeInBytes":1}},
[junit4] 2> "range":"0-7fffffff",
[junit4] 2> "state":"active"},
[junit4] 2> "shard1":{
[junit4] 2> "replicas":{
[junit4] 2> "core_node1":{
[junit4] 2> "node_name":"127.0.0.1:10011_solr",
[junit4] 2> "core":"testNodeWithMultipleReplicasLost_shard1_replica_n1",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "INDEX.sizeInBytes":1},
[junit4] 2> "core_node2":{
[junit4] 2> "node_name":"127.0.0.1:10009_solr",
[junit4] 2> "core":"testNodeWithMultipleReplicasLost_shard1_replica_n2",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "INDEX.sizeInBytes":1},
[junit4] 2> "core_node3":{
[junit4] 2> "node_name":"127.0.0.1:10010_solr",
[junit4] 2> "core":"testNodeWithMultipleReplicasLost_shard1_replica_n3",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "INDEX.sizeInBytes":1}},
[junit4] 2> "range":"80000000-ffffffff",
[junit4] 2> "state":"active"}}}}
[junit4] 2> 3252541 INFO (TEST-TestComputePlanAction.testNodeWithMultipleReplicasLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.TestComputePlanAction -------------_ FINAL STATE --------------
[junit4] 2> 3252541 DEBUG (simCloudManagerPool-10451-thread-15) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testNodeWithMultipleReplicasLost / shard2: {"core_node6":{
[junit4] 2> "node_name":"127.0.0.1:10009_solr",
[junit4] 2> "core":"testNodeWithMultipleReplicasLost_shard2_replica_n6",
[junit4] 2> "leader":"true",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"testNodeWithMultipleReplicasLost"}}
[junit4] 2> 3252541 INFO (TEST-TestComputePlanAction.testNodeWithMultipleReplicasLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.TestComputePlanAction * Node values: {
[junit4] 2> "127.0.0.1:10006_solr":{
[junit4] 2> "sysprop.java.vendor":"Oracle Corporation",
[junit4] 2> "cores":1,
[junit4] 2> "host":"127.0.0.1",
[junit4] 2> "freedisk":999,
[junit4] 2> "sysprop.java.version":"1.8.0_144",
[junit4] 2> "ip_1":"127",
[junit4] 2> "ip_3":"0",
[junit4] 2> "ip_2":"0",
[junit4] 2> "ip_4":"1",
[junit4] 2> "node":"127.0.0.1:10006_solr",
[junit4] 2> "metrics:solr.jvm:buffers.direct.Count":0,
[junit4] 2> "port":10006,
[junit4] 2> "heapUsage":123450000,
[junit4] 2> "sysLoadAvg":1.0,
[junit4] 2> "metrics:solr.node:ADMIN./admin/authorization.clientErrors:count":0},
[junit4] 2> "127.0.0.1:10010_solr":{
[junit4] 2> "sysprop.java.vendor":"Oracle Corporation",
[junit4] 2> "cores":2,
[junit4] 2> "host":"127.0.0.1",
[junit4] 2> "freedisk":998,
[junit4] 2> "sysprop.java.version":"1.8.0_144",
[junit4] 2> "ip_1":"127",
[junit4] 2> "ip_3":"0",
[junit4] 2> "ip_2":"0",
[junit4] 2> "ip_4":"1",
[junit4] 2> "node":"127.0.0.1:10010_solr",
[junit4] 2> "metrics:solr.jvm:buffers.direct.Count":0,
[junit4] 2> "port":10010,
[junit4] 2> "heapUsage":123450000,
[junit4] 2> "sysLoadAvg":1.0,
[junit4] 2> "metrics:solr.node:ADMIN./admin/authorization.clientErrors:count":0},
[junit4] 2> "127.0.0.1:10009_solr":{
[junit4] 2> "sysprop.java.vendor":"Oracle Corporation",
[junit4] 2> "cores":2,
[junit4] 2> "host":"127.0.0.1",
[junit4] 2> "freedisk":998,
[junit4] 2> "sysprop.java.version":"1.8.0_144",
[junit4] 2> "ip_1":"127",
[junit4] 2> "ip_3":"0",
[junit4] 2> "ip_2":"0",
[junit4] 2> "ip_4":"1",
[junit4] 2> "node":"127.0.0.1:10009_solr",
[junit4] 2> "metrics:solr.jvm:buffers.direct.Count":0,
[junit4] 2> "port":10009,
[junit4] 2> "heapUsage":123450000,
[junit4] 2> "sysLoadAvg":1.0,
[junit4] 2> "metrics:solr.node:ADMIN./admin/authorization.clientErrors:count":0},
[junit4] 2> "127.0.0.1:10011_solr":{
[junit4] 2> "sysprop.java.vendor":"Oracle Corporation",
[junit4] 2> "cores":1,
[junit4] 2> "host":"127.0.0.1",
[junit4] 2> "freedisk":999,
[junit4] 2> "sysprop.java.version":"1.8.0_144",
[junit4] 2> "ip_1":"127",
[junit4] 2> "ip_3":"0",
[junit4] 2> "ip_2":"0",
[junit4] 2> "ip_4":"1",
[junit4] 2> "node":"127.0.0.1:10011_solr",
[junit4] 2> "metrics:solr.jvm:buffers.direct.Count":0,
[junit4] 2> "port":10011,
[junit4] 2> "heapUsage":123450000,
[junit4] 2> "sysLoadAvg":1.0,
[junit4] 2> "metrics:solr.node:ADMIN./admin/authorization.clientErrors:count":0}}
[junit4] 2> 3252542 INFO (TEST-TestComputePlanAction.testNodeWithMultipleReplicasLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.TestComputePlanAction * Live nodes: [127.0.0.1:10006_solr, 127.0.0.1:10009_solr, 127.0.0.1:10011_solr]
[junit4] 2> 3252541 DEBUG (simCloudManagerPool-10451-thread-16) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testNodeWithMultipleReplicasLost / shard1: {"core_node1":{
[junit4] 2> "node_name":"127.0.0.1:10011_solr",
[junit4] 2> "core":"testNodeWithMultipleReplicasLost_shard1_replica_n1",
[junit4] 2> "leader":"true",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testNodeWithMultipleReplicasLost"}}
[junit4] 2> 3252542 INFO (TEST-TestComputePlanAction.testNodeWithMultipleReplicasLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.TestComputePlanAction * Collection testNodeWithMultipleReplicasLost state: DocCollection(testNodeWithMultipleReplicasLost//clusterstate.json/12)={
[junit4] 2> "replicationFactor":"3",
[junit4] 2> "pullReplicas":"0",
[junit4] 2> "router":{"name":"compositeId"},
[junit4] 2> "maxShardsPerNode":"1",
[junit4] 2> "autoAddReplicas":"false",
[junit4] 2> "nrtReplicas":"3",
[junit4] 2> "tlogReplicas":"0",
[junit4] 2> "autoCreated":"true",
[junit4] 2> "shards":{
[junit4] 2> "shard2":{
[junit4] 2> "replicas":{
[junit4] 2> "core_node6":{
[junit4] 2> "core":"testNodeWithMultipleReplicasLost_shard2_replica_n6",
[junit4] 2> "leader":"true",
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10009_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT"},
[junit4] 2> "core_node4":{
[junit4] 2> "node_name":"127.0.0.1:10006_solr",
[junit4] 2> "core":"testNodeWithMultipleReplicasLost_shard2_replica_n4",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "INDEX.sizeInBytes":1},
[junit4] 2> "core_node5":{
[junit4] 2> "node_name":"127.0.0.1:10010_solr",
[junit4] 2> "core":"testNodeWithMultipleReplicasLost_shard2_replica_n5",
[junit4] 2> "state":"down",
[junit4] 2> "type":"NRT",
[junit4] 2> "INDEX.sizeInBytes":1}},
[junit4] 2> "range":"0-7fffffff",
[junit4] 2> "state":"active"},
[junit4] 2> "shard1":{
[junit4] 2> "replicas":{
[junit4] 2> "core_node1":{
[junit4] 2> "core":"testNodeWithMultipleReplicasLost_shard1_replica_n1",
[junit4] 2> "leader":"true",
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10011_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT"},
[junit4] 2> "core_node2":{
[junit4] 2> "node_name":"127.0.0.1:10009_solr",
[junit4] 2> "core":"testNodeWithMultipleReplicasLost_shard1_replica_n2",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "INDEX.sizeInBytes":1},
[junit4] 2> "core_node3":{
[junit4] 2> "node_name":"127.0.0.1:10010_solr",
[junit4] 2> "core":"testNodeWithMultipleReplicasLost_shard1_replica_n3",
[junit4] 2> "state":"down",
[junit4] 2> "type":"NRT",
[junit4] 2> "INDEX.sizeInBytes":1}},
[junit4] 2> "range":"80000000-ffffffff",
[junit4] 2> "state":"active"}}}
[junit4] 2> 3252542 INFO (TEST-TestComputePlanAction.testNodeWithMultipleReplicasLost-seed#[4BE996DD454D339A]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testNodeWithMultipleReplicasLost
[junit4] 2> 3252542 INFO (TEST-TestComputePlanAction.testNodeWithMultipleReplicasLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase
[junit4] 2>
[junit4] 2> 3252542 INFO (TEST-TestComputePlanAction.testNodeWithMultipleReplicasLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase #############################################
[junit4] 2> 3252542 INFO (TEST-TestComputePlanAction.testNodeWithMultipleReplicasLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ############ FINAL CLUSTER STATS ############
[junit4] 2> 3252542 INFO (TEST-TestComputePlanAction.testNodeWithMultipleReplicasLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase #############################################
[junit4] 2>
[junit4] 2> 3252542 INFO (TEST-TestComputePlanAction.testNodeWithMultipleReplicasLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Live nodes: 3
[junit4] 2> 3252542 INFO (TEST-TestComputePlanAction.testNodeWithMultipleReplicasLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Empty nodes: 0
[junit4] 2> 3252543 INFO (TEST-TestComputePlanAction.testNodeWithMultipleReplicasLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Dead nodes: 1
[junit4] 2> 3252543 INFO (TEST-TestComputePlanAction.testNodeWithMultipleReplicasLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## 127.0.0.1:10010_solr
[junit4] 2> 3252543 INFO (TEST-TestComputePlanAction.testNodeWithMultipleReplicasLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Collections: [testNodeWithMultipleReplicasLost]
[junit4] 2> 3252543 INFO (TEST-TestComputePlanAction.testNodeWithMultipleReplicasLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Max replicas per node: 2
[junit4] 2> 3252543 INFO (TEST-TestComputePlanAction.testNodeWithMultipleReplicasLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Min replicas per node: 1
[junit4] 2> 3252543 INFO (TEST-TestComputePlanAction.testNodeWithMultipleReplicasLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Total replicas: 4
[junit4] 2> 3252543 INFO (TEST-TestComputePlanAction.testNodeWithMultipleReplicasLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## * testNodeWithMultipleReplicasLost 4
[junit4] 2> 3252543 INFO (TEST-TestComputePlanAction.testNodeWithMultipleReplicasLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - active 4
[junit4] 2> 3252543 INFO (TEST-TestComputePlanAction.testNodeWithMultipleReplicasLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ######### Final Solr op counts ##########
[junit4] 2> 3252543 INFO (TEST-TestComputePlanAction.testNodeWithMultipleReplicasLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - CREATE 1
[junit4] 2> 3252543 INFO (TEST-TestComputePlanAction.testNodeWithMultipleReplicasLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - autoscaling 3
[junit4] 2> 3252543 INFO (TEST-TestComputePlanAction.testNodeWithMultipleReplicasLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - update 4
[junit4] 2> 3252543 INFO (TEST-TestComputePlanAction.testNodeWithMultipleReplicasLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ######### Autoscaling event counts ###########
[junit4] 2> 3252543 INFO (TEST-TestComputePlanAction.testNodeWithMultipleReplicasLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## * Trigger: node_lost_trigger
[junit4] 2> 3252543 INFO (TEST-TestComputePlanAction.testNodeWithMultipleReplicasLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - AFTER_ACTION 1
[junit4] 2> 3252543 INFO (TEST-TestComputePlanAction.testNodeWithMultipleReplicasLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - BEFORE_ACTION 1
[junit4] 2> 3252543 INFO (TEST-TestComputePlanAction.testNodeWithMultipleReplicasLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - STARTED 1
[junit4] 2> 3252543 INFO (TEST-TestComputePlanAction.testNodeWithMultipleReplicasLost-seed#[4BE996DD454D339A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - SUCCEEDED 1
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestComputePlanAction -Dtests.method=testNodeWithMultipleReplicasLost -Dtests.seed=4BE996DD454D339A -Dtests.slow=true -Dtests.locale=ar -Dtests.timezone=Asia/Irkutsk -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[junit4] FAILURE 0.44s J1 | TestComputePlanAction.tes
[...truncated too long message...]
"nodeNames":["127.0.0.1:10008_solr"]}}
[junit4] > at __randomizedtesting.SeedInfo.seed([4BE996DD454D339A:7B29775FCD3FD2C6]:0)
[junit4] > at org.apache.solr.cloud.autoscaling.sim.TestComputePlanAction.testNodeWithMultipleReplicasLost(TestComputePlanAction.java:240)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 3252557 WARN (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 3252558 DEBUG (SUITE-TestComputePlanAction-seed#[4BE996DD454D339A]-worker) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
[junit4] 2> NOTE: leaving temporary files on disk at: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.sim.TestComputePlanAction_4BE996DD454D339A-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=485, maxMBSortInHeap=5.696187596170809, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@3145ef3), locale=ar, timezone=Asia/Irkutsk
[junit4] 2> NOTE: Mac OS X 10.11.6 x86_64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=3,threads=1,free=184502472,total=520093696
[junit4] 2> NOTE: All tests run in this JVM: [TestFuzzyAnalyzedSuggestions, SpellPossibilityIteratorTest, RegexBoostProcessorTest, ResponseHeaderTest, LoggingHandlerTest, TestStressRecovery, TestZkAclsWithHadoopAuth, TestCollectionAPI, TestSolrConfigHandler, BasicFunctionalityTest, SliceStateTest, TestCollectionAPIs, NoCacheHeaderTest, ConfigureRecoveryStrategyTest, TestInPlaceUpdatesStandalone, ChaosMonkeySafeLeaderTest, TestQueryWrapperFilter, TestBadConfig, TestSolrCoreProperties, TestStressReorder, RankQueryTest, AddBlockUpdateTest, TestStressCloudBlindAtomicUpdates, TestLockTree, TestSolrQueryParser, CdcrReplicationDistributedZkTest, PeerSyncReplicationTest, TestCloudDeleteByQuery, TimeZoneUtilsTest, TestPolicyCloud, TestConfigReload, TestMultiValuedNumericRangeQuery, SolrMetricManagerTest, BadIndexSchemaTest, LargeFieldTest, TestTrackingShardHandlerFactory, TestRandomFaceting, TestSolrCloudSnapshots, TestHdfsBackupRestoreCore, TestLegacyFieldCache, TestSearchPerf, BJQParserTest, TestFilteredDocIdSet, TestDistributedMap, DistributedSuggestComponentTest, TestComplexPhraseLeadingWildcard, SortByFunctionTest, BlockJoinFacetRandomTest, QueryParsingTest, BlockCacheTest, TestOrdValues, SolrJmxReporterTest, ShardRoutingTest, TestConfig, NodeMutatorTest, TestReplicaProperties, HdfsUnloadDistributedZkTest, IndexBasedSpellCheckerTest, TestStressLucene, DefaultValueUpdateProcessorTest, SearchRateTriggerTest, ChaosMonkeyNothingIsSafeWithPullReplicasTest, MoveReplicaHDFSFailoverTest, ExternalFileFieldSortTest, HdfsRestartWhileUpdatingTest, TestShardHandlerFactory, TestAnalyzedSuggestions, TestFreeTextSuggestions, TestConfigSets, TestRawResponseWriter, TestWriterPerf, CircularListTest, SuggestComponentContextFilterQueryTest, SolrGraphiteReporterTest, EchoParamsTest, TestRandomFlRTGCloud, TestNonDefinedSimilarityFactory, AddReplicaTest, TestRTGBase, MetricsConfigTest, TestStressLiveNodes, TestUpdate, RestartWhileUpdatingTest, DisMaxRequestHandlerTest, TestNRTOpen, TestComponentsName, AnalyticsMergeStrategyTest, CurrencyRangeFacetCloudTest, TestConfigSetsAPIZkFailure, TestDocSet, VersionInfoTest, GraphQueryTest, CSVRequestHandlerTest, InfixSuggestersTest, HdfsLockFactoryTest, TestCodecSupport, StressHdfsTest, TestOnReconnectListenerSupport, TestCrossCoreJoin, TestRecoveryHdfs, TestSQLHandler, PKIAuthenticationIntegrationTest, TestLegacyNumericRangeQueryBuilder, TestDocBasedVersionConstraints, AutoScalingHandlerTest, HdfsBasicDistributedZkTest, TestCustomDocTransformer, SecurityConfHandlerTest, ParsingFieldUpdateProcessorsTest, TestSimpleTrackingShardHandler, TestSlowCompositeReaderWrapper, HighlighterConfigTest, TestPointFields, TolerantUpdateProcessorTest, TestPolicyCloud, SuggesterTest, TestLuceneMatchVersion, V2StandaloneTest, TestHashPartitioner, DistanceFunctionTest, TestUniqueKeyFieldResource, TestMacros, CdcrUpdateLogTest, SharedFSAutoReplicaFailoverTest, AssignBackwardCompatibilityTest, DocValuesTest, MoveReplicaTest, PreAnalyzedFieldManagedSchemaCloudTest, SimplePostToolTest, TestSmileRequest, TestValueSourceCache, OverseerStatusTest, TestReqParamsAPI, PeerSyncWithIndexFingerprintCachingTest, LeaderVoteWaitTimeoutTest, TestXmlQParserPlugin, DirectUpdateHandlerTest, TestSearcherReuse, TestAddFieldRealTimeGet, HdfsDirectoryFactoryTest, TestFastWriter, TestDeleteCollectionOnDownNodes, TestIndexingPerformance, BasicDistributedZk2Test, TestNamedUpdateProcessors, TestRetrieveFieldsOptimizer, MinimalSchemaTest, TestRebalanceLeaders, TestGeoJSONResponseWriter, TestUtilizeNode, ShowFileRequestHandlerTest, LeaderFailoverAfterPartitionTest, JsonLoaderTest, TestTolerantUpdateProcessorCloud, ConnectionManagerTest, TestSolrCoreParser, IndexSchemaTest, UpdateRequestProcessorFactoryTest, CoreAdminCreateDiscoverTest, ExecutePlanActionTest, HttpPartitionTest, NotRequiredUniqueKeyTest, TestExtendedDismaxParser, TermVectorComponentTest, TestPayloadCheckQParserPlugin, TestAtomicUpdateErrorCases, OverseerModifyCollectionTest, ZkSolrClientTest, OverriddenZkACLAndCredentialsProvidersTest, DeleteLastCustomShardedReplicaTest, ScriptEngineTest, TestAuthenticationFramework, ImplicitSnitchTest, SpellCheckCollatorTest, SystemInfoHandlerTest, SpellCheckComponentTest, TestSolrConfigHandlerCloud, TestShortCircuitedRequests, ClassificationUpdateProcessorTest, TestHttpShardHandlerFactory, ZkControllerTest, SmileWriterTest, NodeAddedTriggerTest, SearchHandlerTest, TestNumericTerms64, ChaosMonkeyNothingIsSafeTest, BasicDistributedZkTest, TestRealTimeGet, TestJoin, TestCoreContainer, SimpleFacetsTest, SolrCoreTest, SolrCmdDistributorTest, TestSort, TestFunctionQuery, TestLazyCores, TestCoreDiscovery, AnalysisAfterCoreReloadTest, SignatureUpdateProcessorFactoryTest, CoreAdminHandlerTest, TestFoldingMultitermQuery, TestTrie, SpatialFilterTest, SuggesterWFSTTest, TestCSVLoader, SolrCoreCheckLockOnStartupTest, TestPseudoReturnFields, TestWordDelimiterFilterFactory, DirectUpdateHandlerOptimizeTest, StatelessScriptUpdateProcessorFactoryTest, DocValuesMultiTest, TestSolrDeletionPolicy1, XsltUpdateRequestHandlerTest, DebugComponentTest, TestSurroundQueryParser, DirectSolrSpellCheckerTest, TestReversedWildcardFilterFactory, DocumentAnalysisRequestHandlerTest, TestQueryTypes, PrimitiveFieldTypeTest, TestOmitPositions, FileBasedSpellCheckerTest, TermsComponentTest, XmlUpdateRequestHandlerTest, RequestHandlersTest, DocumentBuilderTest, PathHierarchyTokenizerFactoryTest, RequiredFieldsTest, FieldAnalysisRequestHandlerTest, IndexSchemaRuntimeFieldTest, TestJmxIntegration, TestCollationField, ReturnFieldsTest, TestCSVResponseWriter, MBeansHandlerTest, UniqFieldsUpdateProcessorFactoryTest, TestPartialUpdateDeduplication, TestPHPSerializedResponseWriter, SearchHandlerTest, TestLFUCache, TestSolrDeletionPolicy2, TestElisionMultitermQuery, TestPostingsSolrHighlighter, SynonymTokenizerTest, TestDFRSimilarityFactory, TestLMDirichletSimilarityFactory, TestLMJelinekMercerSimilarityFactory, TestIBSimilarityFactory, ResourceLoaderTest, PluginInfoTest, TestFastLRUCache, DateMathParserTest, TestSystemIdResolver, PrimUtilsTest, DateFieldTest, DOMUtilTest, ClusterStateTest, TestLRUCache, TestDocumentBuilder, FileUtilsTest, CursorPagingTest, TestDistributedMissingSort, ConnectionReuseTest, CleanupOldIndexTest, CollectionsAPISolrJTest, DeleteNodeTest, DeleteReplicaTest, DistribDocExpirationUpdateProcessorTest, DocValuesNotIndexedTest, HealthCheckHandlerTest, HttpPartitionOnCommitTest, LeaderElectionContextKeyTest, LegacyCloudClusterPropTest, MigrateRouteKeyTest, OverseerCollectionConfigSetProcessorTest, RemoteQueryErrorTest, ReplaceNodeNoTargetTest, ReplaceNodeTest, SSLMigrationTest, SolrCloudExampleTest, TestCloudPseudoReturnFields, TestCloudRecovery, TestClusterProperties, TestConfigSetsAPI, TestExclusionRuleCollectionAccess, TestLeaderElectionWithEmptyReplica, TestRandomRequestDistribution, TestRequestForwarding, TestSSLRandomization, TestSizeLimitedDistributedMap, TestSkipOverseerOperations, TestSolrCloudWithKerberosAlt, TestTolerantUpdateProcessorRandomCloud, TriLevelCompositeIdRoutingTest, VMParamsZkACLAndCredentialsProvidersTest, ZkFailoverTest, CollectionTooManyReplicasTest, CollectionsAPIDistributedZkTest, TestHdfsCloudBackupRestore, AutoAddReplicasIntegrationTest, ComputePlanActionTest, HttpTriggerListenerTest, NodeLostTriggerTest, SystemLogListenerTest, TestClusterStateProvider, TestComputePlanAction]
[junit4] Completed [596/785 (1!)] on J1 in 1.36s, 3 tests, 1 failure <<< FAILURES!
[...truncated 50161 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-master-MacOSX/4518/consoleText
[repro] Revision: ea12b5fd225a6af32cba55e589cdca22e606fc0e
[repro] Ant options: "-Dargs=-XX:-UseCompressedOops -XX:+UseParallelGC"
[repro] Repro line: ant test -Dtestcase=TestComputePlanAction -Dtests.method=testNodeWithMultipleReplicasLost -Dtests.seed=4BE996DD454D339A -Dtests.slow=true -Dtests.locale=ar -Dtests.timezone=Asia/Irkutsk -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[repro] ant clean
[...truncated 6 lines...]
[repro] Test suites by module:
[repro] solr/core
[repro] TestComputePlanAction
[repro] ant compile-test
[...truncated 3317 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.TestComputePlanAction" -Dtests.showOutput=onerror "-Dargs=-XX:-UseCompressedOops -XX:+UseParallelGC" -Dtests.seed=4BE996DD454D339A -Dtests.slow=true -Dtests.locale=ar -Dtests.timezone=Asia/Irkutsk -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[...truncated 78 lines...]
[repro] Failures:
[repro] 0/5 failed: org.apache.solr.cloud.autoscaling.sim.TestComputePlanAction
[repro] Exiting with code 0
[...truncated 70 lines...]