You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2018/05/04 12:02:09 UTC

[JENKINS] Lucene-Solr-master-Linux (32bit/jdk1.8.0_162) - Build # 21955 - Still Unstable!

Error processing tokens: Error while parsing action 'Text/ZeroOrMore/FirstOf/Token/DelimitedToken/DelimitedToken_Action3' at input position (line 79, pos 4):
)"}
   ^

java.lang.OutOfMemoryError: Java heap space

[JENKINS] Lucene-Solr-master-Linux (64bit/jdk1.8.0_162) - Build # 21957 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/21957/
Java: 64bit/jdk1.8.0_162 -XX:-UseCompressedOops -XX:+UseG1GC

2 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.autoscaling.sim.TestExecutePlanAction

Error Message:
Suite timeout exceeded (>= 7200000 msec).

Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
	at __randomizedtesting.SeedInfo.seed([4DDEF31DDDF52FFC]:0)


FAILED:  org.apache.solr.cloud.autoscaling.sim.TestExecutePlanAction.testExecute

Error Message:
Test abandoned because suite timeout was reached.

Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
	at __randomizedtesting.SeedInfo.seed([4DDEF31DDDF52FFC]:0)




Build Log:
[...truncated 14865 lines...]
   [junit4] Suite: org.apache.solr.cloud.autoscaling.sim.TestExecutePlanAction
   [junit4]   2> 244489 INFO  (SUITE-TestExecutePlanAction-seed#[4DDEF31DDDF52FFC]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.sim.TestExecutePlanAction_4DDEF31DDDF52FFC-001/init-core-data-001
   [junit4]   2> 244506 WARN  (SUITE-TestExecutePlanAction-seed#[4DDEF31DDDF52FFC]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=10 numCloses=10
   [junit4]   2> 244506 INFO  (SUITE-TestExecutePlanAction-seed#[4DDEF31DDDF52FFC]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 244508 INFO  (SUITE-TestExecutePlanAction-seed#[4DDEF31DDDF52FFC]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 244517 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and .scheduled_maintenance triggers
   [junit4]   2> 244518 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 0
   [junit4]   2> 244519 INFO  (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testIntegration
   [junit4]   2> 244522 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 0, lastZnodeVersion -1
   [junit4]   2> 244522 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 0
   [junit4]   2> 244523 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
   [junit4]   2> 244523 INFO  (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.a.s.SimCloudManager === Restarting OverseerTriggerThread and clearing object cache...
   [junit4]   2> 244523 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.a.ScheduledTriggers Shutting down scheduled thread pool executor now
   [junit4]   2> 244523 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.a.ScheduledTriggers Shutting down action executor now
   [junit4]   2> 244524 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.a.ScheduledTriggers Awaiting termination for action executor
   [junit4]   2> 244524 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.a.ScheduledTriggers Awaiting termination for scheduled thread pool executor
   [junit4]   2> 244524 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.a.ScheduledTriggers ScheduledTriggers closed completely
   [junit4]   2> 244524 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
   [junit4]   2> 244524 WARN  (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Exception initializing trigger .scheduled_maintenance, configuration ignored
   [junit4]   2> org.apache.lucene.store.AlreadyClosedException: ScheduledTriggers has been closed and cannot be used anymore
   [junit4]   2> 	at org.apache.solr.cloud.autoscaling.ScheduledTriggers.add(ScheduledTriggers.java:202) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.cloud.autoscaling.OverseerTriggerThread.run(OverseerTriggerThread.java:234) [java/:?]
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748) [?:1.8.0_162]
   [junit4]   2> 244524 WARN  (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Exception initializing trigger .auto_add_replicas, configuration ignored
   [junit4]   2> org.apache.lucene.store.AlreadyClosedException: ScheduledTriggers has been closed and cannot be used anymore
   [junit4]   2> 	at org.apache.solr.cloud.autoscaling.ScheduledTriggers.add(ScheduledTriggers.java:202) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.cloud.autoscaling.OverseerTriggerThread.run(OverseerTriggerThread.java:234) [java/:?]
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748) [?:1.8.0_162]
   [junit4]   2> 244524 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 244525 WARN  (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Interrupted
   [junit4]   2> java.lang.InterruptedException: null
   [junit4]   2> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireInterruptibly(AbstractQueuedSynchronizer.java:1220) ~[?:1.8.0_162]
   [junit4]   2> 	at java.util.concurrent.locks.ReentrantLock.lockInterruptibly(ReentrantLock.java:335) ~[?:1.8.0_162]
   [junit4]   2> 	at org.apache.solr.cloud.autoscaling.OverseerTriggerThread.run(OverseerTriggerThread.java:169) [java/:?]
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748) [?:1.8.0_162]
   [junit4]   2> 244527 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and .scheduled_maintenance triggers
   [junit4]   2> 244528 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 2
   [junit4]   2> 244528 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion -1
   [junit4]   2> 244528 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
   [junit4]   2> 244530 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial livenodes: [127.0.0.1:10006_solr, 127.0.0.1:10007_solr]
   [junit4]   2> 244534 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 244534 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
   [junit4]   2> 244534 DEBUG (ScheduledTrigger-836-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 244555 DEBUG (ScheduledTrigger-836-thread-3) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 244575 DEBUG (ScheduledTrigger-836-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 244595 DEBUG (ScheduledTrigger-836-thread-3) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 244622 DEBUG (ScheduledTrigger-836-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 244642 DEBUG (ScheduledTrigger-836-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 244646 DEBUG (simCloudManagerPool-835-thread-1) [    ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 244647 DEBUG (simCloudManagerPool-835-thread-1) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 3
   [junit4]   2> 244648 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 3
   [junit4]   2> 244648 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger node_lost_trigger - Initial livenodes: [127.0.0.1:10006_solr, 127.0.0.1:10007_solr]
   [junit4]   2> 244648 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 244648 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion 3
   [junit4]   2> 244648 DEBUG (ScheduledTrigger-836-thread-1) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 2
   [junit4]   2> 244651 DEBUG (simCloudManagerPool-835-thread-2) [    ] o.a.s.c.o.ClusterStateMutator building a new cName: testIntegration
   [junit4]   2> 244662 DEBUG (simCloudManagerPool-835-thread-2) [    ] o.a.s.c.a.c.Assign Identify nodes using default
   [junit4]   2> 244662 DEBUG (ScheduledTrigger-836-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 244683 DEBUG (ScheduledTrigger-836-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 2
   [junit4]   2> 244683 DEBUG (ScheduledTrigger-836-thread-3) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 244703 DEBUG (ScheduledTrigger-836-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 2
   [junit4]   2> 244703 DEBUG (ScheduledTrigger-836-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 244721 DEBUG (simCloudManagerPool-835-thread-5) [    ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testIntegration / shard1: {"core_node1":{
   [junit4]   2>     "core":"testIntegration_shard1_replica_n1",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":1,
   [junit4]   2>     "node_name":"127.0.0.1:10007_solr",
   [junit4]   2>     "state":"active",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "SEARCHER.searcher.numDocs":0,
   [junit4]   2>     "shard":"shard1",
   [junit4]   2>     "collection":"testIntegration"}}
   [junit4]   2> 244723 DEBUG (ScheduledTrigger-836-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 1
   [junit4]   2> 244723 DEBUG (ScheduledTrigger-836-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
   [junit4]   2> 244723 DEBUG (ScheduledTrigger-836-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Tracking lost node: 127.0.0.1:10006_solr
   [junit4]   2> 244723 DEBUG (ScheduledTrigger-836-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Tracking lost node: 127.0.0.1:10006_solr
   [junit4]   2> 244730 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244731 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244733 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244734 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244735 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244736 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244737 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244738 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244739 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244740 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244741 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244743 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244743 DEBUG (ScheduledTrigger-836-thread-3) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 1
   [junit4]   2> 244744 DEBUG (ScheduledTrigger-836-thread-3) [    ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger firing registered processor for lost nodes: [127.0.0.1:10006_solr]
   [junit4]   2> 244744 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244744 DEBUG (ScheduledTrigger-836-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
   [junit4]   2> 244745 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244745 DEBUG (ScheduledTrigger-836-thread-3) [    ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
   [junit4]   2>   "id":"2a0bbad731b52Taasf2fx85tooudy8m6jjz0ovg",
   [junit4]   2>   "source":"node_lost_trigger",
   [junit4]   2>   "eventTime":739677882751826,
   [junit4]   2>   "eventType":"NODELOST",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[739677882751826],
   [junit4]   2>     "nodeNames":["127.0.0.1:10006_solr"]}}
   [junit4]   2> 244745 DEBUG (ScheduledTrigger-836-thread-3) [    ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: [.auto_add_replicas, .scheduled_maintenance, node_lost_trigger]
   [junit4]   2> 244746 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244747 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244748 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244749 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244750 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244751 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244753 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244754 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244755 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244756 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244757 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244758 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244759 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244760 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244761 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244762 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244764 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244765 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244766 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244767 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244768 DEBUG (AutoscalingActionExecutor-837-thread-1) [    ] o.a.s.c.a.ScheduledTriggers -- processing actions for {
   [junit4]   2>   "id":"2a0bbad731b52Taasf2fx85tooudy8m6jjz0ovg",
   [junit4]   2>   "source":"node_lost_trigger",
   [junit4]   2>   "eventTime":739677882751826,
   [junit4]   2>   "eventType":"NODELOST",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[739677882751826],
   [junit4]   2>     "_enqueue_time_":739678999267326,
   [junit4]   2>     "nodeNames":["127.0.0.1:10006_solr"]}}
   [junit4]   2> 244768 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244770 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244769 DEBUG (AutoscalingActionExecutor-837-thread-1) [    ] o.a.s.c.a.ComputePlanAction -- processing event: {
   [junit4]   2>   "id":"2a0bbad731b52Taasf2fx85tooudy8m6jjz0ovg",
   [junit4]   2>   "source":"node_lost_trigger",
   [junit4]   2>   "eventTime":739677882751826,
   [junit4]   2>   "eventType":"NODELOST",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[739677882751826],
   [junit4]   2>     "_enqueue_time_":739678999267326,
   [junit4]   2>     "nodeNames":["127.0.0.1:10006_solr"]}} with context properties: {BEFORE_ACTION=[compute_plan]}
   [junit4]   2> 244771 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244772 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244773 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244774 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244775 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244776 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244778 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244779 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244780 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244780 INFO  (AutoscalingActionExecutor-837-thread-1) [    ] o.a.s.c.a.ComputePlanAction Computed Plan: action=MOVEREPLICA&collection=testIntegration&targetNode=127.0.0.1:10007_solr&inPlaceMove=true&replica=core_node2
   [junit4]   2> 244781 INFO  (AutoscalingActionExecutor-837-thread-1) [    ] o.a.s.c.s.c.a.PolicyHelper returnSession, curr-time 739680759 sessionWrapper.createTime 739680443925976, this.sessionWrapper.createTime 739680443925976 
   [junit4]   2> 244781 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244781 DEBUG (AutoscalingActionExecutor-837-thread-1) [    ] o.a.s.c.a.ExecutePlanAction -- processing event: {
   [junit4]   2>   "id":"2a0bbad731b52Taasf2fx85tooudy8m6jjz0ovg",
   [junit4]   2>   "source":"node_lost_trigger",
   [junit4]   2>   "eventTime":739677882751826,
   [junit4]   2>   "eventType":"NODELOST",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[739677882751826],
   [junit4]   2>     "_enqueue_time_":739678999267326,
   [junit4]   2>     "nodeNames":["127.0.0.1:10006_solr"]}} with context properties: {operations=[org.apache.solr.client.solrj.request.CollectionAdminRequest$MoveReplica@614dd8f1], AFTER_ACTION=[compute_plan], BEFORE_ACTION=[compute_plan, execute_plan]}
   [junit4]   2> 244781 DEBUG (AutoscalingActionExecutor-837-thread-1) [    ] o.a.s.c.a.ExecutePlanAction Executing operation: action=MOVEREPLICA&collection=testIntegration&targetNode=127.0.0.1:10007_solr&inPlaceMove=true&replica=core_node2
   [junit4]   2> 244782 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244783 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244784 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244786 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244787 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244788 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244789 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244790 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244791 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244792 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244794 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244795 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244796 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244797 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244798 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244799 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244800 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244801 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244802 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244804 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244805 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244806 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244807 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244808 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244809 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244810 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244812 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244813 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244814 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244815 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244816 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244817 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244818 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244875 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244876 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244877 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244878 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244879 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244881 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244882 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244883 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244884 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244885 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244886 DEBUG (simCloudManagerPool-835-thread-8) [    ] o.a.s.c.a.s.SimClusterStateProvider -- new replica: {"core_node4":{
   [junit4]   2>     "core":"testIntegration_shard1_replica_n3",
   [junit4]   2>     "shard":"shard1",
   [junit4]   2>     "collection":"testIntegration",
   [junit4]   2>     "node_name":"127.0.0.1:10007_solr",
   [junit4]   2>     "type":"NRT"}}
   [junit4]   2> 244886 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244887 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244889 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244890 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244891 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244892 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244893 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244894 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244896 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.CloudTestUtils -- wrong number of active replicas in slice shard1, expected=2, found=1
   [junit4]   2> 244998 INFO  (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.a.s.TestExecutePlanAction -------------_ FINAL STATE --------------
   [junit4]   2> 244998 INFO  (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.a.s.TestExecutePlanAction * Node values: {
   [junit4]   2>   "127.0.0.1:10006_solr":{
   [junit4]   2>     "sysprop.java.vendor":"Oracle Corporation",
   [junit4]   2>     "cores":1,
   [junit4]   2>     "host":"127.0.0.1",
   [junit4]   2>     "freedisk":999,
   [junit4]   2>     "sysprop.java.version":"1.8.0_162",
   [junit4]   2>     "ip_1":"127",
   [junit4]   2>     "ip_3":"0",
   [junit4]   2>     "ip_2":"0",
   [junit4]   2>     "ip_4":"1",
   [junit4]   2>     "node":"127.0.0.1:10006_solr",
   [junit4]   2>     "metrics:solr.jvm:buffers.direct.Count":0,
   [junit4]   2>     "port":10006,
   [junit4]   2>     "heapUsage":123450000,
   [junit4]   2>     "sysLoadAvg":1.0,
   [junit4]   2>     "metrics:solr.node:ADMIN./admin/authorization.clientErrors:count":0},
   [junit4]   2>   "127.0.0.1:10007_solr":{
   [junit4]   2>     "sysprop.java.vendor":"Oracle Corporation",
   [junit4]   2>     "cores":2,
   [junit4]   2>     "host":"127.0.0.1",
   [junit4]   2>     "freedisk":998,
   [junit4]   2>     "sysprop.java.version":"1.8.0_162",
   [junit4]   2>     "ip_1":"127",
   [junit4]   2>     "ip_3":"0",
   [junit4]   2>     "ip_2":"0",
   [junit4]   2>     "ip_4":"1",
   [junit4]   2>     "node":"127.0.0.1:10007_solr",
   [junit4]   2>     "metrics:solr.jvm:buffers.direct.Count":0,
   [junit4]   2>     "port":10007,
   [junit4]   2>     "heapUsage":123450000,
   [junit4]   2>     "sysLoadAvg":1.0,
   [junit4]   2>     "metrics:solr.node:ADMIN./admin/authorization.clientErrors:count":0}}
   [junit4]   2> 244998 INFO  (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.a.s.TestExecutePlanAction * Live nodes: [127.0.0.1:10007_solr]
   [junit4]   2> 244998 INFO  (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.a.s.TestExecutePlanAction * Collection testIntegration state: DocCollection(testIntegration//clusterstate.json/7)={
   [junit4]   2>   "replicationFactor":"2",
   [junit4]   2>   "pullReplicas":"0",
   [junit4]   2>   "router":{"name":"compositeId"},
   [junit4]   2>   "maxShardsPerNode":"1",
   [junit4]   2>   "autoAddReplicas":"false",
   [junit4]   2>   "nrtReplicas":"2",
   [junit4]   2>   "tlogReplicas":"0",
   [junit4]   2>   "autoCreated":"true",
   [junit4]   2>   "shards":{"shard1":{
   [junit4]   2>       "replicas":{
   [junit4]   2>         "core_node1":{
   [junit4]   2>           "core":"testIntegration_shard1_replica_n1",
   [junit4]   2>           "leader":"true",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":1,
   [junit4]   2>           "node_name":"127.0.0.1:10007_solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "SEARCHER.searcher.numDocs":0},
   [junit4]   2>         "core_node4":{
   [junit4]   2>           "node_name":"127.0.0.1:10007_solr",
   [junit4]   2>           "core":"testIntegration_shard1_replica_n3",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "INDEX.sizeInBytes":1,
   [junit4]   2>           "type":"NRT"}},
   [junit4]   2>       "range":"80000000-7fffffff",
   [junit4]   2>       "state":"active"}}}
   [junit4]   2> 244998 INFO  (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testIntegration
   [junit4]   2> 245000 INFO  (TEST-TestExecutePlanAction.testIntegration-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.a.s.SimSolrCloudTestCase #######################################
   [junit4]   2> ############ CLUSTER STATE ############
   [junit4]   2> #######################################
   [junit4]   2> ## Live nodes:		1
   [junit4]   2> ## Empty nodes:	0
   [junit4]   2> ## Dead nodes:		1
   [junit4]   2> ##		127.0.0.1:10006_solr
   [junit4]   2> ## Collections:	[testIntegration]
   [junit4]   2> ## Max replicas per node:	2
   [junit4]   2> ## Min replicas per node:	2
   [junit4]   2> ## Total replicas:		2
   [junit4]   2> ## * testIntegration		2
   [junit4]   2> ##		- active           2
   [junit4]   2> ######### Solr op counts ##########
   [junit4]   2> ##		- CREATE             1
   [junit4]   2> ##		- MOVEREPLICA        1
   [junit4]   2> ##		- autoscaling        1
   [junit4]   2> ##		- update             1
   [junit4]   2> ######### Autoscaling event counts ###########
   [junit4]   2> ## * Trigger: node_lost_trigger
   [junit4]   2> ##		- STARTED         1
   [junit4]   2> 
   [junit4]   2> 245011 INFO  (TEST-TestExecutePlanAction.testExecute-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testExecute
   [junit4]   2> 245011 DEBUG (TEST-TestExecutePlanAction.testExecute-seed#[4DDEF31DDDF52FFC]) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 4
   [junit4]   2> 245011 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 4
   [junit4]   2> mai 05, 2018 7:32:06 AM com.carrotsearch.randomizedtesting.ThreadLeakControl$2 evaluate
   [junit4]   2> AVERTISSEMENT: Suite execution timed out: org.apache.solr.cloud.autoscaling.sim.TestExecutePlanAction
   [junit4]   2> ==== jstack at approximately timeout time ====
   [junit4]   2> "simCloudManagerPool-835-thread-11" ID=2597 WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@7dce5c01
   [junit4]   2> 	at sun.misc.Unsafe.park(Native Method)
   [junit4]   2> 	- waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@7dce5c01
   [junit4]   2> 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]   2> 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> "simCloudManagerPool-835-thread-10" ID=2596 WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@7dce5c01
   [junit4]   2> 	at sun.misc.Unsafe.park(Native Method)
   [junit4]   2> 	- waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@7dce5c01
   [junit4]   2> 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]   2> 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> "simCloudManagerPool-835-thread-9" ID=2595 WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@7dce5c01
   [junit4]   2> 	at sun.misc.Unsafe.park(Native Method)
   [junit4]   2> 	- waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@7dce5c01
   [junit4]   2> 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]   2> 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> "simCloudManagerPool-835-thread-8" ID=2594 WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@7dce5c01
   [junit4]   2> 	at sun.misc.Unsafe.park(Native Method)
   [junit4]   2> 	- waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@7dce5c01
   [junit4]   2> 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]   2> 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> "AutoscalingActionExecutor-837-thread-1" ID=2593 WAITING on java.util.concurrent.locks.ReentrantLock$NonfairSync@4cf98095 owned by "Simulated OverseerAutoScalingTriggerThread" ID=2581
   [junit4]   2> 	at sun.misc.Unsafe.park(Native Method)
   [junit4]   2> 	- waiting on java.util.concurrent.locks.ReentrantLock$NonfairSync@4cf98095
   [junit4]   2> 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
   [junit4]   2> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:870)
   [junit4]   2> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1199)
   [junit4]   2> 	at java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(ReentrantLock.java:209)
   [junit4]   2> 	at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:285)
   [junit4]   2> 	at org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager.listData(SimDistribStateManager.java:376)
   [junit4]   2> 	at org.apache.solr.cloud.autoscaling.sim.GenericDistributedQueue.fetchZkChildren(GenericDistributedQueue.java:417)
   [junit4]   2> 	at org.apache.solr.cloud.autoscaling.sim.GenericDistributedQueue.firstChild(GenericDistributedQueue.java:394)
   [junit4]   2> 	at org.apache.solr.cloud.autoscaling.sim.GenericDistributedQueue.removeFirst(GenericDistributedQueue.java:538)
   [junit4]   2> 	at org.apache.solr.cloud.autoscaling.sim.GenericDistributedQueue.poll(GenericDistributedQueue.java:213)
   [junit4]   2> 	at org.apache.solr.cloud.autoscaling.TriggerEventQueue.pollEvent(TriggerEventQueue.java:91)
   [junit4]   2> 	at org.apache.solr.cloud.autoscaling.ScheduledTriggers$TriggerWrapper.dequeue(ScheduledTriggers.java:547)
   [junit4]   2> 	at org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$null$3(ScheduledTriggers.java:318)
   [junit4]   2> 	at org.apache.solr.cloud.autoscaling.ScheduledTriggers$$Lambda$612/1677339163.run(Unknown Source)
   [junit4]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:192)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$25/465494023.run(Unknown Source)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 	Locked synchronizers:
   [junit4]   2> 	- java.util.concurrent.ThreadPoolExecutor$Worker@652a73a5
   [junit4]   2> 	- java.util.concurrent.locks.ReentrantLock$NonfairSync@6a1d496a
   [junit4]   2> 
   [junit4]   2> "simCloudManagerPool-835-thread-7" ID=2592 WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@7dce5c01
   [junit4]   2> 	at sun.misc.Unsafe.park(Native Method)
   [junit4]   2> 	- waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@7dce5c01
   [junit4]   2> 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]   2> 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> "simCloudManagerPool-835-thread-6" ID=2591 WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@7dce5c01
   [junit4]   2> 	at sun.misc.Unsafe.park(Native Method)
   [junit4]   2> 	- waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@7dce5c01
   [junit4]   2> 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]   2> 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> "simCloudManagerPool-835-thread-5" ID=2590 WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@7dce5c01
   [junit4]   2> 	at sun.misc.Unsafe.park(Native Method)
   [junit4]   2> 	- waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@7dce5c01
   [junit4]   2> 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]   2> 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> "simCloudManagerPool-835-thread-4" ID=2589 WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@7dce5c01
   [junit4]   2> 	at sun.misc.Unsafe.park(Native Method)
   [junit4]   2> 	- waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@7dce5c01
   [junit4]   2> 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]   2> 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> "simCloudManagerPool-835-thread-3" ID=2588 WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@7dce5c01
   [junit4]   2> 	at sun.misc.Unsafe.park(Native Method)
   [junit4]   2> 	- waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@7dce5c01
   [junit4]   2> 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]   2> 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> "simCloudManagerPool-835-thread-2" ID=2587 WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@7dce5c01
   [junit4]   2> 	at sun.misc.Unsafe.park(Native Method)
   [junit4]   2> 	- waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@7dce5c01
   [junit4]   2> 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]   2> 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> "simCloudManagerPool-835-thread-1" ID=2586 WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@7dce5c01
   [junit4]   2> 	at sun.misc.Unsafe.park(Native Method)
   [junit4]   2> 	- waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@7dce5c01
   [junit4]   2> 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]   2> 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> "ScheduledTrigger-836-thread-4" ID=2585 WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@12c0cb43
   [junit4]   2> 	at sun.misc.Unsafe.park(Native Method)
   [junit4]   2> 	- waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@12c0cb43
   [junit4]   2> 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]   2> 	at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081)
   [junit4]   2> 	at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> "ScheduledTrigger-836-thread-3" ID=2584 WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@12c0cb43
   [junit4]   2> 	at sun.misc.Unsafe.park(Native Method)
   [junit4]   2> 	- waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@12c0cb43
   [junit4]   2> 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]   2> 	at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081)
   [junit4]   2> 	at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> "ScheduledTrigger-836-thread-2" ID=2583 WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@12c0cb43
   [junit4]   2> 	at sun.misc.Unsafe.park(Native Method)
   [junit4]   2> 	- waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@12c0cb43
   [junit4]   2> 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]   2> 	at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
   [junit4]   2> 	at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> "ScheduledTrigger-836-thread-1" ID=2582 WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@12c0cb43
   [junit4]   2> 	at sun.misc.Unsafe.park(Native Method)
   [junit4]   2> 	- waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@12c0cb43
   [junit4]   2> 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]   2> 	at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
   [junit4]   2> 	at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> "Simulated OverseerAutoScalingTriggerThread" ID=2581 WAITING on java.util.concurrent.locks.ReentrantLock$NonfairSync@6a1d496a owned by "AutoscalingActionExecutor-837-thread-1" ID=2593
   [junit4]   2> 	at sun.misc.Unsafe.park(Native Method)
   [junit4]   2> 	- waiting on java.util.concurrent.locks.ReentrantLock$NonfairSync@6a1d496a
   [junit4]   2> 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
   [junit4]   2> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:870)
   [junit4]   2> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1199)
   [junit4]   2> 	at java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(ReentrantLock.java:209)
   [junit4]   2> 	at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:285)
   [junit4]   2> 	at org.apache.solr.cloud.autoscaling.sim.GenericDistributedQueue$ChildWatcher.process(GenericDistributedQueue.java:588)
   [junit4]   2> 	at org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node.removeChild(SimDistribStateManager.java:177)
   [junit4]   2> 	at org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager.removeData(SimDistribStateManager.java:487)
   [junit4]   2> 	at org.apache.solr.client.solrj.cloud.DistribStateManager.removeRecursively(DistribStateManager.java:140)
   [junit4]   2> 	at org.apache.solr.cloud.autoscaling.ScheduledTriggers.removeTriggerZKData(ScheduledTriggers.java:476)
   [junit4]   2> 	at org.apache.solr.cloud.autoscaling.ScheduledTriggers.remove(ScheduledTriggers.java:464)
   [junit4]   2> 	- locked org.apache.solr.cloud.autoscaling.ScheduledTriggers@1de1a34e
   [junit4]   2> 	at org.apache.solr.cloud.autoscaling.OverseerTriggerThread.run(OverseerTriggerThread.java:217)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 	Locked synchronizers:
   [junit4]   2> 	- java.util.concurrent.locks.ReentrantLock$NonfairSync@4cf98095
   [junit4]   2> 
   [junit4]   2> "TEST-TestExecutePlanAction.testExecute-seed#[4DDEF31DDDF52FFC]" ID=2579 WAITING on java.util.concurrent.locks.ReentrantLock$NonfairSync@4cf98095 owned by "Simulated OverseerAutoScalingTriggerThread" ID=2581
   [junit4]   2> 	at sun.misc.Unsafe.park(Native Method)
   [junit4]   2> 	- waiting on java.util.concurrent.locks.ReentrantLock$NonfairSync@4cf98095
   [junit4]   2> 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
   [junit4]   2> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:870)
   [junit4]   2> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1199)
   [junit4]   2> 	at java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(ReentrantLock.java:209)
   [junit4]   2> 	at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:285)
   [junit4]   2> 	at org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager.hasData(SimDistribStateManager.java:348)
   [junit4]   2> 	at org.apache.solr.cloud.autoscaling.sim.SimSolrCloudTestCase.removeChildren(SimSolrCloudTestCase.java:120)
   [junit4]   2> 	at org.apache.solr.cloud.autoscaling.sim.SimSolrCloudTestCase.setUp(SimSolrCloudTestCase.java:98)
   [junit4]   2> 	at sun.reflect.GeneratedMethodAccessor29.invoke(Unknown Source)
   [junit4]   2> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2> 	at java.lang.reflect.Method.invoke(Method.java:498)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:968)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
   [junit4]   2> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> "SUITE-TestExecutePlanAction-seed#[4DDEF31DDDF52FFC]" ID=2578 RUNNABLE
   [junit4]   2> 	at sun.management.ThreadImpl.dumpThreads0(Native Method)
   [junit4]   2> 	at sun.management.ThreadImpl.dumpAllThreads(ThreadImpl.java:454)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.formatThreadStacksFull(ThreadLeakControl.java:681)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.access$1000(ThreadLeakControl.java:65)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$2.evaluate(ThreadLeakControl.java:415)
   [junit4]   2> 	- locked java.lang.Object@1d37ff81
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:705)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$200(RandomizedRunner.java:139)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:626)
   [junit4]   2> 
   [junit4]   2> "JUnit4-serializer-daemon" ID=11 TIMED_WAITING
   [junit4]   2> 	at java.lang.Thread.sleep(Native Method)
   [junit4]   2> 	at com.carrotsearch.ant.tasks.junit4.events.Serializer$1.run(Serializer.java:50)
   [junit4]   2> 
   [junit4]   2> "Signal Dispatcher" ID=5 RUNNABLE
   [junit4]   2> 
   [junit4]   2> "Finalizer" ID=3 WAITING on java.lang.ref.ReferenceQueue$Lock@1dca299a
   [junit4]   2> 	at java.lang.Object.wait(Native Method)
   [junit4]   2> 	- waiting on java.lang.ref.ReferenceQueue$Lock@1dca299a
   [junit4]   2> 	at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:143)
   [junit4]   2> 	at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:164)
   [junit4]   2> 	at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:212)
   [junit4]   2> 
   [junit4]   2> "Reference Handler" ID=2 WAITING on java.lang.ref.Reference$Lock@9c463b3
   [junit4]   2> 	at java.lang.Object.wait(Native Method)
   [junit4]   2> 	- waiting on java.lang.ref.Reference$Lock@9c463b3
   [junit4]   2> 	at java.lang.Object.wait(Object.java:502)
   [junit4]   2> 	at java.lang.ref.Reference.tryHandlePending(Reference.java:191)
   [junit4]   2> 	at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:153)
   [junit4]   2> 
   [junit4]   2> "main" ID=1 WAITING on com.carrotsearch.randomizedtesting.RandomizedRunner$2@3cf3563a
   [junit4]   2> 	at java.lang.Object.wait(Native Method)
   [junit4]   2> 	- waiting on com.carrotsearch.randomizedtesting.RandomizedRunner$2@3cf3563a
   [junit4]   2> 	at java.lang.Thread.join(Thread.java:1252)
   [junit4]   2> 	at java.lang.Thread.join(Thread.java:1326)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:636)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.run(RandomizedRunner.java:493)
   [junit4]   2> 	at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.execute(SlaveMain.java:251)
   [junit4]   2> 	at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.main(SlaveMain.java:368)
   [junit4]   2> 	at com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe.main(SlaveMainSafe.java:13)
   [junit4]   2> 
   [junit4]   2> ^^==============================================
   [junit4]   2> 
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestExecutePlanAction -Dtests.method=testExecute -Dtests.seed=4DDEF31DDDF52FFC -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=fr-LU -Dtests.timezone=Australia/Adelaide -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   7200s J0 | TestExecutePlanAction.testExecute <<<
   [junit4]    > Throwable #1: java.lang.Exception: Test abandoned because suite timeout was reached.
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([4DDEF31DDDF52FFC]:0)
   [junit4]   2> mai 05, 2018 7:32:06 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> AVERTISSEMENT: Will linger awaiting termination of 18 leaked thread(s).
   [junit4]   2> mai 05, 2018 7:33:26 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> GRAVE: 18 threads leaked from SUITE scope at org.apache.solr.cloud.autoscaling.sim.TestExecutePlanAction: 
   [junit4]   2>    1) Thread[id=2582, name=ScheduledTrigger-836-thread-1, state=WAITING, group=TGRP-TestExecutePlanAction]
   [junit4]   2>         at sun.misc.Unsafe.park(Native Method)
   [junit4]   2>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]   2>         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
   [junit4]   2>         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2>         at java.lang.Thread.run(Thread.java:748)
   [junit4]   2>    2) Thread[id=2593, name=AutoscalingActionExecutor-837-thread-1, state=WAITING, group=TGRP-TestExecutePlanAction]
   [junit4]   2>         at sun.misc.Unsafe.park(Native Method)
   [junit4]   2>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2>         at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
   [junit4]   2>         at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:870)
   [junit4]   2>         at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1199)
   [junit4]   2>         at java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(ReentrantLock.java:209)
   [junit4]   2>         at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:285)
   [junit4]   2>         at org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager.listData(SimDistribStateManager.java:376)
   [junit4]   2>         at org.apache.solr.cloud.autoscaling.sim.GenericDistributedQueue.fetchZkChildren(GenericDistributedQueue.java:417)
   [junit4]   2>         at org.apache.solr.cloud.autoscaling.sim.GenericDistributedQueue.firstChild(GenericDistributedQueue.java:394)
   [junit4]   2>         at org.apache.solr.cloud.autoscaling.sim.GenericDistributedQueue.removeFirst(GenericDistributedQueue.java:538)
   [junit4]   2>         at org.apache.solr.cloud.autoscaling.sim.GenericDistributedQueue.poll(GenericDistributedQueue.java:213)
   [junit4]   2>         at org.apache.solr.cloud.autoscaling.TriggerEventQueue.pollEvent(TriggerEventQueue.java:91)
   [junit4]   2>         at org.apache.solr.cloud.autoscaling.ScheduledTriggers$TriggerWrapper.dequeue(ScheduledTriggers.java:547)
   [junit4]   2>         at org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$null$3(ScheduledTriggers.java:318)
   [junit4]   2>         at org.apache.solr.cloud.autoscaling.ScheduledTriggers$$Lambda$612/1677339163.run(Unknown Source)
   [junit4]   2>         at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
   [junit4]   2>         at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2>         at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:192)
   [junit4]   2>         at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$25/465494023.run(Unknown Source)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2>         at java.lang.Thread.run(Thread.java:748)
   [junit4]   2>    3) Thread[id=2592, name=simCloudManagerPool-835-thread-7, state=WAITING, group=TGRP-TestExecutePlanAction]
   [junit4]   2>         at sun.misc.Unsafe.park(Native Method)
   [junit4]   2>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]   2>         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2>         at java.lang.Thread.run(Thread.java:748)
   [junit4]   2>    4) Thread[id=2587, name=simCloudManagerPool-835-thread-2, state=WAITING, group=TGRP-TestExecutePlanAction]
   [junit4]   2>         at sun.misc.Unsafe.park(Native Method)
   [junit4]   2>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]   2>         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2>         at java.lang.Thread.run(Thread.java:748)
   [junit4]   2>    5) Thread[id=2581, name=Simulated OverseerAutoScalingTriggerThread, state=WAITING, group=Simulated Overseer autoscaling triggers]
   [junit4]   2>         at sun.misc.Unsafe.park(Native Method)
   [junit4]   2>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2>         at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
   [junit4]   2>         at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:870)
   [junit4]   2>         at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1199)
   [junit4]   2>         at java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(ReentrantLock.java:209)
   [junit4]   2>         at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:285)
   [junit4]   2>         at org.apache.solr.cloud.autoscaling.sim.GenericDistributedQueue$ChildWatcher.process(GenericDistributedQueue.java:588)
   [junit4]   2>         at org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node.removeChild(SimDistribStateManager.java:177)
   [junit4]   2>         at org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager.removeData(SimDistribStateManager.java:487)
   [junit4]   2>         at org.apache.solr.client.solrj.cloud.DistribStateManager.removeRecursively(DistribStateManager.java:140)
   [junit4]   2>         at org.apache.solr.cloud.autoscaling.ScheduledTriggers.removeTriggerZKData(ScheduledTriggers.java:476)
   [junit4]   2>         at org.apache.solr.cloud.autoscaling.ScheduledTriggers.remove(ScheduledTriggers.java:464)
   [junit4]   2>         at org.apache.solr.cloud.autoscaling.OverseerTriggerThread.run(OverseerTriggerThread.java:217)
   [junit4]   2>         at java.lang.Thread.run(Thread.java:748)
   [junit4]   2>    6) Thread[id=2594, name=simCloudManagerPool-835-thread-8, state=WAITING, group=TGRP-TestExecutePlanAction]
   [junit4]   2>         at sun.misc.Unsafe.park(Native Method)
   [junit4]   2>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]   2>         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2>         at java.lang.Thread.run(Thread.java:748)
   [junit4]   2>    7) Thread[id=2595, name=simCloudManagerPool-835-thread-9, state=WAITING, group=TGRP-TestExecutePlanAction]
   [junit4]   2>         at sun.misc.Unsafe.park(Native Method)
   [junit4]   2>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]   2>         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2>         at java.lang.Thread.run(Thread.java:748)
   [junit4]   2>    8) Thread[id=2579, name=TEST-TestExecutePlanAction.testExecute-seed#[4DDEF31DDDF52FFC], state=WAITING, group=TGRP-TestExecutePlanAction]
   [junit4]   2>         at sun.misc.Unsafe.park(Native Method)
   [junit4]   2>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2>         at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
   [junit4]   2>         at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:870)
   [junit4]   2>         at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1199)
   [junit4]   2>         at java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(ReentrantLock.java:209)
   [junit4]   2>         at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:285)
   [junit4]   2>         at org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager.hasData(SimDistribStateManager.java:348)
   [junit4]   2>         at org.apache.solr.cloud.autoscaling.sim.SimSolrCloudTestCase.removeChildren(SimSolrCloudTestCase.java:120)
   [junit4]   2>         at org.apache.solr.cloud.autoscaling.sim.SimSolrCloudTestCase.setUp(SimSolrCloudTestCase.java:98)
   [junit4]   2>         at sun.reflect.GeneratedMethodAccessor29.invoke(Unknown Source)
   [junit4]   2>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2>         at java.lang.reflect.Method.invoke(Method.java:498)
   [junit4]   2>         at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
   [junit4]   2>         at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:968)
   [junit4]   2>         at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
   [junit4]   2>         at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2>         at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
   [junit4]   2>         at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2>         at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
   [junit4]   2>         at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2>         at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
   [junit4]   2>         at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
   [junit4]   2>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
   [junit4]   2>         at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
   [junit4]   2>         at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
   [junit4]   2>         at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
   [junit4]   2>         at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
   [junit4]   2>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2>         at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
   [junit4]   2>         at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2>         at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
   [junit4]   2>         at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2>         at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2>         at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
   [junit4]   2>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
   [junit4]   2>         at java.lang.Thread.run(Thread.java:748)
   [junit4]   2>    9) Thread[id=2589, name=simCloudManagerPool-835-thread-4, state=WAITING, group=TGRP-TestExecutePlanAction]
   [junit4]   2>         at sun.misc.Unsafe.park(Native Method)
   [junit4]   2>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]   2>         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2>         at java.lang.Thread.run(Thread.java:748)
   [junit4]   2>   10) Thread[id=2591, name=simCloudManagerPool-835-thread-6, state=WAITING, group=TGRP-TestExecutePlanAction]
   [junit4]   2>         at sun.misc.Unsafe.park(Native Method)
   [junit4]   2>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]   2>         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2>         at java.lang.Thread.run(Thread.java:748)
   [junit4]   2>   11) Thread[id=2583, name=ScheduledTrigger-836-thread-2, state=WAITING, group=TGRP-TestExecutePlanAction]
   [junit4]   2>         at sun.misc.Unsafe.park(Native Method)
   [junit4]   2>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]   2>         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
   [junit4]   2>         at java.util.concurrent

[...truncated too long message...]


[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/top-level-ivy-settings.xml

resolve:

init:

compile-lucene-core:

compile-codecs:

-check-git-state:

-git-cleanroot:

-copy-git-state:

git-autoclean:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/top-level-ivy-settings.xml

resolve:

common.init:

compile-lucene-core:

init:

-clover.disable:

-clover.load:

-clover.classpath:

-clover.setup:

clover:

compile-core:

-clover.disable:

-clover.load:

-clover.classpath:

-clover.setup:

clover:

common.compile-core:

compile-core:

common.compile-test:
    [mkdir] Created dir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/classes/test
    [javac] Compiling 899 source files to /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/classes/test
    [javac] Note: Some input files use or override a deprecated API.
    [javac] Note: Recompile with -Xlint:deprecation for details.
    [javac] Note: Some input files use unchecked or unsafe operations.
    [javac] Note: Recompile with -Xlint:unchecked for details.
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/classes/test/org/apache/solr/cloud/autoscaling/sim/package-info.class
     [copy] Copying 1 file to /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/classes/test

common-solr.compile-test:

compile-test:

BUILD SUCCESSFUL
Total time: 59 seconds
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.TestExecutePlanAction" -Dtests.showOutput=onerror "-Dargs=-XX:-UseCompressedOops -XX:+UseG1GC" -Dtests.seed=4DDEF31DDDF52FFC -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=fr-LU -Dtests.timezone=Australia/Adelaide -Dtests.asserts=true -Dtests.file.encoding=UTF-8
Buildfile: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/build.xml

-clover.disable:

ivy-configure:
[ivy:configure] :: Apache Ivy 2.4.0 - 20141213170938 :: http://ant.apache.org/ivy/ ::
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/top-level-ivy-settings.xml

install-junit4-taskdef:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

resolve-groovy:
[ivy:cachepath] :: resolving dependencies :: org.codehaus.groovy#groovy-all-caller;working
[ivy:cachepath] 	confs: [default]
[ivy:cachepath] 	found org.codehaus.groovy#groovy-all;2.4.15 in public
[ivy:cachepath] :: resolution report :: resolve 25ms :: artifacts dl 0ms
	---------------------------------------------------------------------
	|                  |            modules            ||   artifacts   |
	|       conf       | number| search|dwnlded|evicted|| number|dwnlded|
	---------------------------------------------------------------------
	|      default     |   1   |   0   |   0   |   0   ||   1   |   0   |
	---------------------------------------------------------------------

-init-totals:

-test:
    [mkdir] Created dir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test
[junit4:pickseed] Seed property 'tests.seed' already defined: 4DDEF31DDDF52FFC
    [mkdir] Created dir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/temp
   [junit4] <JUnit4> says ahoj! Master seed: 4DDEF31DDDF52FFC
   [junit4] Executing 5 suites with 3 JVMs.
   [junit4] 
   [junit4] Started J0 PID(2512@serv1.sd-datasolutions.de).
   [junit4] Started J2 PID(2513@serv1.sd-datasolutions.de).
   [junit4] Started J1 PID(2511@serv1.sd-datasolutions.de).
   [junit4] Suite: org.apache.solr.cloud.autoscaling.sim.TestExecutePlanAction
   [junit4] OK      0.80s J1 | TestExecutePlanAction.testIntegration
   [junit4] OK      0.38s J1 | TestExecutePlanAction.testExecute
   [junit4] Completed [1/5] on J1 in 3.85s, 2 tests
   [junit4] 
   [junit4] Suite: org.apache.solr.cloud.autoscaling.sim.TestExecutePlanAction
   [junit4] OK      0.73s J2 | TestExecutePlanAction.testIntegration
   [junit4] OK      0.37s J2 | TestExecutePlanAction.testExecute
   [junit4] Completed [2/5] on J2 in 4.13s, 2 tests
   [junit4] 
   [junit4] Duplicate suite name used with XML reports: org.apache.solr.cloud.autoscaling.sim.TestExecutePlanAction. This may confuse tools that process XML reports. Set 'ignoreDuplicateSuites' to true to skip this message.
   [junit4] Suite: org.apache.solr.cloud.autoscaling.sim.TestExecutePlanAction
   [junit4] OK      0.76s J0 | TestExecutePlanAction.testIntegration
   [junit4] OK      0.36s J0 | TestExecutePlanAction.testExecute
   [junit4] Completed [3/5] on J0 in 4.06s, 2 tests
   [junit4] 
   [junit4] Suite: org.apache.solr.cloud.autoscaling.sim.TestExecutePlanAction
   [junit4] OK      0.42s J1 | TestExecutePlanAction.testIntegration
   [junit4] OK      0.36s J1 | TestExecutePlanAction.testExecute
   [junit4] Completed [4/5] on J1 in 0.80s, 2 tests
   [junit4] 
   [junit4] Suite: org.apache.solr.cloud.autoscaling.sim.TestExecutePlanAction
   [junit4] OK      0.41s J2 | TestExecutePlanAction.testIntegration
   [junit4] OK      0.35s J2 | TestExecutePlanAction.testExecute
   [junit4] Completed [5/5] on J2 in 1.07s, 2 tests
   [junit4] 
   [junit4] JVM J0:     0.56 ..     5.38 =     4.82s
   [junit4] JVM J1:     0.80 ..     6.46 =     5.66s
   [junit4] JVM J2:     0.79 ..     6.85 =     6.06s
   [junit4] Execution time total: 6.86 sec.
   [junit4] Tests summary: 5 suites, 10 tests
   [junit4] Could not remove temporary path: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0 (java.nio.file.DirectoryNotEmptyException: Remaining files: [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp])
   [junit4] Could not remove temporary path: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1 (java.nio.file.DirectoryNotEmptyException: Remaining files: [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp])
   [junit4] Could not remove temporary path: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2 (java.nio.file.DirectoryNotEmptyException: Remaining files: [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp])
     [echo] 5 slowest tests:
[junit4:tophints] 1216.22s | org.apache.solr.cloud.autoscaling.sim.TestExecutePlanAction
[junit4:tophints] 179.03s | org.apache.solr.cloud.autoscaling.SearchRateTriggerIntegrationTest
[junit4:tophints] 117.17s | org.apache.solr.update.SoftAutoCommitTest
[junit4:tophints] 107.82s | org.apache.solr.cloud.ZkFailoverTest
[junit4:tophints]  78.86s | org.apache.solr.cloud.TestPullReplicaErrorHandling

-check-totals:

test-nocompile:

BUILD SUCCESSFUL
Total time: 9 seconds
[repro] Failures:
[repro]   0/5 failed: org.apache.solr.cloud.autoscaling.sim.TestExecutePlanAction
[repro] Exiting with code 0
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
java.lang.InterruptedException: no matches found within 10000
	at hudson.FilePath$34.hasMatch(FilePath.java:2662)
	at hudson.FilePath$34.invoke(FilePath.java:2541)
	at hudson.FilePath$34.invoke(FilePath.java:2531)
	at hudson.FilePath.act(FilePath.java:1032)
	at hudson.FilePath.act(FilePath.java:1010)
	at hudson.FilePath.validateAntFileMask(FilePath.java:2531)
	at hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:243)
	at hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:81)
	at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
	at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:744)
	at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:690)
	at hudson.model.Build$BuildExecution.post2(Build.java:186)
	at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:635)
	at hudson.model.Run.execute(Run.java:1819)
	at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
	at hudson.model.ResourceController.execute(ResourceController.java:97)
	at hudson.model.Executor.run(Executor.java:429)
No artifacts found that match the file pattern "**/*.events,heapdumps/**,**/*_pid*.log". Configuration error?
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=ad0ad2ec891b7c122ddf5b0385a9e4b984e78b38, workspace=/var/lib/jenkins/workspace/Lucene-Solr-master-Linux
[WARNINGS] Computing warning deltas based on reference build #21956
Recording test results
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2

[JENKINS] Lucene-Solr-master-Linux (64bit/jdk-9.0.4) - Build # 21956 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/21956/
Java: 64bit/jdk-9.0.4 -XX:-UseCompressedOops -XX:+UseParallelGC

1 tests failed.
FAILED:  org.apache.solr.cloud.autoscaling.SearchRateTriggerTest.testTrigger

Error Message:
expected:<1> but was:<2>

Stack Trace:
java.lang.AssertionError: expected:<1> but was:<2>
	at __randomizedtesting.SeedInfo.seed([1CE770D1FE5D71F5:7F2C4653679202D8]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.junit.Assert.assertEquals(Assert.java:456)
	at org.apache.solr.cloud.autoscaling.SearchRateTriggerTest.testTrigger(SearchRateTriggerTest.java:133)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)




Build Log:
[...truncated 14339 lines...]
   [junit4] Suite: org.apache.solr.cloud.autoscaling.SearchRateTriggerTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.SearchRateTriggerTest_1CE770D1FE5D71F5-001/init-core-data-001
   [junit4]   2> 2076795 WARN  (SUITE-SearchRateTriggerTest-seed#[1CE770D1FE5D71F5]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=11 numCloses=11
   [junit4]   2> 2076795 INFO  (SUITE-SearchRateTriggerTest-seed#[1CE770D1FE5D71F5]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 2076796 INFO  (SUITE-SearchRateTriggerTest-seed#[1CE770D1FE5D71F5]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason="", value=0.0/0.0, ssl=0.0/0.0, clientAuth=0.0/0.0)
   [junit4]   2> 2076797 INFO  (SUITE-SearchRateTriggerTest-seed#[1CE770D1FE5D71F5]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 2076797 INFO  (SUITE-SearchRateTriggerTest-seed#[1CE770D1FE5D71F5]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.SearchRateTriggerTest_1CE770D1FE5D71F5-001/tempDir-001
   [junit4]   2> 2076797 INFO  (SUITE-SearchRateTriggerTest-seed#[1CE770D1FE5D71F5]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 2076797 INFO  (Thread-3793) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 2076797 INFO  (Thread-3793) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 2076799 ERROR (Thread-3793) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 2076897 INFO  (SUITE-SearchRateTriggerTest-seed#[1CE770D1FE5D71F5]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:46399
   [junit4]   2> 2076904 INFO  (zkConnectionManagerCallback-4833-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2076907 INFO  (jetty-launcher-4830-thread-4) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T05:27:37+08:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 2076907 INFO  (jetty-launcher-4830-thread-3) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T05:27:37+08:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 2076907 INFO  (jetty-launcher-4830-thread-2) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T05:27:37+08:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 2076907 INFO  (jetty-launcher-4830-thread-1) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T05:27:37+08:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 2076908 INFO  (jetty-launcher-4830-thread-4) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 2076908 INFO  (jetty-launcher-4830-thread-4) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 2076908 INFO  (jetty-launcher-4830-thread-4) [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 2076908 INFO  (jetty-launcher-4830-thread-3) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 2076908 INFO  (jetty-launcher-4830-thread-3) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 2076908 INFO  (jetty-launcher-4830-thread-3) [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 2076908 INFO  (jetty-launcher-4830-thread-1) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 2076908 INFO  (jetty-launcher-4830-thread-1) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 2076908 INFO  (jetty-launcher-4830-thread-1) [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 2076908 INFO  (jetty-launcher-4830-thread-3) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@27e58dab{/solr,null,AVAILABLE}
   [junit4]   2> 2076908 INFO  (jetty-launcher-4830-thread-4) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3f04f34a{/solr,null,AVAILABLE}
   [junit4]   2> 2076909 INFO  (jetty-launcher-4830-thread-2) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 2076909 INFO  (jetty-launcher-4830-thread-2) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 2076909 INFO  (jetty-launcher-4830-thread-2) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 2076909 INFO  (jetty-launcher-4830-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@524e218d{/solr,null,AVAILABLE}
   [junit4]   2> 2076909 INFO  (jetty-launcher-4830-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5683522d{/solr,null,AVAILABLE}
   [junit4]   2> 2076910 INFO  (jetty-launcher-4830-thread-3) [    ] o.e.j.s.AbstractConnector Started ServerConnector@7d7105d0{SSL,[ssl, http/1.1]}{127.0.0.1:39711}
   [junit4]   2> 2076910 INFO  (jetty-launcher-4830-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@131cc281{SSL,[ssl, http/1.1]}{127.0.0.1:33315}
   [junit4]   2> 2076910 INFO  (jetty-launcher-4830-thread-3) [    ] o.e.j.s.Server Started @2076951ms
   [junit4]   2> 2076910 INFO  (jetty-launcher-4830-thread-4) [    ] o.e.j.s.AbstractConnector Started ServerConnector@13a29476{SSL,[ssl, http/1.1]}{127.0.0.1:38761}
   [junit4]   2> 2076910 INFO  (jetty-launcher-4830-thread-1) [    ] o.e.j.s.Server Started @2076951ms
   [junit4]   2> 2076910 INFO  (jetty-launcher-4830-thread-4) [    ] o.e.j.s.Server Started @2076952ms
   [junit4]   2> 2076910 INFO  (jetty-launcher-4830-thread-4) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=38761}
   [junit4]   2> 2076910 INFO  (jetty-launcher-4830-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=33315}
   [junit4]   2> 2076910 INFO  (jetty-launcher-4830-thread-3) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=39711}
   [junit4]   2> 2076910 ERROR (jetty-launcher-4830-thread-4) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2076910 ERROR (jetty-launcher-4830-thread-3) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2076910 INFO  (jetty-launcher-4830-thread-4) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 2076910 INFO  (jetty-launcher-4830-thread-3) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 2076910 ERROR (jetty-launcher-4830-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2076910 INFO  (jetty-launcher-4830-thread-4) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 2076910 INFO  (jetty-launcher-4830-thread-3) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 2076910 INFO  (jetty-launcher-4830-thread-1) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 2076910 INFO  (jetty-launcher-4830-thread-4) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2076910 INFO  (jetty-launcher-4830-thread-3) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2076910 INFO  (jetty-launcher-4830-thread-4) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 2076910 INFO  (jetty-launcher-4830-thread-3) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 2076910 INFO  (jetty-launcher-4830-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 2076910 INFO  (jetty-launcher-4830-thread-3) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-05-04T16:29:06.767756Z
   [junit4]   2> 2076910 INFO  (jetty-launcher-4830-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2076910 INFO  (jetty-launcher-4830-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 2076910 INFO  (jetty-launcher-4830-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-05-04T16:29:06.767817Z
   [junit4]   2> 2076910 INFO  (jetty-launcher-4830-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@44707d59{SSL,[ssl, http/1.1]}{127.0.0.1:42273}
   [junit4]   2> 2076910 INFO  (jetty-launcher-4830-thread-4) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-05-04T16:29:06.767750Z
   [junit4]   2> 2076911 INFO  (jetty-launcher-4830-thread-2) [    ] o.e.j.s.Server Started @2076952ms
   [junit4]   2> 2076911 INFO  (jetty-launcher-4830-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=42273}
   [junit4]   2> 2076911 ERROR (jetty-launcher-4830-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2076911 INFO  (jetty-launcher-4830-thread-2) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 2076911 INFO  (jetty-launcher-4830-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 2076911 INFO  (jetty-launcher-4830-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2076911 INFO  (jetty-launcher-4830-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 2076911 INFO  (jetty-launcher-4830-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-05-04T16:29:06.768324Z
   [junit4]   2> 2076911 INFO  (zkConnectionManagerCallback-4835-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2076911 INFO  (zkConnectionManagerCallback-4837-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2076912 INFO  (zkConnectionManagerCallback-4839-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2076912 INFO  (zkConnectionManagerCallback-4841-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2076912 INFO  (jetty-launcher-4830-thread-3) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2076912 INFO  (jetty-launcher-4830-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2076912 INFO  (jetty-launcher-4830-thread-4) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2076912 INFO  (jetty-launcher-4830-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2076917 INFO  (jetty-launcher-4830-thread-3) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46399/solr
   [junit4]   2> 2076918 INFO  (jetty-launcher-4830-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46399/solr
   [junit4]   2> 2076918 INFO  (jetty-launcher-4830-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46399/solr
   [junit4]   2> 2076918 INFO  (zkConnectionManagerCallback-4848-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2076918 INFO  (zkConnectionManagerCallback-4853-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2076918 INFO  (jetty-launcher-4830-thread-4) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46399/solr
   [junit4]   2> 2076918 INFO  (zkConnectionManagerCallback-4854-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2076920 INFO  (zkConnectionManagerCallback-4860-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2076920 INFO  (zkConnectionManagerCallback-4861-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2076920 INFO  (zkConnectionManagerCallback-4857-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2076920 INFO  (zkConnectionManagerCallback-4863-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2076921 INFO  (zkConnectionManagerCallback-4865-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2076977 INFO  (jetty-launcher-4830-thread-3) [n:127.0.0.1:39711_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2076977 INFO  (jetty-launcher-4830-thread-2) [n:127.0.0.1:42273_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2076977 INFO  (jetty-launcher-4830-thread-3) [n:127.0.0.1:39711_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:39711_solr
   [junit4]   2> 2076978 INFO  (jetty-launcher-4830-thread-2) [n:127.0.0.1:42273_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42273_solr
   [junit4]   2> 2076978 INFO  (jetty-launcher-4830-thread-3) [n:127.0.0.1:39711_solr    ] o.a.s.c.Overseer Overseer (id=72104605605625866-127.0.0.1:39711_solr-n_0000000000) starting
   [junit4]   2> 2076978 INFO  (jetty-launcher-4830-thread-4) [n:127.0.0.1:38761_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 2076979 INFO  (zkCallback-4858-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 2076983 INFO  (zkCallback-4859-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 2076984 INFO  (jetty-launcher-4830-thread-4) [n:127.0.0.1:38761_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2076991 INFO  (jetty-launcher-4830-thread-1) [n:127.0.0.1:33315_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 2076992 INFO  (jetty-launcher-4830-thread-4) [n:127.0.0.1:38761_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 2076992 INFO  (jetty-launcher-4830-thread-4) [n:127.0.0.1:38761_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38761_solr
   [junit4]   2> 2076992 INFO  (zkCallback-4858-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 2076992 INFO  (zkCallback-4859-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 2077000 INFO  (zkCallback-4864-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 2077000 INFO  (zkCallback-4862-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 2077000 INFO  (jetty-launcher-4830-thread-1) [n:127.0.0.1:33315_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2077001 INFO  (jetty-launcher-4830-thread-1) [n:127.0.0.1:33315_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 2077001 INFO  (jetty-launcher-4830-thread-1) [n:127.0.0.1:33315_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33315_solr
   [junit4]   2> 2077002 INFO  (zkCallback-4858-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 2077002 INFO  (zkCallback-4859-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 2077007 INFO  (zkConnectionManagerCallback-4878-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2077007 INFO  (zkCallback-4864-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 2077007 INFO  (zkCallback-4862-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 2077007 INFO  (jetty-launcher-4830-thread-3) [n:127.0.0.1:39711_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 2077008 INFO  (jetty-launcher-4830-thread-3) [n:127.0.0.1:39711_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:46399/solr ready
   [junit4]   2> 2077020 INFO  (jetty-launcher-4830-thread-3) [n:127.0.0.1:39711_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 2077020 DEBUG (OverseerAutoScalingTriggerThread-72104605605625866-127.0.0.1:39711_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and .scheduled_maintenance triggers
   [junit4]   2> 2077020 INFO  (jetty-launcher-4830-thread-3) [n:127.0.0.1:39711_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39711_solr
   [junit4]   2> 2077021 INFO  (zkCallback-4859-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2077021 DEBUG (OverseerAutoScalingTriggerThread-72104605605625866-127.0.0.1:39711_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
   [junit4]   2> 2077021 INFO  (zkCallback-4864-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2077021 DEBUG (OverseerAutoScalingTriggerThread-72104605605625866-127.0.0.1:39711_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1
   [junit4]   2> 2077021 DEBUG (OverseerAutoScalingTriggerThread-72104605605625866-127.0.0.1:39711_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
   [junit4]   2> 2077027 INFO  (zkCallback-4858-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2077031 INFO  (zkCallback-4862-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2077039 INFO  (zkCallback-4877-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2077041 DEBUG (OverseerAutoScalingTriggerThread-72104605605625866-127.0.0.1:39711_solr-n_0000000000) [    ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial livenodes: [127.0.0.1:38761_solr, 127.0.0.1:42273_solr, 127.0.0.1:39711_solr, 127.0.0.1:33315_solr]
   [junit4]   2> 2077050 DEBUG (OverseerAutoScalingTriggerThread-72104605605625866-127.0.0.1:39711_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 2077051 DEBUG (OverseerAutoScalingTriggerThread-72104605605625866-127.0.0.1:39711_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
   [junit4]   2> 2077051 DEBUG (ScheduledTrigger-3884-thread-3) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 4
   [junit4]   2> 2077079 INFO  (jetty-launcher-4830-thread-2) [n:127.0.0.1:42273_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42273.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3f146787
   [junit4]   2> 2077086 INFO  (jetty-launcher-4830-thread-2) [n:127.0.0.1:42273_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42273.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3f146787
   [junit4]   2> 2077087 INFO  (jetty-launcher-4830-thread-2) [n:127.0.0.1:42273_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42273.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3f146787
   [junit4]   2> 2077087 INFO  (jetty-launcher-4830-thread-2) [n:127.0.0.1:42273_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.SearchRateTriggerTest_1CE770D1FE5D71F5-001/tempDir-001/node2/.
   [junit4]   2> 2077100 INFO  (jetty-launcher-4830-thread-1) [n:127.0.0.1:33315_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33315.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3f146787
   [junit4]   2> 2077102 INFO  (zkConnectionManagerCallback-4883-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2077103 INFO  (jetty-launcher-4830-thread-4) [n:127.0.0.1:38761_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38761.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3f146787
   [junit4]   2> 2077103 INFO  (jetty-launcher-4830-thread-2) [n:127.0.0.1:42273_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 2077103 INFO  (jetty-launcher-4830-thread-2) [n:127.0.0.1:42273_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:46399/solr ready
   [junit4]   2> 2077107 INFO  (jetty-launcher-4830-thread-4) [n:127.0.0.1:38761_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38761.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3f146787
   [junit4]   2> 2077107 INFO  (jetty-launcher-4830-thread-4) [n:127.0.0.1:38761_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38761.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3f146787
   [junit4]   2> 2077108 INFO  (jetty-launcher-4830-thread-4) [n:127.0.0.1:38761_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.SearchRateTriggerTest_1CE770D1FE5D71F5-001/tempDir-001/node4/.
   [junit4]   2> 2077110 INFO  (jetty-launcher-4830-thread-1) [n:127.0.0.1:33315_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33315.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3f146787
   [junit4]   2> 2077110 INFO  (jetty-launcher-4830-thread-1) [n:127.0.0.1:33315_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33315.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3f146787
   [junit4]   2> 2077111 INFO  (jetty-launcher-4830-thread-1) [n:127.0.0.1:33315_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.SearchRateTriggerTest_1CE770D1FE5D71F5-001/tempDir-001/node1/.
   [junit4]   2> 2077119 INFO  (zkConnectionManagerCallback-4888-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2077120 INFO  (jetty-launcher-4830-thread-4) [n:127.0.0.1:38761_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 2077120 INFO  (jetty-launcher-4830-thread-4) [n:127.0.0.1:38761_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:46399/solr ready
   [junit4]   2> 2077131 INFO  (zkConnectionManagerCallback-4893-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2077131 INFO  (jetty-launcher-4830-thread-1) [n:127.0.0.1:33315_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 2077132 INFO  (jetty-launcher-4830-thread-1) [n:127.0.0.1:33315_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:46399/solr ready
   [junit4]   2> 2077155 INFO  (jetty-launcher-4830-thread-3) [n:127.0.0.1:39711_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39711.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3f146787
   [junit4]   2> 2077159 INFO  (jetty-launcher-4830-thread-3) [n:127.0.0.1:39711_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39711.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3f146787
   [junit4]   2> 2077159 INFO  (jetty-launcher-4830-thread-3) [n:127.0.0.1:39711_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39711.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3f146787
   [junit4]   2> 2077160 INFO  (jetty-launcher-4830-thread-3) [n:127.0.0.1:39711_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.SearchRateTriggerTest_1CE770D1FE5D71F5-001/tempDir-001/node3/.
   [junit4]   2> 2077185 INFO  (zkConnectionManagerCallback-4895-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2077187 INFO  (zkConnectionManagerCallback-4900-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2077187 INFO  (SUITE-SearchRateTriggerTest-seed#[1CE770D1FE5D71F5]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 2077188 INFO  (SUITE-SearchRateTriggerTest-seed#[1CE770D1FE5D71F5]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:46399/solr ready
   [junit4]   2> 2077202 INFO  (TEST-SearchRateTriggerTest.testDefaultsAndBackcompat-seed#[1CE770D1FE5D71F5]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testDefaultsAndBackcompat
   [junit4]   2> 2077202 INFO  (TEST-SearchRateTriggerTest.testDefaultsAndBackcompat-seed#[1CE770D1FE5D71F5]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 2077206 INFO  (TEST-SearchRateTriggerTest.testDefaultsAndBackcompat-seed#[1CE770D1FE5D71F5]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testDefaultsAndBackcompat
   [junit4]   2> 2077219 INFO  (TEST-SearchRateTriggerTest.testWaitForElapsed-seed#[1CE770D1FE5D71F5]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testWaitForElapsed
   [junit4]   2> 2077220 INFO  (TEST-SearchRateTriggerTest.testWaitForElapsed-seed#[1CE770D1FE5D71F5]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 2077236 INFO  (qtp202199287-18745) [n:127.0.0.1:39711_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=2&collection.configName=conf&maxShardsPerNode=1&name=SearchRateTriggerTest-collection1&nrtReplicas=2&action=CREATE&numShards=2&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 2077237 INFO  (OverseerThreadFactory-3886-thread-1) [    ] o.a.s.c.a.c.CreateCollectionCmd Create collection SearchRateTriggerTest-collection1
   [junit4]   2> 2077347 INFO  (OverseerStateUpdate-72104605605625866-127.0.0.1:39711_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"SearchRateTriggerTest-collection1",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"SearchRateTriggerTest-collection1_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:42273/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 2077348 INFO  (OverseerStateUpdate-72104605605625866-127.0.0.1:39711_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"SearchRateTriggerTest-collection1",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"SearchRateTriggerTest-collection1_shard1_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:38761/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 2077349 INFO  (OverseerStateUpdate-72104605605625866-127.0.0.1:39711_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"SearchRateTriggerTest-collection1",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"SearchRateTriggerTest-collection1_shard2_replica_n4",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:39711/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 2077349 INFO  (OverseerStateUpdate-72104605605625866-127.0.0.1:39711_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"SearchRateTriggerTest-collection1",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"SearchRateTriggerTest-collection1_shard2_replica_n6",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:33315/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 2077555 INFO  (qtp202199287-18735) [n:127.0.0.1:39711_solr    x:SearchRateTriggerTest-collection1_shard2_replica_n4] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf&newCollection=true&name=SearchRateTriggerTest-collection1_shard2_replica_n4&action=CREATE&numShards=2&collection=SearchRateTriggerTest-collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 2077567 INFO  (qtp890494908-18761) [n:127.0.0.1:42273_solr    x:SearchRateTriggerTest-collection1_shard1_replica_n1] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=SearchRateTriggerTest-collection1_shard1_replica_n1&action=CREATE&numShards=2&collection=SearchRateTriggerTest-collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 2077567 INFO  (qtp890494908-18761) [n:127.0.0.1:42273_solr    x:SearchRateTriggerTest-collection1_shard1_replica_n1] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 2077569 INFO  (qtp688707540-18757) [n:127.0.0.1:33315_solr    x:SearchRateTriggerTest-collection1_shard2_replica_n6] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf&newCollection=true&name=SearchRateTriggerTest-collection1_shard2_replica_n6&action=CREATE&numShards=2&collection=SearchRateTriggerTest-collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 2077569 INFO  (qtp511710529-18752) [n:127.0.0.1:38761_solr    x:SearchRateTriggerTest-collection1_shard1_replica_n2] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=SearchRateTriggerTest-collection1_shard1_replica_n2&action=CREATE&numShards=2&collection=SearchRateTriggerTest-collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 2078052 DEBUG (ScheduledTrigger-3884-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 4
   [junit4]   2> 2078566 INFO  (qtp202199287-18735) [n:127.0.0.1:39711_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node7 x:SearchRateTriggerTest-collection1_shard2_replica_n4] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 2078579 INFO  (qtp202199287-18735) [n:127.0.0.1:39711_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node7 x:SearchRateTriggerTest-collection1_shard2_replica_n4] o.a.s.s.IndexSchema [SearchRateTriggerTest-collection1_shard2_replica_n4] Schema name=minimal
   [junit4]   2> 2078581 INFO  (qtp890494908-18761) [n:127.0.0.1:42273_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 2078581 INFO  (qtp202199287-18735) [n:127.0.0.1:39711_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node7 x:SearchRateTriggerTest-collection1_shard2_replica_n4] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 2078581 INFO  (qtp202199287-18735) [n:127.0.0.1:39711_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node7 x:SearchRateTriggerTest-collection1_shard2_replica_n4] o.a.s.c.CoreContainer Creating SolrCore 'SearchRateTriggerTest-collection1_shard2_replica_n4' using configuration from collection SearchRateTriggerTest-collection1, trusted=true
   [junit4]   2> 2078581 INFO  (qtp511710529-18752) [n:127.0.0.1:38761_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 2078581 INFO  (qtp688707540-18757) [n:127.0.0.1:33315_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 2078582 INFO  (qtp202199287-18735) [n:127.0.0.1:39711_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node7 x:SearchRateTriggerTest-collection1_shard2_replica_n4] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39711.solr.core.SearchRateTriggerTest-collection1.shard2.replica_n4' (registry 'solr.core.SearchRateTriggerTest-collection1.shard2.replica_n4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3f146787
   [junit4]   2> 2078582 INFO  (qtp202199287-18735) [n:127.0.0.1:39711_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node7 x:SearchRateTriggerTest-collection1_shard2_replica_n4] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 2078583 INFO  (qtp202199287-18735) [n:127.0.0.1:39711_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node7 x:SearchRateTriggerTest-collection1_shard2_replica_n4] o.a.s.c.SolrCore [[SearchRateTriggerTest-collection1_shard2_replica_n4] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.SearchRateTriggerTest_1CE770D1FE5D71F5-001/tempDir-001/node3/SearchRateTriggerTest-collection1_shard2_replica_n4], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.SearchRateTriggerTest_1CE770D1FE5D71F5-001/tempDir-001/node3/./SearchRateTriggerTest-collection1_shard2_replica_n4/data/]
   [junit4]   2> 2078587 INFO  (qtp890494908-18761) [n:127.0.0.1:42273_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1] o.a.s.s.IndexSchema [SearchRateTriggerTest-collection1_shard1_replica_n1] Schema name=minimal
   [junit4]   2> 2078588 INFO  (qtp511710529-18752) [n:127.0.0.1:38761_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2] o.a.s.s.IndexSchema [SearchRateTriggerTest-collection1_shard1_replica_n2] Schema name=minimal
   [junit4]   2> 2078588 INFO  (qtp688707540-18757) [n:127.0.0.1:33315_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6] o.a.s.s.IndexSchema [SearchRateTriggerTest-collection1_shard2_replica_n6] Schema name=minimal
   [junit4]   2> 2078595 INFO  (qtp890494908-18761) [n:127.0.0.1:42273_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 2078595 INFO  (qtp688707540-18757) [n:127.0.0.1:33315_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 2078595 INFO  (qtp890494908-18761) [n:127.0.0.1:42273_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'SearchRateTriggerTest-collection1_shard1_replica_n1' using configuration from collection SearchRateTriggerTest-collection1, trusted=true
   [junit4]   2> 2078595 INFO  (qtp688707540-18757) [n:127.0.0.1:33315_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6] o.a.s.c.CoreContainer Creating SolrCore 'SearchRateTriggerTest-collection1_shard2_replica_n6' using configuration from collection SearchRateTriggerTest-collection1, trusted=true
   [junit4]   2> 2078595 INFO  (qtp511710529-18752) [n:127.0.0.1:38761_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 2078595 INFO  (qtp511710529-18752) [n:127.0.0.1:38761_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'SearchRateTriggerTest-collection1_shard1_replica_n2' using configuration from collection SearchRateTriggerTest-collection1, trusted=true
   [junit4]   2> 2078596 INFO  (qtp511710529-18752) [n:127.0.0.1:38761_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38761.solr.core.SearchRateTriggerTest-collection1.shard1.replica_n2' (registry 'solr.core.SearchRateTriggerTest-collection1.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3f146787
   [junit4]   2> 2078596 INFO  (qtp890494908-18761) [n:127.0.0.1:42273_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42273.solr.core.SearchRateTriggerTest-collection1.shard1.replica_n1' (registry 'solr.core.SearchRateTriggerTest-collection1.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3f146787
   [junit4]   2> 2078596 INFO  (qtp688707540-18757) [n:127.0.0.1:33315_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33315.solr.core.SearchRateTriggerTest-collection1.shard2.replica_n6' (registry 'solr.core.SearchRateTriggerTest-collection1.shard2.replica_n6') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3f146787
   [junit4]   2> 2078596 INFO  (qtp511710529-18752) [n:127.0.0.1:38761_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 2078596 INFO  (qtp890494908-18761) [n:127.0.0.1:42273_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 2078596 INFO  (qtp511710529-18752) [n:127.0.0.1:38761_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2] o.a.s.c.SolrCore [[SearchRateTriggerTest-collection1_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.SearchRateTriggerTest_1CE770D1FE5D71F5-001/tempDir-001/node4/SearchRateTriggerTest-collection1_shard1_replica_n2], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.SearchRateTriggerTest_1CE770D1FE5D71F5-001/tempDir-001/node4/./SearchRateTriggerTest-collection1_shard1_replica_n2/data/]
   [junit4]   2> 2078596 INFO  (qtp688707540-18757) [n:127.0.0.1:33315_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 2078596 INFO  (qtp890494908-18761) [n:127.0.0.1:42273_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1] o.a.s.c.SolrCore [[SearchRateTriggerTest-collection1_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.SearchRateTriggerTest_1CE770D1FE5D71F5-001/tempDir-001/node2/SearchRateTriggerTest-collection1_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.SearchRateTriggerTest_1CE770D1FE5D71F5-001/tempDir-001/node2/./SearchRateTriggerTest-collection1_shard1_replica_n1/data/]
   [junit4]   2> 2078596 INFO  (qtp688707540-18757) [n:127.0.0.1:33315_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6] o.a.s.c.SolrCore [[SearchRateTriggerTest-collection1_shard2_replica_n6] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.SearchRateTriggerTest_1CE770D1FE5D71F5-001/tempDir-001/node1/SearchRateTriggerTest-collection1_shard2_replica_n6], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.SearchRateTriggerTest_1CE770D1FE5D71F5-001/tempDir-001/node1/./SearchRateTriggerTest-collection1_shard2_replica_n6/data/]
   [junit4]   2> 2078626 INFO  (qtp890494908-18761) [n:127.0.0.1:42273_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 2078626 INFO  (qtp890494908-18761) [n:127.0.0.1:42273_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 2078626 INFO  (qtp890494908-18761) [n:127.0.0.1:42273_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 2078626 INFO  (qtp890494908-18761) [n:127.0.0.1:42273_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 2078627 INFO  (qtp890494908-18761) [n:127.0.0.1:42273_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@10e6840f[SearchRateTriggerTest-collection1_shard1_replica_n1] main]
   [junit4]   2> 2078628 INFO  (qtp890494908-18761) [n:127.0.0.1:42273_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 2078628 INFO  (qtp890494908-18761) [n:127.0.0.1:42273_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 2078635 INFO  (qtp890494908-18761) [n:127.0.0.1:42273_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 2078635 INFO  (searcherExecutor-3896-thread-1-processing-n:127.0.0.1:42273_solr x:SearchRateTriggerTest-collection1_shard1_replica_n1 c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3) [n:127.0.0.1:42273_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1] o.a.s.c.SolrCore [SearchRateTriggerTest-collection1_shard1_replica_n1] Registered new searcher Searcher@10e6840f[SearchRateTriggerTest-collection1_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2078635 INFO  (qtp890494908-18761) [n:127.0.0.1:42273_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1599551673196347392
   [junit4]   2> 2078637 INFO  (qtp688707540-18757) [n:127.0.0.1:33315_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 2078637 INFO  (qtp688707540-18757) [n:127.0.0.1:33315_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 2078637 INFO  (qtp688707540-18757) [n:127.0.0.1:33315_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 2078637 INFO  (qtp688707540-18757) [n:127.0.0.1:33315_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 2078638 INFO  (qtp688707540-18757) [n:127.0.0.1:33315_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6] o.a.s.s.SolrIndexSearcher Opening [Searcher@44e38e55[SearchRateTriggerTest-collection1_shard2_replica_n6] main]
   [junit4]   2> 2078638 INFO  (qtp890494908-18761) [n:127.0.0.1:42273_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1] o.a.s.c.ZkShardTerms Successful update of terms at /collections/SearchRateTriggerTest-collection1/terms/shard1 to Terms{values={core_node3=0}, version=0}
   [junit4]   2> 2078639 INFO  (qtp688707540-18757) [n:127.0.0.1:33315_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 2078639 INFO  (qtp688707540-18757) [n:127.0.0.1:33315_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 2078639 INFO  (qtp202199287-18735) [n:127.0.0.1:39711_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node7 x:SearchRateTriggerTest-collection1_shard2_replica_n4] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 2078639 INFO  (qtp202199287-18735) [n:127.0.0.1:39711_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node7 x:SearchRateTriggerTest-collection1_shard2_replica_n4] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 2078639 INFO  (qtp688707540-18757) [n:127.0.0.1:33315_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 2078640 INFO  (qtp890494908-18761) [n:127.0.0.1:42273_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=9999ms
   [junit4]   2> 2078640 INFO  (searcherExecutor-3897-thread-1-processing-n:127.0.0.1:33315_solr x:SearchRateTriggerTest-collection1_shard2_replica_n6 c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8) [n:127.0.0.1:33315_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6] o.a.s.c.SolrCore [SearchRateTriggerTest-collection1_shard2_replica_n6] Registered new searcher Searcher@44e38e55[SearchRateTriggerTest-collection1_shard2_replica_n6] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2078640 INFO  (qtp688707540-18757) [n:127.0.0.1:33315_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1599551673201590272
   [junit4]   2> 2078640 INFO  (qtp202199287-18735) [n:127.0.0.1:39711_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node7 x:SearchRateTriggerTest-collection1_shard2_replica_n4] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 2078640 INFO  (qtp202199287-18735) [n:127.0.0.1:39711_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node7 x:SearchRateTriggerTest-collection1_shard2_replica_n4] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 2078642 INFO  (qtp202199287-18735) [n:127.0.0.1:39711_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node7 x:SearchRateTriggerTest-collection1_shard2_replica_n4] o.a.s.s.SolrIndexSearcher Opening [Searcher@64b9617f[SearchRateTriggerTest-collection1_shard2_replica_n4] main]
   [junit4]   2> 2078642 INFO  (qtp202199287-18735) [n:127.0.0.1:39711_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node7 x:SearchRateTriggerTest-collection1_shard2_replica_n4] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 2078642 INFO  (qtp202199287-18735) [n:127.0.0.1:39711_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node7 x:SearchRateTriggerTest-collection1_shard2_replica_n4] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 2078643 INFO  (qtp688707540-18757) [n:127.0.0.1:33315_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6] o.a.s.c.ZkShardTerms Successful update of terms at /collections/SearchRateTriggerTest-collection1/terms/shard2 to Terms{values={core_node8=0}, version=0}
   [junit4]   2> 2078643 INFO  (qtp202199287-18735) [n:127.0.0.1:39711_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node7 x:SearchRateTriggerTest-collection1_shard2_replica_n4] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 2078643 INFO  (searcherExecutor-3895-thread-1-processing-n:127.0.0.1:39711_solr x:SearchRateTriggerTest-collection1_shard2_replica_n4 c:SearchRateTriggerTest-collection1 s:shard2 r:core_node7) [n:127.0.0.1:39711_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node7 x:SearchRateTriggerTest-collection1_shard2_replica_n4] o.a.s.c.SolrCore [SearchRateTriggerTest-collection1_shard2_replica_n4] Registered new searcher Searcher@64b9617f[SearchRateTriggerTest-collection1_shard2_replica_n4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2078643 INFO  (qtp202199287-18735) [n:127.0.0.1:39711_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node7 x:SearchRateTriggerTest-collection1_shard2_replica_n4] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1599551673204736000
   [junit4]   2> 2078644 INFO  (qtp688707540-18757) [n:127.0.0.1:33315_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard2: total=2 found=1 timeoutin=9999ms
   [junit4]   2> 2078645 INFO  (qtp511710529-18752) [n:127.0.0.1:38761_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 2078645 INFO  (qtp511710529-18752) [n:127.0.0.1:38761_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 2078646 INFO  (qtp511710529-18752) [n:127.0.0.1:38761_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 2078646 INFO  (qtp511710529-18752) [n:127.0.0.1:38761_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 2078646 INFO  (qtp202199287-18735) [n:127.0.0.1:39711_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node7 x:SearchRateTriggerTest-collection1_shard2_replica_n4] o.a.s.c.ZkShardTerms Successful update of terms at /collections/SearchRateTriggerTest-collection1/terms/shard2 to Terms{values={core_node7=0, core_node8=0}, version=1}
   [junit4]   2> 2078647 INFO  (qtp511710529-18752) [n:127.0.0.1:38761_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@770a93e0[SearchRateTriggerTest-collection1_shard1_replica_n2] main]
   [junit4]   2> 2078648 INFO  (qtp511710529-18752) [n:127.0.0.1:38761_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 2078648 INFO  (qtp511710529-18752) [n:127.0.0.1:38761_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 2078648 INFO  (qtp511710529-18752) [n:127.0.0.1:38761_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 2078649 INFO  (searcherExecutor-3898-thread-1-processing-n:127.0.0.1:38761_solr x:SearchRateTriggerTest-collection1_shard1_replica_n2 c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5) [n:127.0.0.1:38761_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2] o.a.s.c.SolrCore [SearchRateTriggerTest-collection1_shard1_replica_n2] Registered new searcher Searcher@770a93e0[SearchRateTriggerTest-collection1_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2078649 INFO  (qtp511710529-18752) [n:127.0.0.1:38761_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1599551673211027456
   [junit4]   2> 2078652 INFO  (qtp511710529-18752) [n:127.0.0.1:38761_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2] o.a.s.c.ZkShardTerms Successful update of terms at /collections/SearchRateTriggerTest-collection1/terms/shard1 to Terms{values={core_node3=0, core_node5=0}, version=1}
   [junit4]   2> 2079052 DEBUG (ScheduledTrigger-3884-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 4
   [junit4]   2> 2079141 INFO  (qtp890494908-18761) [n:127.0.0.1:42273_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 2079141 INFO  (qtp890494908-18761) [n:127.0.0.1:42273_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 2079141 INFO  (qtp890494908-18761) [n:127.0.0.1:42273_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:42273/solr/SearchRateTriggerTest-collection1_shard1_replica_n1/
   [junit4]   2> 2079141 INFO  (qtp890494908-18761) [n:127.0.0.1:42273_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1] o.a.s.u.PeerSync PeerSync: core=SearchRateTriggerTest-collection1_shard1_replica_n1 url=https://127.0.0.1:42273/solr START replicas=[https://127.0.0.1:38761/solr/SearchRateTriggerTest-collection1_shard1_replica_n2/] nUpdates=100
   [junit4]   2> 2079144 INFO  (qtp511710529-18751) [n:127.0.0.1:38761_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2] o.a.s.c.S.Request [SearchRateTriggerTest-collection1_shard1_replica_n2]  webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2079145 INFO  (qtp688707540-18757) [n:127.0.0.1:33315_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 2079145 INFO  (qtp688707540-18757) [n:127.0.0.1:33315_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 2079145 INFO  (qtp688707540-18757) [n:127.0.0.1:33315_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:33315/solr/SearchRateTriggerTest-collection1_shard2_replica_n6/
   [junit4]   2> 2079145 INFO  (qtp688707540-18757) [n:127.0.0.1:33315_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6] o.a.s.u.PeerSync PeerSync: core=SearchRateTriggerTest-collection1_shard2_replica_n6 url=https://127.0.0.1:33315/solr START replicas=[https://127.0.0.1:39711/solr/SearchRateTriggerTest-collection1_shard2_replica_n4/] nUpdates=100
   [junit4]   2> 2079147 INFO  (qtp202199287-18731) [n:127.0.0.1:39711_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node7 x:SearchRateTriggerTest-collection1_shard2_replica_n4] o.a.s.c.S.Request [SearchRateTriggerTest-collection1_shard2_replica_n4]  webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2079441 INFO  (qtp890494908-18761) [n:127.0.0.1:42273_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1] o.a.s.u.PeerSync PeerSync: core=SearchRateTriggerTest-collection1_shard1_replica_n1 url=https://127.0.0.1:42273/solr DONE.  We have no versions.  sync failed.
   [junit4]   2> 2079441 INFO  (qtp890494908-18761) [n:127.0.0.1:42273_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 2079441 INFO  (qtp890494908-18761) [n:127.0.0.1:42273_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 2079441 INFO  (qtp890494908-18761) [n:127.0.0.1:42273_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 2079443 INFO  (qtp890494908-18761) [n:127.0.0.1:42273_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:42273/solr/SearchRateTriggerTest-collection1_shard1_replica_n1/ shard1
   [junit4]   2> 2079445 INFO  (qtp688707540-18757) [n:127.0.0.1:33315_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6] o.a.s.u.PeerSync PeerSync: core=SearchRateTriggerTest-collection1_shard2_replica_n6 url=https://127.0.0.1:33315/solr DONE.  We have no versions.  sync failed.
   [junit4]   2> 2079445 INFO  (qtp688707540-18757) [n:127.0.0.1:33315_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 2079445 INFO  (qtp688707540-18757) [n:127.0.0.1:33315_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 2079445 INFO  (qtp688707540-18757) [n:127.0.0.1:33315_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 2079447 INFO  (qtp688707540-18757) [n:127.0.0.1:33315_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:33315/solr/SearchRateTriggerTest-collection1_shard2_replica_n6/ shard2
   [junit4]   2> 2079548 INFO  (qtp688707540-18757) [n:127.0.0.1:33315_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 2079549 INFO  (qtp688707540-18757) [n:127.0.0.1:33315_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf&newCollection=true&name=SearchRateTriggerTest-collection1_shard2_replica_n6&action=CREATE&numShards=2&collection=SearchRateTriggerTest-collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1979
   [junit4]   2> 2079595 INFO  (qtp890494908-18761) [n:127.0.0.1:42273_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 2079596 INFO  (qtp890494908-18761) [n:127.0.0.1:42273_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=SearchRateTriggerTest-collection1_shard1_replica_n1&action=CREATE&numShards=2&collection=SearchRateTriggerTest-collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2029
   [junit4]   2> 2079649 INFO  (qtp202199287-18735) [n:127.0.0.1:39711_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node7 x:SearchRateTriggerTest-collection1_shard2_replica_n4] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf&newCollection=true&name=SearchRateTriggerTest-collection1_shard2_replica_n4&action=CREATE&numShards=2&collection=SearchRateTriggerTest-collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2094
   [junit4]   2> 2079654 INFO  (qtp511710529-18752) [n:127.0.0.1:38761_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=SearchRateTriggerTest-collection1_shard1_replica_n2&action=CREATE&numShards=2&collection=SearchRateTriggerTest-collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2085
   [junit4]   2> 2079656 INFO  (qtp202199287-18745) [n:127.0.0.1:39711_solr    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 2079754 INFO  (zkCallback-4862-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/SearchRateTriggerTest-collection1/state.json] for collection [SearchRateTriggerTest-collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 2079754 INFO  (zkCallback-4858-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/SearchRateTriggerTest-collection1/state.json] for collection [SearchRateTriggerTest-collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 2079754 INFO  (zkCallback-4859-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/SearchRateTriggerTest-collection1/state.json] for collection [SearchRateTriggerTest-collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 2079754 INFO  (zkCallback-4864-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/SearchRateTriggerTest-collection1/state.json] for collection [SearchRateTriggerTest-collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 2080053 DEBUG (ScheduledTrigger-3884-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 4
   [junit4]   2> 2080656 INFO  (qtp202199287-18745) [n:127.0.0.1:39711_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=2&collection.configName=conf&maxShardsPerNode=1&name=SearchRateTriggerTest-collection1&nrtReplicas=2&action=CREATE&numShards=2&wt=javabin&version=2} status=0 QTime=3420
   [junit4]   2> 2080663 INFO  (qtp202199287-18755) [n:127.0.0.1:39711_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard2.replica_n4:QUERY./select.requestTimes:1minRate} status=0 QTime=1
   [junit4]   2> 2080666 INFO  (qtp511710529-18752) [n:127.0.0.1:38761_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard1.replica_n2:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2080669 INFO  (qtp688707540-18757) [n:127.0.0.1:33315_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard2.replica_n6:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2080673 INFO  (qtp890494908-18758) [n:127.0.0.1:42273_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard1.replica_n1:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2080686 INFO  (qtp202199287-18745) [n:127.0.0.1:39711_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard2.replica_n4:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2080687 INFO  (qtp511710529-18751) [n:127.0.0.1:38761_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard1.replica_n2:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2080689 INFO  (qtp688707540-18753) [n:127.0.0.1:33315_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard2.replica_n6:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2080691 INFO  (qtp890494908-18761) [n:127.0.0.1:42273_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard1.replica_n1:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2081053 DEBUG (ScheduledTrigger-3884-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 4
   [junit4]   2> 2081238 INFO  (OverseerCollectionConfigSetProcessor-72104605605625866-127.0.0.1:39711_solr-n_0000000000) [    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 2081692 INFO  (qtp202199287-18755) [n:127.0.0.1:39711_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard2.replica_n4:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2081694 INFO  (qtp511710529-18752) [n:127.0.0.1:38761_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard1.replica_n2:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2081695 INFO  (qtp688707540-18757) [n:127.0.0.1:33315_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard2.replica_n6:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2081696 INFO  (qtp890494908-18758) [n:127.0.0.1:42273_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard1.replica_n1:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2082053 DEBUG (ScheduledTrigger-3884-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 4
   [junit4]   2> 2082698 INFO  (qtp202199287-18745) [n:127.0.0.1:39711_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard2.replica_n4:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2082699 INFO  (qtp511710529-18751) [n:127.0.0.1:38761_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard1.replica_n2:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2082700 INFO  (qtp688707540-18753) [n:127.0.0.1:33315_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard2.replica_n6:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2082700 INFO  (qtp890494908-18761) [n:127.0.0.1:42273_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard1.replica_n1:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2083053 DEBUG (ScheduledTrigger-3884-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 4
   [junit4]   2> 2083702 INFO  (qtp202199287-18755) [n:127.0.0.1:39711_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard2.replica_n4:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2083703 INFO  (qtp511710529-18752) [n:127.0.0.1:38761_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard1.replica_n2:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2083704 INFO  (qtp688707540-18757) [n:127.0.0.1:33315_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard2.replica_n6:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2083704 INFO  (qtp890494908-18758) [n:127.0.0.1:42273_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard1.replica_n1:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2084053 DEBUG (ScheduledTrigger-3884-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 4
   [junit4]   2> 2084706 INFO  (qtp202199287-18745) [n:127.0.0.1:39711_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard2.replica_n4:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2084706 INFO  (qtp511710529-18751) [n:127.0.0.1:38761_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard1.replica_n2:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2084707 INFO  (qtp688707540-18753) [n:127.0.0.1:33315_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard2.replica_n6:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2084707 INFO  (qtp890494908-18761) [n:127.0.0.1:42273_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard1.replica_n1:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2085054 DEBUG (ScheduledTrigger-3884-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 4
   [junit4]   2> 2085709 INFO  (qtp202199287-18755) [n:127.0.0.1:39711_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard2.replica_n4:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2085710 INFO  (qtp511710529-18752) [n:127.0.0.1:38761_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard1.replica_n2:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2085711 INFO  (qtp688707540-18757) [n:127.0.0.1:33315_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard2.replica_n6:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2085712 INFO  (qtp890494908-18758) [n:127.0.0.1:42273_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard1.replica_n1:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2086054 DEBUG (ScheduledTrigger-3884-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 4
   [junit4]   2> 2086713 INFO  (qtp202199287-18745) [n:127.0.0.1:39711_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard2.replica_n4:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2086715 INFO  (qtp511710529-18751) [n:127.0.0.1:38761_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard1.replica_n2:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2086716 INFO  (qtp688707540-18753) [n:127.0.0.1:33315_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard2.replica_n6:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2086717 INFO  (qtp890494908-18761) [n:127.0.0.1:42273_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard1.replica_n1:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2087054 DEBUG (ScheduledTrigger-3884-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 4
   [junit4]   2> 2087718 INFO  (qtp202199287-18755) [n:127.0.0.1:39711_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard2.replica_n4:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2087719 INFO  (qtp511710529-18752) [n:127.0.0.1:38761_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard1.replica_n2:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2087720 INFO  (qtp688707540-18757) [n:127.0.0.1:33315_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard2.replica_n6:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2087720 INFO  (qtp890494908-18758) [n:127.0.0.1:42273_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard1.replica_n1:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2088054 DEBUG (ScheduledTrigger-3884-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 4
   [junit4]   2> 2088728 INFO  (qtp202199287-18745) [n:127.0.0.1:39711_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard2.replica_n4:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2088729 INFO  (qtp511710529-18751) [n:127.0.0.1:38761_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard1.replica_n2:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2088730 INFO  (qtp688707540-18753) [n:127.0.0.1:33315_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard2.replica_n6:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2088731 INFO  (qtp890494908-18761) [n:127.0.0.1:42273_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard1.replica_n1:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2089054 DEBUG (ScheduledTrigger-3884-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 4
   [junit4]   2> 2089733 INFO  (qtp202199287-18755) [n:127.0.0.1:39711_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard2.replica_n4:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2089734 INFO  (qtp511710529-18752) [n:127.0.0.1:38761_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard1.replica_n2:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2089735 INFO  (qtp688707540-18757) [n:127.0.0.1:33315_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard2.replica_n6:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2089736 INFO  (qtp890494908-18758) [n:127.0.0.1:42273_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard1.replica_n1:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2089738 INFO  (qtp202199287-18745) [n:127.0.0.1:39711_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard2.replica_n4:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2089739 INFO  (qtp511710529-18751) [n:127.0.0.1:38761_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard1.replica_n2:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2089740 INFO  (qtp688707540-18753) [n:127.0.0.1:33315_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard2.replica_n6:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2089740 INFO  (qtp890494908-18761) [n:127.0.0.1:42273_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard1.replica_n1:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2090055 DEBUG (ScheduledTrigger-3884-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 4
   [junit4]   2> 2090742 INFO  (qtp202199287-18755) [n:127.0.0.1:39711_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard2.replica_n4:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2090743 INFO  (qtp511710529-18752) [n:127.0.0.1:38761_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard1.replica_n2:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2090743 INFO  (qtp688707540-18757) [n:127.0.0.1:33315_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard2.replica_n6:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2090744 INFO  (qtp890494908-18758) [n:127.0.0.1:42273_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.SearchRateTriggerTest-collection1.shard1.replica_n1:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 2091055 DEBUG (ScheduledTrigger-3884-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 4
   [junit4]   2> 2091745 INFO  (qtp202199287-18745) [n:127.0.0.1:39711_solr    ] o.a.s.s.Htt

[...truncated too long message...]

on1] has occurred - updating... (live nodes size: [0])
   [junit4]   2> 50024 INFO  (zkCallback-33-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/SearchRateTriggerTest-collection1/state.json] for collection [SearchRateTriggerTest-collection1] has occurred - updating... (live nodes size: [0])
   [junit4]   2> 50026 INFO  (zkCallback-35-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/SearchRateTriggerTest-collection2/state.json] for collection [SearchRateTriggerTest-collection2] has occurred - updating... (live nodes size: [0])
   [junit4]   2> 50026 INFO  (zkCallback-29-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/SearchRateTriggerTest-collection2/state.json] for collection [SearchRateTriggerTest-collection2] has occurred - updating... (live nodes size: [0])
   [junit4]   2> 50026 INFO  (zkCallback-31-thread-3) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/SearchRateTriggerTest-collection2/state.json] for collection [SearchRateTriggerTest-collection2] has occurred - updating... (live nodes size: [0])
   [junit4]   2> 50026 INFO  (zkCallback-33-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/SearchRateTriggerTest-collection2/state.json] for collection [SearchRateTriggerTest-collection2] has occurred - updating... (live nodes size: [0])
   [junit4]   2> 50032 INFO  (coreCloseExecutor-91-thread-2) [n:127.0.0.1:37979_solr c:SearchRateTriggerTest-collection2 s:shard2 r:core_node6 x:SearchRateTriggerTest-collection2_shard2_replica_n4] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.SearchRateTriggerTest-collection2.shard2.leader, tag=768de2ec
   [junit4]   2> 50035 INFO  (coreCloseExecutor-92-thread-2) [n:127.0.0.1:35339_solr c:SearchRateTriggerTest-collection2 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection2_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.SearchRateTriggerTest-collection2.shard1.replica_n1, tag=42bad63a
   [junit4]   2> 50035 INFO  (coreCloseExecutor-92-thread-2) [n:127.0.0.1:35339_solr c:SearchRateTriggerTest-collection2 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection2_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@79e9f6c1: rootName = solr_35339, domain = solr.core.SearchRateTriggerTest-collection2.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.SearchRateTriggerTest-collection2.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@5c7e2388
   [junit4]   2> 50045 INFO  (coreCloseExecutor-92-thread-1) [n:127.0.0.1:35339_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node7 x:SearchRateTriggerTest-collection1_shard2_replica_n4] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.SearchRateTriggerTest-collection1.shard2.leader, tag=583730d3
   [junit4]   2> 50045 INFO  (coreCloseExecutor-92-thread-2) [n:127.0.0.1:35339_solr c:SearchRateTriggerTest-collection2 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection2_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.SearchRateTriggerTest-collection2.shard1.leader, tag=42bad63a
   [junit4]   2> 50092 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x1002ad27220000c, likely client has closed socket
   [junit4]   2> 50095 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x1002ad272200009, likely client has closed socket
   [junit4]   2> 50104 INFO  (jetty-closer-2-thread-4) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@68b67a6c{/solr,null,UNAVAILABLE}
   [junit4]   2> 50104 INFO  (jetty-closer-2-thread-4) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 50132 INFO  (jetty-closer-2-thread-2) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@549a51a2{/solr,null,UNAVAILABLE}
   [junit4]   2> 50132 INFO  (jetty-closer-2-thread-2) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 50148 INFO  (jetty-closer-2-thread-1) [    ] o.a.s.c.Overseer Overseer (id=72104677384126474-127.0.0.1:37979_solr-n_0000000000) closing
   [junit4]   2> 50149 INFO  (OverseerStateUpdate-72104677384126474-127.0.0.1:37979_solr-n_0000000000) [    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:37979_solr
   [junit4]   2> 50165 WARN  (OverseerAutoScalingTriggerThread-72104677384126474-127.0.0.1:37979_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 50184 INFO  (jetty-closer-2-thread-1) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@a88b8cc{/solr,null,UNAVAILABLE}
   [junit4]   2> 50185 INFO  (jetty-closer-2-thread-1) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 51595 INFO  (jetty-closer-2-thread-3) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@5d867a2c{/solr,null,UNAVAILABLE}
   [junit4]   2> 51595 INFO  (jetty-closer-2-thread-3) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 51596 ERROR (SUITE-SearchRateTriggerTest-seed#[1CE770D1FE5D71F5]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 51597 INFO  (SUITE-SearchRateTriggerTest-seed#[1CE770D1FE5D71F5]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:34209 34209
   [junit4]   2> 52381 INFO  (Thread-0) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:34209 34209
   [junit4]   2> 52382 WARN  (Thread-0) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	13	/solr/collections/SearchRateTriggerTest-collection1/terms/shard2
   [junit4]   2> 	12	/solr/aliases.json
   [junit4]   2> 	12	/solr/collections/SearchRateTriggerTest-collection1/terms/shard1
   [junit4]   2> 	8	/solr/configs/conf
   [junit4]   2> 	5	/solr/collections/SearchRateTriggerTest-collection2/terms/shard2
   [junit4]   2> 	5	/solr/collections/SearchRateTriggerTest-collection2/terms/shard1
   [junit4]   2> 	4	/solr/security.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	12	/solr/clusterprops.json
   [junit4]   2> 	12	/solr/clusterstate.json
   [junit4]   2> 	8	/solr/collections/SearchRateTriggerTest-collection1/state.json
   [junit4]   2> 	4	/solr/collections/SearchRateTriggerTest-collection2/state.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	23	/solr/collections
   [junit4]   2> 	12	/solr/live_nodes
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.SearchRateTriggerTest_1CE770D1FE5D71F5-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=1344, maxMBSortInHeap=7.584110921217562, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@3b41b892), locale=no-NO, timezone=HST
   [junit4]   2> NOTE: Linux 4.13.0-39-generic amd64/Oracle Corporation 9.0.4 (64-bit)/cpus=8,threads=1,free=369258040,total=514326528
   [junit4]   2> NOTE: All tests run in this JVM: [SearchRateTriggerTest]
   [junit4] Completed [1/5 (1!)] on J0 in 51.20s, 3 tests, 1 failure <<< FAILURES!

[...truncated 36 lines...]
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1568: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1092: There were test failures: 5 suites, 15 tests, 1 failure [seed: 1CE770D1FE5D71F5]

Total time: 2 minutes 24 seconds

[repro] Setting last failure code to 256

[repro] Failures:
[repro]   1/5 failed: org.apache.solr.cloud.autoscaling.SearchRateTriggerTest
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=ad0ad2ec891b7c122ddf5b0385a9e4b984e78b38, workspace=/var/lib/jenkins/workspace/Lucene-Solr-master-Linux
[WARNINGS] Computing warning deltas based on reference build #21955
Recording test results
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2