You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2018/12/11 18:15:13 UTC

[JENKINS] Lucene-Solr-7.x-Linux (64bit/jdk-9.0.4) - Build # 3204 - Unstable!

Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/3204/
Java: 64bit/jdk-9.0.4 -XX:+UseCompressedOops -XX:+UseG1GC

1 tests failed.
FAILED:  org.apache.solr.cloud.autoscaling.sim.TestSimLargeCluster.testSearchRate

Error Message:


Stack Trace:
java.util.ConcurrentModificationException
	at __randomizedtesting.SeedInfo.seed([E857361A83F9EABB:B51F28934C3F4CF4]:0)
	at java.base/java.util.ArrayList$Itr.checkForComodification(ArrayList.java:939)
	at java.base/java.util.ArrayList$Itr.next(ArrayList.java:893)
	at java.base/java.util.AbstractCollection.toString(AbstractCollection.java:472)
	at java.base/java.lang.String.valueOf(String.java:2801)
	at java.base/java.lang.StringBuilder.append(StringBuilder.java:135)
	at java.base/java.util.concurrent.ConcurrentHashMap.toString(ConcurrentHashMap.java:1341)
	at org.apache.solr.cloud.autoscaling.sim.TestSimLargeCluster.testSearchRate(TestSimLargeCluster.java:704)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)




Build Log:
[...truncated 14661 lines...]
   [junit4] Suite: org.apache.solr.cloud.autoscaling.sim.TestSimLargeCluster
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.sim.TestSimLargeCluster_E857361A83F9EABB-001/init-core-data-001
   [junit4]   2> 1322555 INFO  (SUITE-TestSimLargeCluster-seed#[E857361A83F9EABB]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 1322556 INFO  (SUITE-TestSimLargeCluster-seed#[E857361A83F9EABB]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0)
   [junit4]   2> 1322556 INFO  (SUITE-TestSimLargeCluster-seed#[E857361A83F9EABB]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 1322558 DEBUG (SUITE-TestSimLargeCluster-seed#[E857361A83F9EABB]-worker) [    ] o.a.s.c.a.s.SimClusterStateProvider --- new Overseer leader: 127.0.0.1:10212_solr
   [junit4]   2> 1322558 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and .scheduled_maintenance triggers
   [junit4]   2> 1322558 DEBUG (SUITE-TestSimLargeCluster-seed#[E857361A83F9EABB]-worker) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=0
   [junit4]   2> 1322558 DEBUG (SUITE-TestSimLargeCluster-seed#[E857361A83F9EABB]-worker) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 0
   [junit4]   2> 1322558 INFO  (SUITE-TestSimLargeCluster-seed#[E857361A83F9EABB]-worker) [    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 1322558 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 0
   [junit4]   2> 1322559 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 0, lastZnodeVersion -1
   [junit4]   2> 1322559 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 0
   [junit4]   2> 1322559 INFO  (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial livenodes: [127.0.0.1:10230_solr, 127.0.0.1:10212_solr, 127.0.0.1:10218_solr, 127.0.0.1:10226_solr, 127.0.0.1:10225_solr, 127.0.0.1:10229_solr, 127.0.0.1:10228_solr, 127.0.0.1:10220_solr, 127.0.0.1:10215_solr, 127.0.0.1:10223_solr, 127.0.0.1:10224_solr, 127.0.0.1:10213_solr, 127.0.0.1:10217_solr, 127.0.0.1:10221_solr, 127.0.0.1:10219_solr, 127.0.0.1:10216_solr, 127.0.0.1:10214_solr, 127.0.0.1:10222_solr, 127.0.0.1:10227_solr]
   [junit4]   2> 1322560 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 1322560 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 0, lastZnodeVersion 0
   [junit4]   2> 1322560 INFO  (ScheduledTrigger-8449-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 38 and last live nodes: 19
   [junit4]   2> 1322564 INFO  (TEST-TestSimLargeCluster.testSearchRate-seed#[E857361A83F9EABB]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testSearchRate
   [junit4]   2> 1322564 DEBUG (TEST-TestSimLargeCluster.testSearchRate-seed#[E857361A83F9EABB]) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
   [junit4]   2> 1322564 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
   [junit4]   2> 1322565 INFO  (TEST-TestSimLargeCluster.testSearchRate-seed#[E857361A83F9EABB]) [    ] o.a.s.c.a.s.SimCloudManager === Restarting OverseerTriggerThread and clearing object cache...
   [junit4]   2> 1322565 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
   [junit4]   2> 1322565 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 1322565 DEBUG (TEST-TestSimLargeCluster.testSearchRate-seed#[E857361A83F9EABB]) [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
   [junit4]   2> 1322565 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and .scheduled_maintenance triggers
   [junit4]   2> 1322565 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 2
   [junit4]   2> 1322565 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion -1
   [junit4]   2> 1322565 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
   [junit4]   2> 1322566 INFO  (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial livenodes: [127.0.0.1:10251_solr, 127.0.0.1:10296_solr, 127.0.0.1:10218_solr, 127.0.0.1:10282_solr, 127.0.0.1:10249_solr, 127.0.0.1:10279_solr, 127.0.0.1:10304_solr, 127.0.0.1:10234_solr, 127.0.0.1:10265_solr, 127.0.0.1:10220_solr, 127.0.0.1:10281_solr, 127.0.0.1:10266_solr, 127.0.0.1:10221_solr, 127.0.0.1:10219_solr, 127.0.0.1:10235_solr, 127.0.0.1:10233_solr, 127.0.0.1:10236_solr, 127.0.0.1:10305_solr, 127.0.0.1:10247_solr, 127.0.0.1:10252_solr, 127.0.0.1:10302_solr, 127.0.0.1:10284_solr, 127.0.0.1:10298_solr, 127.0.0.1:10295_solr, 127.0.0.1:10217_solr, 127.0.0.1:10222_solr, 127.0.0.1:10262_solr, 127.0.0.1:10231_solr, 127.0.0.1:10215_solr, 127.0.0.1:10268_solr, 127.0.0.1:10224_solr, 127.0.0.1:10263_solr, 127.0.0.1:10269_solr, 127.0.0.1:10246_solr, 127.0.0.1:10285_solr, 127.0.0.1:10240_solr, 127.0.0.1:10275_solr, 127.0.0.1:10278_solr, 127.0.0.1:10250_solr, 127.0.0.1:10297_solr, 127.0.0.1:10300_solr, 127.0.0.1:10259_solr, 127.0.0.1:10291_solr, 127.0.0.1:10294_solr, 127.0.0.1:10309_solr, 127.0.0.1:10237_solr, 127.0.0.1:10253_solr, 127.0.0.1:10256_solr, 127.0.0.1:10306_solr, 127.0.0.1:10303_solr, 127.0.0.1:10272_solr, 127.0.0.1:10257_solr, 127.0.0.1:10212_solr, 127.0.0.1:10226_solr, 127.0.0.1:10290_solr, 127.0.0.1:10273_solr, 127.0.0.1:10260_solr, 127.0.0.1:10258_solr, 127.0.0.1:10213_solr, 127.0.0.1:10274_solr, 127.0.0.1:10288_solr, 127.0.0.1:10243_solr, 127.0.0.1:10227_solr, 127.0.0.1:10230_solr, 127.0.0.1:10308_solr, 127.0.0.1:10225_solr, 127.0.0.1:10228_solr, 127.0.0.1:10241_solr, 127.0.0.1:10292_solr, 127.0.0.1:10255_solr, 127.0.0.1:10310_solr, 127.0.0.1:10239_solr, 127.0.0.1:10244_solr, 127.0.0.1:10287_solr, 127.0.0.1:10214_solr, 127.0.0.1:10254_solr, 127.0.0.1:10293_solr, 127.0.0.1:10229_solr, 127.0.0.1:10299_solr, 127.0.0.1:10271_solr, 127.0.0.1:10276_solr, 127.0.0.1:10307_solr, 127.0.0.1:10223_solr, 127.0.0.1:10238_solr, 127.0.0.1:10270_solr, 127.0.0.1:10301_solr, 127.0.0.1:10232_solr, 127.0.0.1:10216_solr, 127.0.0.1:10277_solr, 127.0.0.1:10261_solr, 127.0.0.1:10286_solr, 127.0.0.1:10289_solr, 127.0.0.1:10245_solr, 127.0.0.1:10242_solr, 127.0.0.1:10280_solr, 127.0.0.1:10283_solr, 127.0.0.1:10267_solr, 127.0.0.1:10311_solr, 127.0.0.1:10248_solr, 127.0.0.1:10264_solr]
   [junit4]   2> 1322566 INFO  (ScheduledTrigger-8454-thread-1) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1322569 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 1322569 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
   [junit4]   2> 1322586 INFO  (ScheduledTrigger-8454-thread-3) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1322607 INFO  (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1322627 INFO  (ScheduledTrigger-8454-thread-1) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1322647 INFO  (ScheduledTrigger-8454-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1322667 INFO  (ScheduledTrigger-8454-thread-1) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1322688 INFO  (ScheduledTrigger-8454-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1322708 INFO  (ScheduledTrigger-8454-thread-1) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1322728 INFO  (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1322748 INFO  (ScheduledTrigger-8454-thread-1) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1322766 DEBUG (simCloudManagerPool-8453-thread-1) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=1
   [junit4]   2> 1322766 DEBUG (simCloudManagerPool-8453-thread-1) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 1
   [junit4]   2> 1322767 DEBUG (simCloudManagerPool-8453-thread-1) [    ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 1322767 DEBUG (simCloudManagerPool-8453-thread-1) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 3
   [junit4]   2> 1322767 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 3
   [junit4]   2> 1322767 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 1322767 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion 3
   [junit4]   2> 1322768 DEBUG (simCloudManagerPool-8453-thread-2) [    ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 1322768 DEBUG (simCloudManagerPool-8453-thread-2) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 4
   [junit4]   2> 1322768 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 4
   [junit4]   2> 1322768 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
   [junit4]   2> 1322768 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 1322768 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 4, lastZnodeVersion 4
   [junit4]   2> 1322768 DEBUG (simCloudManagerPool-8453-thread-3) [    ] o.a.s.c.a.s.SimClusterStateProvider -- simCreateCollection testSearchRate, currentVersion=2
   [junit4]   2> 1322768 DEBUG (simCloudManagerPool-8453-thread-3) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=2
   [junit4]   2> 1322769 DEBUG (simCloudManagerPool-8453-thread-3) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 2
   [junit4]   2> 1322779 DEBUG (simCloudManagerPool-8453-thread-3) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=3
   [junit4]   2> 1322779 DEBUG (simCloudManagerPool-8453-thread-3) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 3
   [junit4]   2> 1322898 DEBUG (simCloudManagerPool-8453-thread-3) [    ] o.a.s.c.a.s.SimClusterStateProvider -- finished createCollection testSearchRate, currentVersion=4
   [junit4]   2> 1322906 DEBUG (simCloudManagerPool-8453-thread-4) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=4
   [junit4]   2> 1322906 DEBUG (simCloudManagerPool-8453-thread-4) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 4
   [junit4]   2> 1322917 DEBUG (simCloudManagerPool-8453-thread-5) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=5
   [junit4]   2> 1322917 DEBUG (simCloudManagerPool-8453-thread-5) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 5
   [junit4]   2> 1322927 DEBUG (simCloudManagerPool-8453-thread-6) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=6
   [junit4]   2> 1322927 DEBUG (simCloudManagerPool-8453-thread-6) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 6
   [junit4]   2> 1322938 DEBUG (simCloudManagerPool-8453-thread-7) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=7
   [junit4]   2> 1322938 DEBUG (simCloudManagerPool-8453-thread-7) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 7
   [junit4]   2> 1322948 DEBUG (simCloudManagerPool-8453-thread-8) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=8
   [junit4]   2> 1322948 DEBUG (simCloudManagerPool-8453-thread-8) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 8
   [junit4]   2> 1322959 DEBUG (simCloudManagerPool-8453-thread-9) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=9
   [junit4]   2> 1322959 DEBUG (simCloudManagerPool-8453-thread-9) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 9
   [junit4]   2> 1322969 DEBUG (simCloudManagerPool-8453-thread-10) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=10
   [junit4]   2> 1322969 DEBUG (simCloudManagerPool-8453-thread-10) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 10
   [junit4]   2> 1322980 DEBUG (simCloudManagerPool-8453-thread-11) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=11
   [junit4]   2> 1322980 DEBUG (simCloudManagerPool-8453-thread-11) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 11
   [junit4]   2> 1322990 DEBUG (simCloudManagerPool-8453-thread-12) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=12
   [junit4]   2> 1322990 DEBUG (simCloudManagerPool-8453-thread-12) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 12
   [junit4]   2> 1323001 DEBUG (simCloudManagerPool-8453-thread-13) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=13
   [junit4]   2> 1323001 DEBUG (simCloudManagerPool-8453-thread-13) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 13
   [junit4]   2> 1323011 DEBUG (simCloudManagerPool-8453-thread-14) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=14
   [junit4]   2> 1323012 DEBUG (simCloudManagerPool-8453-thread-14) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 14
   [junit4]   2> 1323022 DEBUG (simCloudManagerPool-8453-thread-15) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=15
   [junit4]   2> 1323022 DEBUG (simCloudManagerPool-8453-thread-15) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 15
   [junit4]   2> 1323023 DEBUG (simCloudManagerPool-8453-thread-36) [    ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testSearchRate / shard2 (currentVersion=16): {"core_node12":{
   [junit4]   2>     "core":"testSearchRate_shard2_replica_n12",
   [junit4]   2>     "shard":"shard2",
   [junit4]   2>     "collection":"testSearchRate",
   [junit4]   2>     "node_name":"127.0.0.1:10277_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0}}
   [junit4]   2> 1323033 DEBUG (simCloudManagerPool-8453-thread-16) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=16
   [junit4]   2> 1323033 DEBUG (simCloudManagerPool-8453-thread-16) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 16
   [junit4]   2> 1323043 DEBUG (simCloudManagerPool-8453-thread-17) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=17
   [junit4]   2> 1323044 DEBUG (simCloudManagerPool-8453-thread-17) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 17
   [junit4]   2> 1323054 DEBUG (simCloudManagerPool-8453-thread-18) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=18
   [junit4]   2> 1323054 DEBUG (simCloudManagerPool-8453-thread-18) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 18
   [junit4]   2> 1323064 DEBUG (simCloudManagerPool-8453-thread-19) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=19
   [junit4]   2> 1323065 DEBUG (simCloudManagerPool-8453-thread-19) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 19
   [junit4]   2> 1323075 DEBUG (simCloudManagerPool-8453-thread-20) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=20
   [junit4]   2> 1323075 DEBUG (simCloudManagerPool-8453-thread-20) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 20
   [junit4]   2> 1323086 DEBUG (simCloudManagerPool-8453-thread-21) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=21
   [junit4]   2> 1323086 DEBUG (simCloudManagerPool-8453-thread-21) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 21
   [junit4]   2> 1323096 DEBUG (simCloudManagerPool-8453-thread-22) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=22
   [junit4]   2> 1323096 DEBUG (simCloudManagerPool-8453-thread-22) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 22
   [junit4]   2> 1323107 DEBUG (simCloudManagerPool-8453-thread-23) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=23
   [junit4]   2> 1323107 DEBUG (simCloudManagerPool-8453-thread-23) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 23
   [junit4]   2> 1323107 DEBUG (TEST-TestSimLargeCluster.testSearchRate-seed#[E857361A83F9EABB]) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=24
   [junit4]   2> 1323107 DEBUG (TEST-TestSimLargeCluster.testSearchRate-seed#[E857361A83F9EABB]) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 24
   [junit4]   2> 1323108 INFO  (TEST-TestSimLargeCluster.testSearchRate-seed#[E857361A83F9EABB]) [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard1]
   [junit4]   2> 1323108 DEBUG (simCloudManagerPool-8453-thread-24) [    ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testSearchRate / shard1 (currentVersion=25): {"core_node1":{
   [junit4]   2>     "core":"testSearchRate_shard1_replica_n1",
   [junit4]   2>     "shard":"shard1",
   [junit4]   2>     "collection":"testSearchRate",
   [junit4]   2>     "node_name":"127.0.0.1:10264_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0}}
   [junit4]   2> 1323109 INFO  (simCloudManagerPool-8453-thread-34) [    ] o.a.s.c.ActionThrottle Throttling leader attempts - waiting for 702ms
   [junit4]   2> 1323123 DEBUG (simCloudManagerPool-8453-thread-34) [    ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testSearchRate / shard2 (currentVersion=25): {"core_node11":{
   [junit4]   2>     "core":"testSearchRate_shard2_replica_n11",
   [junit4]   2>     "shard":"shard2",
   [junit4]   2>     "collection":"testSearchRate",
   [junit4]   2>     "node_name":"127.0.0.1:10261_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0}}
   [junit4]   2> 1323124 DEBUG (TEST-TestSimLargeCluster.testSearchRate-seed#[E857361A83F9EABB]) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=25
   [junit4]   2> 1323124 DEBUG (TEST-TestSimLargeCluster.testSearchRate-seed#[E857361A83F9EABB]) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 25
   [junit4]   2> 1323124 INFO  (TEST-TestSimLargeCluster.testSearchRate-seed#[E857361A83F9EABB]) [    ] o.a.s.c.a.s.TestSimLargeCluster Ready after 11297 ms
   [junit4]   2> 1323126 DEBUG (simCloudManagerPool-8453-thread-46) [    ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 1323126 DEBUG (simCloudManagerPool-8453-thread-46) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 5
   [junit4]   2> 1323126 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 5
   [junit4]   2> 1323126 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
   [junit4]   2> 1323126 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 1323126 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 5, lastZnodeVersion 5
   [junit4]   2> 1323127 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10276_solr
   [junit4]   2> 1323127 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10307_solr
   [junit4]   2> 1323127 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10223_solr
   [junit4]   2> 1323127 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10238_solr
   [junit4]   2> 1323127 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10270_solr
   [junit4]   2> 1323127 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10301_solr
   [junit4]   2> 1323127 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10232_solr
   [junit4]   2> 1323127 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10216_solr
   [junit4]   2> 1323127 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10277_solr
   [junit4]   2> 1323127 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10261_solr
   [junit4]   2> 1323127 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10286_solr
   [junit4]   2> 1323127 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ###  metrics:solr.core.testSearchRate.shard1.replica_n10:QUERY./select.requestTimes:1minRate	4
   [junit4]   2> 1323127 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10289_solr
   [junit4]   2> 1323127 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ###  metrics:solr.core.testSearchRate.shard1.replica_n9:QUERY./select.requestTimes:1minRate	4
   [junit4]   2> 1323127 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10245_solr
   [junit4]   2> 1323127 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ###  metrics:solr.core.testSearchRate.shard1.replica_n8:QUERY./select.requestTimes:1minRate	4
   [junit4]   2> 1323127 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10242_solr
   [junit4]   2> 1323127 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ###  metrics:solr.core.testSearchRate.shard1.replica_n7:QUERY./select.requestTimes:1minRate	4
   [junit4]   2> 1323127 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10280_solr
   [junit4]   2> 1323128 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ###  metrics:solr.core.testSearchRate.shard1.replica_n6:QUERY./select.requestTimes:1minRate	4
   [junit4]   2> 1323128 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10283_solr
   [junit4]   2> 1323128 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ###  metrics:solr.core.testSearchRate.shard1.replica_n5:QUERY./select.requestTimes:1minRate	4
   [junit4]   2> 1323128 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10267_solr
   [junit4]   2> 1323128 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ###  metrics:solr.core.testSearchRate.shard1.replica_n4:QUERY./select.requestTimes:1minRate	4
   [junit4]   2> 1323128 DEBUG (simCloudManagerPool-8453-thread-47) [    ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 1323128 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10311_solr
   [junit4]   2> 1323128 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ###  metrics:solr.core.testSearchRate.shard1.replica_n3:QUERY./select.requestTimes:1minRate	4
   [junit4]   2> 1323128 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10248_solr
   [junit4]   2> 1323128 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ###  metrics:solr.core.testSearchRate.shard1.replica_n2:QUERY./select.requestTimes:1minRate	4
   [junit4]   2> 1323128 DEBUG (simCloudManagerPool-8453-thread-47) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 6
   [junit4]   2> 1323128 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10264_solr
   [junit4]   2> 1323128 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ###  metrics:solr.core.testSearchRate.shard1.replica_n1:QUERY./select.requestTimes:1minRate	4
   [junit4]   2> 1323128 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 6
   [junit4]   2> 1323128 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ## Collection: testSearchRate
   [junit4]   2> 1323128 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
   [junit4]   2> 1323128 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 1323128 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 6, lastZnodeVersion 6
   [junit4]   2> 1323128 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##  - shard1
   [junit4]   2> 1323128 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##     testSearchRate_shard1_replica_n10  4.0
   [junit4]   2> 1323128 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##     testSearchRate_shard1_replica_n9  4.0
   [junit4]   2> 1323128 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##     testSearchRate_shard1_replica_n8  4.0
   [junit4]   2> 1323128 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##     testSearchRate_shard1_replica_n7  4.0
   [junit4]   2> 1323128 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##     testSearchRate_shard1_replica_n6  4.0
   [junit4]   2> 1323128 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##     testSearchRate_shard1_replica_n5  4.0
   [junit4]   2> 1323128 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##     testSearchRate_shard1_replica_n4  4.0
   [junit4]   2> 1323128 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##     testSearchRate_shard1_replica_n3  4.0
   [junit4]   2> 1323128 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##     testSearchRate_shard1_replica_n2  4.0
   [junit4]   2> 1323128 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##     testSearchRate_shard1_replica_n1  4.0
   [junit4]   2> 1323129 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger -- testSearchRate.shard1: totalShardRate=40.0, shardRate=4.0
   [junit4]   2> 1323149 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10276_solr
   [junit4]   2> 1323149 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10307_solr
   [junit4]   2> 1323149 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10223_solr
   [junit4]   2> 1323149 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10238_solr
   [junit4]   2> 1323149 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10270_solr
   [junit4]   2> 1323149 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10301_solr
   [junit4]   2> 1323149 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10232_solr
   [junit4]   2> 1323149 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10216_solr
   [junit4]   2> 1323149 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10277_solr
   [junit4]   2> 1323149 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10261_solr
   [junit4]   2> 1323149 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10286_solr
   [junit4]   2> 1323149 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ###  metrics:solr.core.testSearchRate.shard1.replica_n10:QUERY./select.requestTimes:1minRate	4
   [junit4]   2> 1323149 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10289_solr
   [junit4]   2> 1323149 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ###  metrics:solr.core.testSearchRate.shard1.replica_n9:QUERY./select.requestTimes:1minRate	4
   [junit4]   2> 1323149 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10245_solr
   [junit4]   2> 1323149 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ###  metrics:solr.core.testSearchRate.shard1.replica_n8:QUERY./select.requestTimes:1minRate	4
   [junit4]   2> 1323150 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10242_solr
   [junit4]   2> 1323150 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ###  metrics:solr.core.testSearchRate.shard1.replica_n7:QUERY./select.requestTimes:1minRate	4
   [junit4]   2> 1323150 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10280_solr
   [junit4]   2> 1323150 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ###  metrics:solr.core.testSearchRate.shard1.replica_n6:QUERY./select.requestTimes:1minRate	4
   [junit4]   2> 1323150 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10283_solr
   [junit4]   2> 1323150 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ###  metrics:solr.core.testSearchRate.shard1.replica_n5:QUERY./select.requestTimes:1minRate	4
   [junit4]   2> 1323150 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10267_solr
   [junit4]   2> 1323150 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ###  metrics:solr.core.testSearchRate.shard1.replica_n4:QUERY./select.requestTimes:1minRate	4
   [junit4]   2> 1323150 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10311_solr
   [junit4]   2> 1323150 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ###  metrics:solr.core.testSearchRate.shard1.replica_n3:QUERY./select.requestTimes:1minRate	4
   [junit4]   2> 1323150 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10248_solr
   [junit4]   2> 1323150 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ###  metrics:solr.core.testSearchRate.shard1.replica_n2:QUERY./select.requestTimes:1minRate	4
   [junit4]   2> 1323150 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10264_solr
   [junit4]   2> 1323150 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ###  metrics:solr.core.testSearchRate.shard1.replica_n1:QUERY./select.requestTimes:1minRate	4
   [junit4]   2> 1323150 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ## Collection: testSearchRate
   [junit4]   2> 1323150 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##  - shard1
   [junit4]   2> 1323150 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##     testSearchRate_shard1_replica_n10  4.0
   [junit4]   2> 1323150 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##     testSearchRate_shard1_replica_n9  4.0
   [junit4]   2> 1323150 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##     testSearchRate_shard1_replica_n8  4.0
   [junit4]   2> 1323150 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##     testSearchRate_shard1_replica_n7  4.0
   [junit4]   2> 1323150 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##     testSearchRate_shard1_replica_n6  4.0
   [junit4]   2> 1323150 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##     testSearchRate_shard1_replica_n5  4.0
   [junit4]   2> 1323150 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##     testSearchRate_shard1_replica_n4  4.0
   [junit4]   2> 1323150 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##     testSearchRate_shard1_replica_n3  4.0
   [junit4]   2> 1323150 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##     testSearchRate_shard1_replica_n2  4.0
   [junit4]   2> 1323150 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##     testSearchRate_shard1_replica_n1  4.0
   [junit4]   2> 1323150 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger -- testSearchRate.shard1: totalShardRate=40.0, shardRate=4.0
   [junit4]   2> 1323171 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10276_solr
   [junit4]   2> 1323171 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10307_solr
   [junit4]   2> 1323171 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10223_solr
   [junit4]   2> 1323171 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10238_solr
   [junit4]   2> 1323171 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10270_solr
   [junit4]   2> 1323171 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10301_solr
   [junit4]   2> 1323171 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10232_solr
   [junit4]   2> 1323171 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10216_solr
   [junit4]   2> 1323171 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10277_solr
   [junit4]   2> 1323171 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10261_solr
   [junit4]   2> 1323171 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10286_solr
   [junit4]   2> 1323171 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ###  metrics:solr.core.testSearchRate.shard1.replica_n10:QUERY./select.requestTimes:1minRate	4
   [junit4]   2> 1323171 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10289_solr
   [junit4]   2> 1323171 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ###  metrics:solr.core.testSearchRate.shard1.replica_n9:QUERY./select.requestTimes:1minRate	4
   [junit4]   2> 1323171 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10245_solr
   [junit4]   2> 1323171 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ###  metrics:solr.core.testSearchRate.shard1.replica_n8:QUERY./select.requestTimes:1minRate	4
   [junit4]   2> 1323171 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10242_solr
   [junit4]   2> 1323171 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ###  metrics:solr.core.testSearchRate.shard1.replica_n7:QUERY./select.requestTimes:1minRate	4
   [junit4]   2> 1323171 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10280_solr
   [junit4]   2> 1323171 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ###  metrics:solr.core.testSearchRate.shard1.replica_n6:QUERY./select.requestTimes:1minRate	4
   [junit4]   2> 1323171 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10283_solr
   [junit4]   2> 1323171 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ###  metrics:solr.core.testSearchRate.shard1.replica_n5:QUERY./select.requestTimes:1minRate	4
   [junit4]   2> 1323171 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10267_solr
   [junit4]   2> 1323171 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ###  metrics:solr.core.testSearchRate.shard1.replica_n4:QUERY./select.requestTimes:1minRate	4
   [junit4]   2> 1323171 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10311_solr
   [junit4]   2> 1323171 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ###  metrics:solr.core.testSearchRate.shard1.replica_n3:QUERY./select.requestTimes:1minRate	4
   [junit4]   2> 1323171 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10248_solr
   [junit4]   2> 1323171 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ###  metrics:solr.core.testSearchRate.shard1.replica_n2:QUERY./select.requestTimes:1minRate	4
   [junit4]   2> 1323171 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10264_solr
   [junit4]   2> 1323171 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ###  metrics:solr.core.testSearchRate.shard1.replica_n1:QUERY./select.requestTimes:1minRate	4
   [junit4]   2> 1323171 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ## Collection: testSearchRate
   [junit4]   2> 1323171 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##  - shard1
   [junit4]   2> 1323171 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##     testSearchRate_shard1_replica_n10  4.0
   [junit4]   2> 1323171 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##     testSearchRate_shard1_replica_n9  4.0
   [junit4]   2> 1323171 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##     testSearchRate_shard1_replica_n8  4.0
   [junit4]   2> 1323171 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##     testSearchRate_shard1_replica_n7  4.0
   [junit4]   2> 1323171 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##     testSearchRate_shard1_replica_n6  4.0
   [junit4]   2> 1323171 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##     testSearchRate_shard1_replica_n5  4.0
   [junit4]   2> 1323171 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##     testSearchRate_shard1_replica_n4  4.0
   [junit4]   2> 1323171 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##     testSearchRate_shard1_replica_n3  4.0
   [junit4]   2> 1323171 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##     testSearchRate_shard1_replica_n2  4.0
   [junit4]   2> 1323171 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##     testSearchRate_shard1_replica_n1  4.0
   [junit4]   2> 1323171 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger -- testSearchRate.shard1: totalShardRate=40.0, shardRate=4.0
   [junit4]   2> 1323192 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10276_solr
   [junit4]   2> 1323192 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10307_solr
   [junit4]   2> 1323192 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10223_solr
   [junit4]   2> 1323192 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10238_solr
   [junit4]   2> 1323192 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10270_solr
   [junit4]   2> 1323192 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10301_solr
   [junit4]   2> 1323192 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10232_solr
   [junit4]   2> 1323192 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10216_solr
   [junit4]   2> 1323192 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10277_solr
   [junit4]   2> 1323192 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10261_solr
   [junit4]   2> 1323192 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10286_solr
   [junit4]   2> 1323192 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ###  metrics:solr.core.testSearchRate.shard1.replica_n10:QUERY./select.requestTimes:1minRate	4
   [junit4]   2> 1323192 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10289_solr
   [junit4]   2> 1323192 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ###  metrics:solr.core.testSearchRate.shard1.replica_n9:QUERY./select.requestTimes:1minRate	4
   [junit4]   2> 1323192 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10245_solr
   [junit4]   2> 1323192 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ###  metrics:solr.core.testSearchRate.shard1.replica_n8:QUERY./select.requestTimes:1minRate	4
   [junit4]   2> 1323192 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10242_solr
   [junit4]   2> 1323192 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ###  metrics:solr.core.testSearchRate.shard1.replica_n7:QUERY./select.requestTimes:1minRate	4
   [junit4]   2> 1323192 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10280_solr
   [junit4]   2> 1323192 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ###  metrics:solr.core.testSearchRate.shard1.replica_n6:QUERY./select.requestTimes:1minRate	4
   [junit4]   2> 1323192 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10283_solr
   [junit4]   2> 1323192 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ###  metrics:solr.core.testSearchRate.shard1.replica_n5:QUERY./select.requestTimes:1minRate	4
   [junit4]   2> 1323192 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10267_solr
   [junit4]   2> 1323192 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ###  metrics:solr.core.testSearchRate.shard1.replica_n4:QUERY./select.requestTimes:1minRate	4
   [junit4]   2> 1323192 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10311_solr
   [junit4]   2> 1323192 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ###  metrics:solr.core.testSearchRate.shard1.replica_n3:QUERY./select.requestTimes:1minRate	4
   [junit4]   2> 1323192 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10248_solr
   [junit4]   2> 1323192 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ###  metrics:solr.core.testSearchRate.shard1.replica_n2:QUERY./select.requestTimes:1minRate	4
   [junit4]   2> 1323192 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10264_solr
   [junit4]   2> 1323192 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ###  metrics:solr.core.testSearchRate.shard1.replica_n1:QUERY./select.requestTimes:1minRate	4
   [junit4]   2> 1323192 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ## Collection: testSearchRate
   [junit4]   2> 1323192 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##  - shard1
   [junit4]   2> 1323192 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##     testSearchRate_shard1_replica_n10  4.0
   [junit4]   2> 1323192 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##     testSearchRate_shard1_replica_n9  4.0
   [junit4]   2> 1323192 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##     testSearchRate_shard1_replica_n8  4.0
   [junit4]   2> 1323192 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##     testSearchRate_shard1_replica_n7  4.0
   [junit4]   2> 1323192 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##     testSearchRate_shard1_replica_n6  4.0
   [junit4]   2> 1323192 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##     testSearchRate_shard1_replica_n5  4.0
   [junit4]   2> 1323192 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##     testSearchRate_shard1_replica_n4  4.0
   [junit4]   2> 1323192 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##     testSearchRate_shard1_replica_n3  4.0
   [junit4]   2> 1323192 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##     testSearchRate_shard1_replica_n2  4.0
   [junit4]   2> 1323192 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##     testSearchRate_shard1_replica_n1  4.0
   [junit4]   2> 1323193 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger -- testSearchRate.shard1: totalShardRate=40.0, shardRate=4.0
   [junit4]   2> 1323213 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10276_solr
   [junit4]   2> 1323213 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10307_solr
   [junit4]   2> 1323213 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10223_solr
   [junit4]   2> 1323213 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10238_solr
   [junit4]   2> 1323213 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10270_solr
   [junit4]   2> 1323213 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10301_solr
   [junit4]   2> 1323213 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10232_solr
   [junit4]   2> 1323213 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10216_solr
   [junit4]   2> 1323213 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10277_solr
   [junit4]   2> 1323213 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10261_solr
   [junit4]   2> 1323213 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10286_solr
   [junit4]   2> 1323213 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ###  metrics:solr.core.testSearchRate.shard1.replica_n10:QUERY./select.requestTimes:1minRate	4
   [junit4]   2> 1323213 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10289_solr
   [junit4]   2> 1323213 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ###  metrics:solr.core.testSearchRate.shard1.replica_n9:QUERY./select.requestTimes:1minRate	4
   [junit4]   2> 1323213 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10245_solr
   [junit4]   2> 1323213 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ###  metrics:solr.core.testSearchRate.shard1.replica_n8:QUERY./select.requestTimes:1minRate	4
   [junit4]   2> 1323214 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10242_solr
   [junit4]   2> 1323214 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ###  metrics:solr.core.testSearchRate.shard1.replica_n7:QUERY./select.requestTimes:1minRate	4
   [junit4]   2> 1323214 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10280_solr
   [junit4]   2> 1323214 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ###  metrics:solr.core.testSearchRate.shard1.replica_n6:QUERY./select.requestTimes:1minRate	4
   [junit4]   2> 1323214 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10283_solr
   [junit4]   2> 1323214 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ###  metrics:solr.core.testSearchRate.shard1.replica_n5:QUERY./select.requestTimes:1minRate	4
   [junit4]   2> 1323214 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10267_solr
   [junit4]   2> 1323214 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ###  metrics:solr.core.testSearchRate.shard1.replica_n4:QUERY./select.requestTimes:1minRate	4
   [junit4]   2> 1323214 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10311_solr
   [junit4]   2> 1323214 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ###  metrics:solr.core.testSearchRate.shard1.replica_n3:QUERY./select.requestTimes:1minRate	4
   [junit4]   2> 1323214 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10248_solr
   [junit4]   2> 1323214 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ###  metrics:solr.core.testSearchRate.shard1.replica_n2:QUERY./select.requestTimes:1minRate	4
   [junit4]   2> 1323214 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10264_solr
   [junit4]   2> 1323214 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ###  metrics:solr.core.testSearchRate.shard1.replica_n1:QUERY./select.requestTimes:1minRate	4
   [junit4]   2> 1323214 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ## Collection: testSearchRate
   [junit4]   2> 1323214 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##  - shard1
   [junit4]   2> 1323214 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##     testSearchRate_shard1_replica_n10  4.0
   [junit4]   2> 1323214 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##     testSearchRate_shard1_replica_n9  4.0
   [junit4]   2> 1323214 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##     testSearchRate_shard1_replica_n8  4.0
   [junit4]   2> 1323214 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##     testSearchRate_shard1_replica_n7  4.0
   [junit4]   2> 1323214 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##     testSearchRate_shard1_replica_n6  4.0
   [junit4]   2> 1323214 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##     testSearchRate_shard1_replica_n5  4.0
   [junit4]   2> 1323214 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##     testSearchRate_shard1_replica_n4  4.0
   [junit4]   2> 1323214 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##     testSearchRate_shard1_replica_n3  4.0
   [junit4]   2> 1323214 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##     testSearchRate_shard1_replica_n2  4.0
   [junit4]   2> 1323214 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##     testSearchRate_shard1_replica_n1  4.0
   [junit4]   2> 1323214 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger -- testSearchRate.shard1: totalShardRate=40.0, shardRate=4.0
   [junit4]   2> 1323235 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10276_solr
   [junit4]   2> 1323235 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10307_solr
   [junit4]   2> 1323235 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10223_solr
   [junit4]   2> 1323235 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10238_solr
   [junit4]   2> 1323235 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10270_solr
   [junit4]   2> 1323235 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10301_solr
   [junit4]   2> 1323235 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10232_solr
   [junit4]   2> 1323235 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10216_solr
   [junit4]   2> 1323235 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10277_solr
   [junit4]   2> 1323235 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10261_solr
   [junit4]   2> 1323235 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10286_solr
   [junit4]   2> 1323235 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ###  metrics:solr.core.testSearchRate.shard1.replica_n10:QUERY./select.requestTimes:1minRate	4
   [junit4]   2> 1323235 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10289_solr
   [junit4]   2> 1323235 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ###  metrics:solr.core.testSearchRate.shard1.replica_n9:QUERY./select.requestTimes:1minRate	4
   [junit4]   2> 1323235 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10245_solr
   [junit4]   2> 1323235 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ###  metrics:solr.core.testSearchRate.shard1.replica_n8:QUERY./select.requestTimes:1minRate	4
   [junit4]   2> 1323235 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10242_solr
   [junit4]   2> 1323235 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ###  metrics:solr.core.testSearchRate.shard1.replica_n7:QUERY./select.requestTimes:1minRate	4
   [junit4]   2> 1323235 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10280_solr
   [junit4]   2> 1323235 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ###  metrics:solr.core.testSearchRate.shard1.replica_n6:QUERY./select.requestTimes:1minRate	4
   [junit4]   2> 1323235 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10283_solr
   [junit4]   2> 1323235 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ###  metrics:solr.core.testSearchRate.shard1.replica_n5:QUERY./select.requestTimes:1minRate	4
   [junit4]   2> 1323235 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10267_solr
   [junit4]   2> 1323235 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ###  metrics:solr.core.testSearchRate.shard1.replica_n4:QUERY./select.requestTimes:1minRate	4
   [junit4]   2> 1323235 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10311_solr
   [junit4]   2> 1323235 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ###  metrics:solr.core.testSearchRate.shard1.replica_n3:QUERY./select.requestTimes:1minRate	4
   [junit4]   2> 1323235 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10248_solr
   [junit4]   2> 1323235 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ###  metrics:solr.core.testSearchRate.shard1.replica_n2:QUERY./select.requestTimes:1minRate	4
   [junit4]   2> 1323235 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10264_solr
   [junit4]   2> 1323235 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ###  metrics:solr.core.testSearchRate.shard1.replica_n1:QUERY./select.requestTimes:1minRate	4
   [junit4]   2> 1323235 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ## Collection: testSearchRate
   [junit4]   2> 1323235 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##  - shard1
   [junit4]   2> 1323235 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##     testSearchRate_shard1_replica_n10  4.0
   [junit4]   2> 1323236 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##     testSearchRate_shard1_replica_n9  4.0
   [junit4]   2> 1323236 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##     testSearchRate_shard1_replica_n8  4.0
   [junit4]   2> 1323236 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##     testSearchRate_shard1_replica_n7  4.0
   [junit4]   2> 1323236 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##     testSearchRate_shard1_replica_n6  4.0
   [junit4]   2> 1323236 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##     testSearchRate_shard1_replica_n5  4.0
   [junit4]   2> 1323236 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##     testSearchRate_shard1_replica_n4  4.0
   [junit4]   2> 1323236 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##     testSearchRate_shard1_replica_n3  4.0
   [junit4]   2> 1323236 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##     testSearchRate_shard1_replica_n2  4.0
   [junit4]   2> 1323236 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ##     testSearchRate_shard1_replica_n1  4.0
   [junit4]   2> 1323236 DEBUG (ScheduledTrigger-8454-thread-4) [    ] o.a.s.c.a.SearchRateTrigger -- testSearchRate.shard1: totalShardRate=40.0, shardRate=4.0
   [junit4]   2> 1323237 DEBUG (simCloudManagerPool-8453-thread-48) [    ] o.a.s.c.a.s.SimClusterStateProvider -- simCreateCollection .system, currentVersion=26
   [junit4]   2> 1323237 DEBUG (simCloudManagerPool-8453-thread-48) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=26
   [junit4]   2> 1323238 DEBUG (simCloudManagerPool-8453-thread-48) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 26
   [junit4]   2> 1323248 DEBUG (simCloudManagerPool-8453-thread-48) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=27
   [junit4]   2> 1323248 DEBUG (simCloudManagerPool-8453-thread-48) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 27
   [junit4]   2> 1323276 DEBUG (simCloudManagerPool-8453-thread-50) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=28
   [junit4]   2> 1323276 DEBUG (simCloudManagerPool-8453-thread-50) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 28
   [junit4]   2> 1323287 DEBUG (simCloudManagerPool-8453-thread-49) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=29
   [junit4]   2> 1323287 DEBUG (simCloudManagerPool-8453-thread-49) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 29
   [junit4]   2> 1323298 DEBUG (simCloudManagerPool-8453-thread-51) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=30
   [junit4]   2> 1323298 DEBUG (simCloudManagerPool-8453-thread-51) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 30
   [junit4]   2> 1323298 DEBUG (simCloudManagerPool-8453-thread-48) [    ] o.a.s.c.a.s.SimClusterStateProvider -- finished createCollection .system, currentVersion=31
   [junit4]   2> 1323298 INFO  (simCloudManagerPool-8453-thread-48) [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard1]
   [junit4]   2> 1323298 DEBUG (simCloudManagerPool-8453-thread-52) [    ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for .system / shard1 (currentVersion=31): {"core_node2":{
   [junit4]   2>     "core":".system_shard1_replica_n2",
   [junit4]   2>     "shard":"shard1",
   [junit4]   2>     "collection":".system",
   [junit4]   2>     "node_name":"127.0.0.1:10299_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0}}
   [junit4]   2> 1323300 DEBUG (simCloudManagerPool-8453-thread-48) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=31
   [junit4]   2> 1323301 DEBUG (simCloudManagerPool-8453-thread-48) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 31
   [junit4]   2> 1323301 DEBUG (AutoscalingActionExecutor-8455-thread-1) [    ] o.a.s.c.a.ComputePlanAction -- processing event: {
   [junit4]   2>   "id":"6a62488f6dcefT3m8vv37cscbleq4086j77vuob",
   [junit4]   2>   "source":"search_rate_trigger",
   [junit4]   2>   "eventTime":1871525707177199,
   [junit4]   2>   "eventType":"SEARCHRATE",
   [junit4]   2>   "properties":{
   [junit4]   2>     "hotReplicas":[
   [junit4]   2>       {"core_node10":{
   [junit4]   2>           "core":"testSearchRate_shard1_replica_n10",
   [junit4]   2>           "shard":"shard1",
   [junit4]   2>           "collection":"testSearchRate",
   [junit4]   2>           "node_name":"127.0.0.1:10286_solr",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":10240,
   [junit4]   2>           "rate":4.0,
   [junit4]   2>           "state":"active",
   [junit4]   2>           "QUERY./select.requestTimes:1minRate":4,
   [junit4]   2>           "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>           "SEARCHER.searcher.numDocs":0}},
   [junit4]   2>       {"core_node9":{
   [junit4]   2>           "core":"testSearchRate_shard1_replica_n9",
   [junit4]   2>           "shard":"shard1",
   [junit4]   2>           "collection":"testSearchRate",
   [junit4]   2>           "node_name":"127.0.0.1:10289_solr",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":10240,
   [junit4]   2>           "rate":4.0,
   [junit4]   2>           "state":"active",
   [junit4]   2>           "QUERY./select.requestTimes:1minRate":4,
   [junit4]   2>           "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>           "SEARCHER.searcher.numDocs":0}},
   [junit4]   2>       {"core_node8":{
   [junit4]   2>           "core":"testSearchRate_shard1_replica_n8",
   [junit4]   2>           "shard":"shard1",
   [junit4]   2>           "collection":"testSearchRate",
   [junit4]   2>           "node_name":"127.0.0.1:10245_solr",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":10240,
   [junit4]   2>           "rate":4.0,
   [junit4]   2>           "state":"active",
   [junit4]   2>           "QUERY./select.requestTimes:1minRate":4,
   [junit4]   2>           "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>           "SEARCHER.searcher.numDocs":0}},
   [junit4]   2>       {"core_node7":{
   [junit4]   2>           "core":"testSearchRate_shard1_replica_n7",
   [junit4]   2>           "shard":"shard1",
   [junit4]   2>           "collection":"testSearchRate",
   [junit4]   2>           "node_name":"127.0.0.1:10242_solr",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":10240,
   [junit4]   2>           "rate":4.0,
   [junit4]   2>           "state":"active",
   [junit4]   2>           "QUERY./select.requestTimes:1minRate":4,
   [junit4]   2>           "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>           "SEARCHER.searcher.numDocs":0}},
   [junit4]   2>       {"core_node6":{
   [junit4]   2>           "core":"testSearchRate_shard1_replica_n6",
   [junit4]   2>           "shard":"shard1",
   [junit4]   2>           "collection":"testSearchRate",
   [junit4]   2>           "node_name":"127.0.0.1:10280_solr",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":10240,
   [junit4]   2>           "rate":4.0,
   [junit4]   2>           "state":"active",
   [junit4]   2>           "QUERY./select.requestTimes:1minRate":4,
   [junit4]   2>           "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>           "SEARCHER.searcher.numDocs":0}},
   [junit4]   2>       {"core_node5":{
   [junit4]   2>           "core":"testSearchRate_shard1_replica_n5",
   [junit4]   2>           "shard":"shard1",
   [junit4]   2>           "collection":"testSearchRate",
   [junit4]   2>           "node_name":"127.0.0.1:10283_solr",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":10240,
   [junit4]   2>           "rate":4.0,
   [junit4]   2>           "state":"active",
   [junit4]   2>           "QUERY./select.requestTimes:1minRate":4,
   [junit4]   2>           "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>           "SEARCHER.searcher.numDocs":0}},
   [junit4]   2>       {"core_node4":{
   [junit4]   2>           "core":"testSearchRate_shard1_replica_n4",
   [junit4]   2>           "shard":"shard1",
   [junit4]   2>           "collection":"testSearchRate",
   [junit4]   2>           "node_name":"127.0.0.1:10267_solr",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":10240,
   [junit4]   2>           "rate":4.0,
   [junit4]   2>           "state":"active",
   [junit4]   2>           "QUERY./select.requestTimes:1minRate":4,
   [junit4]   2>           "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>           "SEARCHER.searcher.numDocs":0}},
   [junit4]   2>       {"core_node3":{
   [junit4]   2>           "core":"testSearchRate_shard1_replica_n3",
   [junit4]   2>           "shard":"shard1",
   [junit4]   2>           "collection":"testSearchRate",
   [junit4]   2>           "node_name":"127.0.0.1:10311_solr",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":10240,
   [junit4]   2>           "rate":4.0,
   [junit4]   2>           "state":"active",
   [junit4]   2>           "QUERY./select.requestTimes:1minRate":4,
   [junit4]   2>           "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>           "SEARCHER.searcher.numDocs":0}},
   [junit4]   2>       {"core_node2":{
   [junit4]   2>           "core":"testSearchRate_shard1_replica_n2",
   [junit4]   2>           "shard":"shard1",
   [junit4]   2>           "collection":"testSearchRate",
   [junit4]   2>           "node_name":"127.0.0.1:10248_solr",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":10240,
   [junit4]   2>           "rate":4.0,
   [junit4]   2>           "state":"active",
   [junit4]   2>           "QUERY./select.requestTimes:1minRate":4,
   [junit4]   2>           "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>           "SEARCHER.searcher.numDocs":0}},
   [junit4]   2>       {"core_node1":{
   [junit4]   2>           "core":"testSearchRate_shard1_replica_n1",
   [junit4]   2>           "shard":"shard1",
   [junit4]   2>           "collection":"testSearchRate",
   [junit4]   2>           "node_name":"127.0.0.1:10264_solr",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "leader":"true",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":10240,
   [junit4]   2>           "rate":4.0,
   [junit4]   2>           "state":"active",
   [junit4]   2>           "QUERY./select.requestTimes:1minRate":4,
   [junit4]   2>           "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>           "SEARCHER.searcher.numDocs":0}}],
   [junit4]   2>     "coldNodes":{},
   [junit4]   2>     "coldShards":{},
   [junit4]   2>     "coldReplicas":[],
   [junit4]   2>     "violationType":["hotShards"],
   [junit4]   2>     "coldCollections":{},
   [junit4]   2>     "hotShards":{"testSearchRate":{"shard1":4.0}},
   [junit4]   2>     "hotCollections":{"testSearchRate":40.0},
   [junit4]   2>     "hotNodes":{
   [junit4]   2>       "127.0.0.1:10242_solr":4.0,
   [junit4]   2>       "127.0.0.1:10245_solr":4.0,
   [junit4]   2>       "127.0.0.1:10286_solr":4.0,
   [junit4]   2>       "127.0.0.1:10280_solr":4.0,
   [junit4]   2>       "127.0.0.1:10283_solr":4.0,
   [junit4]   2>       "127.0.0.1:10267_solr":4.0,
   [junit4]   2>       "127.0.0.1:10311_solr":4.0,
   [junit4]   2>       "127.0.0.1:10289_solr":4.0,
   [junit4]   2>       "127.0.0.1:10248_solr":4.0,
   [junit4]   2>       "127.0.0.1:10264_solr":4.0},
   [junit4]   2>     "_enqueue_time_":1871531103123749,
   [junit4]   2>     "requestedOps":[{
   [junit4]   2>         "action":"ADDREPLICA",
   [junit4]   2>         "hints":{"COLL_SHARD":[{
   [junit4]   2>               "first":"testSearchRate",
   [junit4]   2>               "second":"shard1"}]}}]}} with context properties: {BEFORE_ACTION=[compute]}
   [junit4]   2> 1323308 DEBUG (AutoscalingActionExecutor-8455-thread-1) [    ] o.a.s.c.a.ComputePlanAction Computed Plan: action=ADDREPLICA&collection=testSearchRate&shard=shard1&node=127.0.0.1:10293_solr&type=NRT
   [junit4]   2> 1323308 DEBUG (AutoscalingActionExecutor-8455-thread-1) [    ] o.a.s.c.a.ExecutePlanAction -- processing event: {
   [junit4]   2>   "id":"6a62488f6dcefT3m8vv37cscbleq4086j77vuob",
   [junit4]   2>   "source":"search_rate_trigger",
   [junit4]   2>   "eventTime":1871525707177199,
   [junit4]   2>   "eventType":"SEARCHRATE",
   [junit4]   2>   "properties":{
   [junit4]   2>     "hotReplicas":[
   [junit4]   2>       {"core_node10":{
   [junit4]   2>           "core":"testSearchRate_shard1_replica_n10",
   [junit4]   2>           "shard":"shard1",
   [junit4]   2>           "collection":"testSearchRate",
   [junit4]   2>           "node_name":"127.0.0.1:10286_solr",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":10240,
   [junit4]   2>           "rate":4.0,
   [junit4]   2>           "state":"active",
   [junit4]   2>           "QUERY./select.requestTimes:1minRate":4,
   [junit4]   2>           "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>           "SEARCHER.searcher.numDocs":0}},
   [junit4]   2>       {"core_node9":{
   [junit4]   2>           "core":"testSearchRate_shard1_replica_n9",
   [junit4]   2>           "shard":"shard1",
   [junit4]   2>           "collection":"testSearchRate",
   [junit4]   2>           "node_name":"127.0.0.1:10289_solr",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":10240,
   [junit4]   2>           "rate":4.0,
   [junit4]   2>           "state":"active",
   [junit4]   2>           "QUERY./select.requestTimes:1minRate":4,
   [junit4]   2>           "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>           "SEARCHER.searcher.numDocs":0}},
   [junit4]   2>       {"core_node8":{
   [junit4]   2>           "core":"testSearchRate_shard1_replica_n8",
   [junit4]   2>           "shard":"shard1",
   [junit4]   2>           "collection":"testSearchRate",
   [junit4]   2>           "node_name":"127.0.0.1:10245_solr",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":10240,
   [junit4]   2>           "rate":4.0,
   [junit4]   2>           "state":"active",
   [junit4]   2>           "QUERY./select.requestTimes:1minRate":4,
   [junit4]   2>           "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>           "SEARCHER.searcher.numDocs":0}},
   [junit4]   2>       {"core_node7":{
   [junit4]   2>           "core":"testSearchRate_shard1_replica_n7",
   [junit4]   2>           "shard":"shard1",
   [junit4]   2>           "collection":"testSearchRate",
   [junit4]   2>           "node_name":"127.0.0.1:10242_solr",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":10240,
   [junit4]   2>           "rate":4.0,
   [junit4]   2>           "state":"active",
   [junit4]   2>           "QUERY./select.requestTimes:1minRate":4,
   [junit4]   2>           "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>           "SEARCHER.searcher.numDocs":0}},
   [junit4]   2>       {"core_node6":{
   [junit4]   2>           "core":"testSearchRate_shard1_replica_n6",
   [junit4]   2>           "shard":"shard1",
   [junit4]   2>           "collection":"testSearchRate",
   [junit4]   2>           "node_name":"127.0.0.1:10280_solr",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":10240,
   [junit4]   2>           "rate":4.0,
   [junit4]   2>           "state":"active",
   [junit4]   2>           "QUERY./select.requestTimes:1minRate":4,
   [junit4]   2>           "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>           "SEARCHER.searcher.numDocs":0}},
   [junit4]   2>       {"core_node5":{
   [junit4]   2>           "core":"testSearchRate_shard1_replica_n5",
   [junit4]   2>           "shard":"shard1",
   [junit4]   2>           "collection":"testSearchRate",
   [junit4]   2>           "node_name":"127.0.0.1:10283_solr",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":10240,
   [junit4]   2>           "rate":4.0,
   [junit4]   2>           "state":"active",
   [junit4]   2>           "QUERY./select.requestTimes:1minRate":4,
   [junit4]   2>           "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>           "SEARCHER.searcher.numDocs":0}},
   [junit4]   2>       {"core_node4":{
   [junit4]   2>           "core":"testSearchRate_shard1_replica_n4",
   [junit4]   2>           "shard":"shard1",
   [junit4]   2>           "collection":"testSearchRate",
   [junit4]   2>           "node_name":"127.0.0.1:10267_solr",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":10240,
   [junit4]   2>           "rate":4.0,
   [junit4]   2>           "state":"active",
   [junit4]   2>           "QUERY./select.requestTimes:1minRate":4,
   [junit4]   2>           "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>           "SEARCHER.searcher.numDocs":0}},
   [junit4]   2>       {"core_node3":{
   [junit4]   2>           "core":"testSearchRate_shard1_replica_n3",
   [junit4]   2>           "shard":"shard1",
   [junit4]   2>           "collection":"testSearchRate",
   [junit4]   2>           "node_name":"127.0.0.1:10311_solr",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":10240,
   [junit4]   2>           "rate":4.0,
   [junit4]   2>           "state":"active",
   [junit4]   2>           "QUERY./select.requestTimes:1minRate":4,
   [junit4]   2>           "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>           "SEARCHER.searcher.numDocs":0}},
   [junit4]   2>       {"core_node2":{
   [junit4]   2>           "core":"testSearchRate_shard1_replica_n2",
   [junit4]   2>           "shard":"shard1",
   [junit4]   2>           "collection":"testSearchRate",
   [junit4]   2>           "node_name":"127.0.0.1:10248_solr",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":10240,
   [junit4]   2>           "rate":4.0,
   [junit4]   2>           "state":"active",
   [junit4]   2>           "QUERY./select.requestTimes:1minRate":4,
   [junit4]   2>           "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>           "SEARCHER.searcher.numDocs":0}},
   [junit4]   2>       {"core_node1":{
   [junit4]   2>           "core":"testSearchRate_shard1_replica_n1",
   [junit4]   2>           "shard":"shard1",
   [junit4]   2>           "collection":"testSearchRate",
   [junit4]   2>           "node_name":"127.0.0.1:10264_solr",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "leader":"true",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":10240,
   [junit4]   2>           "rate":4.0,
   [junit4]   2>           "state":"active",
   [junit4]   2>           "QUERY./select.requestTimes:1minRate":4,
   [junit4]   2>           "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>           "SEARCHER.searcher.numDocs":0}}],
   [junit4]   2>     "__start__":1,
   [junit4]   2>     "coldNodes":{},
   [junit4]   2>     "coldShards":{},
   [junit4]   2>     "coldReplicas":[],
   [junit4]   2>     "violationType":["hotShards"],
   [junit4]   2>     "coldCollections":{},
   [junit4]   2>     "hotShards":{"testSearchRate":{"shard1":4.0}},
   [junit4]   2>     "hotCollections":{"testSearchRate":40.0},
   [junit4]   2>     "hotNodes":{
   [junit4]   2>       "127.0.0.1:10242_solr":4.0,
   [junit4]   2>       "127.0.0.1:10245_solr":4.0,
   [junit4]   2>       "127.0.0.1:10286_solr":4.0,
   [junit4]   2>       "127.0.0.1:10280_solr":4.0,
   [junit4]   2>       "127.0.0.1:10283_solr":4.0,
   [junit4]   2>       "127.0.0.1:10267_solr":4.0,
   [junit4]   2>       "127.0.0.1:10311_solr":4.0,
   [junit4]   2>       "127.0.0.1:10289_solr":4.0,
   [junit4]   2>       "127.0

[...truncated too long message...]

.. 6 more
   [junit4]   2> 1358982 DEBUG (TEST-TestSimLargeCluster.testAddNode-seed#[E857361A83F9EABB]) [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
   [junit4]   2> 1358987 DEBUG (TEST-TestSimLargeCluster.testAddNode-seed#[E857361A83F9EABB]) [    ] o.a.s.c.a.s.SimClusterStateProvider --- new Overseer leader: 127.0.0.1:10432_solr
   [junit4]   2> 1358987 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and .scheduled_maintenance triggers
   [junit4]   2> 1358988 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 0
   [junit4]   2> 1358988 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 0, lastZnodeVersion -1
   [junit4]   2> 1358988 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 0
   [junit4]   2> 1358989 DEBUG (TEST-TestSimLargeCluster.testAddNode-seed#[E857361A83F9EABB]) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=0
   [junit4]   2> 1358989 DEBUG (TEST-TestSimLargeCluster.testAddNode-seed#[E857361A83F9EABB]) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 0
   [junit4]   2> 1358989 INFO  (TEST-TestSimLargeCluster.testAddNode-seed#[E857361A83F9EABB]) [    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 1358989 INFO  (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial livenodes: [127.0.0.1:10432_solr]
   [junit4]   2> 1358989 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 1358989 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 0, lastZnodeVersion 0
   [junit4]   2> 1358989 INFO  (ScheduledTrigger-8467-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1 and last live nodes: 1
   [junit4]   2> 1358993 INFO  (TEST-TestSimLargeCluster.testAddNode-seed#[E857361A83F9EABB]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testAddNode
   [junit4]   2> 1358993 DEBUG (TEST-TestSimLargeCluster.testAddNode-seed#[E857361A83F9EABB]) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=1
   [junit4]   2> 1358994 DEBUG (TEST-TestSimLargeCluster.testAddNode-seed#[E857361A83F9EABB]) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 1
   [junit4]   2> 1358994 INFO  (TEST-TestSimLargeCluster.testAddNode-seed#[E857361A83F9EABB]) [    ] o.a.s.c.a.s.SimSolrCloudTestCase #######################################
   [junit4]   2> ############ CLUSTER STATE ############
   [junit4]   2> #######################################
   [junit4]   2> ## Live nodes:		100
   [junit4]   2> ## Empty nodes:	100
   [junit4]   2> ## Dead nodes:		0
   [junit4]   2> ## Collections:
   [junit4]   2> ## Max replicas per node:	0
   [junit4]   2> ## Min replicas per node:	0
   [junit4]   2> ## Total replicas:		0
   [junit4]   2> ######### Solr op counts ##########
   [junit4]   2> ######### Autoscaling event counts ###########
   [junit4]   2> 
   [junit4] IGNOR/A 0.00s J1 | TestSimLargeCluster.testBasic
   [junit4]    > Assumption #1: 'awaitsfix' test group is disabled (@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028"))
   [junit4] IGNOR/A 0.00s J1 | TestSimLargeCluster.testNodeLost
   [junit4]    > Assumption #1: 'badapple' test group is disabled (@BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028"))
   [junit4]   2> 1358995 INFO  (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 1358995 DEBUG (SUITE-TestSimLargeCluster-seed#[E857361A83F9EABB]-worker) [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.sim.TestSimLargeCluster_E857361A83F9EABB-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=1063, maxMBSortInHeap=5.365536517280933, sim=RandomSimilarity(queryNorm=false): {}, locale=ar-ER, timezone=Pacific/Enderbury
   [junit4]   2> NOTE: Linux 4.15.0-39-generic amd64/Oracle Corporation 9.0.4 (64-bit)/cpus=8,threads=1,free=308429536,total=536870912
   [junit4]   2> NOTE: All tests run in this JVM: [SaslZkACLProviderTest, TestRecovery, MergeStrategyTest, RegexBoostProcessorTest, DocValuesNotIndexedTest, PropertiesRequestHandlerTest, IgnoreLargeDocumentProcessorFactoryTest, TestCloudJSONFacetSKG, TestPolicyCloud, CurrencyFieldTypeTest, TestReversedWildcardFilterFactory, LeaderTragicEventTest, TestSimComputePlanAction, MetricUtilsTest, BasicDistributedZkTest, TestRTGBase, TestManagedResourceStorage, TestBadConfig, TestSystemCollAutoCreate, SolrMetricReporterTest, RangeFacetCloudTest, TestDynamicLoading, EmbeddedSolrNoSerializeTest, DOMUtilTest, UpdateLogTest, TestUtilizeNode, UUIDFieldTest, BlockJoinFacetDistribTest, TestCloudManagedSchema, MetricsConfigTest, TestStressCloudBlindAtomicUpdates, TestSolrCoreSnapshots, TestRandomFaceting, TestMissingGroups, TaggerTest, TestCollectionsAPIViaSolrCloudCluster, TestSolrDeletionPolicy1, SearchRateTriggerIntegrationTest, TestNumericTerms32, CheckHdfsIndexTest, TestIBSimilarityFactory, PluginInfoTest, ChaosMonkeyNothingIsSafeWithPullReplicasTest, PrimUtilsTest, TestFieldTypeResource, StressHdfsTest, TestOverriddenPrefixQueryForCustomFieldType, TestCloudDeleteByQuery, TestCopyFieldCollectionResource, CdcrWithNodesRestartsTest, DistributedQueryComponentOptimizationTest, MultiSolrCloudTestCaseTest, CreateRoutedAliasTest, MinimalSchemaTest, DocValuesMissingTest, TestConfigSetsAPIExclusivity, SynonymTokenizerTest, ConfigureRecoveryStrategyTest, ExecutePlanActionTest, HttpPartitionOnCommitTest, TlogReplayBufferedWhileIndexingTest, TestFieldSortValues, TestRTimerTree, TestNonDefinedSimilarityFactory, TestChildDocTransformer, SolrSlf4jReporterTest, TestSchemaSimilarityResource, TestSystemIdResolver, PolyFieldTest, TestSortableTextField, DistributedSuggestComponentTest, CloudMLTQParserTest, TestSimpleQParserPlugin, RestartWhileUpdatingTest, RecoveryAfterSoftCommitTest, SolrCoreCheckLockOnStartupTest, AssignBackwardCompatibilityTest, OverseerModifyCollectionTest, DistributedFacetPivotLongTailTest, SoftAutoCommitTest, HLLSerializationTest, SharedFSAutoReplicaFailoverTest, IndexSizeTriggerTest, ConfigSetsAPITest, DocExpirationUpdateProcessorFactoryTest, TestManagedSchemaAPI, SolrCloudExampleTest, TestRandomFlRTGCloud, BasicFunctionalityTest, TestFieldCacheReopen, DistribJoinFromCollectionTest, TestCoreAdminApis, TestReplicaProperties, TestReqParamsAPI, TestManagedSynonymGraphFilterFactory, TestCSVLoader, HdfsBasicDistributedZkTest, NodeAddedTriggerIntegrationTest, TestEmbeddedSolrServerSchemaAPI, TestRuleBasedAuthorizationPlugin, TestLockTree, TestMacros, DistributedExpandComponentTest, TestSimPolicyCloud, XmlUpdateRequestHandlerTest, ActionThrottleTest, TestCloudSearcherWarming, TestLeaderElectionWithEmptyReplica, TestShardHandlerFactory, TestFoldingMultitermQuery, PrimitiveFieldTypeTest, TestPhraseSuggestions, TestTrackingShardHandlerFactory, CloneFieldUpdateProcessorFactoryTest, TestApiFramework, LIRRollingUpdatesTest, RulesTest, TestTlogReplica, TestDownShardTolerantSearch, DataDrivenBlockJoinTest, DeleteNodeTest, TestShortCircuitedRequests, CollectionStateFormat2Test, TestScoreJoinQPNoScore, ClassificationUpdateProcessorFactoryTest, TestPrepRecovery, RankQueryTest, ResponseBuilderTest, SubstringBytesRefFilterTest, TestStressReorder, TestUnInvertedFieldException, ShowFileRequestHandlerTest, TestUniqueKeyFieldResource, HdfsTlogReplayBufferedWhileIndexingTest, GraphQueryTest, TestCloudPseudoReturnFields, TestDeleteCollectionOnDownNodes, TestExclusionRuleCollectionAccess, TestRebalanceLeaders, ZkControllerTest, ZkFailoverTest, CollectionReloadTest, CollectionsAPIDistributedZkTest, AutoAddReplicasIntegrationTest, ScheduledMaintenanceTriggerTest, SearchRateTriggerTest, TestSimDistribStateManager, TestSimDistributedQueue, TestSimExecutePlanAction, TestSimExtremeIndexing, TestSimGenericDistributedQueue, TestSimLargeCluster]
   [junit4] Completed [534/836 (1!)] on J1 in 36.45s, 4 tests, 1 error, 2 skipped <<< FAILURES!

[...truncated 43477 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/3204/consoleText

[repro] Revision: 2b62f8be407eaeece98411efc3ded5184af478ec

[repro] Ant options: "-Dargs=-XX:+UseCompressedOops -XX:+UseG1GC"
[repro] Repro line:  ant test  -Dtestcase=TestSimLargeCluster -Dtests.method=testSearchRate -Dtests.seed=E857361A83F9EABB -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ar-ER -Dtests.timezone=Pacific/Enderbury -Dtests.asserts=true -Dtests.file.encoding=UTF-8

[repro] ant clean

[...truncated 6 lines...]
[repro] Test suites by module:
[repro]    solr/core
[repro]       TestSimLargeCluster
[repro] ant compile-test

[...truncated 3610 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.TestSimLargeCluster" -Dtests.showOutput=onerror "-Dargs=-XX:+UseCompressedOops -XX:+UseG1GC" -Dtests.seed=E857361A83F9EABB -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ar-ER -Dtests.timezone=Pacific/Enderbury -Dtests.asserts=true -Dtests.file.encoding=UTF-8

[...truncated 95 lines...]
[repro] Failures:
[repro]   0/5 failed: org.apache.solr.cloud.autoscaling.sim.TestSimLargeCluster
[repro] Exiting with code 0

[...truncated 40 lines...]

[JENKINS] Lucene-Solr-7.x-Linux (32bit/jdk1.8.0_172) - Build # 3205 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/3205/
Java: 32bit/jdk1.8.0_172 -server -XX:+UseSerialGC

8 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.SaslZkACLProviderTest

Error Message:
3 threads leaked from SUITE scope at org.apache.solr.cloud.SaslZkACLProviderTest:     1) Thread[id=39, name=TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[CF84F3C1F6FF3D16]-EventThread, state=WAITING, group=TGRP-SaslZkACLProviderTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:504)    2) Thread[id=36, name=TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[CF84F3C1F6FF3D16]-EventThread, state=WAITING, group=TGRP-SaslZkACLProviderTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:504)    3) Thread[id=30, name=TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[CF84F3C1F6FF3D16]-EventThread, state=WAITING, group=TGRP-SaslZkACLProviderTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:504)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 3 threads leaked from SUITE scope at org.apache.solr.cloud.SaslZkACLProviderTest: 
   1) Thread[id=39, name=TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[CF84F3C1F6FF3D16]-EventThread, state=WAITING, group=TGRP-SaslZkACLProviderTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:504)
   2) Thread[id=36, name=TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[CF84F3C1F6FF3D16]-EventThread, state=WAITING, group=TGRP-SaslZkACLProviderTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:504)
   3) Thread[id=30, name=TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[CF84F3C1F6FF3D16]-EventThread, state=WAITING, group=TGRP-SaslZkACLProviderTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:504)
	at __randomizedtesting.SeedInfo.seed([CF84F3C1F6FF3D16]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.SaslZkACLProviderTest

Error Message:
3 threads leaked from SUITE scope at org.apache.solr.cloud.SaslZkACLProviderTest:     1) Thread[id=60, name=TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[CF84F3C1F6FF3D16]-EventThread, state=WAITING, group=TGRP-SaslZkACLProviderTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:504)    2) Thread[id=67, name=TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[CF84F3C1F6FF3D16]-EventThread, state=WAITING, group=TGRP-SaslZkACLProviderTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:504)    3) Thread[id=63, name=TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[CF84F3C1F6FF3D16]-EventThread, state=WAITING, group=TGRP-SaslZkACLProviderTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:504)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 3 threads leaked from SUITE scope at org.apache.solr.cloud.SaslZkACLProviderTest: 
   1) Thread[id=60, name=TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[CF84F3C1F6FF3D16]-EventThread, state=WAITING, group=TGRP-SaslZkACLProviderTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:504)
   2) Thread[id=67, name=TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[CF84F3C1F6FF3D16]-EventThread, state=WAITING, group=TGRP-SaslZkACLProviderTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:504)
   3) Thread[id=63, name=TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[CF84F3C1F6FF3D16]-EventThread, state=WAITING, group=TGRP-SaslZkACLProviderTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:504)
	at __randomizedtesting.SeedInfo.seed([CF84F3C1F6FF3D16]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.SaslZkACLProviderTest

Error Message:
3 threads leaked from SUITE scope at org.apache.solr.cloud.SaslZkACLProviderTest:     1) Thread[id=63, name=TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[CF84F3C1F6FF3D16]-EventThread, state=WAITING, group=TGRP-SaslZkACLProviderTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:504)    2) Thread[id=68, name=TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[CF84F3C1F6FF3D16]-EventThread, state=WAITING, group=TGRP-SaslZkACLProviderTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:504)    3) Thread[id=60, name=TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[CF84F3C1F6FF3D16]-EventThread, state=WAITING, group=TGRP-SaslZkACLProviderTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:504)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 3 threads leaked from SUITE scope at org.apache.solr.cloud.SaslZkACLProviderTest: 
   1) Thread[id=63, name=TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[CF84F3C1F6FF3D16]-EventThread, state=WAITING, group=TGRP-SaslZkACLProviderTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:504)
   2) Thread[id=68, name=TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[CF84F3C1F6FF3D16]-EventThread, state=WAITING, group=TGRP-SaslZkACLProviderTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:504)
   3) Thread[id=60, name=TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[CF84F3C1F6FF3D16]-EventThread, state=WAITING, group=TGRP-SaslZkACLProviderTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:504)
	at __randomizedtesting.SeedInfo.seed([CF84F3C1F6FF3D16]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.SaslZkACLProviderTest

Error Message:
3 threads leaked from SUITE scope at org.apache.solr.cloud.SaslZkACLProviderTest:     1) Thread[id=23282, name=TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[CF84F3C1F6FF3D16]-EventThread, state=WAITING, group=TGRP-SaslZkACLProviderTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:504)    2) Thread[id=23277, name=TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[CF84F3C1F6FF3D16]-EventThread, state=WAITING, group=TGRP-SaslZkACLProviderTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:504)    3) Thread[id=23286, name=TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[CF84F3C1F6FF3D16]-EventThread, state=WAITING, group=TGRP-SaslZkACLProviderTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:504)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 3 threads leaked from SUITE scope at org.apache.solr.cloud.SaslZkACLProviderTest: 
   1) Thread[id=23282, name=TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[CF84F3C1F6FF3D16]-EventThread, state=WAITING, group=TGRP-SaslZkACLProviderTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:504)
   2) Thread[id=23277, name=TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[CF84F3C1F6FF3D16]-EventThread, state=WAITING, group=TGRP-SaslZkACLProviderTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:504)
   3) Thread[id=23286, name=TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[CF84F3C1F6FF3D16]-EventThread, state=WAITING, group=TGRP-SaslZkACLProviderTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:504)
	at __randomizedtesting.SeedInfo.seed([CF84F3C1F6FF3D16]:0)


FAILED:  org.apache.solr.cloud.SaslZkACLProviderTest.testSaslZkACLProvider

Error Message:
KeeperErrorCode = AuthFailed for /solr

Stack Trace:
org.apache.zookeeper.KeeperException$AuthFailedException: KeeperErrorCode = AuthFailed for /solr
	at __randomizedtesting.SeedInfo.seed([CF84F3C1F6FF3D16:CB70A5196FBB9E18]:0)
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:126)
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:54)
	at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:792)
	at org.apache.solr.common.cloud.SolrZkClient.lambda$makePath$8(SolrZkClient.java:545)
	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:71)
	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:544)
	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:436)
	at org.apache.solr.cloud.SaslZkACLProviderTest.setUp(SaslZkACLProviderTest.java:83)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:969)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.SaslZkACLProviderTest.testSaslZkACLProvider

Error Message:
KeeperErrorCode = AuthFailed for /solr

Stack Trace:
org.apache.zookeeper.KeeperException$AuthFailedException: KeeperErrorCode = AuthFailed for /solr
	at __randomizedtesting.SeedInfo.seed([CF84F3C1F6FF3D16:CB70A5196FBB9E18]:0)
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:126)
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:54)
	at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:792)
	at org.apache.solr.common.cloud.SolrZkClient.lambda$makePath$8(SolrZkClient.java:545)
	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:71)
	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:544)
	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:436)
	at org.apache.solr.cloud.SaslZkACLProviderTest.setUp(SaslZkACLProviderTest.java:83)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:969)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.SaslZkACLProviderTest.testSaslZkACLProvider

Error Message:
KeeperErrorCode = AuthFailed for /solr

Stack Trace:
org.apache.zookeeper.KeeperException$AuthFailedException: KeeperErrorCode = AuthFailed for /solr
	at __randomizedtesting.SeedInfo.seed([CF84F3C1F6FF3D16:CB70A5196FBB9E18]:0)
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:126)
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:54)
	at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:792)
	at org.apache.solr.common.cloud.SolrZkClient.lambda$makePath$8(SolrZkClient.java:545)
	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:71)
	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:544)
	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:436)
	at org.apache.solr.cloud.SaslZkACLProviderTest.setUp(SaslZkACLProviderTest.java:83)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:969)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.SaslZkACLProviderTest.testSaslZkACLProvider

Error Message:
KeeperErrorCode = AuthFailed for /solr

Stack Trace:
org.apache.zookeeper.KeeperException$AuthFailedException: KeeperErrorCode = AuthFailed for /solr
	at __randomizedtesting.SeedInfo.seed([CF84F3C1F6FF3D16:CB70A5196FBB9E18]:0)
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:126)
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:54)
	at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:792)
	at org.apache.solr.common.cloud.SolrZkClient.lambda$makePath$8(SolrZkClient.java:545)
	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:71)
	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:544)
	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:436)
	at org.apache.solr.cloud.SaslZkACLProviderTest.setUp(SaslZkACLProviderTest.java:83)
	at sun.reflect.GeneratedMethodAccessor19.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:969)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 13 lines...]
ERROR: Error fetching remote repo 'origin'
hudson.plugins.git.GitException: Failed to fetch from git://git.apache.org/lucene-solr.git
	at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:888)
	at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1155)
	at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1186)
	at hudson.scm.SCM.checkout(SCM.java:504)
	at hudson.model.AbstractProject.checkout(AbstractProject.java:1208)
	at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:574)
	at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86)
	at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:499)
	at hudson.model.Run.execute(Run.java:1810)
	at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
	at hudson.model.ResourceController.execute(ResourceController.java:97)
	at hudson.model.Executor.run(Executor.java:429)
Caused by: hudson.plugins.git.GitException: org.eclipse.jgit.api.errors.TransportException: Broken pipe (Write failed)
	at org.jenkinsci.plugins.gitclient.JGitAPIImpl$2.execute(JGitAPIImpl.java:634)
	at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:886)
	... 11 more
Caused by: org.eclipse.jgit.api.errors.TransportException: Broken pipe (Write failed)
	at org.eclipse.jgit.api.FetchCommand.call(FetchCommand.java:135)
	at org.jenkinsci.plugins.gitclient.JGitAPIImpl$2.execute(JGitAPIImpl.java:632)
	... 12 more
Caused by: org.eclipse.jgit.errors.TransportException: Broken pipe (Write failed)
	at org.eclipse.jgit.transport.BasePackFetchConnection.doFetch(BasePackFetchConnection.java:377)
	at org.eclipse.jgit.transport.BasePackFetchConnection.fetch(BasePackFetchConnection.java:308)
	at org.eclipse.jgit.transport.BasePackFetchConnection.fetch(BasePackFetchConnection.java:298)
	at org.eclipse.jgit.transport.FetchProcess.fetchObjects(FetchProcess.java:245)
	at org.eclipse.jgit.transport.FetchProcess.executeImp(FetchProcess.java:161)
	at org.eclipse.jgit.transport.FetchProcess.execute(FetchProcess.java:122)
	at org.eclipse.jgit.transport.Transport.fetch(Transport.java:1201)
	at org.eclipse.jgit.api.FetchCommand.call(FetchCommand.java:128)
	... 13 more
Caused by: java.net.SocketException: Broken pipe (Write failed)
	at java.net.SocketOutputStream.socketWrite0(Native Method)
	at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:111)
	at java.net.SocketOutputStream.write(SocketOutputStream.java:155)
	at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
	at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140)
	at org.eclipse.jgit.transport.PacketLineOut.flush(PacketLineOut.java:180)
	at org.eclipse.jgit.transport.PacketLineOut.end(PacketLineOut.java:167)
	at org.eclipse.jgit.transport.BasePackFetchConnection.negotiate(BasePackFetchConnection.java:573)
	at org.eclipse.jgit.transport.BasePackFetchConnection.doFetch(BasePackFetchConnection.java:363)
	... 20 more
ERROR: Error fetching remote repo 'origin'
Retrying after 10 seconds
Fetching changes from the remote Git repository
Cleaning workspace
Checking out Revision bd104ffd48859f625c999856768b9f14bb6fe1f2 (refs/remotes/origin/branch_7x)
Commit message: "SOLR-13060: set suite timeout on non-terminating HDFS Nightly tests to one hour"
No emails were triggered.
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[description-setter] Description set: Java: 32bit/jdk1.8.0_172 -server -XX:+UseSerialGC
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[Lucene-Solr-7.x-Linux] $ /var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/bin/ant "-Dargs=-server -XX:+UseSerialGC" jenkins-hourly
Buildfile: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/build.xml

jenkins-hourly:

-print-java-info:
[java-info] java version "1.8.0_172"
[java-info] Java(TM) SE Runtime Environment (1.8.0_172-b11, Oracle Corporation)
[java-info] Java HotSpot(TM) Server VM (25.172-b11, Oracle Corporation)
[java-info] Test args: [-server -XX:+UseSerialGC]

clean:

clean:

clean:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: Apache Ivy 2.4.0 - 20141213170938 :: http://ant.apache.org/ivy/ ::
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/top-level-ivy-settings.xml

resolve-groovy:
[ivy:cachepath] :: resolving dependencies :: org.codehaus.groovy#groovy-all-caller;working
[ivy:cachepath] 	confs: [default]
[ivy:cachepath] 	found org.codehaus.groovy#groovy-all;2.4.15 in public
[ivy:cachepath] :: resolution report :: resolve 140ms :: artifacts dl 2ms
	---------------------------------------------------------------------
	|                  |            modules            ||   artifacts   |
	|       conf       | number| search|dwnlded|evicted|| number|dwnlded|
	---------------------------------------------------------------------
	|      default     |   1   |   0   |   0   |   0   ||   1   |   0   |
	---------------------------------------------------------------------

-test-with-heapdumps-enabled:
     [echo] Java HotSpot(TM) Server VM: Enabling heap dumps on OutOfMemoryError to dir '/home/jenkins/workspace/Lucene-Solr-7.x-Linux/heapdumps'.
    [mkdir] Created dir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/heapdumps

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/top-level-ivy-settings.xml

resolve-groovy:

test:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/top-level-ivy-settings.xml

-clover.load:

resolve-groovy:

-init-totals:

test-core:

-clover.disable:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/top-level-ivy-settings.xml

-clover.load:

-clover.classpath:

-clover.setup:

clover:

-check-git-state:

-git-cleanroot:

-copy-git-state:
     [copy] Copying 1 file to /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build

git-autoclean:

resolve:

init:

compile-core:
    [mkdir] Created dir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/java
    [javac] Compiling 859 source files to /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/java
    [javac] /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/core/src/java/org/apache/lucene/index/FrozenBufferedUpdates.java:246: warning: [try] auto-closeable resource finalizer is never referenced in body of corresponding try statement
    [javac]         try (Closeable finalizer = () -> finishApply(writer, segStates, success.get(), delFiles)) {
    [javac]                        ^
    [javac] /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/core/src/java/org/apache/lucene/index/NumericDocValuesFieldUpdates.java:37: warning: [rawtypes] found raw type: AbstractPagedMutable
    [javac]     private final AbstractPagedMutable values;
    [javac]                   ^
    [javac]   missing type arguments for generic class AbstractPagedMutable<T>
    [javac]   where T is a type-variable:
    [javac]     T extends AbstractPagedMutable<T> declared in class AbstractPagedMutable
    [javac] /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/core/src/java/org/apache/lucene/index/NumericDocValuesFieldUpdates.java:41: warning: [rawtypes] found raw type: AbstractPagedMutable
    [javac]     Iterator(int size, long minValue, AbstractPagedMutable values, PagedMutable docs, long delGen) {
    [javac]                                       ^
    [javac]   missing type arguments for generic class AbstractPagedMutable<T>
    [javac]   where T is a type-variable:
    [javac]     T extends AbstractPagedMutable<T> declared in class AbstractPagedMutable
    [javac] /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/core/src/java/org/apache/lucene/index/NumericDocValuesFieldUpdates.java:61: warning: [rawtypes] found raw type: AbstractPagedMutable
    [javac]   private AbstractPagedMutable values;
    [javac]           ^
    [javac]   missing type arguments for generic class AbstractPagedMutable<T>
    [javac]   where T is a type-variable:
    [javac]     T extends AbstractPagedMutable<T> declared in class AbstractPagedMutable
    [javac] Note: Some input files use or override a deprecated API.
    [javac] Note: Recompile with -Xlint:deprecation for details.
    [javac] 4 warnings
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/java/org/apache/lucene/util/graph/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/java/org/apache/lucene/document/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/java/org/apache/lucene/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/java/org/apache/lucene/util/bkd/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/java/org/apache/lucene/codecs/compressing/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/java/org/apache/lucene/codecs/lucene60/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/java/org/apache/lucene/codecs/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/java/org/apache/lucene/util/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/java/org/apache/lucene/index/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/java/org/apache/lucene/util/fst/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/java/org/apache/lucene/analysis/tokenattributes/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/java/org/apache/lucene/search/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/java/org/apache/lucene/codecs/lucene62/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/java/org/apache/lucene/util/packed/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/java/org/apache/lucene/util/mutable/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/java/org/apache/lucene/codecs/lucene70/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/java/org/apache/lucene/codecs/perfield/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/java/org/apache/lucene/analysis/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/java/org/apache/lucene/analysis/standard/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/java/org/apache/lucene/store/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/java/org/apache/lucene/codecs/blocktree/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/java/org/apache/lucene/search/spans/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/java/org/apache/lucene/search/similarities/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/java/org/apache/lucene/util/automaton/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/java/org/apache/lucene/codecs/lucene50/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/java/org/apache/lucene/geo/package-info.class
     [copy] Copying 3 files to /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/java

compile-test-framework:

-check-git-state:

-git-cleanroot:

-copy-git-state:

git-autoclean:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/top-level-ivy-settings.xml

resolve:

init:

compile-lucene-core:

-check-git-state:

-git-cleanroot:

-copy-git-state:

git-autoclean:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/top-level-ivy-settings.xml

resolve:

init:

-clover.disable:

-clover.load:

-clover.classpath:

-clover.setup:

clover:

compile-core:

compile-codecs:

-check-git-state:

-git-cleanroot:

-copy-git-state:

git-autoclean:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/top-level-ivy-settings.xml

resolve:

common.init:

compile-lucene-core:

init:

-clover.disable:

-clover.load:

-clover.classpath:

-clover.setup:

clover:

compile-core:
    [mkdir] Created dir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/codecs/classes/java
    [javac] Compiling 67 source files to /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/codecs/classes/java
    [javac] Note: Some input files use or override a deprecated API.
    [javac] Note: Recompile with -Xlint:deprecation for details.
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/codecs/classes/java/org/apache/lucene/codecs/bloom/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/codecs/classes/java/org/apache/lucene/codecs/memory/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/codecs/classes/java/org/apache/lucene/codecs/simpletext/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/codecs/classes/java/org/apache/lucene/codecs/blockterms/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/codecs/classes/java/org/apache/lucene/codecs/blocktreeords/package-info.class
     [copy] Copying 3 files to /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/codecs/classes/java

-clover.disable:

-clover.load:

-clover.classpath:

-clover.setup:

clover:

common.compile-core:
    [mkdir] Created dir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/test-framework/classes/java
    [javac] Compiling 191 source files to /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/test-framework/classes/java
    [javac] /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/test-framework/src/java/org/apache/lucene/store/BaseDirectoryTestCase.java:416: warning: [try] auto-closeable resource output is never referenced in body of corresponding try statement
    [javac]             try (IndexOutput output = dir.createOutput(fileName, newIOContext(random()))) {
    [javac]                              ^
    [javac] /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/test-framework/src/java/org/apache/lucene/store/BaseDirectoryTestCase.java:440: warning: [try] auto-closeable resource input is never referenced in body of corresponding try statement
    [javac]                 try (IndexInput input = dir.openInput(file, newIOContext(random()))) {
    [javac]                                 ^
    [javac] /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/test-framework/src/java/org/apache/lucene/store/BaseDirectoryTestCase.java:1051: warning: [try] auto-closeable resource out is never referenced in body of corresponding try statement
    [javac]       try (IndexOutput out = dir.createOutput(name, IOContext.DEFAULT)) {
    [javac]                        ^
    [javac] /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/test-framework/src/java/org/apache/lucene/store/BaseDirectoryTestCase.java:1056: warning: [try] auto-closeable resource out is never referenced in body of corresponding try statement
    [javac]         try (IndexOutput out = dir.createOutput(name, IOContext.DEFAULT)) {
    [javac]                          ^
    [javac] Note: Some input files use or override a deprecated API.
    [javac] Note: Recompile with -Xlint:deprecation for details.
    [javac] 4 warnings
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/test-framework/classes/java/org/apache/lucene/codecs/asserting/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/test-framework/classes/java/org/apache/lucene/codecs/ramonly/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/test-framework/classes/java/org/apache/lucene/mockfile/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/test-framework/classes/java/org/apache/lucene/codecs/cheapbastard/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/test-framework/classes/java/org/apache/lucene/codecs/mockrandom/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/test-framework/classes/java/org/apache/lucene/codecs/cranky/package-info.class
    [javac] Creating empty /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/test-framework/classes/java/org/apache/lucene/codecs/compressing/dummy/package-info.class
     [copy] Copying 4 files to /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/test-framework/classes/java

compile-core:

compile-test:
    [mkdir] Created dir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/test
    [javac] Compiling 495 source files to /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/test
    [javac] /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/core/src/test/org/apache/lucene/index/TestFieldUpdatesBuffer.java:158: warning: [unchecked] unchecked cast
    [javac]       return (T) (rarely() ? value.prepareForApply(random().nextInt(100)) : value);
    [javac]                  ^
    [javac]   required: T
    [javac]   found:    BinaryDocValuesUpdate
    [javac]   where T is a type-variable:
    [javac]     T extends DocValuesUpdate declared in method <T>getRandomUpdate(boolean)
    [javac] /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/core/src/test/org/apache/lucene/index/TestFieldUpdatesBuffer.java:163: warning: [unchecked] unchecked cast
    [javac]       return (T) (rarely() ? value.prepareForApply(random().nextInt(100)) : value);
    [javac]                  ^
    [javac]   required: T
    [javac]   found:    NumericDocValuesUpdate
    [javac]   where T is a type-variable:
    [javac]     T extends DocValuesUpdate declared in method <T>getRandomUpdate(boolean)
    [javac] /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/core/src/test/org/apache/lucene/index/TestIndexWriter.java:2687: warning: [try] auto-closeable resource closeable is never referenced in body of corresponding try statement
    [javac]          Closeable closeable = () -> IOUtils.close(toClose)) {
    [javac]                    ^
    [javac] /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/core/src/test/org/apache/lucene/index/TestIndexWriter.java:3644: warning: [try] auto-closeable resource w is never referenced in body of corresponding try statement
    [javac]             try (IndexWriter w = new IndexWriter(dir, newIndexWriterConfig().setIndexCreatedVersionMajor(previousMajor))) {}
    [javac]                              ^
    [javac] /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/core/src/test/org/apache/lucene/index/TestIndexWriter.java:3647: warning: [try] auto-closeable resource w is never referenced in body of corresponding try statement
    [javac]             try (IndexWriter w = new IndexWriter(dir, newIndexWriterConfig().setOpenMode(openMode).setIndexCreatedVersionMajor(newMajor))) {}
    [javac]                              ^
    [javac] Note: Some input files use or override a deprecated API.
    [javac] Note: Recompile with -Xlint:deprecation for details.
    [javac] 5 warnings
     [copy] Copying 3 files to /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/test

-mrjar-classes-uptodate:

resolve-groovy:

patch-mrjar-classes:
[patch-cls] Remapped: org/apache/lucene/analysis/tokenattributes/CharTermAttributeImpl
[patch-cls] Remapped: org/apache/lucene/codecs/compressing/LZ4
[patch-cls] Remapped: org/apache/lucene/document/BinaryPoint$2
[patch-cls] Remapped: org/apache/lucene/document/DoubleRange
[patch-cls] Remapped: org/apache/lucene/document/FloatRange
[patch-cls] Remapped: org/apache/lucene/document/IntRange
[patch-cls] Remapped: org/apache/lucene/document/LatLonPointDistanceQuery$1$2
[patch-cls] Remapped: org/apache/lucene/document/LatLonPointDistanceQuery$1$3
[patch-cls] Remapped: org/apache/lucene/document/LatLonPointInPolygonQuery$1$1
[patch-cls] Remapped: org/apache/lucene/document/LongRange
[patch-cls] Remapped: org/apache/lucene/document/RangeFieldQuery$QueryType$1
[patch-cls] Remapped: org/apache/lucene/document/RangeFieldQuery$QueryType$2
[patch-cls] Remapped: org/apache/lucene/document/RangeFieldQuery$QueryType$3
[patch-cls] Remapped: org/apache/lucene/index/BitsSlice
[patch-cls] Remapped: org/apache/lucene/index/CheckIndex$VerifyPointsVisitor
[patch-cls] Remapped: org/apache/lucene/index/CodecReader
[patch-cls] Remapped: org/apache/lucene/index/MergeReaderWrapper
[patch-cls] Remapped: org/apache/lucene/index/PointValues
[patch-cls] Remapped: org/apache/lucene/search/BooleanScorer$TailPriorityQueue
[patch-cls] Remapped: org/apache/lucene/search/PointInSetQuery$SinglePointVisitor
[patch-cls] Remapped: org/apache/lucene/search/PointRangeQuery$1$1
[patch-cls] Remapped: org/apache/lucene/search/PointRangeQuery$1$2
[patch-cls] Remapped: org/apache/lucene/search/PointRangeQuery$1
[patch-cls] Remapped: org/apache/lucene/util/BytesRef
[patch-cls] Remapped: org/apache/lucene/util/BytesRefArray
[patch-cls] Remapped: org/apache/lucene/util/CharsRef$UTF16SortedAsUTF8Comparator
[patch-cls] Remapped: org/apache/lucene/util/CharsRef
[patch-cls] Remapped: org/apache/lucene/util/IntsRef
[patch-cls] Remapped: org/apache/lucene/util/LongsRef
[patch-cls] Remapped: org/apache/lucene/util/StringHelper
[patch-cls] Remapped: org/apache/lucene/util/automaton/Automaton$Builder
[patch-cls] Remapped: org/apache/lucene/util/automaton/Automaton
[patch-cls] Remapped: org/apache/lucene/util/bkd/BKDReader
[patch-cls] Remapped: org/apache/lucene/util/bkd/BKDWriter$BKDMergeQueue
[patch-cls] Remapped: org/apache/lucene/util/bkd/BKDWriter$OneDimensionBKDWriter
[patch-cls] Remapped: org/apache/lucene/util/bkd/BKDWriter
[patch-cls] Remapped: org/apache/lucene/util/bkd/MutablePointsReaderUtils$1$1
[patch-cls] Remapped: org/apache/lucene/util/bkd/MutablePointsReaderUtils$2
[patch-cls] Remapped: org/apache/lucene/util/bkd/MutablePointsReaderUtils$3$1
[patch-cls] Remapped 39 class files for Java 9 to: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/classes/java9
    [touch] Creating /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/patch-mrjar.stamp

install-junit4-taskdef:

validate:

-init-totals:

-test:
    [mkdir] Created dir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/test
[loadresource] Do not set property tests.explicitclass as its length is 0.
    [mkdir] Created dir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/test/temp
    [mkdir] Created dir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/.caches/test-stats/core
   [junit4] <JUnit4> says aloha! Master seed: 41973EF1CF05224B
   [junit4] Executing 487 suites with 3 JVMs.
   [junit4] 
   [junit4] Started J1 PID(30811@localhost).
   [junit4] Started J2 PID(30809@localhost).
   [junit4] Started J0 PID(30810@localhost).
   [junit4] Suite: org.apache.lucene.search.TestSimilarity
   [junit4] Completed [1/487] on J1 in 0.66s, 1 test
   [junit4] 
   [junit4] Suite: org.apache.lucene.search.TestSimilarityProvider
   [junit4] Completed [2/487] on J2 in 0.67s, 1 test
   [junit4] 
   [junit4] Suite: org.apache.lucene.util.TestPriorityQueue
   [junit4] Completed [3/487] on J2 in 0.55s, 10 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.store.TestBufferedChecksum
   [junit4] Completed [4/487] on J2 in 0.11s, 2 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.search.TestMatchNoDocsQuery
   [junit4] Completed [5/487] on J2 in 0.09s, 3 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.analysis.TestCharArraySet
   [junit4] Completed [6/487] on J2 in 0.07s, 15 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestPointValues
   [junit4] Completed [7/487] on J0 in 4.81s, 32 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestDocValuesFieldUpdates
   [junit4] Completed [8/487] on J0 in 0.04s, 5 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.util.TestRollingBuffer
   [junit4] Completed [9/487] on J0 in 0.34s, 1 test
   [junit4] 
   [junit4] Suite: org.apache.lucene.util.TestPagedBytes
   [junit4] Completed [10/487] on J1 in 5.66s, 4 tests, 1 skipped
   [junit4] 
   [junit4] Suite: org.apache.lucene.search.spans.TestSpansEnum
   [junit4] Completed [11/487] on J1 in 0.40s, 7 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.search.TestMatchAllDocsQuery
   [junit4] Completed [12/487] on J1 in 0.19s, 2 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.analysis.TestCharArrayMap
   [junit4] Completed [13/487] on J1 in 0.18s, 4 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.search.TestRegexpRandom2
   [junit4] Completed [14/487] on J0 in 2.58s, 1 test
   [junit4] 
   [junit4] Suite: org.apache.lucene.store.TestByteBuffersDataOutput
   [junit4] Completed [15/487] on J0 in 2.30s, 8 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestIndexWriterMerging
   [junit4] Completed [16/487] on J1 in 5.45s, 6 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestFilterCodecReader
   [junit4] Completed [17/487] on J1 in 0.05s, 2 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.search.TestAutomatonQuery
   [junit4] Completed [18/487] on J1 in 2.92s, 8 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestDoc
   [junit4] Completed [19/487] on J1 in 0.29s, 1 test
   [junit4] 
   [junit4] Suite: org.apache.lucene.search.similarities.TestSimilarityBase
   [junit4] Completed [20/487] on J1 in 0.59s, 31 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.geo.TestGeoEncodingUtils
   [junit4] Completed [21/487] on J1 in 0.87s, 3 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.search.TestFilterWeight
   [junit4] Completed [22/487] on J1 in 0.01s, 1 test
   [junit4] 
   [junit4] Suite: org.apache.lucene.analysis.TestWordlistLoader
   [junit4] Completed [23/487] on J1 in 0.01s, 3 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.analysis.TestGraphTokenizers
   [junit4] Completed [24/487] on J0 in 7.96s, 23 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.Test4GBStoredFields
   [junit4] IGNOR/A 0.01s J0 | Test4GBStoredFields.test
   [junit4]    > Assumption #1: 'nightly' test group is disabled (@Nightly())
   [junit4] Completed [25/487] on J0 in 0.01s, 1 test, 1 skipped
   [junit4] 
   [junit4] Suite: org.apache.lucene.util.TestUnicodeUtil
   [junit4] Completed [26/487] on J0 in 0.92s, 5 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestOneMergeWrappingMergePolicy
   [junit4] Completed [27/487] on J0 in 0.07s, 1 test
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestIndexWriterNRTIsCurrent
   [junit4] Completed [28/487] on J2 in 20.00s, 1 test
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestFilterDirectoryReader
   [junit4] Completed [29/487] on J2 in 0.08s, 1 test
   [junit4] 
   [junit4] Suite: org.apache.lucene.search.TestAutomatonQueryUnicode
   [junit4] Completed [30/487] on J2 in 0.12s, 1 test
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestDocCount
   [junit4] Completed [31/487] on J2 in 0.45s, 1 test
   [junit4] 
   [junit4] Suite: org.apache.lucene.search.spans.TestBasics
   [junit4] Completed [32/487] on J2 in 2.87s, 27 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestIndexWriter
   [junit4] Completed [33/487] on J1 in 11.52s, 90 tests, 1 skipped
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestManyFields
   [junit4] Completed [34/487] on J1 in 2.99s, 3 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestTermVectorsWriter
   [junit4] Completed [35/487] on J1 in 0.33s, 15 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestParallelReaderEmptyIndex
   [junit4] Completed [36/487] on J1 in 0.07s, 2 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestIndexWriterExceptions
   [junit4] IGNOR/A 0.00s J0 | TestIndexWriterExceptions.testTooManyTokens
   [junit4]    > Assumption #1: 'nightly' test group is disabled (@Nightly())
   [junit4] Completed [37/487] on J0 in 14.20s, 35 tests, 1 skipped
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestIndexFileDeleter
   [junit4] Completed [38/487] on J1 in 1.06s, 10 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.Test2BNumericDocValues
   [junit4] IGNOR/A 0.00s J1 | Test2BNumericDocValues.testNumerics
   [junit4]    > Assumption #1: 'monster' test group is disabled (@Monster(value=takes ~ 2 hours if the heap is 5gb))
   [junit4] Completed [39/487] on J1 in 0.04s, 1 test, 1 skipped
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestIndexWriterOnJRECrash
   [junit4] IGNOR/A 0.00s J1 | TestIndexWriterOnJRECrash.testNRTThreads
   [junit4]    > Assumption #1: 'nightly' test group is disabled (@Nightly())
   [junit4] Completed [40/487] on J1 in 0.02s, 1 test, 1 skipped
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestSizeBoundedForceMerge
   [junit4] Completed [41/487] on J0 in 0.26s, 11 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestFieldInvertState
   [junit4] Completed [42/487] on J0 in 0.15s, 2 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.util.TestFixedBitDocIdSet
   [junit4] Completed [43/487] on J0 in 1.70s, 5 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestReaderWrapperDVTypeCheck
   [junit4] Completed [44/487] on J0 in 0.08s, 1 test
   [junit4] 
   [junit4] Suite: org.apache.lucene.search.TestMultiPhraseEnum
   [junit4] Completed [45/487] on J0 in 0.08s, 2 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.search.TestNGramPhraseQuery
   [junit4] Completed [46/487] on J0 in 0.06s, 1 test
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestIndexManyDocuments
   [junit4] Completed [47/487] on J0 in 1.08s, 1 test
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestOmitNorms
   [junit4] Completed [48/487] on J0 in 1.11s, 5 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.geo.TestGeoUtils
   [junit4] Completed [49/487] on J2 in 26.11s, 7 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestDuelingCodecs
   [junit4] Completed [50/487] on J1 in 18.98s, 2 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.util.automaton.TestCompiledAutomaton
   [junit4] Completed [51/487] on J1 in 0.48s, 6 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.util.TestIntroSorter
   [junit4] Completed [52/487] on J1 in 0.25s, 9 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestBinaryDocValuesUpdates
   [junit4] IGNOR/A 0.00s J0 | TestBinaryDocValuesUpdates.testTonsOfUpdates
   [junit4]    > Assumption #1: 'nightly' test group is disabled (@Nightly())
   [junit4] Completed [53/487] on J0 in 20.02s, 29 tests, 1 skipped
   [junit4] 
   [junit4] Suite: org.apache.lucene.search.spans.TestFieldMaskingSpanQuery
   [junit4] IGNOR/A 0.00s J0 | TestFieldMaskingSpanQuery.testSimple2
   [junit4]    > Assumption #1: Broken scoring: LUCENE-3723
   [junit4] IGNOR/A 0.01s J0 | TestFieldMaskingSpanQuery.testSpans2
   [junit4]    > Assumption #1: Broken scoring: LUCENE-3723
   [junit4] Completed [54/487] on J0 in 0.50s, 11 tests, 2 skipped
   [junit4] 
   [junit4] Suite: org.apache.lucene.search.TestFloatRangeFieldQueries
   [junit4] IGNOR/A 0.00s J2 | TestFloatRangeFieldQueries.testRandomBig
   [junit4]    > Assumption #1: 'nightly' test group is disabled (@Nightly())
   [junit4] Completed [55/487] on J2 in 9.30s, 5 tests, 1 skipped
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestNRTReaderWithThreads
   [junit4] Completed [56/487] on J0 in 3.04s, 1 test
   [junit4] 
   [junit4] Suite: org.apache.lucene.search.TestConjunctionDISI
   [junit4] Completed [57/487] on J1 in 9.43s, 5 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestFilterMergePolicy
   [junit4] Completed [58/487] on J1 in 0.05s, 1 test
   [junit4] 
   [junit4] Suite: org.apache.lucene.util.automaton.TestMinimize
   [junit4] Completed [59/487] on J0 in 3.27s, 3 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.analysis.tokenattributes.TestBytesRefAttImpl
   [junit4] Completed [60/487] on J0 in 0.07s, 1 test
   [junit4] 
   [junit4] Suite: org.apache.lucene.search.TestTermRangeQuery
   [junit4] Completed [61/487] on J0 in 0.24s, 7 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.codecs.compressing.TestFastCompressionMode
   [junit4] Completed [62/487] on J0 in 1.24s, 11 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.util.TestFrequencyTrackingRingBuffer
   [junit4] Completed [63/487] on J0 in 0.36s, 2 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.analysis.standard.TestStandardAnalyzer
   [junit4] Completed [64/487] on J2 in 14.23s, 36 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestIndexWriterCommit
   [junit4] Completed [65/487] on J2 in 2.23s, 14 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestMaxPosition
   [junit4] Completed [66/487] on J2 in 0.08s, 2 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestTermdocPerf
   [junit4] Completed [67/487] on J2 in 0.08s, 1 test
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestParallelTermEnum
   [junit4] Completed [68/487] on J2 in 0.09s, 1 test
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestTieredMergePolicy
   [junit4] Completed [69/487] on J1 in 15.36s, 12 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestIndexInput
   [junit4] Completed [70/487] on J2 in 1.72s, 2 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.Test2BPoints
   [junit4] IGNOR/A 0.00s J2 | Test2BPoints.test2D
   [junit4]    > Assumption #1: 'monster' test group is disabled (@Monster(value=takes at least 4 hours and consumes many GB of temp disk space))
   [junit4] IGNOR/A 0.00s J2 | Test2BPoints.test1D
   [junit4]    > Assumption #1: 'monster' test group is disabled (@Monster(value=takes at least 4 hours and consumes many GB of temp disk space))
   [junit4] Completed [71/487] on J2 in 0.00s, 2 tests, 2 skipped
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestIndexWriterOnVMError
   [junit4] IGNOR/A 0.00s J2 | TestIndexWriterOnVMError.testCheckpoint
   [junit4]    > Assumption #1: 'nightly' test group is disabled (@Nightly())
   [junit4] Completed [72/487] on J2 in 1.05s, 3 tests, 1 skipped
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestDuelingCodecsAtNight
   [junit4] IGNOR/A 0.00s J2 | TestDuelingCodecsAtNight.testCrazyReaderEquals
   [junit4]    > Assumption #1: 'nightly' test group is disabled (@Nightly())
   [junit4] IGNOR/A 0.00s J2 | TestDuelingCodecsAtNight.testBigEquals
   [junit4]    > Assumption #1: 'nightly' test group is disabled (@Nightly())
   [junit4] IGNOR/A 0.00s J2 | TestDuelingCodecsAtNight.testEquals
   [junit4]    > Assumption #1: 'nightly' test group is disabled (@Nightly())
   [junit4] Completed [73/487] on J2 in 0.02s, 3 tests, 3 skipped
   [junit4] 
   [junit4] Suite: org.apache.lucene.util.automaton.TestDaciukMihovAutomatonBuilder
   [junit4] Completed [74/487] on J2 in 0.05s, 1 test
   [junit4] 
   [junit4] Suite: org.apache.lucene.util.TestIntsRef
   [junit4] Completed [75/487] on J2 in 0.04s, 3 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.search.TestConjunctions
   [junit4] Completed [76/487] on J2 in 0.15s, 2 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestFlex
   [junit4] Completed [77/487] on J2 in 0.41s, 2 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestTragicIndexWriterDeadlock
   [junit4] Completed [78/487] on J2 in 0.12s, 2 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.search.TestSearchAfter
   [junit4] Completed [79/487] on J2 in 1.36s, 1 test
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestCrash
   [junit4] Completed [80/487] on J2 in 0.76s, 5 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.util.TestRoaringDocIdSet
   [junit4] Completed [81/487] on J2 in 0.99s, 5 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.analysis.TestDelegatingAnalyzerWrapper
   [junit4] Completed [82/487] on J2 in 0.06s, 3 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.store.TestNRTCachingDirectory
   [junit4] IGNOR/A 0.01s J2 | TestNRTCachingDirectory.testFsyncDoesntCreateNewFiles
   [junit4]    > Assumption #1: test only works for FSDirectory subclasses
   [junit4] IGNOR/A 0.00s J2 | TestNRTCachingDirectory.testPendingDeletions
   [junit4]    > Assumption #1: we can only install VirusCheckingFS on an FSDirectory
   [junit4] Completed [83/487] on J2 in 3.89s, 43 tests, 2 skipped
   [junit4] 
   [junit4] Suite: org.apache.lucene.search.spans.TestNearSpansOrdered
   [junit4] Completed [84/487] on J2 in 0.71s, 19 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.search.TestIndexSearcher
   [junit4] Completed [85/487] on J2 in 0.50s, 6 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.search.TestScorerPerf
   [junit4] Completed [86/487] on J1 in 13.08s, 1 test
   [junit4] 
   [junit4] Suite: org.apache.lucene.search.TestFieldCacheRewriteMethod
   [junit4] Completed [87/487] on J2 in 4.01s, 2 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestConsistentFieldNumbers
   [junit4] Completed [88/487] on J1 in 2.24s, 4 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.util.TestRecyclingIntBlockAllocator
   [junit4] Completed [89/487] on J1 in 0.08s, 3 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.analysis.TestCharacterUtils
   [junit4] Completed [90/487] on J1 in 0.05s, 4 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.store.TestNIOFSDirectory
   [junit4] Completed [91/487] on J1 in 1.67s, 41 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.search.spans.TestFilterSpans
   [junit4] Completed [92/487] on J1 in 0.07s, 1 test
   [junit4] 
   [junit4] Suite: org.apache.lucene.search.TestIndexOrDocValuesQuery
   [junit4] Completed [93/487] on J1 in 0.29s, 1 test
   [junit4] 
   [junit4] Suite: org.apache.lucene.search.TestElevationComparator
   [junit4] Completed [94/487] on J1 in 0.12s, 1 test
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestIndexWriterThreadsToSegments
   [junit4] Completed [95/487] on J2 in 3.27s, 4 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.util.TestIntArrayDocIdSet
   [junit4] Completed [96/487] on J2 in 1.58s, 5 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestCodecs
   [junit4] Completed [97/487] on J2 in 0.84s, 3 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.util.automaton.LimitedFiniteStringsIteratorTest
   [junit4] Completed [98/487] on J2 in 0.45s, 6 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestTermsEnum2
   [junit4] Completed [99/487] on J2 in 2.04s, 4 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.util.TestLongsRef
   [junit4] Completed [100/487] on J2 in 0.07s, 3 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestAllFilesHaveCodecHeader
   [junit4] Completed [101/487] on J2 in 0.85s, 1 test
   [junit4] 
   [junit4] Suite: org.apache.lucene.store.TestSingleInstanceLockFactory
   [junit4] Completed [102/487] on J2 in 1.39s, 7 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestIndexWriterReader
   [junit4] IGNOR/A 0.00s J1 | TestIndexWriterReader.testDuringAddIndexes
   [junit4]    > Assumption #1: 'nightly' test group is disabled (@Nightly())
   [junit4] Completed [103/487] on J1 in 9.95s, 23 tests, 1 skipped
   [junit4] 
   [junit4] Suite: org.apache.lucene.util.TestInPlaceMergeSorter
   [junit4] Completed [104/487] on J1 in 0.21s, 9 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestCodecHoldsOpenFiles
   [junit4] Completed [105/487] on J1 in 0.13s, 1 test
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestMixedCodecs
   [junit4] Completed [106/487] on J2 in 2.33s, 1 test
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestTermVectors
   [junit4] Completed [107/487] on J2 in 0.52s, 3 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestAllFilesCheckIndexHeader
   [junit4] Completed [108/487] on J2 in 0.82s, 1 test
   [junit4] 
   [junit4] Suite: org.apache.lucene.util.automaton.FiniteStringsIteratorTest
   [junit4] Completed [109/487] on J1 in 3.92s, 7 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestByteSlices
   [junit4] Completed [110/487] on J2 in 4.62s, 1 test
   [junit4] 
   [junit4] Suite: org.apache.lucene.search.similarities.TestClassicSimilarity
   [junit4] Completed [111/487] on J2 in 0.15s, 12 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.search.TestSegmentCacheables
   [junit4] Completed [112/487] on J2 in 0.03s, 1 test
   [junit4] 
   [junit4] Suite: org.apache.lucene.util.TestBytesRefHash
   [junit4] Completed [113/487] on J2 in 2.95s, 8 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestTryDelete
   [junit4] Completed [114/487] on J2 in 0.07s, 3 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.store.TestRateLimiter
   [junit4] Completed [115/487] on J2 in 0.79s, 2 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.search.similarities.TestAxiomaticSimilarity
   [junit4] Completed [116/487] on J2 in 0.04s, 3 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestIndexWriterDeleteByQuery
   [junit4] Completed [117/487] on J2 in 0.04s, 1 test
   [junit4] 
   [junit4] Suite: org.apache.lucene.util.packed.TestDirectPacked
   [junit4] Completed [118/487] on J2 in 0.95s, 4 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.search.TestMultiCollector
   [junit4] Completed [119/487] on J2 in 0.66s, 2 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestForceMergeForever
   [junit4] Completed [120/487] on J2 in 0.89s, 1 test
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestMultiFields
   [junit4] Completed [121/487] on J2 in 2.32s, 3 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.util.TestStringHelper
   [junit4] Completed [122/487] on J2 in 0.06s, 7 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.Test2BBinaryDocValues
   [junit4] IGNOR/A 0.00s J2 | Test2BBinaryDocValues.testVariableBinary
   [junit4]    > Assumption #1: 'monster' test group is disabled (@Monster(value=takes ~ 6 hours if the heap is 5gb))
   [junit4] IGNOR/A 0.00s J2 | Test2BBinaryDocValues.testFixedBinary
   [junit4]    > Assumption #1: 'monster' test group is disabled (@Monster(value=takes ~ 6 hours if the heap is 5gb))
   [junit4] Completed [123/487] on J2 in 0.01s, 2 tests, 2 skipped
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestLogMergePolicy
   [junit4] Completed [124/487] on J2 in 0.89s, 5 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.document.TestDocument
   [junit4] Completed [125/487] on J2 in 0.10s, 12 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.search.spans.TestSpanNotQuery
   [junit4] Completed [126/487] on J2 in 0.07s, 3 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.search.TestSortedSetSortField
   [junit4] Completed [127/487] on J2 in 0.09s, 7 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestIntBlockPool
   [junit4] Completed [128/487] on J2 in 1.12s, 2 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestDocValues
   [junit4] Completed [129/487] on J2 in 0.14s, 8 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestIndexWriterMaxDocs
   [junit4] IGNOR/A 0.00s J2 | TestIndexWriterMaxDocs.testExactlyAtTrueLimit
   [junit4]    > Assumption #1: 'monster' test group is disabled (@Monster(value=takes over two hours))
   [junit4] Completed [130/487] on J2 in 2.11s, 21 tests, 1 skipped
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestCustomTermFreq
   [junit4] Completed [131/487] on J2 in 0.19s, 12 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.TestSearchForDuplicates
   [junit4] Completed [132/487] on J2 in 0.15s, 1 test
   [junit4] 
   [junit4] Suite: org.apache.lucene.util.TestFilterIterator
   [junit4] Completed [133/487] on J2 in 0.07s, 8 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.search.TestSimpleExplanationsWithFillerDocs
   [junit4] Completed [134/487] on J2 in 18.46s, 70 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestDirectoryReader
   [junit4] Completed [135/487] on J2 in 1.16s, 24 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.codecs.perfield.TestPerFieldDocValuesFormat
   [junit4] Completed [136/487] on J0 in 79.28s, 110 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestIndexWriterFromReader
   [junit4] Completed [137/487] on J0 in 0.65s, 12 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.geo.TestPolygon
   [junit4] Completed [138/487] on J0 in 0.10s, 15 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestFilterLeafReader
   [junit4] Completed [139/487] on J0 in 0.08s, 3 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.search.TestLongRangeFieldQueries
   [junit4] IGNOR/A 0.00s J2 | TestLongRangeFieldQueries.testRandomBig
   [junit4]    > Assumption #1: 'nightly' test group is disabled (@Nightly())
   [junit4] Completed [140/487] on J2 in 11.63s, 5 tests, 1 skipped
   [junit4] 
   [junit4] Suite: org.apache.lucene.util.TestVirtualMethod
   [junit4] Completed [141/487] on J2 in 0.06s, 2 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestDocsAndPositions
   [junit4] Completed [142/487] on J2 in 0.51s, 6 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.search.TestMultiset
   [junit4] Completed [143/487] on J2 in 0.07s, 2 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestDocumentsWriterDeleteQueue
   [junit4] Completed [144/487] on J2 in 0.17s, 5 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestStressIndexing2
   [junit4] Completed [145/487] on J2 in 1.07s, 3 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestMixedDocValuesUpdates
   [junit4] IGNOR/A 0.00s J0 | TestMixedDocValuesUpdates.testTonsOfUpdates
   [junit4]    > Assumption #1: 'nightly' test group is disabled (@Nightly())
   [junit4] Completed [146/487] on J0 in 13.53s, 10 tests, 1 skipped
   [junit4] 
   [junit4] Suite: org.apache.lucene.codecs.compressing.TestHighCompressionMode
   [junit4] Completed [147/487] on J2 in 1.63s, 7 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestNRTReaderCleanup
   [junit4] Completed [148/487] on J2 in 0.09s, 1 test
   [junit4] 
   [junit4] Suite: org.apache.lucene.codecs.lucene50.TestLucene50LiveDocsFormat
   [junit4] IGNOR/A 0.00s J2 | TestLucene50LiveDocsFormat.testOverflow
   [junit4]    > Assumption #1: 'monster' test group is disabled (@Monster(value=Uses lots of memory))
   [junit4] Completed [149/487] on J2 in 0.04s, 4 tests, 1 skipped
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.Test2BTerms
   [junit4] IGNOR/A 0.00s J2 | Test2BTerms.test2BTerms
   [junit4]    > Assumption #1: 'monster' test group is disabled (@Monster(value=very slow, use 5g minimum heap))
   [junit4] Completed [150/487] on J2 in 0.02s, 1 test, 1 skipped
   [junit4] 
   [junit4] Suite: org.apache.lucene.TestDemo
   [junit4] Completed [151/487] on J2 in 0.17s, 1 test
   [junit4] 
   [junit4] Suite: org.apache.lucene.TestExternalCodecs
   [junit4] Completed [152/487] on J2 in 0.51s, 1 test
   [junit4] 
   [junit4] Suite: org.apache.lucene.analysis.TestCachingTokenFilter
   [junit4] Completed [153/487] on J2 in 0.05s, 2 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.analysis.TestCharFilter
   [junit4] Completed [154/487] on J2 in 0.04s, 4 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.analysis.TestReusableStringReader
   [junit4] Completed [155/487] on J2 in 0.02s, 1 test
   [junit4] 
   [junit4] Suite: org.apache.lucene.analysis.TestStopFilter
   [junit4] Completed [156/487] on J2 in 0.03s, 5 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.analysis.TestToken
   [junit4] Completed [157/487] on J2 in 0.06s, 5 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.analysis.tokenattributes.TestCharTermAttributeImpl
   [junit4] Completed [158/487] on J2 in 0.36s, 13 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.analysis.tokenattributes.TestPackedTokenAttributeImpl
   [junit4] Completed [159/487] on J2 in 0.02s, 4 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestAtomicUpdate
   [junit4] Completed [160/487] on J0 in 3.65s, 1 test
   [junit4] 
   [junit4] Suite: org.apache.lucene.analysis.tokenattributes.TestSimpleAttributeImpl
   [junit4] Completed [161/487] on J2 in 0.02s, 1 test
   [junit4] 
   [junit4] Suite: org.apache.lucene.search.TestSimpleSearchEquivalence
   [junit4] Completed [162/487] on J0 in 0.80s, 17 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.util.TestBytesRef
   [junit4] Completed [163/487] on J0 in 0.04s, 4 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestTerm
   [junit4] Completed [164/487] on J0 in 0.03s, 1 test
   [junit4] 
   [junit4] Suite: org.apache.lucene.codecs.TestCodecLoadingDeadlock
   [junit4] Completed [165/487] on J2 in 0.60s, 1 test
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestPayloads
   [junit4] Completed [166/487] on J0 in 0.22s, 7 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.codecs.TestCodecUtil
   [junit4] Completed [167/487] on J2 in 0.08s, 16 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestMaxTermFrequency
   [junit4] Completed [168/487] on J0 in 0.23s, 1 test
   [junit4] 
   [junit4] Suite: org.apache.lucene.util.TestQueryBuilder
   [junit4] Completed [169/487] on J0 in 0.25s, 25 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestIndexCommit
   [junit4] Completed [170/487] on J0 in 0.04s, 1 test
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestTransactionRollback
   [junit4] Completed [171/487] on J0 in 0.18s, 2 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.search.TestEarlyTermination
   [junit4] Completed [172/487] on J0 in 0.17s, 1 test
   [junit4] 
   [junit4] Suite: org.apache.lucene.document.TestFieldType
   [junit4] Completed [173/487] on J0 in 0.06s, 3 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.search.TestSort
   [junit4] Completed [174/487] on J0 in 0.20s, 25 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.search.TestNot
   [junit4] Completed [175/487] on J0 in 0.04s, 1 test
   [junit4] 
   [junit4] Suite: org.apache.lucene.codecs.lucene50.TestBlockPostingsFormat2
   [junit4] Completed [176/487] on J2 in 3.00s, 4 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.codecs.lucene50.TestBlockPostingsFormat3
   [junit4] Completed [177/487] on J2 in 1.18s, 1 test
   [junit4] 
   [junit4] Suite: org.apache.lucene.codecs.lucene50.TestForUtil
   [junit4] Completed [178/487] on J2 in 0.05s, 1 test
   [junit4] 
   [junit4] Suite: org.apache.lucene.codecs.lucene50.TestLucene50StoredFieldsFormat
   [junit4] IGNOR/A 0.00s J2 | TestLucene50StoredFieldsFormat.testBigDocuments
   [junit4]    > Assumption #1: 'nightly' test group is disabled (@Nightly())
   [junit4] Completed [179/487] on J2 in 3.26s, 17 tests, 1 skipped
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestConcurrentMergeScheduler
   [junit4] Completed [180/487] on J0 in 6.85s, 16 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.codecs.lucene50.TestLucene50StoredFieldsFormatHighCompression
   [junit4] IGNOR/A 0.00s J2 | TestLucene50StoredFieldsFormatHighCompression.testBigDocuments
   [junit4]    > Assumption #1: 'nightly' test group is disabled (@Nightly())
   [junit4] Completed [181/487] on J2 in 7.71s, 19 tests, 1 skipped
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestTermsEnum
   [junit4] Completed [182/487] on J1 in 74.10s, 13 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.util.TestLongBitSet
   [junit4] IGNOR/A 0.00s J1 | TestLongBitSet.testHugeCapacity
   [junit4]    > Assumption #1: 'nightly' test group is disabled (@Nightly())
   [junit4] Completed [183/487] on J1 in 0.59s, 11 tests, 1 skipped
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestAllFilesHaveChecksumFooter
   [junit4] Completed [184/487] on J1 in 0.57s, 1 test
   [junit4] 
   [junit4] Suite: org.apache.lucene.store.TestSimpleFSLockFactory
   [junit4] Completed [185/487] on J1 in 5.27s, 7 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestMergeRateLimiter
   [junit4] Completed [186/487] on J1 in 0.03s, 1 test
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestTermContext
   [junit4] Completed [187/487] on J1 in 0.02s, 1 test
   [junit4] 
   [junit4] Suite: org.apache.lucene.search.TestTopFieldCollectorEarlyTermination
   [junit4] Completed [188/487] on J0 in 18.59s, 4 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.search.spans.TestSpans
   [junit4] Completed [189/487] on J0 in 0.59s, 26 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestMultiLevelSkipList
   [junit4] Completed [190/487] on J0 in 0.08s, 1 test
   [junit4] 
   [junit4] Suite: org.apache.lucene.search.spans.TestSpanBoostQuery
   [junit4] Completed [191/487] on J0 in 0.06s, 2 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.search.TestSortedNumericSortField
   [junit4] Completed [192/487] on J0 in 0.13s, 9 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestAddIndexes
   [junit4] Completed [193/487] on J1 in 3.30s, 28 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.index.TestBinaryTerms
   [junit4] Completed [194/487] on J1 in 0.10s, 2 tests
   [junit4] 
   [junit4] Suite: org.apache.lucene.search.similarities.TestBooleanSimila

[...truncated too long message...]

)
   [junit4]   2>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]   2>         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2>         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:504)
   [junit4]   2> Dec 12, 2018 9:43:06 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> INFO: Starting to interrupt leaked threads:
   [junit4]   2>    1) Thread[id=63, name=TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[CF84F3C1F6FF3D16]-EventThread, state=WAITING, group=TGRP-SaslZkACLProviderTest]
   [junit4]   2>    2) Thread[id=68, name=TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[CF84F3C1F6FF3D16]-EventThread, state=WAITING, group=TGRP-SaslZkACLProviderTest]
   [junit4]   2>    3) Thread[id=60, name=TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[CF84F3C1F6FF3D16]-EventThread, state=WAITING, group=TGRP-SaslZkACLProviderTest]
   [junit4]   2> 37106 ERROR (TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[CF84F3C1F6FF3D16]-EventThread) [    ] o.a.z.ClientCnxn Event thread exiting due to interruption
   [junit4]   2> java.lang.InterruptedException: null
   [junit4]   2> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) ~[?:1.8.0_172]
   [junit4]   2> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2048) ~[?:1.8.0_172]
   [junit4]   2> 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) ~[?:1.8.0_172]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:504) [zookeeper-3.4.13.jar:3.4.13-2d71af4dbe22557fda74f9a9b4309b15a7487f03]
   [junit4]   2> 37106 ERROR (TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[CF84F3C1F6FF3D16]-EventThread) [    ] o.a.z.ClientCnxn Event thread exiting due to interruption
   [junit4]   2> java.lang.InterruptedException: null
   [junit4]   2> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) ~[?:1.8.0_172]
   [junit4]   2> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2048) ~[?:1.8.0_172]
   [junit4]   2> 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) ~[?:1.8.0_172]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:504) [zookeeper-3.4.13.jar:3.4.13-2d71af4dbe22557fda74f9a9b4309b15a7487f03]
   [junit4]   2> 37106 ERROR (TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[CF84F3C1F6FF3D16]-EventThread) [    ] o.a.z.ClientCnxn Event thread exiting due to interruption
   [junit4]   2> java.lang.InterruptedException: null
   [junit4]   2> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) ~[?:1.8.0_172]
   [junit4]   2> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2048) ~[?:1.8.0_172]
   [junit4]   2> 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) ~[?:1.8.0_172]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:504) [zookeeper-3.4.13.jar:3.4.13-2d71af4dbe22557fda74f9a9b4309b15a7487f03]
   [junit4]   2> Dec 12, 2018 9:43:06 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> INFO: All leaked threads terminated.
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=1122, maxMBSortInHeap=7.148807305751278, sim=RandomSimilarity(queryNorm=true): {}, locale=es-NI, timezone=ART
   [junit4]   2> NOTE: Linux 4.15.0-39-generic i386/Oracle Corporation 1.8.0_172 (32-bit)/cpus=8,threads=1,free=30485376,total=85618688
   [junit4]   2> NOTE: All tests run in this JVM: [SaslZkACLProviderTest, SaslZkACLProviderTest]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=SaslZkACLProviderTest -Dtests.seed=CF84F3C1F6FF3D16 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.badapples=true -Dtests.locale=es-NI -Dtests.timezone=ART -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.00s J0 | SaslZkACLProviderTest (suite) <<<
   [junit4]    > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 3 threads leaked from SUITE scope at org.apache.solr.cloud.SaslZkACLProviderTest: 
   [junit4]    >    1) Thread[id=63, name=TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[CF84F3C1F6FF3D16]-EventThread, state=WAITING, group=TGRP-SaslZkACLProviderTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]    >         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]    >         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:504)
   [junit4]    >    2) Thread[id=68, name=TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[CF84F3C1F6FF3D16]-EventThread, state=WAITING, group=TGRP-SaslZkACLProviderTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]    >         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]    >         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:504)
   [junit4]    >    3) Thread[id=60, name=TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[CF84F3C1F6FF3D16]-EventThread, state=WAITING, group=TGRP-SaslZkACLProviderTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]    >         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]    >         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:504)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([CF84F3C1F6FF3D16]:0)
   [junit4] Completed [5/5 (5!)] on J0 in 15.68s, 1 test, 2 errors <<< FAILURES!
   [junit4] 
   [junit4] 
   [junit4] Tests with failures [seed: CF84F3C1F6FF3D16]:
   [junit4]   - org.apache.solr.cloud.SaslZkACLProviderTest.testSaslZkACLProvider
   [junit4]   - org.apache.solr.cloud.SaslZkACLProviderTest (suite)
   [junit4]   - org.apache.solr.cloud.SaslZkACLProviderTest.testSaslZkACLProvider
   [junit4]   - org.apache.solr.cloud.SaslZkACLProviderTest.testSaslZkACLProvider
   [junit4]   - org.apache.solr.cloud.SaslZkACLProviderTest (suite)
   [junit4]   - org.apache.solr.cloud.SaslZkACLProviderTest (suite)
   [junit4]   - org.apache.solr.cloud.SaslZkACLProviderTest.testSaslZkACLProvider
   [junit4]   - org.apache.solr.cloud.SaslZkACLProviderTest (suite)
   [junit4]   - org.apache.solr.cloud.SaslZkACLProviderTest.testSaslZkACLProvider
   [junit4]   - org.apache.solr.cloud.SaslZkACLProviderTest (suite)
   [junit4] 
   [junit4] 
   [junit4] JVM J0:     0.44 ..    37.62 =    37.18s
   [junit4] JVM J1:     0.43 ..    21.82 =    21.39s
   [junit4] JVM J2:     0.44 ..    37.34 =    36.90s
   [junit4] Execution time total: 37 seconds
   [junit4] Tests summary: 5 suites, 5 tests, 5 suite-level errors, 5 errors

BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/common-build.xml:1572: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/common-build.xml:1099: There were test failures: 5 suites, 5 tests, 5 suite-level errors, 5 errors [seed: CF84F3C1F6FF3D16]

Total time: 39 seconds

[repro] Setting last failure code to 256

[repro] Failures:
[repro]   5/5 failed: org.apache.solr.cloud.SaslZkACLProviderTest
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=bd104ffd48859f625c999856768b9f14bb6fe1f2, workspace=/var/lib/jenkins/workspace/Lucene-Solr-7.x-Linux
[WARNINGS] Computing warning deltas based on reference build #3204
Recording test results
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2