You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2018/05/19 20:01:28 UTC

[JENKINS] Lucene-Solr-Tests-7.x - Build # 614 - Still Unstable

Build: https://builds.apache.org/job/Lucene-Solr-Tests-7.x/614/

3 tests failed.
FAILED:  org.apache.solr.cloud.LeaderVoteWaitTimeoutTest.testMostInSyncReplicasCanWinElection

Error Message:
Timeout waiting for new leader null Live Nodes: [127.0.0.1:33711_solr, 127.0.0.1:33898_solr, 127.0.0.1:39483_solr] Last available state: DocCollection(collection1//collections/collection1/state.json/14)={   "pullReplicas":"0",   "replicationFactor":"3",   "shards":{"shard1":{       "range":"80000000-7fffffff",       "state":"active",       "replicas":{         "core_node62":{           "core":"collection1_shard1_replica_n61",           "base_url":"https://127.0.0.1:38158/solr",           "node_name":"127.0.0.1:38158_solr",           "state":"down",           "type":"NRT",           "force_set_state":"false"},         "core_node64":{           "core":"collection1_shard1_replica_n63",           "base_url":"https://127.0.0.1:33898/solr",           "node_name":"127.0.0.1:33898_solr",           "state":"active",           "type":"NRT",           "force_set_state":"false"},         "core_node66":{           "core":"collection1_shard1_replica_n65",           "base_url":"https://127.0.0.1:39483/solr",           "node_name":"127.0.0.1:39483_solr",           "state":"active",           "type":"NRT",           "force_set_state":"false"}}}},   "router":{"name":"compositeId"},   "maxShardsPerNode":"1",   "autoAddReplicas":"false",   "nrtReplicas":"3",   "tlogReplicas":"0"}

Stack Trace:
java.lang.AssertionError: Timeout waiting for new leader
null
Live Nodes: [127.0.0.1:33711_solr, 127.0.0.1:33898_solr, 127.0.0.1:39483_solr]
Last available state: DocCollection(collection1//collections/collection1/state.json/14)={
  "pullReplicas":"0",
  "replicationFactor":"3",
  "shards":{"shard1":{
      "range":"80000000-7fffffff",
      "state":"active",
      "replicas":{
        "core_node62":{
          "core":"collection1_shard1_replica_n61",
          "base_url":"https://127.0.0.1:38158/solr",
          "node_name":"127.0.0.1:38158_solr",
          "state":"down",
          "type":"NRT",
          "force_set_state":"false"},
        "core_node64":{
          "core":"collection1_shard1_replica_n63",
          "base_url":"https://127.0.0.1:33898/solr",
          "node_name":"127.0.0.1:33898_solr",
          "state":"active",
          "type":"NRT",
          "force_set_state":"false"},
        "core_node66":{
          "core":"collection1_shard1_replica_n65",
          "base_url":"https://127.0.0.1:39483/solr",
          "node_name":"127.0.0.1:39483_solr",
          "state":"active",
          "type":"NRT",
          "force_set_state":"false"}}}},
  "router":{"name":"compositeId"},
  "maxShardsPerNode":"1",
  "autoAddReplicas":"false",
  "nrtReplicas":"3",
  "tlogReplicas":"0"}
	at __randomizedtesting.SeedInfo.seed([F523DD514E83EF45:5D3FC1EB8CC3DB6F]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.SolrCloudTestCase.waitForState(SolrCloudTestCase.java:278)
	at org.apache.solr.cloud.LeaderVoteWaitTimeoutTest.testMostInSyncReplicasCanWinElection(LeaderVoteWaitTimeoutTest.java:187)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.client.solrj.io.stream.StreamDecoratorTest.testParallelUpdateStream

Error Message:
java.util.concurrent.ExecutionException: java.io.IOException: --> https://127.0.0.1:44615/solr/collection1_shard2_replica_n2/:org.apache.solr.common.SolrException: Could not load collection from ZK: collection1

Stack Trace:
java.io.IOException: java.util.concurrent.ExecutionException: java.io.IOException: --> https://127.0.0.1:44615/solr/collection1_shard2_replica_n2/:org.apache.solr.common.SolrException: Could not load collection from ZK: collection1
	at __randomizedtesting.SeedInfo.seed([E5C61FBEF2717179:86285C5CAE458A12]:0)
	at org.apache.solr.client.solrj.io.stream.CloudSolrStream.openStreams(CloudSolrStream.java:400)
	at org.apache.solr.client.solrj.io.stream.CloudSolrStream.open(CloudSolrStream.java:275)
	at org.apache.solr.client.solrj.io.stream.StreamDecoratorTest.getTuples(StreamDecoratorTest.java:3916)
	at org.apache.solr.client.solrj.io.stream.StreamDecoratorTest.testParallelUpdateStream(StreamDecoratorTest.java:2520)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)
Caused by: java.util.concurrent.ExecutionException: java.io.IOException: --> https://127.0.0.1:44615/solr/collection1_shard2_replica_n2/:org.apache.solr.common.SolrException: Could not load collection from ZK: collection1
	at java.util.concurrent.FutureTask.report(FutureTask.java:122)
	at java.util.concurrent.FutureTask.get(FutureTask.java:192)
	at org.apache.solr.client.solrj.io.stream.CloudSolrStream.openStreams(CloudSolrStream.java:394)
	... 42 more
Caused by: java.io.IOException: --> https://127.0.0.1:44615/solr/collection1_shard2_replica_n2/:org.apache.solr.common.SolrException: Could not load collection from ZK: collection1
	at org.apache.solr.client.solrj.io.stream.SolrStream.read(SolrStream.java:222)
	at org.apache.solr.client.solrj.io.stream.CloudSolrStream$TupleWrapper.next(CloudSolrStream.java:484)
	at org.apache.solr.client.solrj.io.stream.CloudSolrStream$StreamOpener.call(CloudSolrStream.java:507)
	at org.apache.solr.client.solrj.io.stream.CloudSolrStream$StreamOpener.call(CloudSolrStream.java:494)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:192)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	... 1 more


FAILED:  org.apache.solr.common.cloud.TestCollectionStateWatchers.testWaitForStateWatcherIsRetainedOnPredicateFailure

Error Message:
Did not see a fully active cluster after 30 seconds

Stack Trace:
java.lang.AssertionError: Did not see a fully active cluster after 30 seconds
	at __randomizedtesting.SeedInfo.seed([E5C61FBEF2717179:6DF0BDED2ADE996B]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.common.cloud.TestCollectionStateWatchers.testWaitForStateWatcherIsRetainedOnPredicateFailure(TestCollectionStateWatchers.java:250)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 12744 lines...]
   [junit4] Suite: org.apache.solr.cloud.LeaderVoteWaitTimeoutTest
   [junit4]   2> Creating dataDir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderVoteWaitTimeoutTest_F523DD514E83EF45-001/init-core-data-001
   [junit4]   2> 863844 WARN  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=1 numCloses=1
   [junit4]   2> 863860 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 863861 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 863862 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 863863 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderVoteWaitTimeoutTest_F523DD514E83EF45-001/tempDir-001
   [junit4]   2> 863863 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 863863 INFO  (Thread-2303) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 863863 INFO  (Thread-2303) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 863969 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:42953
   [junit4]   2> 863986 ERROR (Thread-2303) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 864139 INFO  (zkConnectionManagerCallback-764-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 864212 INFO  (jetty-launcher-761-thread-1) [    ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 1.8.0_172-b11
   [junit4]   2> 864218 INFO  (jetty-launcher-761-thread-2) [    ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 1.8.0_172-b11
   [junit4]   2> 864303 INFO  (jetty-launcher-761-thread-4) [    ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 1.8.0_172-b11
   [junit4]   2> 864303 INFO  (jetty-launcher-761-thread-3) [    ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 1.8.0_172-b11
   [junit4]   2> 864367 INFO  (jetty-launcher-761-thread-2) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 864367 INFO  (jetty-launcher-761-thread-2) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 864368 INFO  (jetty-launcher-761-thread-2) [    ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 864388 INFO  (jetty-launcher-761-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@26c50159{/solr,null,AVAILABLE}
   [junit4]   2> 864389 INFO  (jetty-launcher-761-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@386c9615{SSL,[ssl, http/1.1]}{127.0.0.1:33253}
   [junit4]   2> 864390 INFO  (jetty-launcher-761-thread-2) [    ] o.e.j.s.Server Started @864611ms
   [junit4]   2> 864390 INFO  (jetty-launcher-761-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=33253}
   [junit4]   2> 864390 ERROR (jetty-launcher-761-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 864390 INFO  (jetty-launcher-761-thread-2) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 864390 INFO  (jetty-launcher-761-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.4.0
   [junit4]   2> 864390 INFO  (jetty-launcher-761-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 864390 INFO  (jetty-launcher-761-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 864390 INFO  (jetty-launcher-761-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-05-19T17:32:39.444Z
   [junit4]   2> 864432 INFO  (jetty-launcher-761-thread-1) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 864432 INFO  (jetty-launcher-761-thread-1) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 864432 INFO  (jetty-launcher-761-thread-1) [    ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 864453 INFO  (jetty-launcher-761-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7bc56b15{/solr,null,AVAILABLE}
   [junit4]   2> 864453 INFO  (jetty-launcher-761-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@5fa903a0{SSL,[ssl, http/1.1]}{127.0.0.1:37621}
   [junit4]   2> 864453 INFO  (jetty-launcher-761-thread-1) [    ] o.e.j.s.Server Started @864674ms
   [junit4]   2> 864453 INFO  (jetty-launcher-761-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=37621}
   [junit4]   2> 864454 ERROR (jetty-launcher-761-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 864454 INFO  (jetty-launcher-761-thread-1) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 864454 INFO  (jetty-launcher-761-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.4.0
   [junit4]   2> 864454 INFO  (jetty-launcher-761-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 864454 INFO  (jetty-launcher-761-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 864454 INFO  (jetty-launcher-761-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-05-19T17:32:39.508Z
   [junit4]   2> 864501 INFO  (jetty-launcher-761-thread-3) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 864501 INFO  (jetty-launcher-761-thread-3) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 864501 INFO  (jetty-launcher-761-thread-3) [    ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 864502 INFO  (jetty-launcher-761-thread-3) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3437a277{/solr,null,AVAILABLE}
   [junit4]   2> 864503 INFO  (jetty-launcher-761-thread-3) [    ] o.e.j.s.AbstractConnector Started ServerConnector@102a3b9b{SSL,[ssl, http/1.1]}{127.0.0.1:45858}
   [junit4]   2> 864503 INFO  (jetty-launcher-761-thread-3) [    ] o.e.j.s.Server Started @864724ms
   [junit4]   2> 864503 INFO  (jetty-launcher-761-thread-3) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=45858}
   [junit4]   2> 864503 ERROR (jetty-launcher-761-thread-3) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 864503 INFO  (jetty-launcher-761-thread-3) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 864503 INFO  (jetty-launcher-761-thread-3) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.4.0
   [junit4]   2> 864503 INFO  (jetty-launcher-761-thread-3) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 864503 INFO  (jetty-launcher-761-thread-3) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 864503 INFO  (jetty-launcher-761-thread-3) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-05-19T17:32:39.557Z
   [junit4]   2> 864570 INFO  (jetty-launcher-761-thread-4) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 864570 INFO  (jetty-launcher-761-thread-4) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 864570 INFO  (jetty-launcher-761-thread-4) [    ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 864571 INFO  (jetty-launcher-761-thread-4) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@31186404{/solr,null,AVAILABLE}
   [junit4]   2> 864571 INFO  (jetty-launcher-761-thread-4) [    ] o.e.j.s.AbstractConnector Started ServerConnector@695c31d0{SSL,[ssl, http/1.1]}{127.0.0.1:40467}
   [junit4]   2> 864571 INFO  (jetty-launcher-761-thread-4) [    ] o.e.j.s.Server Started @864792ms
   [junit4]   2> 864571 INFO  (jetty-launcher-761-thread-4) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=40467}
   [junit4]   2> 864572 ERROR (jetty-launcher-761-thread-4) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 864572 INFO  (jetty-launcher-761-thread-4) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 864572 INFO  (jetty-launcher-761-thread-4) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.4.0
   [junit4]   2> 864572 INFO  (jetty-launcher-761-thread-4) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 864572 INFO  (jetty-launcher-761-thread-4) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 864572 INFO  (jetty-launcher-761-thread-4) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-05-19T17:32:39.626Z
   [junit4]   2> 864770 INFO  (zkConnectionManagerCallback-766-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 864784 INFO  (zkConnectionManagerCallback-770-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 864801 INFO  (jetty-launcher-761-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 864801 INFO  (jetty-launcher-761-thread-3) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 864831 INFO  (zkConnectionManagerCallback-768-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 864845 INFO  (zkConnectionManagerCallback-772-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 864870 INFO  (jetty-launcher-761-thread-3) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42953/solr
   [junit4]   2> 864916 INFO  (jetty-launcher-761-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 864917 INFO  (zkConnectionManagerCallback-776-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 864917 INFO  (jetty-launcher-761-thread-4) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 864934 INFO  (jetty-launcher-761-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42953/solr
   [junit4]   2> 864975 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x1021db86b200005, likely client has closed socket
   [junit4]   2> 865011 INFO  (jetty-launcher-761-thread-4) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42953/solr
   [junit4]   2> 865013 INFO  (zkConnectionManagerCallback-780-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 865034 INFO  (zkConnectionManagerCallback-786-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 865034 INFO  (zkConnectionManagerCallback-783-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 865046 INFO  (jetty-launcher-761-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42953/solr
   [junit4]   2> 865078 INFO  (zkConnectionManagerCallback-790-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 865079 INFO  (zkConnectionManagerCallback-794-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 865079 INFO  (zkConnectionManagerCallback-792-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 865122 INFO  (zkConnectionManagerCallback-796-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 865680 INFO  (jetty-launcher-761-thread-2) [n:127.0.0.1:33253_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 865681 INFO  (jetty-launcher-761-thread-2) [n:127.0.0.1:33253_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:33253_solr
   [junit4]   2> 865682 INFO  (jetty-launcher-761-thread-4) [n:127.0.0.1:40467_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 865695 INFO  (jetty-launcher-761-thread-1) [n:127.0.0.1:37621_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 865695 INFO  (jetty-launcher-761-thread-2) [n:127.0.0.1:33253_solr    ] o.a.s.c.Overseer Overseer (id=72653221899796490-127.0.0.1:33253_solr-n_0000000000) starting
   [junit4]   2> 865699 INFO  (jetty-launcher-761-thread-4) [n:127.0.0.1:40467_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40467_solr
   [junit4]   2> 865704 INFO  (jetty-launcher-761-thread-1) [n:127.0.0.1:37621_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37621_solr
   [junit4]   2> 865724 INFO  (zkCallback-791-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 865724 INFO  (zkCallback-789-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 865748 INFO  (zkCallback-795-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 865772 INFO  (zkCallback-795-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 865773 INFO  (zkCallback-789-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 865774 INFO  (zkCallback-791-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 865829 INFO  (zkConnectionManagerCallback-809-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 865832 INFO  (jetty-launcher-761-thread-2) [n:127.0.0.1:33253_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 865833 INFO  (jetty-launcher-761-thread-2) [n:127.0.0.1:33253_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:42953/solr ready
   [junit4]   2> 865882 INFO  (jetty-launcher-761-thread-3) [n:127.0.0.1:45858_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 865883 INFO  (jetty-launcher-761-thread-2) [n:127.0.0.1:33253_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 865883 INFO  (jetty-launcher-761-thread-2) [n:127.0.0.1:33253_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33253_solr
   [junit4]   2> 865885 INFO  (jetty-launcher-761-thread-3) [n:127.0.0.1:45858_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 865906 INFO  (zkCallback-791-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 865922 INFO  (zkCallback-795-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 865925 INFO  (zkCallback-789-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 865926 INFO  (jetty-launcher-761-thread-3) [n:127.0.0.1:45858_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 865926 INFO  (jetty-launcher-761-thread-3) [n:127.0.0.1:45858_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45858_solr
   [junit4]   2> 865928 INFO  (zkCallback-789-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 866012 INFO  (zkCallback-808-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 866012 INFO  (zkCallback-782-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (4)
   [junit4]   2> 866048 INFO  (zkCallback-795-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 866048 INFO  (zkCallback-808-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 866048 INFO  (zkCallback-791-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 866234 INFO  (jetty-launcher-761-thread-4) [n:127.0.0.1:40467_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40467.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@71bf2727
   [junit4]   2> 866306 INFO  (jetty-launcher-761-thread-4) [n:127.0.0.1:40467_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40467.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@71bf2727
   [junit4]   2> 866306 INFO  (jetty-launcher-761-thread-4) [n:127.0.0.1:40467_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40467.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@71bf2727
   [junit4]   2> 866307 INFO  (jetty-launcher-761-thread-4) [n:127.0.0.1:40467_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderVoteWaitTimeoutTest_F523DD514E83EF45-001/tempDir-001/node4/.
   [junit4]   2> 866499 INFO  (zkConnectionManagerCallback-814-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 866606 INFO  (jetty-launcher-761-thread-4) [n:127.0.0.1:40467_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 866607 INFO  (jetty-launcher-761-thread-4) [n:127.0.0.1:40467_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:42953/solr ready
   [junit4]   2> 866758 INFO  (jetty-launcher-761-thread-1) [n:127.0.0.1:37621_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37621.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@71bf2727
   [junit4]   2> 866787 INFO  (jetty-launcher-761-thread-1) [n:127.0.0.1:37621_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37621.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@71bf2727
   [junit4]   2> 866787 INFO  (jetty-launcher-761-thread-1) [n:127.0.0.1:37621_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37621.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@71bf2727
   [junit4]   2> 866800 INFO  (jetty-launcher-761-thread-1) [n:127.0.0.1:37621_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderVoteWaitTimeoutTest_F523DD514E83EF45-001/tempDir-001/node1/.
   [junit4]   2> 866866 INFO  (zkConnectionManagerCallback-819-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 866929 INFO  (jetty-launcher-761-thread-1) [n:127.0.0.1:37621_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 866946 INFO  (jetty-launcher-761-thread-1) [n:127.0.0.1:37621_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:42953/solr ready
   [junit4]   2> 866969 INFO  (jetty-launcher-761-thread-2) [n:127.0.0.1:33253_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33253.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@71bf2727
   [junit4]   2> 867050 INFO  (jetty-launcher-761-thread-2) [n:127.0.0.1:33253_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33253.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@71bf2727
   [junit4]   2> 867050 INFO  (jetty-launcher-761-thread-2) [n:127.0.0.1:33253_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33253.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@71bf2727
   [junit4]   2> 867051 INFO  (jetty-launcher-761-thread-2) [n:127.0.0.1:33253_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderVoteWaitTimeoutTest_F523DD514E83EF45-001/tempDir-001/node2/.
   [junit4]   2> 867537 INFO  (jetty-launcher-761-thread-3) [n:127.0.0.1:45858_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45858.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@71bf2727
   [junit4]   2> 867552 INFO  (jetty-launcher-761-thread-3) [n:127.0.0.1:45858_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45858.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@71bf2727
   [junit4]   2> 867552 INFO  (jetty-launcher-761-thread-3) [n:127.0.0.1:45858_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45858.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@71bf2727
   [junit4]   2> 867553 INFO  (jetty-launcher-761-thread-3) [n:127.0.0.1:45858_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderVoteWaitTimeoutTest_F523DD514E83EF45-001/tempDir-001/node3/.
   [junit4]   2> 867569 INFO  (zkConnectionManagerCallback-824-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 867571 INFO  (jetty-launcher-761-thread-3) [n:127.0.0.1:45858_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 867571 INFO  (jetty-launcher-761-thread-3) [n:127.0.0.1:45858_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:42953/solr ready
   [junit4]   2> 867688 INFO  (zkConnectionManagerCallback-826-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 867692 INFO  (zkConnectionManagerCallback-831-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 867693 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 867702 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:42953/solr ready
   [junit4]   2> 867719 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@695c31d0{SSL,[ssl, http/1.1]}{127.0.0.1:0}
   [junit4]   2> 867719 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1677060137
   [junit4]   2> 867720 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 867720 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@17214fa9: rootName = solr_40467, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@268fc704
   [junit4]   2> 867737 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 867737 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@471bad8e: rootName = solr_40467, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@1935bed7
   [junit4]   2> 867748 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 867749 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2740905b: rootName = solr_40467, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@6686b409
   [junit4]   2> 867750 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:40467_solr
   [junit4]   2> 867751 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 867751 INFO  (zkCallback-791-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 867751 INFO  (zkCallback-795-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 867751 INFO  (zkCallback-808-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 867751 INFO  (zkCallback-789-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 867753 INFO  (zkCallback-818-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 867753 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 867754 INFO  (zkCallback-830-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 867754 INFO  (zkCallback-823-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 867754 INFO  (zkCallback-813-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 867775 INFO  (zkCallback-782-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 867784 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@31186404{/solr,null,UNAVAILABLE}
   [junit4]   2> 867784 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 867786 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 1.8.0_172-b11
   [junit4]   2> 867788 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 867788 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 867788 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 867788 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@34b210fc{/solr,null,AVAILABLE}
   [junit4]   2> 867789 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.e.j.s.AbstractConnector Started ServerConnector@6b404611{SSL,[ssl, http/1.1]}{127.0.0.1:46866}
   [junit4]   2> 867789 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.e.j.s.Server Started @868011ms
   [junit4]   2> 867790 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=38158}
   [junit4]   2> 867790 ERROR (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 867790 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 867790 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.4.0
   [junit4]   2> 867790 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 867790 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 867790 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-05-19T17:32:42.844Z
   [junit4]   2> 867832 INFO  (zkConnectionManagerCallback-833-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 867833 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 867867 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42953/solr
   [junit4]   2> 867877 INFO  (zkConnectionManagerCallback-837-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 867880 INFO  (zkConnectionManagerCallback-839-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 867894 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [n:127.0.0.1:38158_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 867896 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [n:127.0.0.1:38158_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 867906 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [n:127.0.0.1:38158_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 867906 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [n:127.0.0.1:38158_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38158_solr
   [junit4]   2> 867911 INFO  (zkCallback-782-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 867911 INFO  (zkCallback-823-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 867911 INFO  (zkCallback-830-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 867911 INFO  (zkCallback-818-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 867911 INFO  (zkCallback-791-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 867911 INFO  (zkCallback-808-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 867911 INFO  (zkCallback-795-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 867934 INFO  (zkCallback-838-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 868590 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [n:127.0.0.1:38158_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38158.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@71bf2727
   [junit4]   2> 868605 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [n:127.0.0.1:38158_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38158.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@71bf2727
   [junit4]   2> 868605 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [n:127.0.0.1:38158_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38158.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@71bf2727
   [junit4]   2> 868606 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [n:127.0.0.1:38158_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderVoteWaitTimeoutTest_F523DD514E83EF45-001/tempDir-001/node4/.
   [junit4]   2> 868637 INFO  (zkConnectionManagerCallback-846-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 868638 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [n:127.0.0.1:38158_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 868639 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [n:127.0.0.1:38158_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:42953/solr ready
   [junit4]   2> 868709 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.c.LeaderVoteWaitTimeoutTest Adding proxy for URL: https://127.0.0.1:46866/solr. Proxy: https://127.0.0.1:38158/solr
   [junit4]   2> 868711 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@5fa903a0{SSL,[ssl, http/1.1]}{127.0.0.1:0}
   [junit4]   2> 868711 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1824270319
   [junit4]   2> 868711 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 868712 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2783f97a: rootName = solr_37621, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@2a066d5f
   [junit4]   2> 868716 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 868717 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@305078c3: rootName = solr_37621, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@1935bed7
   [junit4]   2> 868736 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 868736 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@314f5ebd: rootName = solr_37621, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@6686b409
   [junit4]   2> 868737 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:37621_solr
   [junit4]   2> 868739 INFO  (zkCallback-823-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 868739 INFO  (zkCallback-830-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 868739 INFO  (zkCallback-818-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 868739 INFO  (zkCallback-791-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 868739 INFO  (zkCallback-838-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 868742 INFO  (zkCallback-782-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 868742 INFO  (zkCallback-808-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 868742 INFO  (zkCallback-795-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 868758 INFO  (zkCallback-845-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 868758 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 868775 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 868778 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x1021db86b20000c, likely client has closed socket
   [junit4]   2> 868779 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@7bc56b15{/solr,null,UNAVAILABLE}
   [junit4]   2> 868779 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 868782 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 1.8.0_172-b11
   [junit4]   2> 868795 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 868795 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 868795 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 868795 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4d5441ec{/solr,null,AVAILABLE}
   [junit4]   2> 868797 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.e.j.s.AbstractConnector Started ServerConnector@66999197{SSL,[ssl, http/1.1]}{127.0.0.1:34135}
   [junit4]   2> 868797 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.e.j.s.Server Started @869018ms
   [junit4]   2> 868797 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=33898}
   [junit4]   2> 868797 ERROR (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 868797 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 868797 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.4.0
   [junit4]   2> 868797 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 868798 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 868798 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-05-19T17:32:43.852Z
   [junit4]   2> 868821 INFO  (zkConnectionManagerCallback-848-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 868821 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 868851 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42953/solr
   [junit4]   2> 868861 INFO  (zkConnectionManagerCallback-852-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 868864 INFO  (zkConnectionManagerCallback-854-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 868869 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [n:127.0.0.1:33898_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 868871 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [n:127.0.0.1:33898_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 868873 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [n:127.0.0.1:33898_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 868873 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [n:127.0.0.1:33898_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33898_solr
   [junit4]   2> 868875 INFO  (zkCallback-838-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 868875 INFO  (zkCallback-791-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 868875 INFO  (zkCallback-782-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 868875 INFO  (zkCallback-830-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 868903 INFO  (zkCallback-823-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 868904 INFO  (zkCallback-808-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 868904 INFO  (zkCallback-845-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 868917 INFO  (zkCallback-853-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 869553 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [n:127.0.0.1:33898_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33898.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@71bf2727
   [junit4]   2> 869589 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [n:127.0.0.1:33898_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33898.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@71bf2727
   [junit4]   2> 869589 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [n:127.0.0.1:33898_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33898.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@71bf2727
   [junit4]   2> 869590 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [n:127.0.0.1:33898_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderVoteWaitTimeoutTest_F523DD514E83EF45-001/tempDir-001/node1/.
   [junit4]   2> 869606 INFO  (zkConnectionManagerCallback-861-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 869620 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [n:127.0.0.1:33898_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 869620 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [n:127.0.0.1:33898_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:42953/solr ready
   [junit4]   2> 869723 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.c.LeaderVoteWaitTimeoutTest Adding proxy for URL: https://127.0.0.1:34135/solr. Proxy: https://127.0.0.1:33898/solr
   [junit4]   2> 869733 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@386c9615{SSL,[ssl, http/1.1]}{127.0.0.1:0}
   [junit4]   2> 869733 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=169281866
   [junit4]   2> 869733 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 869734 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4de05554: rootName = solr_33253, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@1dde4293
   [junit4]   2> 869739 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 869739 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4c2a591: rootName = solr_33253, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@1935bed7
   [junit4]   2> 869754 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 869754 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@7c2516d9: rootName = solr_33253, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@6686b409
   [junit4]   2> 869755 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:33253_solr
   [junit4]   2> 869757 INFO  (zkCallback-823-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 869757 INFO  (zkCallback-808-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 869757 INFO  (zkCallback-838-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 869757 INFO  (zkCallback-845-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 869757 INFO  (zkCallback-853-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 869757 INFO  (zkCallback-830-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 869757 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 869757 INFO  (zkCallback-782-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 869757 INFO  (zkCallback-791-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 869759 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.c.Overseer Overseer (id=72653221899796490-127.0.0.1:33253_solr-n_0000000000) closing
   [junit4]   2> 869761 WARN  (OverseerAutoScalingTriggerThread-72653221899796490-127.0.0.1:33253_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 869761 INFO  (OverseerStateUpdate-72653221899796490-127.0.0.1:33253_solr-n_0000000000) [    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:33253_solr
   [junit4]   2> 869790 INFO  (zkCallback-860-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 869822 INFO  (zkCallback-782-thread-1) [    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:45858_solr
   [junit4]   2> 869822 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@26c50159{/solr,null,UNAVAILABLE}
   [junit4]   2> 869823 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 869824 INFO  (zkCallback-782-thread-1) [    ] o.a.s.c.Overseer Overseer (id=72653221899796487-127.0.0.1:45858_solr-n_0000000003) starting
   [junit4]   2> 869824 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 1.8.0_172-b11
   [junit4]   2> 869825 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 869825 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 869825 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 869826 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@54b61ae1{/solr,null,AVAILABLE}
   [junit4]   2> 869827 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.e.j.s.AbstractConnector Started ServerConnector@54bcabce{SSL,[ssl, http/1.1]}{127.0.0.1:35762}
   [junit4]   2> 869828 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.e.j.s.Server Started @870049ms
   [junit4]   2> 869828 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=39483}
   [junit4]   2> 869828 ERROR (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 869829 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 869829 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.4.0
   [junit4]   2> 869829 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 869829 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 869829 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-05-19T17:32:44.883Z
   [junit4]   2> 869849 INFO  (zkConnectionManagerCallback-863-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 869850 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 869900 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42953/solr
   [junit4]   2> 869902 INFO  (zkConnectionManagerCallback-867-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 869912 INFO  (zkConnectionManagerCallback-869-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 869925 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [n:127.0.0.1:39483_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 869927 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [n:127.0.0.1:39483_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 869929 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [n:127.0.0.1:39483_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 869929 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [n:127.0.0.1:39483_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39483_solr
   [junit4]   2> 869930 INFO  (zkCallback-860-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 869930 INFO  (zkCallback-853-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 869930 INFO  (zkCallback-830-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 869930 INFO  (zkCallback-782-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 869930 INFO  (zkCallback-845-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 869931 INFO  (zkCallback-868-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 869944 INFO  (zkCallback-823-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 869948 INFO  (zkCallback-838-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 870181 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [n:127.0.0.1:39483_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39483.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@71bf2727
   [junit4]   2> 870208 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [n:127.0.0.1:39483_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39483.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@71bf2727
   [junit4]   2> 870209 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [n:127.0.0.1:39483_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39483.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@71bf2727
   [junit4]   2> 870210 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [n:127.0.0.1:39483_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderVoteWaitTimeoutTest_F523DD514E83EF45-001/tempDir-001/node2/.
   [junit4]   2> 870214 INFO  (zkConnectionManagerCallback-876-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 870215 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [n:127.0.0.1:39483_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 870215 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [n:127.0.0.1:39483_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:42953/solr ready
   [junit4]   2> 870306 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.c.LeaderVoteWaitTimeoutTest Adding proxy for URL: https://127.0.0.1:35762/solr. Proxy: https://127.0.0.1:39483/solr
   [junit4]   2> 870307 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@102a3b9b{SSL,[ssl, http/1.1]}{127.0.0.1:0}
   [junit4]   2> 870308 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1389737782
   [junit4]   2> 870308 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 870308 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@10801e57: rootName = solr_45858, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@6337e5b9
   [junit4]   2> 870313 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 870313 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6677965e: rootName = solr_45858, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@1935bed7
   [junit4]   2> 870328 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 870328 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4ffd82a6: rootName = solr_45858, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@6686b409
   [junit4]   2> 870333 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:45858_solr
   [junit4]   2> 870350 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 870352 INFO  (zkCallback-860-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 870352 INFO  (zkCallback-782-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 870352 INFO  (zkCallback-845-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 870352 INFO  (zkCallback-838-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 870352 INFO  (zkCallback-853-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 870352 INFO  (zkCallback-823-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 870352 INFO  (zkCallback-830-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 870352 INFO  (zkCallback-868-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 870353 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.c.Overseer Overseer (id=72653221899796487-127.0.0.1:45858_solr-n_0000000003) closing
   [junit4]   2> 870353 WARN  (OverseerAutoScalingTriggerThread-72653221899796487-127.0.0.1:45858_solr-n_0000000003) [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 870353 INFO  (OverseerStateUpdate-72653221899796487-127.0.0.1:45858_solr-n_0000000003) [    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:45858_solr
   [junit4]   2> 870367 INFO  (zkCallback-875-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 870383 INFO  (zkCallback-838-thread-1) [    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:38158_solr
   [junit4]   2> 870384 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@3437a277{/solr,null,UNAVAILABLE}
   [junit4]   2> 870384 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 870385 INFO  (zkCallback-838-thread-1) [    ] o.a.s.c.Overseer Overseer (id=72653221899796501-127.0.0.1:38158_solr-n_0000000004) starting
   [junit4]   2> 870386 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 1.8.0_172-b11
   [junit4]   2> 870395 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 870395 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 870395 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 870396 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@31185df5{/solr,null,AVAILABLE}
   [junit4]   2> 870397 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.e.j.s.AbstractConnector Started ServerConnector@6feecd1f{SSL,[ssl, http/1.1]}{127.0.0.1:35809}
   [junit4]   2> 870397 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.e.j.s.Server Started @870618ms
   [junit4]   2> 870397 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=33711}
   [junit4]   2> 870397 ERROR (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 870398 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 870398 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.4.0
   [junit4]   2> 870398 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 870398 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 870398 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-05-19T17:32:45.452Z
   [junit4]   2> 870412 INFO  (zkConnectionManagerCallback-878-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 870413 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 870452 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42953/solr
   [junit4]   2> 870491 INFO  (zkConnectionManagerCallback-882-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 870515 INFO  (zkConnectionManagerCallback-884-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 870529 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [n:127.0.0.1:33711_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 870530 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [n:127.0.0.1:33711_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 870532 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [n:127.0.0.1:33711_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 870532 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [n:127.0.0.1:33711_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33711_solr
   [junit4]   2> 870546 INFO  (zkCallback-875-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 870546 INFO  (zkCallback-860-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 870546 INFO  (zkCallback-868-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 870546 INFO  (zkCallback-830-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 870551 INFO  (zkCallback-838-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 870551 INFO  (zkCallback-845-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 870551 INFO  (zkCallback-853-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 870574 INFO  (zkCallback-883-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 871957 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [n:127.0.0.1:33711_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33711.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@71bf2727
   [junit4]   2> 871993 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [n:127.0.0.1:33711_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33711.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@71bf2727
   [junit4]   2> 871993 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [n:127.0.0.1:33711_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33711.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@71bf2727
   [junit4]   2> 871995 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [n:127.0.0.1:33711_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderVoteWaitTimeoutTest_F523DD514E83EF45-001/tempDir-001/node3/.
   [junit4]   2> 872110 INFO  (zkConnectionManagerCallback-891-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 872123 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [n:127.0.0.1:33711_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 872124 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [n:127.0.0.1:33711_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:42953/solr ready
   [junit4]   2> 872581 INFO  (SUITE-LeaderVoteWaitTimeoutTest-seed#[F523DD514E83EF45]-worker) [    ] o.a.s.c.LeaderVoteWaitTimeoutTest Adding proxy for URL: https://127.0.0.1:35809/solr. Proxy: https://127.0.0.1:33711/solr
   [junit4]   2> 872769 INFO  (TEST-LeaderVoteWaitTimeoutTest.basicTest-seed#[F523DD514E83EF45]) [    ] o.a.s.SolrTestCaseJ4 ###Starting basicTest
   [junit4]   2> 872770 INFO  (SocketProxy-Acceptor-33711) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=46876,localport=33711], receiveBufferSize:531000
   [junit4]   2> 872771 INFO  (SocketProxy-Acceptor-33711) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=35809,localport=46076], receiveBufferSize=530904
   [junit4]   2> 872969 INFO  (qtp321202344-4669) [n:127.0.0.1:33711_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params pullReplicas=0&replicationFactor=1&name=basicTest&nrtReplicas=1&action=CREATE&numShards=1&tlogReplicas=0&createNodeSet=127.0.0.1:38158_solr&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 873016 INFO  (OverseerThreadFactory-832-thread-1) [    ] o.a.s.c.a.c.CreateCollectionCmd Create collection basicTest
   [junit4]   2> 873031 INFO  (OverseerThreadFactory-832-thread-1) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/protwords.txt to /configs/basicTest.AUTOCREATED/protwords.txt
   [junit4]   2> 873032 INFO  (OverseerThreadFactory-832-thread-1) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/managed-schema to /configs/basicTest.AUTOCREATED/managed-schema
   [junit4]   2> 873034 INFO  (OverseerThreadFactory-832-thread-1) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/solrconfig.xml to /configs/basicTest.AUTOCREATED/solrconfig.xml
   [junit4]   2> 873035 INFO  (OverseerThreadFactory-832-thread-1) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/synonyms.txt to /configs/basicTest.AUTOCREATED/synonyms.txt
   [junit4]   2> 873057 INFO  (OverseerThreadFactory-832-thread-1) [    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/stopwords.txt to /configs/basicT

[...truncated too long message...]

ome/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

jar-checksums:
    [mkdir] Created dir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/null312480335
     [copy] Copying 39 files to /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/null312480335
   [delete] Deleting directory /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/null312480335

resolve-example:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

resolve-server:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

jar-checksums:
    [mkdir] Created dir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/null2032898322
     [copy] Copying 246 files to /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/null2032898322
   [delete] Deleting directory /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/null2032898322

check-working-copy:
[ivy:cachepath] :: resolving dependencies :: org.eclipse.jgit#org.eclipse.jgit-caller;working
[ivy:cachepath] 	confs: [default]
[ivy:cachepath] 	found org.eclipse.jgit#org.eclipse.jgit;4.6.0.201612231935-r in public
[ivy:cachepath] 	found com.jcraft#jsch;0.1.53 in public
[ivy:cachepath] 	found com.googlecode.javaewah#JavaEWAH;1.1.6 in public
[ivy:cachepath] 	found org.apache.httpcomponents#httpclient;4.3.6 in public
[ivy:cachepath] 	found org.apache.httpcomponents#httpcore;4.3.3 in public
[ivy:cachepath] 	found commons-logging#commons-logging;1.1.3 in public
[ivy:cachepath] 	found commons-codec#commons-codec;1.6 in public
[ivy:cachepath] 	found org.slf4j#slf4j-api;1.7.2 in public
[ivy:cachepath] :: resolution report :: resolve 60ms :: artifacts dl 1ms
	---------------------------------------------------------------------
	|                  |            modules            ||   artifacts   |
	|       conf       | number| search|dwnlded|evicted|| number|dwnlded|
	---------------------------------------------------------------------
	|      default     |   8   |   0   |   0   |   0   ||   8   |   0   |
	---------------------------------------------------------------------
[wc-checker] Initializing working copy...
[wc-checker] SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
[wc-checker] SLF4J: Defaulting to no-operation (NOP) logger implementation
[wc-checker] SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
[wc-checker] Checking working copy status...

-jenkins-base:

BUILD SUCCESSFUL
Total time: 272 minutes 27 seconds
Archiving artifacts
WARN: No artifacts found that match the file pattern "**/*.events,heapdumps/**,**/hs_err_pid*". Configuration error?
WARN: java.lang.InterruptedException: no matches found within 10000
Recording test results
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)

[JENKINS] Lucene-Solr-Tests-7.x - Build # 616 - Still Unstable

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-7.x/616/

1 tests failed.
FAILED:  org.apache.solr.cloud.autoscaling.SearchRateTriggerIntegrationTest.testDeleteNode

Error Message:
unexpected DELETENODE status: {responseHeader={status=0,QTime=4},status={state=notfound,msg=Did not find [search_rate_trigger3/603fd2d64d8858T6qg9p8drulxtpe2mqdfuv8swf/0] in any tasks queue}}

Stack Trace:
java.lang.AssertionError: unexpected DELETENODE status: {responseHeader={status=0,QTime=4},status={state=notfound,msg=Did not find [search_rate_trigger3/603fd2d64d8858T6qg9p8drulxtpe2mqdfuv8swf/0] in any tasks queue}}
	at __randomizedtesting.SeedInfo.seed([76CF8E654A4312FB:545D40E77D899D86]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.autoscaling.SearchRateTriggerIntegrationTest.lambda$testDeleteNode$6(SearchRateTriggerIntegrationTest.java:668)
	at java.util.ArrayList.forEach(ArrayList.java:1257)
	at org.apache.solr.cloud.autoscaling.SearchRateTriggerIntegrationTest.testDeleteNode(SearchRateTriggerIntegrationTest.java:660)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 12985 lines...]
   [junit4] Suite: org.apache.solr.cloud.autoscaling.SearchRateTriggerIntegrationTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.SearchRateTriggerIntegrationTest_76CF8E654A4312FB-001/init-core-data-001
   [junit4]   2> 707967 WARN  (SUITE-SearchRateTriggerIntegrationTest-seed#[76CF8E654A4312FB]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=9 numCloses=9
   [junit4]   2> 707967 INFO  (SUITE-SearchRateTriggerIntegrationTest-seed#[76CF8E654A4312FB]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 707979 INFO  (SUITE-SearchRateTriggerIntegrationTest-seed#[76CF8E654A4312FB]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 707979 INFO  (SUITE-SearchRateTriggerIntegrationTest-seed#[76CF8E654A4312FB]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 707980 INFO  (SUITE-SearchRateTriggerIntegrationTest-seed#[76CF8E654A4312FB]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 5 servers in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.SearchRateTriggerIntegrationTest_76CF8E654A4312FB-001/tempDir-001
   [junit4]   2> 707980 INFO  (SUITE-SearchRateTriggerIntegrationTest-seed#[76CF8E654A4312FB]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 708081 INFO  (Thread-1144) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 708081 INFO  (Thread-1144) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 708092 ERROR (Thread-1144) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 708181 INFO  (SUITE-SearchRateTriggerIntegrationTest-seed#[76CF8E654A4312FB]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:51367
   [junit4]   2> 708183 INFO  (zkConnectionManagerCallback-1445-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 708232 INFO  (jetty-launcher-1442-thread-3) [    ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 1.8.0_172-b11
   [junit4]   2> 708233 INFO  (jetty-launcher-1442-thread-3) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 708233 INFO  (jetty-launcher-1442-thread-3) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 708233 INFO  (jetty-launcher-1442-thread-3) [    ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 708233 INFO  (jetty-launcher-1442-thread-3) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@758fd377{/solr,null,AVAILABLE}
   [junit4]   2> 708237 INFO  (jetty-launcher-1442-thread-4) [    ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 1.8.0_172-b11
   [junit4]   2> 708238 INFO  (jetty-launcher-1442-thread-1) [    ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 1.8.0_172-b11
   [junit4]   2> 708239 INFO  (jetty-launcher-1442-thread-2) [    ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 1.8.0_172-b11
   [junit4]   2> 708241 INFO  (jetty-launcher-1442-thread-4) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 708241 INFO  (jetty-launcher-1442-thread-4) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 708241 INFO  (jetty-launcher-1442-thread-4) [    ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 708241 INFO  (jetty-launcher-1442-thread-4) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@58ceffb{/solr,null,AVAILABLE}
   [junit4]   2> 708243 INFO  (jetty-launcher-1442-thread-1) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 708243 INFO  (jetty-launcher-1442-thread-1) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 708243 INFO  (jetty-launcher-1442-thread-1) [    ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 708243 INFO  (jetty-launcher-1442-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@18e72338{/solr,null,AVAILABLE}
   [junit4]   2> 708256 INFO  (jetty-launcher-1442-thread-5) [    ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 1.8.0_172-b11
   [junit4]   2> 708257 INFO  (jetty-launcher-1442-thread-2) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 708257 INFO  (jetty-launcher-1442-thread-2) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 708257 INFO  (jetty-launcher-1442-thread-2) [    ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 708257 INFO  (jetty-launcher-1442-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@618454e8{/solr,null,AVAILABLE}
   [junit4]   2> 708272 INFO  (jetty-launcher-1442-thread-5) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 708272 INFO  (jetty-launcher-1442-thread-5) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 708272 INFO  (jetty-launcher-1442-thread-5) [    ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 708273 INFO  (jetty-launcher-1442-thread-5) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@10331a18{/solr,null,AVAILABLE}
   [junit4]   2> 708309 INFO  (jetty-launcher-1442-thread-3) [    ] o.e.j.s.AbstractConnector Started ServerConnector@2345dc82{SSL,[ssl, http/1.1]}{127.0.0.1:60421}
   [junit4]   2> 708309 INFO  (jetty-launcher-1442-thread-3) [    ] o.e.j.s.Server Started @708364ms
   [junit4]   2> 708309 INFO  (jetty-launcher-1442-thread-3) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=60421}
   [junit4]   2> 708313 ERROR (jetty-launcher-1442-thread-3) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 708313 INFO  (jetty-launcher-1442-thread-3) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 708313 INFO  (jetty-launcher-1442-thread-3) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.4.0
   [junit4]   2> 708313 INFO  (jetty-launcher-1442-thread-3) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 708313 INFO  (jetty-launcher-1442-thread-3) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 708313 INFO  (jetty-launcher-1442-thread-3) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-05-20T18:10:14.310Z
   [junit4]   2> 708339 INFO  (jetty-launcher-1442-thread-5) [    ] o.e.j.s.AbstractConnector Started ServerConnector@6efd43ec{SSL,[ssl, http/1.1]}{127.0.0.1:59986}
   [junit4]   2> 708339 INFO  (jetty-launcher-1442-thread-5) [    ] o.e.j.s.Server Started @708394ms
   [junit4]   2> 708339 INFO  (jetty-launcher-1442-thread-5) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=59986}
   [junit4]   2> 708340 INFO  (jetty-launcher-1442-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@1135537c{SSL,[ssl, http/1.1]}{127.0.0.1:56792}
   [junit4]   2> 708340 INFO  (jetty-launcher-1442-thread-2) [    ] o.e.j.s.Server Started @708395ms
   [junit4]   2> 708340 INFO  (jetty-launcher-1442-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=56792}
   [junit4]   2> 708340 INFO  (jetty-launcher-1442-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@1bcfc86f{SSL,[ssl, http/1.1]}{127.0.0.1:53281}
   [junit4]   2> 708340 INFO  (jetty-launcher-1442-thread-1) [    ] o.e.j.s.Server Started @708395ms
   [junit4]   2> 708340 INFO  (jetty-launcher-1442-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=53281}
   [junit4]   2> 708341 INFO  (jetty-launcher-1442-thread-4) [    ] o.e.j.s.AbstractConnector Started ServerConnector@4820f71a{SSL,[ssl, http/1.1]}{127.0.0.1:60740}
   [junit4]   2> 708341 INFO  (jetty-launcher-1442-thread-4) [    ] o.e.j.s.Server Started @708396ms
   [junit4]   2> 708341 INFO  (jetty-launcher-1442-thread-4) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=60740}
   [junit4]   2> 708341 ERROR (jetty-launcher-1442-thread-5) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 708341 INFO  (jetty-launcher-1442-thread-5) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 708341 INFO  (jetty-launcher-1442-thread-5) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.4.0
   [junit4]   2> 708341 INFO  (jetty-launcher-1442-thread-5) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 708341 INFO  (jetty-launcher-1442-thread-5) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 708341 INFO  (jetty-launcher-1442-thread-5) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-05-20T18:10:14.338Z
   [junit4]   2> 708342 ERROR (jetty-launcher-1442-thread-4) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 708342 INFO  (jetty-launcher-1442-thread-4) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 708342 INFO  (jetty-launcher-1442-thread-4) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.4.0
   [junit4]   2> 708342 INFO  (jetty-launcher-1442-thread-4) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 708342 INFO  (jetty-launcher-1442-thread-4) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 708342 INFO  (jetty-launcher-1442-thread-4) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-05-20T18:10:14.339Z
   [junit4]   2> 708343 ERROR (jetty-launcher-1442-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 708343 INFO  (jetty-launcher-1442-thread-1) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 708343 INFO  (jetty-launcher-1442-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.4.0
   [junit4]   2> 708343 INFO  (jetty-launcher-1442-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 708343 INFO  (jetty-launcher-1442-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 708343 INFO  (jetty-launcher-1442-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-05-20T18:10:14.340Z
   [junit4]   2> 708343 ERROR (jetty-launcher-1442-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 708344 INFO  (jetty-launcher-1442-thread-2) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 708344 INFO  (jetty-launcher-1442-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.4.0
   [junit4]   2> 708344 INFO  (jetty-launcher-1442-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 708344 INFO  (jetty-launcher-1442-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 708344 INFO  (jetty-launcher-1442-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-05-20T18:10:14.341Z
   [junit4]   2> 708368 INFO  (zkConnectionManagerCallback-1447-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 708368 INFO  (jetty-launcher-1442-thread-3) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 708375 INFO  (zkConnectionManagerCallback-1455-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 708375 INFO  (jetty-launcher-1442-thread-5) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 708381 INFO  (zkConnectionManagerCallback-1449-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 708382 INFO  (zkConnectionManagerCallback-1451-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 708382 INFO  (jetty-launcher-1442-thread-4) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 708382 INFO  (jetty-launcher-1442-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 708396 INFO  (zkConnectionManagerCallback-1453-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 708396 INFO  (jetty-launcher-1442-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 708411 INFO  (jetty-launcher-1442-thread-3) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:51367/solr
   [junit4]   2> 708413 INFO  (jetty-launcher-1442-thread-4) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:51367/solr
   [junit4]   2> 708417 INFO  (jetty-launcher-1442-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:51367/solr
   [junit4]   2> 708423 INFO  (zkConnectionManagerCallback-1463-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 708443 INFO  (zkConnectionManagerCallback-1467-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 708454 INFO  (jetty-launcher-1442-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:51367/solr
   [junit4]   2> 708531 INFO  (zkConnectionManagerCallback-1459-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 708535 INFO  (zkConnectionManagerCallback-1469-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 708550 INFO  (jetty-launcher-1442-thread-5) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:51367/solr
   [junit4]   2> 708590 INFO  (zkConnectionManagerCallback-1473-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 708610 INFO  (zkConnectionManagerCallback-1483-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 708631 INFO  (zkConnectionManagerCallback-1476-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 708647 INFO  (jetty-launcher-1442-thread-1) [n:127.0.0.1:53281_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 708676 INFO  (jetty-launcher-1442-thread-1) [n:127.0.0.1:53281_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:53281_solr
   [junit4]   2> 708677 INFO  (jetty-launcher-1442-thread-1) [n:127.0.0.1:53281_solr    ] o.a.s.c.Overseer Overseer (id=73833076418412556-127.0.0.1:53281_solr-n_0000000000) starting
   [junit4]   2> 708679 INFO  (zkConnectionManagerCallback-1478-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 708687 INFO  (zkConnectionManagerCallback-1485-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 708687 INFO  (zkConnectionManagerCallback-1487-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 708720 INFO  (jetty-launcher-1442-thread-5) [n:127.0.0.1:59986_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 708721 INFO  (jetty-launcher-1442-thread-2) [n:127.0.0.1:56792_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 708724 INFO  (jetty-launcher-1442-thread-3) [n:127.0.0.1:60421_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 708724 INFO  (jetty-launcher-1442-thread-2) [n:127.0.0.1:56792_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56792_solr
   [junit4]   2> 708724 INFO  (jetty-launcher-1442-thread-5) [n:127.0.0.1:59986_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59986_solr
   [junit4]   2> 708748 INFO  (jetty-launcher-1442-thread-4) [n:127.0.0.1:60740_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 708750 INFO  (jetty-launcher-1442-thread-4) [n:127.0.0.1:60740_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 708751 INFO  (zkConnectionManagerCallback-1500-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 708753 INFO  (jetty-launcher-1442-thread-1) [n:127.0.0.1:53281_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 708754 INFO  (jetty-launcher-1442-thread-3) [n:127.0.0.1:60421_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 708754 INFO  (jetty-launcher-1442-thread-3) [n:127.0.0.1:60421_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60421_solr
   [junit4]   2> 708766 INFO  (jetty-launcher-1442-thread-1) [n:127.0.0.1:53281_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:51367/solr ready
   [junit4]   2> 708770 INFO  (zkCallback-1486-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 708778 INFO  (zkCallback-1475-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 708787 INFO  (zkCallback-1477-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 708815 INFO  (jetty-launcher-1442-thread-4) [n:127.0.0.1:60740_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 708815 INFO  (jetty-launcher-1442-thread-4) [n:127.0.0.1:60740_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60740_solr
   [junit4]   2> 708815 INFO  (jetty-launcher-1442-thread-1) [n:127.0.0.1:53281_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 708815 INFO  (jetty-launcher-1442-thread-1) [n:127.0.0.1:53281_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53281_solr
   [junit4]   2> 708816 DEBUG (OverseerAutoScalingTriggerThread-73833076418412556-127.0.0.1:53281_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and .scheduled_maintenance triggers
   [junit4]   2> 708818 DEBUG (OverseerAutoScalingTriggerThread-73833076418412556-127.0.0.1:53281_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
   [junit4]   2> 708818 DEBUG (OverseerAutoScalingTriggerThread-73833076418412556-127.0.0.1:53281_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1
   [junit4]   2> 708818 DEBUG (OverseerAutoScalingTriggerThread-73833076418412556-127.0.0.1:53281_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
   [junit4]   2> 708835 INFO  (zkCallback-1499-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (5)
   [junit4]   2> 708850 INFO  (zkCallback-1486-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (5)
   [junit4]   2> 708850 INFO  (zkCallback-1477-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (5)
   [junit4]   2> 708851 INFO  (zkCallback-1484-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (5)
   [junit4]   2> 708858 INFO  (zkCallback-1475-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (5)
   [junit4]   2> 708871 INFO  (zkCallback-1468-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (5)
   [junit4]   2> 708897 DEBUG (OverseerAutoScalingTriggerThread-73833076418412556-127.0.0.1:53281_solr-n_0000000000) [    ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial livenodes: [127.0.0.1:53281_solr, 127.0.0.1:59986_solr, 127.0.0.1:60421_solr, 127.0.0.1:56792_solr, 127.0.0.1:60740_solr]
   [junit4]   2> 708909 DEBUG (OverseerAutoScalingTriggerThread-73833076418412556-127.0.0.1:53281_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 708909 DEBUG (OverseerAutoScalingTriggerThread-73833076418412556-127.0.0.1:53281_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
   [junit4]   2> 708910 DEBUG (ScheduledTrigger-1551-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 5
   [junit4]   2> 709600 INFO  (jetty-launcher-1442-thread-4) [n:127.0.0.1:60740_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_60740.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f92add1
   [junit4]   2> 709665 INFO  (jetty-launcher-1442-thread-1) [n:127.0.0.1:53281_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_53281.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f92add1
   [junit4]   2> 709710 INFO  (jetty-launcher-1442-thread-1) [n:127.0.0.1:53281_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_53281.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f92add1
   [junit4]   2> 709710 INFO  (jetty-launcher-1442-thread-1) [n:127.0.0.1:53281_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_53281.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f92add1
   [junit4]   2> 709711 INFO  (jetty-launcher-1442-thread-1) [n:127.0.0.1:53281_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.SearchRateTriggerIntegrationTest_76CF8E654A4312FB-001/tempDir-001/node4/.
   [junit4]   2> 709820 WARN  (jetty-launcher-1442-thread-4) [n:127.0.0.1:60740_solr    ] o.a.s.m.r.j.JmxMetricsReporter Unable to register gauge
   [junit4]   2> javax.management.InstanceNotFoundException: solr_60740:dom1=solr,dom2=jvm,name0=os,name=processCpuTime
   [junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1095) ~[?:1.8.0_172]
   [junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.exclusiveUnregisterMBean(DefaultMBeanServerInterceptor.java:427) ~[?:1.8.0_172]
   [junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.unregisterMBean(DefaultMBeanServerInterceptor.java:415) ~[?:1.8.0_172]
   [junit4]   2> 	at com.sun.jmx.mbeanserver.JmxMBeanServer.unregisterMBean(JmxMBeanServer.java:546) ~[?:1.8.0_172]
   [junit4]   2> 	at org.apache.solr.metrics.reporters.jmx.JmxMetricsReporter$JmxListener.registerMBean(JmxMetricsReporter.java:530) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.metrics.reporters.jmx.JmxMetricsReporter$JmxListener.onGaugeAdded(JmxMetricsReporter.java:565) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.metrics.reporters.jmx.JmxMetricsReporter.lambda$start$0(JmxMetricsReporter.java:738) ~[java/:?]
   [junit4]   2> 	at java.util.HashMap.forEach(HashMap.java:1289) ~[?:1.8.0_172]
   [junit4]   2> 	at org.apache.solr.metrics.reporters.jmx.JmxMetricsReporter.start(JmxMetricsReporter.java:728) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.metrics.reporters.SolrJmxReporter.doInit(SolrJmxReporter.java:110) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.metrics.SolrMetricReporter.init(SolrMetricReporter.java:70) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.metrics.SolrMetricManager.loadReporter(SolrMetricManager.java:930) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.metrics.SolrMetricManager.loadReporters(SolrMetricManager.java:866) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.load(CoreContainer.java:549) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:268) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:188) ~[java/:?]
   [junit4]   2> 	at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:139) ~[jetty-servlet-9.4.10.v20180503.jar:9.4.10.v20180503]
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:741) ~[jetty-servlet-9.4.10.v20180503.jar:9.4.10.v20180503]
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1477) ~[jetty-servlet-9.4.10.v20180503.jar:9.4.10.v20180503]
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1542) ~[jetty-servlet-9.4.10.v20180503.jar:9.4.10.v20180503]
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1186) ~[jetty-servlet-9.4.10.v20180503.jar:9.4.10.v20180503]
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1023) ~[jetty-servlet-9.4.10.v20180503.jar:9.4.10.v20180503]
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:473) ~[jetty-servlet-9.4.10.v20180503.jar:9.4.10.v20180503]
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:308) ~[java/:?]
   [junit4]   2> 	at org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179) ~[jetty-util-9.4.10.v20180503.jar:9.4.10.v20180503]
   [junit4]   2> 	at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69) ~[jetty-util-9.4.10.v20180503.jar:9.4.10.v20180503]
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:396) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:369) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:392) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:248) ~[java/:?]
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_172]
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:192) ~[java/:?]
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_172]
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_172]
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748) [?:1.8.0_172]
   [junit4]   2> 709876 INFO  (jetty-launcher-1442-thread-5) [n:127.0.0.1:59986_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_59986.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f92add1
   [junit4]   2> 709888 INFO  (jetty-launcher-1442-thread-2) [n:127.0.0.1:56792_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_56792.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f92add1
   [junit4]   2> 709901 INFO  (jetty-launcher-1442-thread-4) [n:127.0.0.1:60740_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_60740.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f92add1
   [junit4]   2> 709901 INFO  (jetty-launcher-1442-thread-4) [n:127.0.0.1:60740_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_60740.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f92add1
   [junit4]   2> 709910 INFO  (jetty-launcher-1442-thread-4) [n:127.0.0.1:60740_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.SearchRateTriggerIntegrationTest_76CF8E654A4312FB-001/tempDir-001/node3/.
   [junit4]   2> 709933 DEBUG (ScheduledTrigger-1551-thread-1) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 5
   [junit4]   2> 709939 INFO  (jetty-launcher-1442-thread-2) [n:127.0.0.1:56792_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_56792.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f92add1
   [junit4]   2> 709939 INFO  (jetty-launcher-1442-thread-2) [n:127.0.0.1:56792_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_56792.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f92add1
   [junit4]   2> 709941 INFO  (jetty-launcher-1442-thread-5) [n:127.0.0.1:59986_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_59986.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f92add1
   [junit4]   2> 709941 INFO  (jetty-launcher-1442-thread-5) [n:127.0.0.1:59986_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_59986.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f92add1
   [junit4]   2> 709971 INFO  (jetty-launcher-1442-thread-2) [n:127.0.0.1:56792_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.SearchRateTriggerIntegrationTest_76CF8E654A4312FB-001/tempDir-001/node1/.
   [junit4]   2> 709971 INFO  (jetty-launcher-1442-thread-5) [n:127.0.0.1:59986_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.SearchRateTriggerIntegrationTest_76CF8E654A4312FB-001/tempDir-001/node5/.
   [junit4]   2> 710158 INFO  (zkConnectionManagerCallback-1505-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 710159 INFO  (jetty-launcher-1442-thread-4) [n:127.0.0.1:60740_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (5)
   [junit4]   2> 710160 INFO  (jetty-launcher-1442-thread-4) [n:127.0.0.1:60740_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:51367/solr ready
   [junit4]   2> 710199 INFO  (zkConnectionManagerCallback-1511-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 710200 INFO  (jetty-launcher-1442-thread-5) [n:127.0.0.1:59986_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (5)
   [junit4]   2> 710201 INFO  (jetty-launcher-1442-thread-5) [n:127.0.0.1:59986_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:51367/solr ready
   [junit4]   2> 710211 INFO  (zkConnectionManagerCallback-1515-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 710212 INFO  (jetty-launcher-1442-thread-2) [n:127.0.0.1:56792_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (5)
   [junit4]   2> 710213 INFO  (jetty-launcher-1442-thread-2) [n:127.0.0.1:56792_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:51367/solr ready
   [junit4]   2> 710294 INFO  (jetty-launcher-1442-thread-3) [n:127.0.0.1:60421_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_60421.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f92add1
   [junit4]   2> 710324 INFO  (jetty-launcher-1442-thread-3) [n:127.0.0.1:60421_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_60421.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f92add1
   [junit4]   2> 710325 INFO  (jetty-launcher-1442-thread-3) [n:127.0.0.1:60421_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_60421.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f92add1
   [junit4]   2> 710326 INFO  (jetty-launcher-1442-thread-3) [n:127.0.0.1:60421_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.SearchRateTriggerIntegrationTest_76CF8E654A4312FB-001/tempDir-001/node2/.
   [junit4]   2> 710386 INFO  (zkConnectionManagerCallback-1520-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 710387 INFO  (jetty-launcher-1442-thread-3) [n:127.0.0.1:60421_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (5)
   [junit4]   2> 710388 INFO  (jetty-launcher-1442-thread-3) [n:127.0.0.1:60421_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:51367/solr ready
   [junit4]   2> 710526 INFO  (zkConnectionManagerCallback-1522-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 710558 INFO  (zkConnectionManagerCallback-1527-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 710559 INFO  (SUITE-SearchRateTriggerIntegrationTest-seed#[76CF8E654A4312FB]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (5)
   [junit4]   2> 710560 INFO  (SUITE-SearchRateTriggerIntegrationTest-seed#[76CF8E654A4312FB]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:51367/solr ready
   [junit4]   2> 710922 INFO  (qtp1173905842-4756) [n:127.0.0.1:60421_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=32
   [junit4]   2> 710974 DEBUG (ScheduledTrigger-1551-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 5
   [junit4]   2> 710987 INFO  (qtp613516905-4772) [n:127.0.0.1:53281_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 711265 INFO  (qtp145610257-4781) [n:127.0.0.1:56792_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 711324 INFO  (qtp1322072216-4792) [n:127.0.0.1:59986_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 711384 INFO  (qtp1213582878-4763) [n:127.0.0.1:60740_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 711386 DEBUG (qtp1173905842-4753) [n:127.0.0.1:60421_solr    ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 711387 DEBUG (zkCallback-1499-thread-1) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 2
   [junit4]   2> 711388 DEBUG (OverseerAutoScalingTriggerThread-73833076418412556-127.0.0.1:53281_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
   [junit4]   2> 711390 DEBUG (OverseerAutoScalingTriggerThread-73833076418412556-127.0.0.1:53281_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 711391 DEBUG (OverseerAutoScalingTriggerThread-73833076418412556-127.0.0.1:53281_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
   [junit4]   2> 711396 INFO  (qtp1173905842-4753) [n:127.0.0.1:60421_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=560
   [junit4]   2> 711493 INFO  (TEST-SearchRateTriggerIntegrationTest.testAboveSearchRate-seed#[76CF8E654A4312FB]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testAboveSearchRate
   [junit4]   2> 711494 INFO  (TEST-SearchRateTriggerIntegrationTest.testAboveSearchRate-seed#[76CF8E654A4312FB]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (5)
   [junit4]   2> 711502 INFO  (TEST-SearchRateTriggerIntegrationTest.testAboveSearchRate-seed#[76CF8E654A4312FB]) [    ] o.a.s.c.a.SearchRateTriggerIntegrationTest /autoscaling.json reset, new znode version 3
   [junit4]   2> 711506 DEBUG (zkCallback-1499-thread-1) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 3
   [junit4]   2> 711506 DEBUG (OverseerAutoScalingTriggerThread-73833076418412556-127.0.0.1:53281_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 3
   [junit4]   2> 711508 DEBUG (OverseerAutoScalingTriggerThread-73833076418412556-127.0.0.1:53281_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
   [junit4]   2> 711508 DEBUG (OverseerAutoScalingTriggerThread-73833076418412556-127.0.0.1:53281_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 711509 DEBUG (OverseerAutoScalingTriggerThread-73833076418412556-127.0.0.1:53281_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion 3
   [junit4]   2> 716511 INFO  (qtp1173905842-4755) [n:127.0.0.1:60421_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=2&collection.configName=conf&name=aboveRate_collection&nrtReplicas=2&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 716514 INFO  (OverseerThreadFactory-1553-thread-1) [    ] o.a.s.c.a.c.CreateCollectionCmd Create collection aboveRate_collection
   [junit4]   2> 716636 INFO  (OverseerStateUpdate-73833076418412556-127.0.0.1:53281_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"aboveRate_collection",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"aboveRate_collection_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:56792/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 716638 INFO  (OverseerStateUpdate-73833076418412556-127.0.0.1:53281_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"aboveRate_collection",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"aboveRate_collection_shard1_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:53281/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 716889 INFO  (qtp145610257-4780) [n:127.0.0.1:56792_solr    x:aboveRate_collection_shard1_replica_n1] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=aboveRate_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=aboveRate_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 716890 INFO  (qtp145610257-4780) [n:127.0.0.1:56792_solr    x:aboveRate_collection_shard1_replica_n1] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 716891 INFO  (qtp613516905-4772) [n:127.0.0.1:53281_solr    x:aboveRate_collection_shard1_replica_n2] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=aboveRate_collection_shard1_replica_n2&action=CREATE&numShards=1&collection=aboveRate_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 717933 INFO  (qtp145610257-4780) [n:127.0.0.1:56792_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.4.0
   [junit4]   2> 717944 INFO  (qtp613516905-4772) [n:127.0.0.1:53281_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.4.0
   [junit4]   2> 717959 INFO  (qtp145610257-4780) [n:127.0.0.1:56792_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.s.IndexSchema [aboveRate_collection_shard1_replica_n1] Schema name=minimal
   [junit4]   2> 717978 INFO  (qtp613516905-4772) [n:127.0.0.1:53281_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.s.IndexSchema [aboveRate_collection_shard1_replica_n2] Schema name=minimal
   [junit4]   2> 717983 INFO  (qtp145610257-4780) [n:127.0.0.1:56792_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 717983 INFO  (qtp145610257-4780) [n:127.0.0.1:56792_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'aboveRate_collection_shard1_replica_n1' using configuration from collection aboveRate_collection, trusted=true
   [junit4]   2> 717984 INFO  (qtp145610257-4780) [n:127.0.0.1:56792_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_56792.solr.core.aboveRate_collection.shard1.replica_n1' (registry 'solr.core.aboveRate_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f92add1
   [junit4]   2> 717984 INFO  (qtp145610257-4780) [n:127.0.0.1:56792_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 717984 INFO  (qtp145610257-4780) [n:127.0.0.1:56792_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.c.SolrCore [[aboveRate_collection_shard1_replica_n1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.SearchRateTriggerIntegrationTest_76CF8E654A4312FB-001/tempDir-001/node1/aboveRate_collection_shard1_replica_n1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.SearchRateTriggerIntegrationTest_76CF8E654A4312FB-001/tempDir-001/node1/./aboveRate_collection_shard1_replica_n1/data/]
   [junit4]   2> 717986 INFO  (qtp613516905-4772) [n:127.0.0.1:53281_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 717986 INFO  (qtp613516905-4772) [n:127.0.0.1:53281_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'aboveRate_collection_shard1_replica_n2' using configuration from collection aboveRate_collection, trusted=true
   [junit4]   2> 717986 INFO  (qtp613516905-4772) [n:127.0.0.1:53281_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_53281.solr.core.aboveRate_collection.shard1.replica_n2' (registry 'solr.core.aboveRate_collection.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f92add1
   [junit4]   2> 717986 INFO  (qtp613516905-4772) [n:127.0.0.1:53281_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 717986 INFO  (qtp613516905-4772) [n:127.0.0.1:53281_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.SolrCore [[aboveRate_collection_shard1_replica_n2] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.SearchRateTriggerIntegrationTest_76CF8E654A4312FB-001/tempDir-001/node4/aboveRate_collection_shard1_replica_n2], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.SearchRateTriggerIntegrationTest_76CF8E654A4312FB-001/tempDir-001/node4/./aboveRate_collection_shard1_replica_n2/data/]
   [junit4]   2> 718209 INFO  (qtp613516905-4772) [n:127.0.0.1:53281_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 718209 INFO  (qtp613516905-4772) [n:127.0.0.1:53281_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 718211 INFO  (qtp613516905-4772) [n:127.0.0.1:53281_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 718211 INFO  (qtp613516905-4772) [n:127.0.0.1:53281_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 718213 INFO  (qtp613516905-4772) [n:127.0.0.1:53281_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@5dcefafe[aboveRate_collection_shard1_replica_n2] main]
   [junit4]   2> 718215 INFO  (qtp613516905-4772) [n:127.0.0.1:53281_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 718216 INFO  (qtp613516905-4772) [n:127.0.0.1:53281_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 718217 INFO  (qtp613516905-4772) [n:127.0.0.1:53281_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 718220 INFO  (qtp145610257-4780) [n:127.0.0.1:56792_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 718220 INFO  (qtp145610257-4780) [n:127.0.0.1:56792_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 718222 INFO  (qtp145610257-4780) [n:127.0.0.1:56792_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 718222 INFO  (qtp145610257-4780) [n:127.0.0.1:56792_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 718223 INFO  (qtp613516905-4772) [n:127.0.0.1:53281_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1601007595521310720
   [junit4]   2> 718226 INFO  (searcherExecutor-1565-thread-1-processing-n:127.0.0.1:53281_solr x:aboveRate_collection_shard1_replica_n2 c:aboveRate_collection s:shard1 r:core_node4) [n:127.0.0.1:53281_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.SolrCore [aboveRate_collection_shard1_replica_n2] Registered new searcher Searcher@5dcefafe[aboveRate_collection_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 718234 INFO  (qtp613516905-4772) [n:127.0.0.1:53281_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.ZkShardTerms Successful update of terms at /collections/aboveRate_collection/terms/shard1 to Terms{values={core_node4=0}, version=0}
   [junit4]   2> 718240 INFO  (qtp613516905-4772) [n:127.0.0.1:53281_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=9999ms
   [junit4]   2> 718240 INFO  (qtp145610257-4780) [n:127.0.0.1:56792_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@17dfe1bb[aboveRate_collection_shard1_replica_n1] main]
   [junit4]   2> 718242 INFO  (qtp145610257-4780) [n:127.0.0.1:56792_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 718242 INFO  (qtp145610257-4780) [n:127.0.0.1:56792_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 718243 INFO  (qtp145610257-4780) [n:127.0.0.1:56792_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 718244 INFO  (searcherExecutor-1564-thread-1-processing-n:127.0.0.1:56792_solr x:aboveRate_collection_shard1_replica_n1 c:aboveRate_collection s:shard1 r:core_node3) [n:127.0.0.1:56792_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.c.SolrCore [aboveRate_collection_shard1_replica_n1] Registered new searcher Searcher@17dfe1bb[aboveRate_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 718258 INFO  (qtp145610257-4780) [n:127.0.0.1:56792_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1601007595558010880
   [junit4]   2> 718272 INFO  (qtp145610257-4780) [n:127.0.0.1:56792_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.c.ZkShardTerms Successful update of terms at /collections/aboveRate_collection/terms/shard1 to Terms{values={core_node3=0, core_node4=0}, version=1}
   [junit4]   2> 718741 INFO  (qtp613516905-4772) [n:127.0.0.1:53281_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 718741 INFO  (qtp613516905-4772) [n:127.0.0.1:53281_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 718741 INFO  (qtp613516905-4772) [n:127.0.0.1:53281_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:53281/solr/aboveRate_collection_shard1_replica_n2/
   [junit4]   2> 718742 INFO  (qtp613516905-4772) [n:127.0.0.1:53281_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.u.PeerSync PeerSync: core=aboveRate_collection_shard1_replica_n2 url=https://127.0.0.1:53281/solr START replicas=[https://127.0.0.1:56792/solr/aboveRate_collection_shard1_replica_n1/] nUpdates=100
   [junit4]   2> 718768 INFO  (qtp145610257-4779) [n:127.0.0.1:56792_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n1]  webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 719050 INFO  (qtp613516905-4772) [n:127.0.0.1:53281_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.u.PeerSync PeerSync: core=aboveRate_collection_shard1_replica_n2 url=https://127.0.0.1:53281/solr DONE.  We have no versions.  sync failed.
   [junit4]   2> 719050 INFO  (qtp613516905-4772) [n:127.0.0.1:53281_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 719050 INFO  (qtp613516905-4772) [n:127.0.0.1:53281_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 719050 INFO  (qtp613516905-4772) [n:127.0.0.1:53281_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 719054 INFO  (qtp613516905-4772) [n:127.0.0.1:53281_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:53281/solr/aboveRate_collection_shard1_replica_n2/ shard1
   [junit4]   2> 719158 INFO  (qtp613516905-4772) [n:127.0.0.1:53281_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 719161 INFO  (qtp613516905-4772) [n:127.0.0.1:53281_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=aboveRate_collection_shard1_replica_n2&action=CREATE&numShards=1&collection=aboveRate_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2270
   [junit4]   2> 719261 INFO  (zkCallback-1475-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/aboveRate_collection/state.json] for collection [aboveRate_collection] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 719279 INFO  (qtp145610257-4780) [n:127.0.0.1:56792_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=aboveRate_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=aboveRate_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2389
   [junit4]   2> 719292 INFO  (qtp1173905842-4755) [n:127.0.0.1:60421_solr    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 719381 INFO  (zkCallback-1484-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/aboveRate_collection/state.json] for collection [aboveRate_collection] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 719381 INFO  (zkCallback-1475-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/aboveRate_collection/state.json] for collection [aboveRate_collection] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 720293 INFO  (qtp1173905842-4755) [n:127.0.0.1:60421_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=2&collection.configName=conf&name=aboveRate_collection&nrtReplicas=2&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=3782
   [junit4]   2> 720345 INFO  (qtp1173905842-4752) [n:127.0.0.1:60421_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 720351 INFO  (qtp613516905-4774) [n:127.0.0.1:53281_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.aboveRate_collection.shard1.replica_n2:INDEX.sizeInBytes} status=0 QTime=1
   [junit4]   2> 720354 INFO  (qtp613516905-4772) [n:127.0.0.1:53281_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 720362 INFO  (qtp145610257-4782) [n:127.0.0.1:56792_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.aboveRate_collection.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=3
   [junit4]   2> 720364 INFO  (qtp145610257-4780) [n:127.0.0.1:56792_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 720368 INFO  (qtp1322072216-4787) [n:127.0.0.1:59986_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 720380 INFO  (qtp1213582878-4759) [n:127.0.0.1:60740_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 720381 DEBUG (qtp1173905842-4753) [n:127.0.0.1:60421_solr    ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 720382 DEBUG (zkCallback-1499-thread-1) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 4
   [junit4]   2> 720383 DEBUG (OverseerAutoScalingTriggerThread-73833076418412556-127.0.0.1:53281_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 4
   [junit4]   2> 720383 DEBUG (OverseerAutoScalingTriggerThread-73833076418412556-127.0.0.1:53281_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
   [junit4]   2> 720383 DEBUG (OverseerAutoScalingTriggerThread-73833076418412556-127.0.0.1:53281_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 720383 INFO  (qtp1173905842-4753) [n:127.0.0.1:60421_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=81
   [junit4]   2> 720384 DEBUG (OverseerAutoScalingTriggerThread-73833076418412556-127.0.0.1:53281_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 4, lastZnodeVersion 4
   [junit4]   2> 720391 INFO  (qtp1173905842-4752) [n:127.0.0.1:60421_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 720396 INFO  (qtp613516905-4774) [n:127.0.0.1:53281_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.aboveRate_collection.shard1.replica_n2:INDEX.sizeInBytes} status=0 QTime=2
   [junit4]   2> 720402 INFO  (qtp613516905-4772) [n:127.0.0.1:53281_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 720411 INFO  (qtp145610257-4780) [n:127.0.0.1:56792_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.aboveRate_collection.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=0
   [junit4]   2> 720413 INFO  (qtp145610257-4782) [n:127.0.0.1:56792_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 720416 INFO  (qtp1322072216-4791) [n:127.0.0.1:59986_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 720436 INFO  (qtp1213582878-4762) [n:127.0.0.1:60740_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 720438 DEBUG (qtp1173905842-4755) [n:127.0.0.1:60421_solr    ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 720439 DEBUG (zkCallback-1499-thread-1) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 5
   [junit4]   2> 720439 DEBUG (OverseerAutoScalingTriggerThread-73833076418412556-127.0.0.1:53281_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 5
   [junit4]   2> 720439 DEBUG (OverseerAutoScalingTriggerThread-73833076418412556-127.0.0.1:53281_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
   [junit4]   2> 720440 DEBUG (OverseerAutoScalingTriggerThread-73833076418412556-127.0.0.1:53281_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 720440 DEBUG (OverseerAutoScalingTriggerThread-73833076418412556-127.0.0.1:53281_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 5, lastZnodeVersion 5
   [junit4]   2> 720440 INFO  (qtp1173905842-4755) [n:127.0.0.1:60421_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=54
   [junit4]   2> 720445 INFO  (qtp1173905842-4756) [n:127.0.0.1:60421_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 720446 INFO  (qtp613516905-4772) [n:127.0.0.1:53281_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.aboveRate_collection.shard1.replica_n2:INDEX.sizeInBytes} status=0 QTime=0
   [junit4]   2> 720448 INFO  (qtp613516905-4772) [n:127.0.0.1:53281_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 720449 INFO  (qtp145610257-4782) [n:127.0.0.1:56792_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.aboveRate_collection.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=0
   [junit4]   2> 720451 INFO  (qtp145610257-4782) [n:127.0.0.1:56792_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 720452 INFO  (qtp1322072216-4787) [n:127.0.0.1:59986_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 720454 INFO  (qtp1213582878-4764) [n:127.0.0.1:60740_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 720454 DEBUG (qtp1173905842-4753) [n:127.0.0.1:60421_solr    ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 720455 INFO  (qtp1173905842-4753) [n:127.0.0.1:60421_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=13
   [junit4]   2> 720455 DEBUG (zkCallback-1499-thread-1) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 6
   [junit4]   2> 720456 DEBUG (OverseerAutoScalingTriggerThread-73833076418412556-127.0.0.1:53281_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 6
   [junit4]   2> 720456 DEBUG (OverseerAutoScalingTriggerThread-73833076418412556-127.0.0.1:53281_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
   [junit4]   2> 720459 DEBUG (OverseerAutoScalingTriggerThread-73833076418412556-127.0.0.1:53281_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 720460 DEBUG (OverseerAutoScalingTriggerThread-73833076418412556-127.0.0.1:53281_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 6, lastZnodeVersion 6
   [junit4]   2> 720491 INFO  (qtp1173905842-4755) [n:127.0.0.1:60421_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 720505 INFO  (qtp613516905-4772) [n:127.0.0.1:53281_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.aboveRate_collection.shard1.replica_n2:INDEX.sizeInBytes} status=0 QTime=0
   [junit4]   2> 720507 INFO  (qtp613516905-4772) [n:127.0.0.1:53281_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 720522 INFO  (qtp145610257-4783) [n:127.0.0.1:56792_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.aboveRate_collection.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=0
   [junit4]   2> 720525 INFO  (qtp145610257-4783) [n:127.0.0.1:56792_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 720542 INFO  (qtp1322072216-4789) [n:127.0.0.1:59986_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 720570 INFO  (qtp1213582878-4764) [n:127.0.0.1:60740_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 720571 DEBUG (qtp1213582878-4762) [n:127.0.0.1:60740_solr    ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 720572 INFO  (qtp1213582878-4762) [n:127.0.0.1:60740_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=95
   [junit4]   2> 720572 DEBUG (zkCallback-1499-thread-1) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 7
   [junit4]   2> 720573 DEBUG (OverseerAutoScalingTriggerThread-73833076418412556-127.0.0.1:53281_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 7
   [junit4]   2> 720573 DEBUG (OverseerAutoScalingTriggerThread-73833076418412556-127.0.0.1:53281_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
   [junit4]   2> 720573 DEBUG (OverseerAutoScalingTriggerThread-73833076418412556-127.0.0.1:53281_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 720581 DEBUG (OverseerAutoScalingTriggerThread-73833076418412556-127.0.0.1:53281_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 7, lastZnodeVersion 7
   [junit4]   2> 720583 INFO  (qtp145610257-4780) [n:127.0.0.1:56792_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 720584 INFO  (qtp145610257-4782) [n:127.0.0.1:56792_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 720635 INFO  (qtp613516905-4774) [n:127.0.0.1:53281_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n2]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 720636 INFO  (qtp613516905-4775) [n:127.0.0.1:53281_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n2]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 720637 INFO  (qtp145610257-4782) [n:127.0.0.1:56792_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 720638 INFO  (OverseerCollectionConfigSetProcessor-73833076418412556-127.0.0.1:53281_solr-n_0000000000) [    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 720639 INFO  (qtp145610257-4780) [n:127.0.0.1:56792_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 720640 INFO  (qtp145610257-4780) [n:127.0.0.1:56792_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 720641 INFO  (qtp613516905-4775) [n:127.0.0.1:53281_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n2]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 720642 INFO  (qtp613516905-4774) [n:127.0.0.1:53281_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n2]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 720643 INFO  (qtp613516905-4774) [n:127.0.0.1:53281_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n2]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 720644 INFO  (qtp145610257-4780) [n:127.0.0.1:56792_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 720645 INFO  (qtp613516905-4774) [n:127.0.0.1:53281_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n2]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 720647 INFO  (qtp145610257-4780) [n:127.0.0.1:56792_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 720648 INFO  (qtp145610257-4780) [n:127.0.0.1:56792_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 720649 INFO  (qtp613516905-4774) [n:127.0.0.1:53281_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n2]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 720650 INFO  (qtp613516905-4774) [n:127.0.0.1:53281_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n2]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 720652 INFO  (qtp613516905-4774) [n:127.0.0.1:53281_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n2]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 720653 INFO  (qtp145610257-4780) [n:127.0.0.1:56792_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 720654 INFO  (qtp145610257-4780) [n:127.0.0.1:56792_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 720655 INFO  (qtp613516905-4775) [n:127.0.0.1:53281_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n2]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 720657 INFO  (qtp613516905-4775) [n:127.0.0.1:53281_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n2]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 720658 INFO  (qtp145610257-4782) [n:127.0.0.1:56792_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 720660 INFO  (qtp613516905-4775) [n:127.0.0.1:53281_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n2]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 720661 INFO  (qtp145610257-4782) [n:127.0.0.1:56792_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 720662 INFO  (qtp145610257-4782) [n:127.0.0.1:56792_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 720663 INFO  (qtp613516905-4775) [n:127.0.0.1:53281_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n2]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 720664 INFO  (qtp613516905-4775) [n:127.0.0.1:53281_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n2]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 720667 INFO  (qtp613516905-4775) [n:127.0.0.1:53281_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n2]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 720687 INFO  (qtp613516905-4774) [n:127.0.0.1:53281_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n2]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 720689 INFO  (qtp613516905-4775) [n:127.0.0.1:53281_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n2]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 720691 INFO  (qtp145610257-4782) [n:127.0.0.1:56792_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 720692 INFO  (qtp145610257-4782) [n:127.0.0.1:56792_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 720693 INFO  (qtp613516905-4775) [n:127.0.0.1:53281_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n2]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 720694 INFO  (qtp145610257-4782) [n:127.0.0.1:56792_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 720703 INFO  (qtp613516905-4775) [n:127.0.0.1:53281_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n2]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 720704 INFO  (qtp613516905-4775) [n:127.0.0.1:53281_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n2]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 720705 INFO  (qtp613516905-4775) [n:127.0.0.1:53281_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n2]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 720706 INFO  (qtp145610257-4782) [n:127.0.0.1:56792_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 720710 INFO  (qtp145610257-4782) [n:127.0.0.1:56792_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 720711 INFO  (qtp613516905-4775) [n:127.0.0.1:53281_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n2]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 720713 INFO  (qtp145610257-4782) [n:127.0.0.1:56792_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 720716 INFO  (qtp613516905-4774) [n:127.0.0.1:53281_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n2]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 720717 INFO  (qtp145610257-4782) [n:127.0.0.1:56792_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n1]  webapp=/solr path=/select param

[...truncated too long message...]

gure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

jar-checksums:
    [mkdir] Created dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/null1159699024
     [copy] Copying 39 files to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/null1159699024
   [delete] Deleting directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/null1159699024

resolve-example:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

resolve-server:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

jar-checksums:
    [mkdir] Created dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/null1403981373
     [copy] Copying 246 files to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/null1403981373
   [delete] Deleting directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/null1403981373

check-working-copy:
[ivy:cachepath] :: resolving dependencies :: org.eclipse.jgit#org.eclipse.jgit-caller;working
[ivy:cachepath] 	confs: [default]
[ivy:cachepath] 	found org.eclipse.jgit#org.eclipse.jgit;4.6.0.201612231935-r in public
[ivy:cachepath] 	found com.jcraft#jsch;0.1.53 in public
[ivy:cachepath] 	found com.googlecode.javaewah#JavaEWAH;1.1.6 in public
[ivy:cachepath] 	found org.apache.httpcomponents#httpclient;4.3.6 in public
[ivy:cachepath] 	found org.apache.httpcomponents#httpcore;4.3.3 in public
[ivy:cachepath] 	found commons-logging#commons-logging;1.1.3 in public
[ivy:cachepath] 	found commons-codec#commons-codec;1.6 in public
[ivy:cachepath] 	found org.slf4j#slf4j-api;1.7.2 in public
[ivy:cachepath] :: resolution report :: resolve 202ms :: artifacts dl 4ms
	---------------------------------------------------------------------
	|                  |            modules            ||   artifacts   |
	|       conf       | number| search|dwnlded|evicted|| number|dwnlded|
	---------------------------------------------------------------------
	|      default     |   8   |   0   |   0   |   0   ||   8   |   0   |
	---------------------------------------------------------------------
[wc-checker] Initializing working copy...
[wc-checker] SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
[wc-checker] SLF4J: Defaulting to no-operation (NOP) logger implementation
[wc-checker] SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
[wc-checker] Checking working copy status...

-jenkins-base:

BUILD SUCCESSFUL
Total time: 148 minutes 56 seconds
Archiving artifacts
WARN: No artifacts found that match the file pattern "**/*.events,heapdumps/**,**/hs_err_pid*". Configuration error?
WARN: java.lang.InterruptedException: no matches found within 10000
Recording test results
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)

[JENKINS] Lucene-Solr-Tests-7.x - Build # 615 - Still Unstable

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-7.x/615/

2 tests failed.
FAILED:  org.apache.solr.cloud.autoscaling.SearchRateTriggerIntegrationTest.testDeleteNode

Error Message:
unexpected DELETENODE status: {responseHeader={status=0,QTime=20},status={state=notfound,msg=Did not find [search_rate_trigger3/206e74c14575c3Tadq7y0tzo0ermf1qkdck7f9ff/0] in any tasks queue}}

Stack Trace:
java.lang.AssertionError: unexpected DELETENODE status: {responseHeader={status=0,QTime=20},status={state=notfound,msg=Did not find [search_rate_trigger3/206e74c14575c3Tadq7y0tzo0ermf1qkdck7f9ff/0] in any tasks queue}}
	at __randomizedtesting.SeedInfo.seed([11EC16010A538A6C:337ED8833D990511]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.autoscaling.SearchRateTriggerIntegrationTest.lambda$testDeleteNode$6(SearchRateTriggerIntegrationTest.java:668)
	at java.util.ArrayList.forEach(ArrayList.java:1257)
	at org.apache.solr.cloud.autoscaling.SearchRateTriggerIntegrationTest.testDeleteNode(SearchRateTriggerIntegrationTest.java:660)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.autoscaling.TestPolicyCloud.testCreateCollectionAddShardWithReplicaTypeUsingPolicy

Error Message:
Could not load collection from ZK: policiesTest

Stack Trace:
org.apache.solr.common.SolrException: Could not load collection from ZK: policiesTest
	at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1302)
	at org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:731)
	at org.apache.solr.common.cloud.ClusterState.getCollectionOrNull(ClusterState.java:148)
	at org.apache.solr.common.cloud.ClusterState.getCollectionOrNull(ClusterState.java:131)
	at org.apache.solr.common.cloud.ClusterState.getCollection(ClusterState.java:117)
	at org.apache.solr.cloud.SolrCloudTestCase.getCollectionState(SolrCloudTestCase.java:256)
	at org.apache.solr.cloud.autoscaling.TestPolicyCloud.testCreateCollectionAddShardWithReplicaTypeUsingPolicy(TestPolicyCloud.java:297)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.junit.rules.ExpectedException$ExpectedExceptionStatement.evaluate(ExpectedException.java:110)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/policiesTest/state.json
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:130)
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:54)
	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1215)
	at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$5(SolrZkClient.java:340)
	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:340)
	at org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1314)
	at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1300)
	... 46 more




Build Log:
[...truncated 13083 lines...]
   [junit4] Suite: org.apache.solr.cloud.autoscaling.SearchRateTriggerIntegrationTest
   [junit4]   2> Creating dataDir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.SearchRateTriggerIntegrationTest_11EC16010A538A6C-001/init-core-data-001
   [junit4]   2> 1368525 INFO  (SUITE-SearchRateTriggerIntegrationTest-seed#[11EC16010A538A6C]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 1368545 INFO  (SUITE-SearchRateTriggerIntegrationTest-seed#[11EC16010A538A6C]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 1368545 INFO  (SUITE-SearchRateTriggerIntegrationTest-seed#[11EC16010A538A6C]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 1368545 INFO  (SUITE-SearchRateTriggerIntegrationTest-seed#[11EC16010A538A6C]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 5 servers in /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.SearchRateTriggerIntegrationTest_11EC16010A538A6C-001/tempDir-001
   [junit4]   2> 1368546 INFO  (SUITE-SearchRateTriggerIntegrationTest-seed#[11EC16010A538A6C]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1368547 INFO  (Thread-778) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1368547 INFO  (Thread-778) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1368586 ERROR (Thread-778) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1368650 INFO  (SUITE-SearchRateTriggerIntegrationTest-seed#[11EC16010A538A6C]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:40275
   [junit4]   2> 1368671 INFO  (zkConnectionManagerCallback-2797-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1369019 INFO  (jetty-launcher-2794-thread-1) [    ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 1.8.0_172-b11
   [junit4]   2> 1369020 INFO  (jetty-launcher-2794-thread-2) [    ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 1.8.0_172-b11
   [junit4]   2> 1369039 INFO  (jetty-launcher-2794-thread-4) [    ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 1.8.0_172-b11
   [junit4]   2> 1369147 INFO  (jetty-launcher-2794-thread-3) [    ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 1.8.0_172-b11
   [junit4]   2> 1369183 INFO  (jetty-launcher-2794-thread-3) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1369183 INFO  (jetty-launcher-2794-thread-3) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1369183 INFO  (jetty-launcher-2794-thread-3) [    ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 1369183 INFO  (jetty-launcher-2794-thread-5) [    ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 1.8.0_172-b11
   [junit4]   2> 1369313 INFO  (jetty-launcher-2794-thread-2) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1369313 INFO  (jetty-launcher-2794-thread-2) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1369313 INFO  (jetty-launcher-2794-thread-2) [    ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 1369330 INFO  (jetty-launcher-2794-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4896d8d{/solr,null,AVAILABLE}
   [junit4]   2> 1369331 INFO  (jetty-launcher-2794-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@6462b0c5{HTTP/1.1,[http/1.1]}{127.0.0.1:37028}
   [junit4]   2> 1369331 INFO  (jetty-launcher-2794-thread-2) [    ] o.e.j.s.Server Started @1369555ms
   [junit4]   2> 1369331 INFO  (jetty-launcher-2794-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=37028}
   [junit4]   2> 1369331 ERROR (jetty-launcher-2794-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1369331 INFO  (jetty-launcher-2794-thread-2) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1369331 INFO  (jetty-launcher-2794-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.4.0
   [junit4]   2> 1369331 INFO  (jetty-launcher-2794-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1369331 INFO  (jetty-launcher-2794-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1369332 INFO  (jetty-launcher-2794-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-05-20T04:39:29.773Z
   [junit4]   2> 1369388 INFO  (jetty-launcher-2794-thread-1) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1369388 INFO  (jetty-launcher-2794-thread-1) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1369388 INFO  (jetty-launcher-2794-thread-1) [    ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 1369388 INFO  (jetty-launcher-2794-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@ab865c{/solr,null,AVAILABLE}
   [junit4]   2> 1369389 INFO  (jetty-launcher-2794-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@63d0c8e8{HTTP/1.1,[http/1.1]}{127.0.0.1:36772}
   [junit4]   2> 1369389 INFO  (jetty-launcher-2794-thread-1) [    ] o.e.j.s.Server Started @1369613ms
   [junit4]   2> 1369389 INFO  (jetty-launcher-2794-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=36772}
   [junit4]   2> 1369389 ERROR (jetty-launcher-2794-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1369389 INFO  (jetty-launcher-2794-thread-1) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1369389 INFO  (jetty-launcher-2794-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.4.0
   [junit4]   2> 1369389 INFO  (jetty-launcher-2794-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1369389 INFO  (jetty-launcher-2794-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1369389 INFO  (jetty-launcher-2794-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-05-20T04:39:29.831Z
   [junit4]   2> 1369422 INFO  (zkConnectionManagerCallback-2799-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1369438 INFO  (jetty-launcher-2794-thread-5) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1369438 INFO  (jetty-launcher-2794-thread-5) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1369438 INFO  (jetty-launcher-2794-thread-5) [    ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 1369472 INFO  (jetty-launcher-2794-thread-5) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4a7daab0{/solr,null,AVAILABLE}
   [junit4]   2> 1369472 INFO  (jetty-launcher-2794-thread-5) [    ] o.e.j.s.AbstractConnector Started ServerConnector@41a341ce{HTTP/1.1,[http/1.1]}{127.0.0.1:37467}
   [junit4]   2> 1369472 INFO  (jetty-launcher-2794-thread-5) [    ] o.e.j.s.Server Started @1369696ms
   [junit4]   2> 1369472 INFO  (jetty-launcher-2794-thread-5) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=37467}
   [junit4]   2> 1369473 ERROR (jetty-launcher-2794-thread-5) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1369473 INFO  (jetty-launcher-2794-thread-5) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1369473 INFO  (jetty-launcher-2794-thread-5) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.4.0
   [junit4]   2> 1369473 INFO  (jetty-launcher-2794-thread-5) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1369473 INFO  (jetty-launcher-2794-thread-5) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1369473 INFO  (jetty-launcher-2794-thread-5) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-05-20T04:39:29.915Z
   [junit4]   2> 1369476 INFO  (jetty-launcher-2794-thread-3) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1950267d{/solr,null,AVAILABLE}
   [junit4]   2> 1369477 INFO  (jetty-launcher-2794-thread-3) [    ] o.e.j.s.AbstractConnector Started ServerConnector@117ad588{HTTP/1.1,[http/1.1]}{127.0.0.1:40126}
   [junit4]   2> 1369477 INFO  (jetty-launcher-2794-thread-3) [    ] o.e.j.s.Server Started @1369701ms
   [junit4]   2> 1369477 INFO  (jetty-launcher-2794-thread-3) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=40126}
   [junit4]   2> 1369477 ERROR (jetty-launcher-2794-thread-3) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1369477 INFO  (jetty-launcher-2794-thread-3) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1369477 INFO  (jetty-launcher-2794-thread-3) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.4.0
   [junit4]   2> 1369477 INFO  (jetty-launcher-2794-thread-3) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1369477 INFO  (jetty-launcher-2794-thread-3) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1369477 INFO  (jetty-launcher-2794-thread-3) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-05-20T04:39:29.919Z
   [junit4]   2> 1369479 INFO  (jetty-launcher-2794-thread-4) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1369479 INFO  (jetty-launcher-2794-thread-4) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1369479 INFO  (jetty-launcher-2794-thread-4) [    ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 1369479 INFO  (jetty-launcher-2794-thread-4) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@17130ada{/solr,null,AVAILABLE}
   [junit4]   2> 1369567 INFO  (zkConnectionManagerCallback-2801-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1369567 INFO  (jetty-launcher-2794-thread-4) [    ] o.e.j.s.AbstractConnector Started ServerConnector@168bd00d{HTTP/1.1,[http/1.1]}{127.0.0.1:34941}
   [junit4]   2> 1369567 INFO  (jetty-launcher-2794-thread-4) [    ] o.e.j.s.Server Started @1369791ms
   [junit4]   2> 1369567 INFO  (jetty-launcher-2794-thread-4) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=34941}
   [junit4]   2> 1369568 ERROR (jetty-launcher-2794-thread-4) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1369568 INFO  (jetty-launcher-2794-thread-4) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1369568 INFO  (jetty-launcher-2794-thread-4) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.4.0
   [junit4]   2> 1369568 INFO  (jetty-launcher-2794-thread-4) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1369568 INFO  (jetty-launcher-2794-thread-4) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1369568 INFO  (jetty-launcher-2794-thread-4) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-05-20T04:39:30.010Z
   [junit4]   2> 1369568 INFO  (zkConnectionManagerCallback-2805-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1369581 INFO  (zkConnectionManagerCallback-2803-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1369640 INFO  (jetty-launcher-2794-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1369641 INFO  (zkConnectionManagerCallback-2807-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1369642 INFO  (jetty-launcher-2794-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1369677 INFO  (jetty-launcher-2794-thread-3) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1369960 INFO  (jetty-launcher-2794-thread-5) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1369960 INFO  (jetty-launcher-2794-thread-4) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1370014 INFO  (jetty-launcher-2794-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40275/solr
   [junit4]   2> 1370195 INFO  (jetty-launcher-2794-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40275/solr
   [junit4]   2> 1370233 INFO  (jetty-launcher-2794-thread-5) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40275/solr
   [junit4]   2> 1370400 INFO  (jetty-launcher-2794-thread-3) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40275/solr
   [junit4]   2> 1370428 INFO  (jetty-launcher-2794-thread-4) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40275/solr
   [junit4]   2> 1370432 INFO  (zkConnectionManagerCallback-2819-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1370432 INFO  (zkConnectionManagerCallback-2823-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1370433 INFO  (zkConnectionManagerCallback-2815-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1370459 INFO  (zkConnectionManagerCallback-2811-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1370488 INFO  (zkConnectionManagerCallback-2827-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1370489 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x102201aec550007, likely client has closed socket
   [junit4]   2> 1370490 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x102201aec550008, likely client has closed socket
   [junit4]   2> 1370490 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x102201aec550006, likely client has closed socket
   [junit4]   2> 1370507 INFO  (zkConnectionManagerCallback-2829-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1370541 INFO  (zkConnectionManagerCallback-2831-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1370543 INFO  (zkConnectionManagerCallback-2833-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1370589 INFO  (zkConnectionManagerCallback-2835-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1370589 INFO  (zkConnectionManagerCallback-2837-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1371404 INFO  (jetty-launcher-2794-thread-4) [n:127.0.0.1:34941_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1371405 INFO  (jetty-launcher-2794-thread-4) [n:127.0.0.1:34941_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:34941_solr
   [junit4]   2> 1371406 INFO  (jetty-launcher-2794-thread-4) [n:127.0.0.1:34941_solr    ] o.a.s.c.Overseer Overseer (id=72655843997581327-127.0.0.1:34941_solr-n_0000000000) starting
   [junit4]   2> 1371686 INFO  (zkConnectionManagerCallback-2852-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1371865 INFO  (jetty-launcher-2794-thread-4) [n:127.0.0.1:34941_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:40275/solr ready
   [junit4]   2> 1372048 INFO  (jetty-launcher-2794-thread-4) [n:127.0.0.1:34941_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34941_solr
   [junit4]   2> 1372052 DEBUG (OverseerAutoScalingTriggerThread-72655843997581327-127.0.0.1:34941_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and .scheduled_maintenance triggers
   [junit4]   2> 1372105 DEBUG (OverseerAutoScalingTriggerThread-72655843997581327-127.0.0.1:34941_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
   [junit4]   2> 1372106 DEBUG (OverseerAutoScalingTriggerThread-72655843997581327-127.0.0.1:34941_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1
   [junit4]   2> 1372106 DEBUG (OverseerAutoScalingTriggerThread-72655843997581327-127.0.0.1:34941_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
   [junit4]   2> 1372122 INFO  (zkCallback-2836-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1372199 INFO  (zkCallback-2851-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1372321 DEBUG (OverseerAutoScalingTriggerThread-72655843997581327-127.0.0.1:34941_solr-n_0000000000) [    ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial livenodes: [127.0.0.1:34941_solr]
   [junit4]   2> 1372345 DEBUG (OverseerAutoScalingTriggerThread-72655843997581327-127.0.0.1:34941_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 1372359 DEBUG (OverseerAutoScalingTriggerThread-72655843997581327-127.0.0.1:34941_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
   [junit4]   2> 1372359 DEBUG (ScheduledTrigger-2450-thread-1) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
   [junit4]   2> 1372889 INFO  (jetty-launcher-2794-thread-3) [n:127.0.0.1:40126_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1372939 INFO  (jetty-launcher-2794-thread-1) [n:127.0.0.1:36772_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1372941 INFO  (jetty-launcher-2794-thread-1) [n:127.0.0.1:36772_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1372977 INFO  (jetty-launcher-2794-thread-1) [n:127.0.0.1:36772_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1372977 INFO  (jetty-launcher-2794-thread-1) [n:127.0.0.1:36772_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36772_solr
   [junit4]   2> 1372997 INFO  (zkCallback-2836-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1372998 INFO  (zkCallback-2851-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1373013 INFO  (jetty-launcher-2794-thread-3) [n:127.0.0.1:40126_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1373015 INFO  (jetty-launcher-2794-thread-3) [n:127.0.0.1:40126_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1373015 INFO  (jetty-launcher-2794-thread-3) [n:127.0.0.1:40126_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40126_solr
   [junit4]   2> 1373056 INFO  (zkCallback-2834-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1373057 INFO  (zkCallback-2830-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1373069 INFO  (zkCallback-2851-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 1373069 INFO  (zkCallback-2836-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 1373093 INFO  (zkCallback-2834-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 1373093 INFO  (zkCallback-2830-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 1373589 DEBUG (ScheduledTrigger-2450-thread-3) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
   [junit4]   2> 1373809 INFO  (jetty-launcher-2794-thread-4) [n:127.0.0.1:34941_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34941.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@65afc78b
   [junit4]   2> 1373869 INFO  (jetty-launcher-2794-thread-4) [n:127.0.0.1:34941_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34941.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@65afc78b
   [junit4]   2> 1373869 INFO  (jetty-launcher-2794-thread-4) [n:127.0.0.1:34941_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34941.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@65afc78b
   [junit4]   2> 1373882 INFO  (jetty-launcher-2794-thread-4) [n:127.0.0.1:34941_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.SearchRateTriggerIntegrationTest_11EC16010A538A6C-001/tempDir-001/node4/.
   [junit4]   2> 1374261 INFO  (jetty-launcher-2794-thread-3) [n:127.0.0.1:40126_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40126.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@65afc78b
   [junit4]   2> 1374297 INFO  (jetty-launcher-2794-thread-3) [n:127.0.0.1:40126_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40126.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@65afc78b
   [junit4]   2> 1374297 INFO  (jetty-launcher-2794-thread-3) [n:127.0.0.1:40126_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40126.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@65afc78b
   [junit4]   2> 1374298 INFO  (jetty-launcher-2794-thread-3) [n:127.0.0.1:40126_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.SearchRateTriggerIntegrationTest_11EC16010A538A6C-001/tempDir-001/node3/.
   [junit4]   2> 1374451 INFO  (zkConnectionManagerCallback-2857-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1374646 DEBUG (ScheduledTrigger-2450-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
   [junit4]   2> 1374699 INFO  (jetty-launcher-2794-thread-3) [n:127.0.0.1:40126_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 1374772 INFO  (jetty-launcher-2794-thread-3) [n:127.0.0.1:40126_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:40275/solr ready
   [junit4]   2> 1375182 INFO  (jetty-launcher-2794-thread-2) [n:127.0.0.1:37028_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 1375422 INFO  (jetty-launcher-2794-thread-2) [n:127.0.0.1:37028_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1375752 DEBUG (ScheduledTrigger-2450-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
   [junit4]   2> 1375769 INFO  (jetty-launcher-2794-thread-2) [n:127.0.0.1:37028_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1375769 INFO  (jetty-launcher-2794-thread-2) [n:127.0.0.1:37028_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37028_solr
   [junit4]   2> 1375789 INFO  (zkCallback-2851-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1375789 INFO  (zkCallback-2834-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1375840 INFO  (jetty-launcher-2794-thread-5) [n:127.0.0.1:37467_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 1375972 INFO  (zkCallback-2856-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1376008 INFO  (zkCallback-2836-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1376021 INFO  (jetty-launcher-2794-thread-5) [n:127.0.0.1:37467_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1376023 INFO  (jetty-launcher-2794-thread-5) [n:127.0.0.1:37467_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1376023 INFO  (jetty-launcher-2794-thread-5) [n:127.0.0.1:37467_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37467_solr
   [junit4]   2> 1376028 INFO  (zkCallback-2830-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1376044 INFO  (zkCallback-2851-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 1376045 INFO  (zkCallback-2834-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 1376203 INFO  (zkCallback-2828-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 1376301 INFO  (zkCallback-2836-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 1376301 INFO  (zkCallback-2830-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 1376301 INFO  (zkCallback-2856-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 1376410 INFO  (zkCallback-2832-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (5)
   [junit4]   2> 1376755 DEBUG (ScheduledTrigger-2450-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 5
   [junit4]   2> 1377153 INFO  (jetty-launcher-2794-thread-1) [n:127.0.0.1:36772_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36772.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@65afc78b
   [junit4]   2> 1377160 INFO  (jetty-launcher-2794-thread-2) [n:127.0.0.1:37028_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37028.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@65afc78b
   [junit4]   2> 1377233 INFO  (jetty-launcher-2794-thread-2) [n:127.0.0.1:37028_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37028.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@65afc78b
   [junit4]   2> 1377253 INFO  (jetty-launcher-2794-thread-2) [n:127.0.0.1:37028_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37028.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@65afc78b
   [junit4]   2> 1377254 INFO  (jetty-launcher-2794-thread-2) [n:127.0.0.1:37028_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.SearchRateTriggerIntegrationTest_11EC16010A538A6C-001/tempDir-001/node2/.
   [junit4]   2> 1377282 INFO  (jetty-launcher-2794-thread-1) [n:127.0.0.1:36772_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36772.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@65afc78b
   [junit4]   2> 1377282 INFO  (jetty-launcher-2794-thread-1) [n:127.0.0.1:36772_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36772.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@65afc78b
   [junit4]   2> 1377296 INFO  (jetty-launcher-2794-thread-1) [n:127.0.0.1:36772_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.SearchRateTriggerIntegrationTest_11EC16010A538A6C-001/tempDir-001/node1/.
   [junit4]   2> 1377617 INFO  (zkConnectionManagerCallback-2863-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1377763 DEBUG (ScheduledTrigger-2450-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 5
   [junit4]   2> 1377832 INFO  (zkConnectionManagerCallback-2867-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1377927 INFO  (jetty-launcher-2794-thread-2) [n:127.0.0.1:37028_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (5)
   [junit4]   2> 1377927 INFO  (jetty-launcher-2794-thread-2) [n:127.0.0.1:37028_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:40275/solr ready
   [junit4]   2> 1378313 INFO  (jetty-launcher-2794-thread-1) [n:127.0.0.1:36772_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (5)
   [junit4]   2> 1378314 INFO  (jetty-launcher-2794-thread-1) [n:127.0.0.1:36772_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:40275/solr ready
   [junit4]   2> 1378953 DEBUG (ScheduledTrigger-2450-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 5
   [junit4]   2> 1379421 INFO  (jetty-launcher-2794-thread-5) [n:127.0.0.1:37467_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37467.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@65afc78b
   [junit4]   2> 1379456 INFO  (jetty-launcher-2794-thread-5) [n:127.0.0.1:37467_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37467.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@65afc78b
   [junit4]   2> 1379456 INFO  (jetty-launcher-2794-thread-5) [n:127.0.0.1:37467_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37467.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@65afc78b
   [junit4]   2> 1379457 INFO  (jetty-launcher-2794-thread-5) [n:127.0.0.1:37467_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.SearchRateTriggerIntegrationTest_11EC16010A538A6C-001/tempDir-001/node5/.
   [junit4]   2> 1379548 INFO  (zkConnectionManagerCallback-2872-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1379561 INFO  (jetty-launcher-2794-thread-5) [n:127.0.0.1:37467_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (5)
   [junit4]   2> 1379562 INFO  (jetty-launcher-2794-thread-5) [n:127.0.0.1:37467_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:40275/solr ready
   [junit4]   2> 1379763 INFO  (zkConnectionManagerCallback-2874-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1379833 INFO  (zkConnectionManagerCallback-2879-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1379854 INFO  (SUITE-SearchRateTriggerIntegrationTest-seed#[11EC16010A538A6C]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (5)
   [junit4]   2> 1379854 INFO  (SUITE-SearchRateTriggerIntegrationTest-seed#[11EC16010A538A6C]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:40275/solr ready
   [junit4]   2> 1379890 INFO  (qtp67914285-7750) [n:127.0.0.1:37028_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 1379891 INFO  (qtp731751430-7773) [n:127.0.0.1:37467_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 1379902 INFO  (qtp2280593-7741) [n:127.0.0.1:40126_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 1379909 INFO  (qtp525504927-7786) [n:127.0.0.1:34941_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 1379926 INFO  (qtp1643983479-7756) [n:127.0.0.1:36772_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 1379927 DEBUG (qtp1643983479-7761) [n:127.0.0.1:36772_solr    ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 1379928 DEBUG (zkCallback-2851-thread-1) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 2
   [junit4]   2> 1379942 INFO  (qtp1643983479-7761) [n:127.0.0.1:36772_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=66
   [junit4]   2> 1380036 DEBUG (ScheduledTrigger-2450-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 5
   [junit4]   2> 1380036 DEBUG (OverseerAutoScalingTriggerThread-72655843997581327-127.0.0.1:34941_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
   [junit4]   2> 1380068 DEBUG (OverseerAutoScalingTriggerThread-72655843997581327-127.0.0.1:34941_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 1380069 DEBUG (OverseerAutoScalingTriggerThread-72655843997581327-127.0.0.1:34941_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
   [junit4]   2> 1380311 INFO  (TEST-SearchRateTriggerIntegrationTest.testAboveSearchRate-seed#[11EC16010A538A6C]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testAboveSearchRate
   [junit4]   2> 1380345 INFO  (TEST-SearchRateTriggerIntegrationTest.testAboveSearchRate-seed#[11EC16010A538A6C]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (5)
   [junit4]   2> 1380347 INFO  (TEST-SearchRateTriggerIntegrationTest.testAboveSearchRate-seed#[11EC16010A538A6C]) [    ] o.a.s.c.a.SearchRateTriggerIntegrationTest /autoscaling.json reset, new znode version 3
   [junit4]   2> 1380347 DEBUG (zkCallback-2851-thread-1) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 3
   [junit4]   2> 1380347 DEBUG (OverseerAutoScalingTriggerThread-72655843997581327-127.0.0.1:34941_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 3
   [junit4]   2> 1380348 DEBUG (OverseerAutoScalingTriggerThread-72655843997581327-127.0.0.1:34941_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
   [junit4]   2> 1380349 DEBUG (OverseerAutoScalingTriggerThread-72655843997581327-127.0.0.1:34941_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 1380361 DEBUG (OverseerAutoScalingTriggerThread-72655843997581327-127.0.0.1:34941_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion 3
   [junit4]   2> 1385353 INFO  (qtp67914285-7745) [n:127.0.0.1:37028_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=2&collection.configName=conf&name=aboveRate_collection&nrtReplicas=2&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1385395 INFO  (OverseerThreadFactory-2452-thread-1) [    ] o.a.s.c.a.c.CreateCollectionCmd Create collection aboveRate_collection
   [junit4]   2> 1385701 INFO  (OverseerStateUpdate-72655843997581327-127.0.0.1:34941_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"aboveRate_collection",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"aboveRate_collection_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:37467/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1385703 INFO  (OverseerStateUpdate-72655843997581327-127.0.0.1:34941_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"aboveRate_collection",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"aboveRate_collection_shard1_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:34941/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1385957 INFO  (qtp731751430-7768) [n:127.0.0.1:37467_solr    x:aboveRate_collection_shard1_replica_n1] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=aboveRate_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=aboveRate_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1385985 INFO  (qtp525504927-7742) [n:127.0.0.1:34941_solr    x:aboveRate_collection_shard1_replica_n2] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=aboveRate_collection_shard1_replica_n2&action=CREATE&numShards=1&collection=aboveRate_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1385985 INFO  (qtp525504927-7742) [n:127.0.0.1:34941_solr    x:aboveRate_collection_shard1_replica_n2] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1387282 INFO  (qtp525504927-7742) [n:127.0.0.1:34941_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.4.0
   [junit4]   2> 1387355 INFO  (qtp731751430-7768) [n:127.0.0.1:37467_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.4.0
   [junit4]   2> 1387373 INFO  (qtp525504927-7742) [n:127.0.0.1:34941_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.s.IndexSchema [aboveRate_collection_shard1_replica_n2] Schema name=minimal
   [junit4]   2> 1387407 INFO  (qtp731751430-7768) [n:127.0.0.1:37467_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.s.IndexSchema [aboveRate_collection_shard1_replica_n1] Schema name=minimal
   [junit4]   2> 1387425 INFO  (qtp731751430-7768) [n:127.0.0.1:37467_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1387425 INFO  (qtp731751430-7768) [n:127.0.0.1:37467_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'aboveRate_collection_shard1_replica_n1' using configuration from collection aboveRate_collection, trusted=true
   [junit4]   2> 1387425 INFO  (qtp731751430-7768) [n:127.0.0.1:37467_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37467.solr.core.aboveRate_collection.shard1.replica_n1' (registry 'solr.core.aboveRate_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@65afc78b
   [junit4]   2> 1387426 INFO  (qtp731751430-7768) [n:127.0.0.1:37467_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1387426 INFO  (qtp731751430-7768) [n:127.0.0.1:37467_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.c.SolrCore [[aboveRate_collection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.SearchRateTriggerIntegrationTest_11EC16010A538A6C-001/tempDir-001/node5/aboveRate_collection_shard1_replica_n1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.SearchRateTriggerIntegrationTest_11EC16010A538A6C-001/tempDir-001/node5/./aboveRate_collection_shard1_replica_n1/data/]
   [junit4]   2> 1387444 INFO  (qtp525504927-7742) [n:127.0.0.1:34941_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1387444 INFO  (qtp525504927-7742) [n:127.0.0.1:34941_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'aboveRate_collection_shard1_replica_n2' using configuration from collection aboveRate_collection, trusted=true
   [junit4]   2> 1387445 INFO  (qtp525504927-7742) [n:127.0.0.1:34941_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34941.solr.core.aboveRate_collection.shard1.replica_n2' (registry 'solr.core.aboveRate_collection.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@65afc78b
   [junit4]   2> 1387445 INFO  (qtp525504927-7742) [n:127.0.0.1:34941_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1387445 INFO  (qtp525504927-7742) [n:127.0.0.1:34941_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.SolrCore [[aboveRate_collection_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.SearchRateTriggerIntegrationTest_11EC16010A538A6C-001/tempDir-001/node4/aboveRate_collection_shard1_replica_n2], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.SearchRateTriggerIntegrationTest_11EC16010A538A6C-001/tempDir-001/node4/./aboveRate_collection_shard1_replica_n2/data/]
   [junit4]   2> 1388091 INFO  (qtp525504927-7742) [n:127.0.0.1:34941_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1388091 INFO  (qtp525504927-7742) [n:127.0.0.1:34941_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1388092 INFO  (qtp525504927-7742) [n:127.0.0.1:34941_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1388092 INFO  (qtp525504927-7742) [n:127.0.0.1:34941_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1388110 INFO  (qtp525504927-7742) [n:127.0.0.1:34941_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@5d23dcb0[aboveRate_collection_shard1_replica_n2] main]
   [junit4]   2> 1388111 INFO  (qtp525504927-7742) [n:127.0.0.1:34941_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 1388112 INFO  (qtp525504927-7742) [n:127.0.0.1:34941_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 1388112 INFO  (qtp525504927-7742) [n:127.0.0.1:34941_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 1388126 INFO  (searcherExecutor-2464-thread-1-processing-n:127.0.0.1:34941_solr x:aboveRate_collection_shard1_replica_n2 c:aboveRate_collection s:shard1 r:core_node4) [n:127.0.0.1:34941_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.SolrCore [aboveRate_collection_shard1_replica_n2] Registered new searcher Searcher@5d23dcb0[aboveRate_collection_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1388126 INFO  (qtp525504927-7742) [n:127.0.0.1:34941_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1600956597343879168
   [junit4]   2> 1388148 INFO  (qtp525504927-7742) [n:127.0.0.1:34941_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.ZkShardTerms Successful update of terms at /collections/aboveRate_collection/terms/shard1 to Terms{values={core_node4=0}, version=0}
   [junit4]   2> 1388151 INFO  (qtp731751430-7768) [n:127.0.0.1:37467_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1388151 INFO  (qtp731751430-7768) [n:127.0.0.1:37467_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1388152 INFO  (qtp731751430-7768) [n:127.0.0.1:37467_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1388152 INFO  (qtp731751430-7768) [n:127.0.0.1:37467_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1388164 INFO  (qtp525504927-7742) [n:127.0.0.1:34941_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=9999ms
   [junit4]   2> 1388203 INFO  (qtp731751430-7768) [n:127.0.0.1:37467_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@50edbabc[aboveRate_collection_shard1_replica_n1] main]
   [junit4]   2> 1388219 INFO  (qtp731751430-7768) [n:127.0.0.1:37467_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 1388219 INFO  (qtp731751430-7768) [n:127.0.0.1:37467_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 1388220 INFO  (qtp731751430-7768) [n:127.0.0.1:37467_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 1388220 INFO  (qtp731751430-7768) [n:127.0.0.1:37467_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1600956597442445312
   [junit4]   2> 1388222 INFO  (searcherExecutor-2463-thread-1-processing-n:127.0.0.1:37467_solr x:aboveRate_collection_shard1_replica_n1 c:aboveRate_collection s:shard1 r:core_node3) [n:127.0.0.1:37467_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.c.SolrCore [aboveRate_collection_shard1_replica_n1] Registered new searcher Searcher@50edbabc[aboveRate_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1388418 INFO  (qtp731751430-7768) [n:127.0.0.1:37467_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.c.ZkShardTerms Successful update of terms at /collections/aboveRate_collection/terms/shard1 to Terms{values={core_node3=0, core_node4=0}, version=1}
   [junit4]   2> 1388711 INFO  (qtp525504927-7742) [n:127.0.0.1:34941_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1388711 INFO  (qtp525504927-7742) [n:127.0.0.1:34941_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1388711 INFO  (qtp525504927-7742) [n:127.0.0.1:34941_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:34941/solr/aboveRate_collection_shard1_replica_n2/
   [junit4]   2> 1388712 INFO  (qtp525504927-7742) [n:127.0.0.1:34941_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.u.PeerSync PeerSync: core=aboveRate_collection_shard1_replica_n2 url=http://127.0.0.1:34941/solr START replicas=[http://127.0.0.1:37467/solr/aboveRate_collection_shard1_replica_n1/] nUpdates=100
   [junit4]   2> 1388722 INFO  (qtp731751430-7769) [n:127.0.0.1:37467_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n1]  webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1389019 INFO  (qtp525504927-7742) [n:127.0.0.1:34941_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.u.PeerSync PeerSync: core=aboveRate_collection_shard1_replica_n2 url=http://127.0.0.1:34941/solr DONE.  We have no versions.  sync failed.
   [junit4]   2> 1389019 INFO  (qtp525504927-7742) [n:127.0.0.1:34941_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 1389019 INFO  (qtp525504927-7742) [n:127.0.0.1:34941_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 1389019 INFO  (qtp525504927-7742) [n:127.0.0.1:34941_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 1389040 INFO  (qtp525504927-7742) [n:127.0.0.1:34941_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:34941/solr/aboveRate_collection_shard1_replica_n2/ shard1
   [junit4]   2> 1389259 INFO  (qtp525504927-7742) [n:127.0.0.1:34941_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1389262 INFO  (qtp525504927-7742) [n:127.0.0.1:34941_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=aboveRate_collection_shard1_replica_n2&action=CREATE&numShards=1&collection=aboveRate_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=3277
   [junit4]   2> 1389365 INFO  (zkCallback-2836-thread-3) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/aboveRate_collection/state.json] for collection [aboveRate_collection] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 1389456 INFO  (qtp731751430-7768) [n:127.0.0.1:37467_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=aboveRate_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=aboveRate_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=3499
   [junit4]   2> 1389552 INFO  (qtp67914285-7745) [n:127.0.0.1:37028_solr    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 1389569 INFO  (zkCallback-2836-thread-3) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/aboveRate_collection/state.json] for collection [aboveRate_collection] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 1389580 INFO  (zkCallback-2828-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/aboveRate_collection/state.json] for collection [aboveRate_collection] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 1390554 INFO  (qtp67914285-7745) [n:127.0.0.1:37028_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=2&collection.configName=conf&name=aboveRate_collection&nrtReplicas=2&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=5200
   [junit4]   2> 1390633 INFO  (qtp67914285-7746) [n:127.0.0.1:37028_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 1390646 INFO  (qtp731751430-7772) [n:127.0.0.1:37467_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.aboveRate_collection.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=1
   [junit4]   2> 1390648 INFO  (qtp731751430-7775) [n:127.0.0.1:37467_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 1390690 INFO  (qtp2280593-7736) [n:127.0.0.1:40126_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 1390750 INFO  (qtp525504927-7782) [n:127.0.0.1:34941_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.aboveRate_collection.shard1.replica_n2:INDEX.sizeInBytes} status=0 QTime=52
   [junit4]   2> 1390752 INFO  (qtp525504927-7788) [n:127.0.0.1:34941_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 1390824 INFO  (qtp1643983479-7757) [n:127.0.0.1:36772_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 1390825 DEBUG (qtp67914285-7749) [n:127.0.0.1:37028_solr    ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 1390825 DEBUG (zkCallback-2851-thread-1) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 4
   [junit4]   2> 1390826 DEBUG (OverseerAutoScalingTriggerThread-72655843997581327-127.0.0.1:34941_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 4
   [junit4]   2> 1390826 DEBUG (OverseerAutoScalingTriggerThread-72655843997581327-127.0.0.1:34941_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
   [junit4]   2> 1390826 DEBUG (OverseerAutoScalingTriggerThread-72655843997581327-127.0.0.1:34941_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 1390826 DEBUG (OverseerAutoScalingTriggerThread-72655843997581327-127.0.0.1:34941_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 4, lastZnodeVersion 4
   [junit4]   2> 1390826 INFO  (qtp67914285-7749) [n:127.0.0.1:37028_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=266
   [junit4]   2> 1390849 INFO  (qtp67914285-7746) [n:127.0.0.1:37028_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 1390880 INFO  (qtp731751430-7772) [n:127.0.0.1:37467_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.aboveRate_collection.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=0
   [junit4]   2> 1390882 INFO  (qtp731751430-7772) [n:127.0.0.1:37467_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 1390922 INFO  (qtp2280593-7736) [n:127.0.0.1:40126_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 1390933 INFO  (qtp525504927-7786) [n:127.0.0.1:34941_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.aboveRate_collection.shard1.replica_n2:INDEX.sizeInBytes} status=0 QTime=0
   [junit4]   2> 1390950 INFO  (qtp525504927-7788) [n:127.0.0.1:34941_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 1390951 INFO  (qtp1643983479-7757) [n:127.0.0.1:36772_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 1390951 DEBUG (qtp67914285-7752) [n:127.0.0.1:37028_solr    ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 1390952 DEBUG (zkCallback-2851-thread-1) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 5
   [junit4]   2> 1390952 DEBUG (OverseerAutoScalingTriggerThread-72655843997581327-127.0.0.1:34941_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 5
   [junit4]   2> 1390952 DEBUG (OverseerAutoScalingTriggerThread-72655843997581327-127.0.0.1:34941_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
   [junit4]   2> 1390953 DEBUG (OverseerAutoScalingTriggerThread-72655843997581327-127.0.0.1:34941_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 1390953 DEBUG (OverseerAutoScalingTriggerThread-72655843997581327-127.0.0.1:34941_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 5, lastZnodeVersion 5
   [junit4]   2> 1390953 INFO  (qtp67914285-7752) [n:127.0.0.1:37028_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=112
   [junit4]   2> 1391007 INFO  (qtp67914285-7749) [n:127.0.0.1:37028_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 1391009 INFO  (qtp731751430-7772) [n:127.0.0.1:37467_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.aboveRate_collection.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=0
   [junit4]   2> 1391043 INFO  (qtp731751430-7773) [n:127.0.0.1:37467_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=33
   [junit4]   2> 1391052 INFO  (qtp2280593-7737) [n:127.0.0.1:40126_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 1391175 INFO  (qtp525504927-7785) [n:127.0.0.1:34941_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.aboveRate_collection.shard1.replica_n2:INDEX.sizeInBytes} status=0 QTime=0
   [junit4]   2> 1391176 INFO  (qtp525504927-7786) [n:127.0.0.1:34941_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 1391283 INFO  (qtp1643983479-7756) [n:127.0.0.1:36772_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 1391299 DEBUG (qtp731751430-7769) [n:127.0.0.1:37467_solr    ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 1391300 DEBUG (zkCallback-2851-thread-1) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 6
   [junit4]   2> 1391300 DEBUG (OverseerAutoScalingTriggerThread-72655843997581327-127.0.0.1:34941_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 6
   [junit4]   2> 1391300 DEBUG (OverseerAutoScalingTriggerThread-72655843997581327-127.0.0.1:34941_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
   [junit4]   2> 1391300 DEBUG (OverseerAutoScalingTriggerThread-72655843997581327-127.0.0.1:34941_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 1391301 INFO  (qtp731751430-7769) [n:127.0.0.1:37467_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=322
   [junit4]   2> 1391302 DEBUG (OverseerAutoScalingTriggerThread-72655843997581327-127.0.0.1:34941_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 6, lastZnodeVersion 6
   [junit4]   2> 1391336 INFO  (qtp67914285-7746) [n:127.0.0.1:37028_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 1391336 INFO  (qtp731751430-7772) [n:127.0.0.1:37467_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.aboveRate_collection.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=0
   [junit4]   2> 1391338 INFO  (qtp731751430-7773) [n:127.0.0.1:37467_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 1391339 INFO  (qtp2280593-7736) [n:127.0.0.1:40126_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 1391372 INFO  (qtp525504927-7788) [n:127.0.0.1:34941_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.aboveRate_collection.shard1.replica_n2:INDEX.sizeInBytes} status=0 QTime=0
   [junit4]   2> 1391373 INFO  (qtp525504927-7788) [n:127.0.0.1:34941_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 1391374 INFO  (qtp1643983479-7757) [n:127.0.0.1:36772_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 1391374 DEBUG (qtp67914285-7749) [n:127.0.0.1:37028_solr    ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 1391375 INFO  (qtp67914285-7749) [n:127.0.0.1:37028_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=72
   [junit4]   2> 1391375 DEBUG (zkCallback-2851-thread-1) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 7
   [junit4]   2> 1391375 DEBUG (OverseerAutoScalingTriggerThread-72655843997581327-127.0.0.1:34941_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 7
   [junit4]   2> 1391389 INFO  (qtp525504927-7785) [n:127.0.0.1:34941_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n2]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 1391390 INFO  (qtp525504927-7788) [n:127.0.0.1:34941_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n2]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 1391391 INFO  (qtp525504927-7788) [n:127.0.0.1:34941_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n2]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 1391392 INFO  (qtp525504927-7788) [n:127.0.0.1:34941_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n2]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 1391408 DEBUG (OverseerAutoScalingTriggerThread-72655843997581327-127.0.0.1:34941_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
   [junit4]   2> 1391409 INFO  (OverseerCollectionConfigSetProcessor-72655843997581327-127.0.0.1:34941_solr-n_0000000000) [    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 1391409 DEBUG (OverseerAutoScalingTriggerThread-72655843997581327-127.0.0.1:34941_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 1391409 DEBUG (OverseerAutoScalingTriggerThread-72655843997581327-127.0.0.1:34941_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 7, lastZnodeVersion 7
   [junit4]   2> 1391446 INFO  (qtp731751430-7775) [n:127.0.0.1:37467_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 1391462 INFO  (qtp731751430-7775) [n:127.0.0.1:37467_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 1391462 INFO  (qtp731751430-7775) [n:127.0.0.1:37467_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 1391478 INFO  (qtp525504927-7788) [n:127.0.0.1:34941_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n2]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 1391478 INFO  (qtp731751430-7775) [n:127.0.0.1:37467_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 1391479 INFO  (qtp525504927-7788) [n:127.0.0.1:34941_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n2]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 1391480 INFO  (qtp731751430-7775) [n:127.0.0.1:37467_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 1391481 INFO  (qtp525504927-7788) [n:127.0.0.1:34941_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n2]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 1391481 INFO  (qtp731751430-7775) [n:127.0.0.1:37467_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 1391515 INFO  (qtp731751430-7775) [n:127.0.0.1:37467_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 1391515 INFO  (qtp731751430-7775) [n:127.0.0.1:37467_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 1391516 INFO  (qtp731751430-7775) [n:127.0.0.1:37467_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 1391517 INFO  (qtp731751430-7775) [n:127.0.0.1:37467_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 1391517 INFO  (qtp525504927-7788) [n:127.0.0.1:34941_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n2]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 1391530 INFO  (qtp525504927-7788) [n:127.0.0.1:34941_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n2]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=12
   [junit4]   2> 1391531 INFO  (qtp525504927-7788) [n:127.0.0.1:34941_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n2]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 1391532 INFO  (qtp525504927-7788) [n:127.0.0.1:34941_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n2]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 1391532 INFO  (qtp525504927-7788) [n:127.0.0.1:34941_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n2]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 1391533 INFO  (qtp525504927-7788) [n:127.0.0.1:34941_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n2]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 1391535 INFO  (qtp731751430-7772) [n:127.0.0.1:37467_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 1391535 INFO  (qtp731751430-7772) [n:127.0.0.1:37467_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 1391536 INFO  (qtp731751430-7772) [n:127.0.0.1:37467_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 1391537 INFO  (qtp525504927-7785) [n:127.0.0.1:34941_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n2]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 1391537 INFO  (qtp731751430-7772) [n:127.0.0.1:37467_solr c:aboveRate_collection s:shard1 r:core_node3 x:aboveRate_collection_shard1_replica_n1] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 1391538 INFO  (qtp525504927-7785) [n:127.0.0.1:34941_solr c:aboveRate_collection s:shard1 r:core_node4 x:aboveRate_collection_shard1_replica_n2] o.a.s.c.S.Request [aboveRate_collection_shard1_replica_n2]  webapp=/solr path=/select params={q=*:*&_stateVer_=aboveRate_collection:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 1391555 INFO  (qtp731751430-7772) [n:12

[...truncated too long message...]

/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

jar-checksums:
    [mkdir] Created dir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/null2093382906
     [copy] Copying 39 files to /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/null2093382906
   [delete] Deleting directory /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/null2093382906

resolve-example:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

resolve-server:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml

resolve:

jar-checksums:
    [mkdir] Created dir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/null1665527544
     [copy] Copying 246 files to /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/null1665527544
   [delete] Deleting directory /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/null1665527544

check-working-copy:
[ivy:cachepath] :: resolving dependencies :: org.eclipse.jgit#org.eclipse.jgit-caller;working
[ivy:cachepath] 	confs: [default]
[ivy:cachepath] 	found org.eclipse.jgit#org.eclipse.jgit;4.6.0.201612231935-r in public
[ivy:cachepath] 	found com.jcraft#jsch;0.1.53 in public
[ivy:cachepath] 	found com.googlecode.javaewah#JavaEWAH;1.1.6 in public
[ivy:cachepath] 	found org.apache.httpcomponents#httpclient;4.3.6 in public
[ivy:cachepath] 	found org.apache.httpcomponents#httpcore;4.3.3 in public
[ivy:cachepath] 	found commons-logging#commons-logging;1.1.3 in public
[ivy:cachepath] 	found commons-codec#commons-codec;1.6 in public
[ivy:cachepath] 	found org.slf4j#slf4j-api;1.7.2 in public
[ivy:cachepath] :: resolution report :: resolve 61ms :: artifacts dl 9ms
	---------------------------------------------------------------------
	|                  |            modules            ||   artifacts   |
	|       conf       | number| search|dwnlded|evicted|| number|dwnlded|
	---------------------------------------------------------------------
	|      default     |   8   |   0   |   0   |   0   ||   8   |   0   |
	---------------------------------------------------------------------
[wc-checker] Initializing working copy...
[wc-checker] SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
[wc-checker] SLF4J: Defaulting to no-operation (NOP) logger implementation
[wc-checker] SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
[wc-checker] Checking working copy status...

-jenkins-base:

BUILD SUCCESSFUL
Total time: 274 minutes 55 seconds
Archiving artifacts
WARN: No artifacts found that match the file pattern "**/*.events,heapdumps/**,**/hs_err_pid*". Configuration error?
WARN: java.lang.InterruptedException: no matches found within 10000
Recording test results
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)